2024-05-14T01:08:52.339 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-14T01:08:52.339 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --verbose --name yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} --archive /home/teuthworker/archive/yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi/7705395 -- /home/teuthworker/archive/yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi/7705395/orig.config.yaml 2024-05-14T01:08:52.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-14T01:08:52.475 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi/7705395 branch: wip-yuri4-testing-2024-04-29-0642 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} email: null first_in_suite: false job_id: '7705395' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri4-testing-2024-04-29-0642 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 2ba596c3826798bb3a2f22bc9b02848b92dbe579 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2ba596c3826798bb3a2f22bc9b02848b92dbe579 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2024-04-29-0642 sha1: 2ba596c3826798bb3a2f22bc9b02848b92dbe579 owner: scheduled_yuriw@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1311 sha1: 2ba596c3826798bb3a2f22bc9b02848b92dbe579 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri4-testing-2024-04-29-0642 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_2ba596c3826798bb3a2f22bc9b02848b92dbe579/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 2ba596c3826798bb3a2f22bc9b02848b92dbe579 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHs4J0mm8zx8a3J4L2rvdMTA/33DT2sz01pZKEX5gziVhadzlKnXKRttkVSc5otyuWH95KlxYvPeyK/8iOLZtKM= smithi176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE874pIG9yhkkKXVMjdZHAjPMQcXOXGYm66jv3txQQE3SckErXMjv6Wo6Vet8hmuDtnhVpwpy5bu+j1eEPSkuXU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-14_00:30:07 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-14T01:08:52.475 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_2ba596c3826798bb3a2f22bc9b02848b92dbe579/qa; will attempt to use it 2024-05-14T01:08:52.476 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_2ba596c3826798bb3a2f22bc9b02848b92dbe579/qa/tasks 2024-05-14T01:08:52.476 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-14T01:08:52.478 INFO:teuthology.task.internal:Checking packages... 2024-05-14T01:08:52.502 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '2ba596c3826798bb3a2f22bc9b02848b92dbe579' 2024-05-14T01:08:52.502 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-14T01:08:52.502 INFO:teuthology.packaging:ref: None 2024-05-14T01:08:52.502 INFO:teuthology.packaging:tag: None 2024-05-14T01:08:52.502 INFO:teuthology.packaging:branch: wip-yuri4-testing-2024-04-29-0642 2024-05-14T01:08:52.502 INFO:teuthology.packaging:sha1: 2ba596c3826798bb3a2f22bc9b02848b92dbe579 2024-05-14T01:08:52.503 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri4-testing-2024-04-29-0642 2024-05-14T01:08:52.857 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2569-g2ba596c3-1jammy 2024-05-14T01:08:52.859 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-14T01:08:52.866 INFO:teuthology.task.internal:no buildpackages task found 2024-05-14T01:08:52.866 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-14T01:08:52.890 INFO:teuthology.task.internal:Saving configuration 2024-05-14T01:08:52.908 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-14T01:08:52.914 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T01:08:52.939 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi/7705395', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 01:02:09.933037', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINE9Q2VZkHIMfilSe19+uPNOQm0nKCWO8cBdvKKQaBDb'} 2024-05-14T01:08:52.965 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi/7705395', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 01:02:09.931259', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEoMKpcZmLYJMHkXJ/xsdTwGDx+hBON9Ef27Kq40p770'} 2024-05-14T01:08:52.965 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-14T01:08:52.971 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-14T01:08:52.971 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-14T01:08:52.971 INFO:teuthology.run_tasks:Running task console_log... 2024-05-14T01:08:53.039 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc6b2e834c0>, signals=[15]) 2024-05-14T01:08:53.040 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-14T01:08:53.046 INFO:teuthology.task.internal:Opening connections... 2024-05-14T01:08:53.046 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-05-14T01:08:53.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T01:08:53.127 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi176.front.sepia.ceph.com 2024-05-14T01:08:53.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T01:08:53.206 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-14T01:08:53.212 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-05-14T01:08:53.218 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-05-14T01:08:53.218 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-05-14T01:08:53.266 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-14T01:08:53.266 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Ubuntu" 2024-05-14T01:08:53.267 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="22.04" 2024-05-14T01:08:53.267 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-14T01:08:53.267 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_CODENAME=jammy 2024-05-14T01:08:53.267 INFO:teuthology.orchestra.run.smithi154.stdout:ID=ubuntu 2024-05-14T01:08:53.267 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE=debian 2024-05-14T01:08:53.267 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-14T01:08:53.267 INFO:teuthology.orchestra.run.smithi154.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-14T01:08:53.267 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-14T01:08:53.267 INFO:teuthology.orchestra.run.smithi154.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-14T01:08:53.267 INFO:teuthology.orchestra.run.smithi154.stdout:UBUNTU_CODENAME=jammy 2024-05-14T01:08:53.268 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-05-14T01:08:53.298 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2024-05-14T01:08:53.303 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2024-05-14T01:08:53.303 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2024-05-14T01:08:53.351 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-14T01:08:53.352 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="Ubuntu" 2024-05-14T01:08:53.352 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="22.04" 2024-05-14T01:08:53.352 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-14T01:08:53.352 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_CODENAME=jammy 2024-05-14T01:08:53.352 INFO:teuthology.orchestra.run.smithi176.stdout:ID=ubuntu 2024-05-14T01:08:53.352 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE=debian 2024-05-14T01:08:53.352 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-14T01:08:53.353 INFO:teuthology.orchestra.run.smithi176.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-14T01:08:53.353 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-14T01:08:53.353 INFO:teuthology.orchestra.run.smithi176.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-14T01:08:53.353 INFO:teuthology.orchestra.run.smithi176.stdout:UBUNTU_CODENAME=jammy 2024-05-14T01:08:53.353 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2024-05-14T01:08:53.373 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-14T01:08:53.383 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-14T01:08:53.388 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-14T01:08:53.389 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-05-14T01:08:53.391 DEBUG:teuthology.orchestra.run.smithi176:> test '!' -e /home/ubuntu/cephtest 2024-05-14T01:08:53.399 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-14T01:08:53.405 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-14T01:08:53.406 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-05-14T01:08:53.436 DEBUG:teuthology.orchestra.run.smithi176:> test -z $(ls -A /var/lib/ceph) 2024-05-14T01:08:53.531 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-14T01:08:53.588 INFO:teuthology.run_tasks:Running task kernel... 2024-05-14T01:08:53.604 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-14T01:08:53.604 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-14T01:08:53.605 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-14T01:08:53.605 DEBUG:teuthology.orchestra.run.smithi176:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-14T01:08:53.610 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T01:08:53.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T01:08:53.611 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-05-14T01:08:53.612 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-05-14T01:08:53.659 INFO:teuthology.orchestra.run.smithi154.stdout:5.15.0-56-generic 2024-05-14T01:08:53.659 INFO:teuthology.task.kernel:Running kernel on smithi154: 5.15.0-56-generic 2024-05-14T01:08:53.659 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get clean 2024-05-14T01:08:53.660 INFO:teuthology.orchestra.run.smithi176.stdout:5.15.0-56-generic 2024-05-14T01:08:53.661 INFO:teuthology.task.kernel:Running kernel on smithi176: 5.15.0-56-generic 2024-05-14T01:08:53.661 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get clean 2024-05-14T01:08:53.793 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get update 2024-05-14T01:08:53.814 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-05-14T01:08:54.021 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-14T01:08:54.030 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-14T01:08:54.073 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-14T01:08:54.073 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-14T01:08:54.079 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-14T01:08:54.079 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-14T01:08:54.269 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-14T01:08:54.270 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-14T01:08:54.344 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [462 kB] 2024-05-14T01:08:54.370 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,671 kB] 2024-05-14T01:08:54.437 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [630 kB] 2024-05-14T01:08:54.444 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,427 kB] 2024-05-14T01:08:54.539 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,427 kB] 2024-05-14T01:08:54.600 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,671 kB] 2024-05-14T01:08:54.658 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [630 kB] 2024-05-14T01:08:54.660 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [247 kB] 2024-05-14T01:08:54.677 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-14T01:08:54.678 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [310 kB] 2024-05-14T01:08:54.678 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-14T01:08:54.687 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-14T01:08:54.687 INFO:teuthology.orchestra.run.smithi176.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-14T01:08:54.689 INFO:teuthology.orchestra.run.smithi176.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,914 kB] 2024-05-14T01:08:54.710 INFO:teuthology.orchestra.run.smithi176.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [462 kB] 2024-05-14T01:08:54.773 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [310 kB] 2024-05-14T01:08:54.780 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-14T01:08:54.781 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,914 kB] 2024-05-14T01:08:54.800 INFO:teuthology.orchestra.run.smithi176.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [247 kB] 2024-05-14T01:08:54.805 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-14T01:08:54.806 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-14T01:08:54.813 INFO:teuthology.orchestra.run.smithi176.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [325 kB] 2024-05-14T01:08:54.821 INFO:teuthology.orchestra.run.smithi176.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-14T01:08:54.821 INFO:teuthology.orchestra.run.smithi176.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-14T01:08:54.827 INFO:teuthology.orchestra.run.smithi176.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-14T01:08:54.839 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-14T01:08:54.840 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-14T01:08:54.840 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-05-14T01:08:54.840 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [325 kB] 2024-05-14T01:08:54.841 INFO:teuthology.orchestra.run.smithi176.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-14T01:08:54.846 INFO:teuthology.orchestra.run.smithi176.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-14T01:08:54.847 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-14T01:08:54.847 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-14T01:08:54.854 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [603 kB] 2024-05-14T01:08:54.873 INFO:teuthology.orchestra.run.smithi176.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-14T01:08:54.873 INFO:teuthology.orchestra.run.smithi176.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-14T01:08:54.914 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-14T01:08:54.921 INFO:teuthology.orchestra.run.smithi176.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-14T01:08:54.922 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [164 kB] 2024-05-14T01:08:54.925 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-14T01:08:54.926 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-14T01:08:54.926 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-14T01:08:54.927 INFO:teuthology.orchestra.run.smithi176.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-14T01:08:54.927 INFO:teuthology.orchestra.run.smithi176.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-14T01:08:54.927 INFO:teuthology.orchestra.run.smithi176.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-05-14T01:08:54.927 INFO:teuthology.orchestra.run.smithi176.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-14T01:08:54.929 INFO:teuthology.orchestra.run.smithi176.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-14T01:08:54.929 INFO:teuthology.orchestra.run.smithi176.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-14T01:08:54.930 INFO:teuthology.orchestra.run.smithi176.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-14T01:08:54.930 INFO:teuthology.orchestra.run.smithi176.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-14T01:08:54.931 INFO:teuthology.orchestra.run.smithi176.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-14T01:08:54.932 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-14T01:08:54.933 INFO:teuthology.orchestra.run.smithi176.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-14T01:08:54.937 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-14T01:08:54.938 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-14T01:08:54.938 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-14T01:08:54.940 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-14T01:08:54.940 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-14T01:08:54.941 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-14T01:08:54.941 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-14T01:08:54.941 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-14T01:08:54.941 INFO:teuthology.orchestra.run.smithi176.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [603 kB] 2024-05-14T01:08:54.942 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-14T01:08:54.946 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-14T01:08:54.947 INFO:teuthology.orchestra.run.smithi176.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-14T01:08:54.952 INFO:teuthology.orchestra.run.smithi176.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [164 kB] 2024-05-14T01:08:54.955 INFO:teuthology.orchestra.run.smithi176.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-14T01:08:54.955 INFO:teuthology.orchestra.run.smithi176.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-14T01:08:54.956 INFO:teuthology.orchestra.run.smithi176.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-14T01:08:54.957 INFO:teuthology.orchestra.run.smithi176.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-14T01:08:54.957 INFO:teuthology.orchestra.run.smithi176.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-14T01:08:54.966 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-14T01:08:54.967 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-14T01:08:54.967 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-14T01:08:54.968 INFO:teuthology.orchestra.run.smithi176.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-14T01:08:54.968 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-14T01:08:54.969 INFO:teuthology.orchestra.run.smithi154.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-14T01:08:54.969 INFO:teuthology.orchestra.run.smithi176.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-14T01:08:54.969 INFO:teuthology.orchestra.run.smithi176.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-14T01:08:54.970 INFO:teuthology.orchestra.run.smithi176.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-14T01:09:00.261 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 13.5 MB in 2s (6,295 kB/s) 2024-05-14T01:09:00.371 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 13.5 MB in 2s (6,064 kB/s) 2024-05-14T01:09:01.633 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-05-14T01:09:01.649 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-14T01:09:01.712 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-05-14T01:09:01.849 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-05-14T01:09:01.866 DEBUG:teuthology.orchestra.run.smithi176:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-14T01:09:01.913 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-05-14T01:09:01.914 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-05-14T01:09:01.917 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-05-14T01:09:02.090 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-05-14T01:09:02.090 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-14T01:09:02.090 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-14T01:09:02.090 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-14T01:09:02.090 INFO:teuthology.orchestra.run.smithi154.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-14T01:09:02.091 INFO:teuthology.orchestra.run.smithi154.stdout: python2.7-minimal 2024-05-14T01:09:02.091 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-14T01:09:02.092 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-05-14T01:09:02.092 INFO:teuthology.orchestra.run.smithi154.stdout: linux-generic linux-headers-5.15.0-107 linux-headers-5.15.0-107-generic 2024-05-14T01:09:02.092 INFO:teuthology.orchestra.run.smithi154.stdout: linux-headers-generic linux-image-5.15.0-107-generic 2024-05-14T01:09:02.092 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-5.15.0-107-generic linux-modules-extra-5.15.0-107-generic 2024-05-14T01:09:02.094 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-05-14T01:09:02.094 INFO:teuthology.orchestra.run.smithi154.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-14T01:09:02.094 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2024-05-14T01:09:02.094 INFO:teuthology.orchestra.run.smithi154.stdout: thermald 2024-05-14T01:09:02.097 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2024-05-14T01:09:02.098 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2024-05-14T01:09:02.144 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-05-14T01:09:02.144 INFO:teuthology.orchestra.run.smithi154.stdout: linux-headers-5.15.0-107 linux-headers-5.15.0-107-generic 2024-05-14T01:09:02.144 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.15.0-107-generic linux-modules-5.15.0-107-generic 2024-05-14T01:09:02.145 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-extra-5.15.0-107-generic 2024-05-14T01:09:02.146 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages will be upgraded: 2024-05-14T01:09:02.147 INFO:teuthology.orchestra.run.smithi154.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-14T01:09:02.231 INFO:teuthology.orchestra.run.smithi154.stdout:3 upgraded, 5 newly installed, 0 to remove and 320 not upgraded. 2024-05-14T01:09:02.231 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 113 MB of archives. 2024-05-14T01:09:02.231 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-14T01:09:02.231 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-107-generic amd64 5.15.0-107.117 [22.7 MB] 2024-05-14T01:09:02.255 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages were automatically installed and are no longer required: 2024-05-14T01:09:02.255 INFO:teuthology.orchestra.run.smithi176.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-14T01:09:02.255 INFO:teuthology.orchestra.run.smithi176.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-14T01:09:02.256 INFO:teuthology.orchestra.run.smithi176.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-14T01:09:02.256 INFO:teuthology.orchestra.run.smithi176.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-14T01:09:02.256 INFO:teuthology.orchestra.run.smithi176.stdout: python2.7-minimal 2024-05-14T01:09:02.256 INFO:teuthology.orchestra.run.smithi176.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-14T01:09:02.257 INFO:teuthology.orchestra.run.smithi176.stdout:The following additional packages will be installed: 2024-05-14T01:09:02.257 INFO:teuthology.orchestra.run.smithi176.stdout: linux-generic linux-headers-5.15.0-107 linux-headers-5.15.0-107-generic 2024-05-14T01:09:02.257 INFO:teuthology.orchestra.run.smithi176.stdout: linux-headers-generic linux-image-5.15.0-107-generic 2024-05-14T01:09:02.258 INFO:teuthology.orchestra.run.smithi176.stdout: linux-modules-5.15.0-107-generic linux-modules-extra-5.15.0-107-generic 2024-05-14T01:09:02.259 INFO:teuthology.orchestra.run.smithi176.stdout:Suggested packages: 2024-05-14T01:09:02.259 INFO:teuthology.orchestra.run.smithi176.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-14T01:09:02.259 INFO:teuthology.orchestra.run.smithi176.stdout:Recommended packages: 2024-05-14T01:09:02.259 INFO:teuthology.orchestra.run.smithi176.stdout: thermald 2024-05-14T01:09:02.293 INFO:teuthology.orchestra.run.smithi176.stdout:The following NEW packages will be installed: 2024-05-14T01:09:02.293 INFO:teuthology.orchestra.run.smithi176.stdout: linux-headers-5.15.0-107 linux-headers-5.15.0-107-generic 2024-05-14T01:09:02.293 INFO:teuthology.orchestra.run.smithi176.stdout: linux-image-5.15.0-107-generic linux-modules-5.15.0-107-generic 2024-05-14T01:09:02.293 INFO:teuthology.orchestra.run.smithi176.stdout: linux-modules-extra-5.15.0-107-generic 2024-05-14T01:09:02.294 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages will be upgraded: 2024-05-14T01:09:02.295 INFO:teuthology.orchestra.run.smithi176.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-14T01:09:02.472 INFO:teuthology.orchestra.run.smithi176.stdout:3 upgraded, 5 newly installed, 0 to remove and 320 not upgraded. 2024-05-14T01:09:02.472 INFO:teuthology.orchestra.run.smithi176.stdout:Need to get 113 MB of archives. 2024-05-14T01:09:02.472 INFO:teuthology.orchestra.run.smithi176.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-14T01:09:02.472 INFO:teuthology.orchestra.run.smithi176.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-107-generic amd64 5.15.0-107.117 [22.7 MB] 2024-05-14T01:09:03.256 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-107-generic amd64 5.15.0-107.117 [11.5 MB] 2024-05-14T01:09:03.570 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-107-generic amd64 5.15.0-107.117 [63.9 MB] 2024-05-14T01:09:03.895 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-107-generic amd64 5.15.0-107.117 [11.5 MB] 2024-05-14T01:09:04.222 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-107-generic amd64 5.15.0-107.117 [63.9 MB] 2024-05-14T01:09:05.406 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.107.107 [1,694 B] 2024-05-14T01:09:05.406 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.107.107 [2,496 B] 2024-05-14T01:09:05.407 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-107 all 5.15.0-107.117 [12.3 MB] 2024-05-14T01:09:05.710 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-107-generic amd64 5.15.0-107.117 [2,887 kB] 2024-05-14T01:09:05.747 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.107.107 [2,354 B] 2024-05-14T01:09:06.141 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 113 MB in 4s (31.5 MB/s) 2024-05-14T01:09:06.315 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-modules-5.15.0-107-generic. 2024-05-14T01:09:06.379 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.107.107 [1,694 B] 2024-05-14T01:09:06.379 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.107.107 [2,496 B] 2024-05-14T01:09:06.380 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-107 all 5.15.0-107.117 [12.3 MB] 2024-05-14T01:09:07.390 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-107-generic amd64 5.15.0-107.117 [2,887 kB] 2024-05-14T01:09:07.493 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.107.107 [2,354 B] 2024-05-14T01:09:07.907 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 113 MB in 5s (21.8 MB/s) 2024-05-14T01:09:08.108 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package linux-modules-5.15.0-107-generic. 2024-05-14T01:09:08.438 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-14T01:09:08.442 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../0-linux-modules-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-14T01:09:08.562 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-modules-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-14T01:09:10.084 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-14T01:09:10.089 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../0-linux-modules-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-14T01:09:10.171 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-modules-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-14T01:09:10.706 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-image-5.15.0-107-generic. 2024-05-14T01:09:10.727 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../1-linux-image-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-14T01:09:10.809 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-14T01:09:11.251 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-107-generic. 2024-05-14T01:09:11.271 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-14T01:09:11.309 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-modules-extra-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-14T01:09:12.563 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package linux-image-5.15.0-107-generic. 2024-05-14T01:09:12.584 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../1-linux-image-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-14T01:09:12.672 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-image-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-14T01:09:13.182 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-107-generic. 2024-05-14T01:09:13.203 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-14T01:09:13.240 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-modules-extra-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-14T01:09:18.059 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../3-linux-generic_5.15.0.107.107_amd64.deb ... 2024-05-14T01:09:18.179 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-generic (5.15.0.107.107) over (5.15.0.56.54) ... 2024-05-14T01:09:18.496 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.107.107_amd64.deb ... 2024-05-14T01:09:18.624 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-generic (5.15.0.107.107) over (5.15.0.56.54) ... 2024-05-14T01:09:18.919 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-headers-5.15.0-107. 2024-05-14T01:09:18.930 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../5-linux-headers-5.15.0-107_5.15.0-107.117_all.deb ... 2024-05-14T01:09:18.977 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-5.15.0-107 (5.15.0-107.117) ... 2024-05-14T01:09:19.698 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../3-linux-generic_5.15.0.107.107_amd64.deb ... 2024-05-14T01:09:19.823 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-generic (5.15.0.107.107) over (5.15.0.56.54) ... 2024-05-14T01:09:20.114 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.107.107_amd64.deb ... 2024-05-14T01:09:20.251 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-image-generic (5.15.0.107.107) over (5.15.0.56.54) ... 2024-05-14T01:09:20.554 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package linux-headers-5.15.0-107. 2024-05-14T01:09:20.576 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../5-linux-headers-5.15.0-107_5.15.0-107.117_all.deb ... 2024-05-14T01:09:20.620 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-headers-5.15.0-107 (5.15.0-107.117) ... 2024-05-14T01:09:24.840 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-headers-5.15.0-107-generic. 2024-05-14T01:09:24.878 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../6-linux-headers-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-14T01:09:24.915 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-14T01:09:26.931 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package linux-headers-5.15.0-107-generic. 2024-05-14T01:09:26.968 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../6-linux-headers-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-14T01:09:27.005 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-headers-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-14T01:09:27.452 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.107.107_amd64.deb ... 2024-05-14T01:09:27.568 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-generic (5.15.0.107.107) over (5.15.0.56.54) ... 2024-05-14T01:09:27.901 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-5.15.0-107 (5.15.0-107.117) ... 2024-05-14T01:09:28.022 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-14T01:09:28.173 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-generic (5.15.0.107.107) ... 2024-05-14T01:09:28.303 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-14T01:09:29.740 INFO:teuthology.orchestra.run.smithi154.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-14T01:09:29.740 INFO:teuthology.orchestra.run.smithi154.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-14T01:09:29.741 INFO:teuthology.orchestra.run.smithi154.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-107-generic 2024-05-14T01:09:29.741 INFO:teuthology.orchestra.run.smithi154.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-107-generic 2024-05-14T01:09:30.288 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-modules-extra-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-14T01:09:30.598 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.107.107_amd64.deb ... 2024-05-14T01:09:30.724 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-headers-generic (5.15.0.107.107) over (5.15.0.56.54) ... 2024-05-14T01:09:31.090 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-headers-5.15.0-107 (5.15.0-107.117) ... 2024-05-14T01:09:31.212 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-headers-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-14T01:09:31.355 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-headers-generic (5.15.0.107.107) ... 2024-05-14T01:09:31.459 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-image-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-14T01:09:31.680 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-modules-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-14T01:09:32.742 INFO:teuthology.orchestra.run.smithi176.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-14T01:09:32.743 INFO:teuthology.orchestra.run.smithi176.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-14T01:09:32.743 INFO:teuthology.orchestra.run.smithi176.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-107-generic 2024-05-14T01:09:32.743 INFO:teuthology.orchestra.run.smithi176.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-107-generic 2024-05-14T01:09:32.936 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-modules-extra-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-14T01:09:33.048 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-generic (5.15.0.107.107) ... 2024-05-14T01:09:33.149 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-generic (5.15.0.107.107) ... 2024-05-14T01:09:33.258 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for linux-image-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-14T01:09:33.330 INFO:teuthology.orchestra.run.smithi154.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-14T01:09:33.330 INFO:teuthology.orchestra.run.smithi154.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-107-generic 2024-05-14T01:09:34.327 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-modules-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-14T01:09:36.112 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-image-generic (5.15.0.107.107) ... 2024-05-14T01:09:36.213 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-generic (5.15.0.107.107) ... 2024-05-14T01:09:36.314 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for linux-image-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-14T01:09:36.361 INFO:teuthology.orchestra.run.smithi176.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-14T01:09:36.361 INFO:teuthology.orchestra.run.smithi176.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-107-generic 2024-05-14T01:09:47.542 INFO:teuthology.orchestra.run.smithi154.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-14T01:09:47.542 INFO:teuthology.orchestra.run.smithi154.stdout:Sourcing file `/etc/default/grub' 2024-05-14T01:09:47.563 INFO:teuthology.orchestra.run.smithi154.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-14T01:09:47.579 INFO:teuthology.orchestra.run.smithi154.stdout:Generating grub configuration file ... 2024-05-14T01:09:47.846 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.15.0-107-generic 2024-05-14T01:09:47.860 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.15.0-107-generic 2024-05-14T01:09:48.145 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-14T01:09:48.151 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-14T01:09:48.217 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-14T01:09:48.222 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-14T01:09:48.384 INFO:teuthology.orchestra.run.smithi154.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-14T01:09:48.384 INFO:teuthology.orchestra.run.smithi154.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-14T01:09:48.384 INFO:teuthology.orchestra.run.smithi154.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-14T01:09:48.422 INFO:teuthology.orchestra.run.smithi154.stdout:done 2024-05-14T01:09:48.851 DEBUG:teuthology.orchestra.run.smithi154:> dpkg -s linux-image-generic 2024-05-14T01:09:48.875 INFO:teuthology.orchestra.run.smithi154.stdout:Package: linux-image-generic 2024-05-14T01:09:48.875 INFO:teuthology.orchestra.run.smithi154.stdout:Status: install ok installed 2024-05-14T01:09:48.876 INFO:teuthology.orchestra.run.smithi154.stdout:Priority: optional 2024-05-14T01:09:48.876 INFO:teuthology.orchestra.run.smithi154.stdout:Section: kernel 2024-05-14T01:09:48.876 INFO:teuthology.orchestra.run.smithi154.stdout:Installed-Size: 21 2024-05-14T01:09:48.876 INFO:teuthology.orchestra.run.smithi154.stdout:Maintainer: Ubuntu Kernel Team 2024-05-14T01:09:48.876 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: amd64 2024-05-14T01:09:48.876 INFO:teuthology.orchestra.run.smithi154.stdout:Source: linux-meta 2024-05-14T01:09:48.876 INFO:teuthology.orchestra.run.smithi154.stdout:Version: 5.15.0.107.107 2024-05-14T01:09:48.876 INFO:teuthology.orchestra.run.smithi154.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-107), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-14T01:09:48.876 INFO:teuthology.orchestra.run.smithi154.stdout:Depends: linux-image-5.15.0-107-generic, linux-modules-extra-5.15.0-107-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-14T01:09:48.876 INFO:teuthology.orchestra.run.smithi154.stdout:Recommends: thermald 2024-05-14T01:09:48.876 INFO:teuthology.orchestra.run.smithi154.stdout:Description: Generic Linux kernel image 2024-05-14T01:09:48.876 INFO:teuthology.orchestra.run.smithi154.stdout: This package will always depend on the latest generic kernel image 2024-05-14T01:09:48.876 INFO:teuthology.orchestra.run.smithi154.stdout: available. 2024-05-14T01:09:48.877 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-107-generic 2024-05-14T01:09:48.877 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-14T01:09:48.877 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-14T01:09:48.877 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-14T01:09:48.877 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi154.front.sepia.ceph.com, path=None, version=distro) 2024-05-14T01:09:48.877 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get clean 2024-05-14T01:09:49.034 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-05-14T01:09:49.292 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-14T01:09:49.330 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-14T01:09:49.411 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-14T01:09:49.492 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-14T01:09:50.366 INFO:teuthology.orchestra.run.smithi176.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-14T01:09:50.366 INFO:teuthology.orchestra.run.smithi176.stdout:Sourcing file `/etc/default/grub' 2024-05-14T01:09:50.384 INFO:teuthology.orchestra.run.smithi176.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-14T01:09:50.400 INFO:teuthology.orchestra.run.smithi176.stdout:Generating grub configuration file ... 2024-05-14T01:09:50.677 INFO:teuthology.orchestra.run.smithi176.stdout:Found linux image: /boot/vmlinuz-5.15.0-107-generic 2024-05-14T01:09:50.699 INFO:teuthology.orchestra.run.smithi176.stdout:Found initrd image: /boot/initrd.img-5.15.0-107-generic 2024-05-14T01:09:50.707 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-05-14T01:09:50.724 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-14T01:09:50.775 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-05-14T01:09:50.964 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-05-14T01:09:50.964 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-05-14T01:09:51.051 INFO:teuthology.orchestra.run.smithi176.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-14T01:09:51.057 INFO:teuthology.orchestra.run.smithi176.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-14T01:09:51.120 INFO:teuthology.orchestra.run.smithi154.stdout:linux-image-generic is already the newest version (5.15.0.107.107). 2024-05-14T01:09:51.120 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-05-14T01:09:51.120 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-14T01:09:51.120 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-14T01:09:51.120 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-14T01:09:51.120 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-14T01:09:51.120 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-14T01:09:51.120 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-14T01:09:51.124 INFO:teuthology.orchestra.run.smithi176.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-14T01:09:51.129 INFO:teuthology.orchestra.run.smithi176.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-14T01:09:51.161 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 0 newly installed, 0 to remove and 320 not upgraded. 2024-05-14T01:09:51.163 DEBUG:teuthology.orchestra.run.smithi154:> dpkg -s linux-image-generic 2024-05-14T01:09:51.219 INFO:teuthology.orchestra.run.smithi154.stdout:Package: linux-image-generic 2024-05-14T01:09:51.220 INFO:teuthology.orchestra.run.smithi154.stdout:Status: install ok installed 2024-05-14T01:09:51.220 INFO:teuthology.orchestra.run.smithi154.stdout:Priority: optional 2024-05-14T01:09:51.220 INFO:teuthology.orchestra.run.smithi154.stdout:Section: kernel 2024-05-14T01:09:51.220 INFO:teuthology.orchestra.run.smithi154.stdout:Installed-Size: 21 2024-05-14T01:09:51.220 INFO:teuthology.orchestra.run.smithi154.stdout:Maintainer: Ubuntu Kernel Team 2024-05-14T01:09:51.220 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: amd64 2024-05-14T01:09:51.220 INFO:teuthology.orchestra.run.smithi154.stdout:Source: linux-meta 2024-05-14T01:09:51.220 INFO:teuthology.orchestra.run.smithi154.stdout:Version: 5.15.0.107.107 2024-05-14T01:09:51.220 INFO:teuthology.orchestra.run.smithi154.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-107), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-14T01:09:51.220 INFO:teuthology.orchestra.run.smithi154.stdout:Depends: linux-image-5.15.0-107-generic, linux-modules-extra-5.15.0-107-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-14T01:09:51.220 INFO:teuthology.orchestra.run.smithi154.stdout:Recommends: thermald 2024-05-14T01:09:51.220 INFO:teuthology.orchestra.run.smithi154.stdout:Description: Generic Linux kernel image 2024-05-14T01:09:51.220 INFO:teuthology.orchestra.run.smithi154.stdout: This package will always depend on the latest generic kernel image 2024-05-14T01:09:51.221 INFO:teuthology.orchestra.run.smithi154.stdout: available. 2024-05-14T01:09:51.221 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-05-14T01:09:51.265 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.SU5VuH8BBi 2024-05-14T01:09:51.265 DEBUG:teuthology.orchestra.run.smithi154:> sudo cp /boot/grub/grub.cfg /tmp/tmp.SU5VuH8BBi 2024-05-14T01:09:51.302 INFO:teuthology.orchestra.run.smithi176.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-14T01:09:51.302 INFO:teuthology.orchestra.run.smithi176.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-14T01:09:51.302 INFO:teuthology.orchestra.run.smithi176.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-14T01:09:51.321 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.SU5VuH8BBi 2024-05-14T01:09:51.344 INFO:teuthology.orchestra.run.smithi176.stdout:done 2024-05-14T01:09:51.438 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.SU5VuH8BBi is 10KB 2024-05-14T01:09:51.452 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.SU5VuH8BBi 2024-05-14T01:09:51.458 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-14T01:09:51.513 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:09:51.513 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-14T01:09:51.513 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-14T01:09:51.581 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-107-generic 2024-05-14T01:09:51.581 DEBUG:teuthology.orchestra.run.smithi154:> sudo update-grub 2024-05-14T01:09:51.810 DEBUG:teuthology.orchestra.run.smithi176:> dpkg -s linux-image-generic 2024-05-14T01:09:51.830 INFO:teuthology.orchestra.run.smithi176.stdout:Package: linux-image-generic 2024-05-14T01:09:51.830 INFO:teuthology.orchestra.run.smithi176.stdout:Status: install ok installed 2024-05-14T01:09:51.830 INFO:teuthology.orchestra.run.smithi176.stdout:Priority: optional 2024-05-14T01:09:51.830 INFO:teuthology.orchestra.run.smithi176.stdout:Section: kernel 2024-05-14T01:09:51.830 INFO:teuthology.orchestra.run.smithi176.stdout:Installed-Size: 21 2024-05-14T01:09:51.830 INFO:teuthology.orchestra.run.smithi176.stdout:Maintainer: Ubuntu Kernel Team 2024-05-14T01:09:51.830 INFO:teuthology.orchestra.run.smithi176.stdout:Architecture: amd64 2024-05-14T01:09:51.830 INFO:teuthology.orchestra.run.smithi176.stdout:Source: linux-meta 2024-05-14T01:09:51.831 INFO:teuthology.orchestra.run.smithi176.stdout:Version: 5.15.0.107.107 2024-05-14T01:09:51.831 INFO:teuthology.orchestra.run.smithi176.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-107), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-14T01:09:51.831 INFO:teuthology.orchestra.run.smithi176.stdout:Depends: linux-image-5.15.0-107-generic, linux-modules-extra-5.15.0-107-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-14T01:09:51.831 INFO:teuthology.orchestra.run.smithi176.stdout:Recommends: thermald 2024-05-14T01:09:51.831 INFO:teuthology.orchestra.run.smithi176.stdout:Description: Generic Linux kernel image 2024-05-14T01:09:51.831 INFO:teuthology.orchestra.run.smithi176.stdout: This package will always depend on the latest generic kernel image 2024-05-14T01:09:51.831 INFO:teuthology.orchestra.run.smithi176.stdout: available. 2024-05-14T01:09:51.831 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-107-generic 2024-05-14T01:09:51.831 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-14T01:09:51.831 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-14T01:09:51.831 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-14T01:09:51.831 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi176.front.sepia.ceph.com, path=None, version=distro) 2024-05-14T01:09:51.832 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get clean 2024-05-14T01:09:52.050 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get update 2024-05-14T01:09:52.175 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-14T01:09:52.193 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-14T01:09:52.215 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-14T01:09:52.289 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-14T01:09:52.741 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub' 2024-05-14T01:09:52.743 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-14T01:09:52.745 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2024-05-14T01:09:52.939 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-107-generic 2024-05-14T01:09:52.945 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-107-generic 2024-05-14T01:09:53.194 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-14T01:09:53.196 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-14T01:09:53.241 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-14T01:09:53.246 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-14T01:09:53.418 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-14T01:09:53.419 INFO:teuthology.orchestra.run.smithi154.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-14T01:09:53.419 INFO:teuthology.orchestra.run.smithi154.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-14T01:09:53.448 INFO:teuthology.orchestra.run.smithi154.stderr:done 2024-05-14T01:09:53.457 DEBUG:teuthology.orchestra.run.smithi154:> sudo shutdown -r now 2024-05-14T01:09:53.618 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-05-14T01:09:53.635 DEBUG:teuthology.orchestra.run.smithi176:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-14T01:09:53.685 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-05-14T01:09:53.864 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2024-05-14T01:09:53.865 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2024-05-14T01:09:54.019 INFO:teuthology.orchestra.run.smithi176.stdout:linux-image-generic is already the newest version (5.15.0.107.107). 2024-05-14T01:09:54.020 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages were automatically installed and are no longer required: 2024-05-14T01:09:54.020 INFO:teuthology.orchestra.run.smithi176.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-14T01:09:54.020 INFO:teuthology.orchestra.run.smithi176.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-14T01:09:54.020 INFO:teuthology.orchestra.run.smithi176.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-14T01:09:54.020 INFO:teuthology.orchestra.run.smithi176.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-14T01:09:54.020 INFO:teuthology.orchestra.run.smithi176.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-14T01:09:54.021 INFO:teuthology.orchestra.run.smithi176.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-14T01:09:54.057 INFO:teuthology.orchestra.run.smithi176.stdout:0 upgraded, 0 newly installed, 0 to remove and 320 not upgraded. 2024-05-14T01:09:54.059 DEBUG:teuthology.orchestra.run.smithi176:> dpkg -s linux-image-generic 2024-05-14T01:09:54.121 INFO:teuthology.orchestra.run.smithi176.stdout:Package: linux-image-generic 2024-05-14T01:09:54.121 INFO:teuthology.orchestra.run.smithi176.stdout:Status: install ok installed 2024-05-14T01:09:54.122 INFO:teuthology.orchestra.run.smithi176.stdout:Priority: optional 2024-05-14T01:09:54.122 INFO:teuthology.orchestra.run.smithi176.stdout:Section: kernel 2024-05-14T01:09:54.122 INFO:teuthology.orchestra.run.smithi176.stdout:Installed-Size: 21 2024-05-14T01:09:54.122 INFO:teuthology.orchestra.run.smithi176.stdout:Maintainer: Ubuntu Kernel Team 2024-05-14T01:09:54.122 INFO:teuthology.orchestra.run.smithi176.stdout:Architecture: amd64 2024-05-14T01:09:54.122 INFO:teuthology.orchestra.run.smithi176.stdout:Source: linux-meta 2024-05-14T01:09:54.122 INFO:teuthology.orchestra.run.smithi176.stdout:Version: 5.15.0.107.107 2024-05-14T01:09:54.122 INFO:teuthology.orchestra.run.smithi176.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-107), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-14T01:09:54.122 INFO:teuthology.orchestra.run.smithi176.stdout:Depends: linux-image-5.15.0-107-generic, linux-modules-extra-5.15.0-107-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-14T01:09:54.122 INFO:teuthology.orchestra.run.smithi176.stdout:Recommends: thermald 2024-05-14T01:09:54.122 INFO:teuthology.orchestra.run.smithi176.stdout:Description: Generic Linux kernel image 2024-05-14T01:09:54.122 INFO:teuthology.orchestra.run.smithi176.stdout: This package will always depend on the latest generic kernel image 2024-05-14T01:09:54.122 INFO:teuthology.orchestra.run.smithi176.stdout: available. 2024-05-14T01:09:54.123 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-05-14T01:09:54.168 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.mLe2jp9r3Y 2024-05-14T01:09:54.169 DEBUG:teuthology.orchestra.run.smithi176:> sudo cp /boot/grub/grub.cfg /tmp/tmp.mLe2jp9r3Y 2024-05-14T01:09:54.223 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.mLe2jp9r3Y 2024-05-14T01:09:54.337 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.mLe2jp9r3Y is 10KB 2024-05-14T01:09:54.349 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.mLe2jp9r3Y 2024-05-14T01:09:54.354 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-14T01:09:54.406 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:09:54.406 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-14T01:09:54.406 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-14T01:09:54.475 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-107-generic 2024-05-14T01:09:54.475 DEBUG:teuthology.orchestra.run.smithi176:> sudo update-grub 2024-05-14T01:09:55.699 INFO:teuthology.orchestra.run.smithi176.stderr:Sourcing file `/etc/default/grub' 2024-05-14T01:09:55.701 INFO:teuthology.orchestra.run.smithi176.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-14T01:09:55.708 INFO:teuthology.orchestra.run.smithi176.stderr:Generating grub configuration file ... 2024-05-14T01:09:55.867 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-5.15.0-107-generic 2024-05-14T01:09:55.874 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-5.15.0-107-generic 2024-05-14T01:09:56.093 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-14T01:09:56.099 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-14T01:09:56.140 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-14T01:09:56.145 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-14T01:09:56.259 INFO:teuthology.orchestra.run.smithi176.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-14T01:09:56.260 INFO:teuthology.orchestra.run.smithi176.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-14T01:09:56.260 INFO:teuthology.orchestra.run.smithi176.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-14T01:09:56.290 INFO:teuthology.orchestra.run.smithi176.stderr:done 2024-05-14T01:09:56.299 DEBUG:teuthology.orchestra.run.smithi176:> sudo shutdown -r now 2024-05-14T01:10:23.487 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-14T01:10:23.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-05-14T01:10:23.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T01:10:26.302 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-14T01:10:26.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-05-14T01:10:26.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T01:10:41.955 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-05-14T01:10:44.766 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-05-14T01:10:50.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-05-14T01:10:50.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T01:10:53.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-05-14T01:10:53.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T01:10:54.014 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-05-14T01:10:56.834 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-05-14T01:11:06.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-05-14T01:11:06.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T01:11:08.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-05-14T01:11:08.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T01:11:27.262 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-05-14T01:11:42.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-05-14T01:11:42.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T01:11:42.617 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-05-14T01:11:43.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-05-14T01:11:43.215 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-107-generic"... 2024-05-14T01:11:43.215 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-05-14T01:11:43.263 INFO:teuthology.orchestra.run.smithi176.stdout:5.15.0-107-generic 2024-05-14T01:11:43.263 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-107-generic vs 5.15.0-107-generic 2024-05-14T01:11:43.263 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-14T01:11:43.263 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-14T01:11:44.264 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-14T01:11:44.265 DEBUG:teuthology.orchestra.run.smithi176:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-14T01:11:44.317 INFO:teuthology.orchestra.run.smithi176.stdout:ttyS1 2024-05-14T01:11:44.348 DEBUG:teuthology.parallel:result is None 2024-05-14T01:12:06.045 DEBUG:teuthology.orchestra.remote:timed out 2024-05-14T01:12:21.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-05-14T01:12:21.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T01:12:21.318 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-05-14T01:12:21.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-05-14T01:12:21.872 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-107-generic"... 2024-05-14T01:12:21.872 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-05-14T01:12:21.920 INFO:teuthology.orchestra.run.smithi154.stdout:5.15.0-107-generic 2024-05-14T01:12:21.920 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-107-generic vs 5.15.0-107-generic 2024-05-14T01:12:21.920 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-14T01:12:21.920 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-14T01:12:22.921 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-14T01:12:22.921 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-14T01:12:22.999 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2024-05-14T01:12:23.018 DEBUG:teuthology.parallel:result is None 2024-05-14T01:12:23.018 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-14T01:12:23.026 INFO:teuthology.task.internal:Creating test directory... 2024-05-14T01:12:23.026 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-14T01:12:23.029 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-14T01:12:23.035 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-14T01:12:23.043 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-14T01:12:23.052 INFO:teuthology.task.internal:Creating archive directory... 2024-05-14T01:12:23.052 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-14T01:12:23.077 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-14T01:12:23.102 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-14T01:12:23.110 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-14T01:12:23.110 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-14T01:12:23.142 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-14T01:12:23.163 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T01:12:23.170 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T01:12:23.185 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T01:12:23.193 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T01:12:23.198 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-14T01:12:23.205 INFO:teuthology.task.internal:Configuring sudo... 2024-05-14T01:12:23.205 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-14T01:12:23.218 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-14T01:12:23.250 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-14T01:12:23.259 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-14T01:12:23.260 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-14T01:12:23.282 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-14T01:12:23.299 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T01:12:23.332 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T01:12:23.381 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:12:23.381 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-14T01:12:23.443 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T01:12:23.449 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T01:12:23.495 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:12:23.495 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-14T01:12:23.555 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-05-14T01:12:23.557 DEBUG:teuthology.orchestra.run.smithi176:> sudo service rsyslog restart 2024-05-14T01:12:23.628 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-14T01:12:23.636 INFO:teuthology.task.internal:Starting timer... 2024-05-14T01:12:23.637 INFO:teuthology.run_tasks:Running task pcp... 2024-05-14T01:12:23.649 INFO:teuthology.run_tasks:Running task selinux... 2024-05-14T01:12:23.658 DEBUG:teuthology.task.selinux:Excluding smithi154: OS 'ubuntu' does not support SELinux 2024-05-14T01:12:23.658 DEBUG:teuthology.task.selinux:Excluding smithi176: OS 'ubuntu' does not support SELinux 2024-05-14T01:12:23.658 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-14T01:12:23.658 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-14T01:12:23.659 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-14T01:12:23.659 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-14T01:12:23.676 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-14T01:12:23.692 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-14T01:12:23.694 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi154.front.sepia.ceph.com,smithi176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-14T01:19:27.076 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi154.front.sepia.ceph.com'), Remote(name='ubuntu@smithi176.front.sepia.ceph.com')] 2024-05-14T01:19:27.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-05-14T01:19:27.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T01:19:27.159 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-05-14T01:19:27.238 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-05-14T01:19:27.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-05-14T01:19:27.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T01:19:27.320 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-05-14T01:19:27.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-05-14T01:19:27.403 INFO:teuthology.run_tasks:Running task clock... 2024-05-14T01:19:27.415 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-14T01:19:27.415 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-14T01:19:27.415 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T01:19:27.418 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-14T01:19:27.418 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T01:19:27.445 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-14T01:19:27.446 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: Command line: ntpd -gq 2024-05-14T01:19:27.446 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: ---------------------------------------------------- 2024-05-14T01:19:27.446 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: ntp-4 is maintained by Network Time Foundation, 2024-05-14T01:19:27.446 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-14T01:19:27.446 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: corporation. Support and training for ntp-4 are 2024-05-14T01:19:27.446 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: available at https://www.nwtime.org/support 2024-05-14T01:19:27.446 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: ---------------------------------------------------- 2024-05-14T01:19:27.446 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: proto: precision = 0.062 usec (-24) 2024-05-14T01:19:27.448 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: basedate set to 2022-02-04 2024-05-14T01:19:27.448 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: gps base set to 2022-02-06 (week 2196) 2024-05-14T01:19:27.448 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-14T01:19:27.448 INFO:teuthology.orchestra.run.smithi154.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-14T01:19:27.448 INFO:teuthology.orchestra.run.smithi154.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-14T01:19:27.449 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: restrict ::: KOD does nothing without LIMITED. 2024-05-14T01:19:27.449 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: Listen and drop on 0 v6wildcard [::]:123 2024-05-14T01:19:27.449 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-14T01:19:27.449 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: Listen normally on 2 lo 127.0.0.1:123 2024-05-14T01:19:27.450 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: Listen normally on 3 enp3s0f1 172.21.15.154:123 2024-05-14T01:19:27.450 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: Listen normally on 4 lo [::1]:123 2024-05-14T01:19:27.450 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7761%5]:123 2024-05-14T01:19:27.450 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:27 ntpd[17297]: Listening on routing socket on fd #22 for interface updates 2024-05-14T01:19:27.472 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-14T01:19:27.472 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: Command line: ntpd -gq 2024-05-14T01:19:27.472 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: ---------------------------------------------------- 2024-05-14T01:19:27.472 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: ntp-4 is maintained by Network Time Foundation, 2024-05-14T01:19:27.472 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-14T01:19:27.472 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: corporation. Support and training for ntp-4 are 2024-05-14T01:19:27.472 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: available at https://www.nwtime.org/support 2024-05-14T01:19:27.472 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: ---------------------------------------------------- 2024-05-14T01:19:27.473 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: proto: precision = 0.072 usec (-24) 2024-05-14T01:19:27.473 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: basedate set to 2022-02-04 2024-05-14T01:19:27.473 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: gps base set to 2022-02-06 (week 2196) 2024-05-14T01:19:27.473 INFO:teuthology.orchestra.run.smithi176.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-14T01:19:27.474 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-14T01:19:27.474 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: restrict ::: KOD does nothing without LIMITED. 2024-05-14T01:19:27.474 INFO:teuthology.orchestra.run.smithi176.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-14T01:19:27.475 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: Listen and drop on 0 v6wildcard [::]:123 2024-05-14T01:19:27.475 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-14T01:19:27.475 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: Listen normally on 2 lo 127.0.0.1:123 2024-05-14T01:19:27.475 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: Listen normally on 3 enp3s0f1 172.21.15.176:123 2024-05-14T01:19:27.475 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: Listen normally on 4 lo [::1]:123 2024-05-14T01:19:27.475 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f61%5]:123 2024-05-14T01:19:27.475 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:27 ntpd[17235]: Listening on routing socket on fd #22 for interface updates 2024-05-14T01:19:28.446 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:28 ntpd[17297]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:28.446 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:28 ntpd[17297]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:28.446 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:28 ntpd[17297]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:28.446 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:28 ntpd[17297]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:28.446 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:28 ntpd[17297]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-14T01:19:28.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:28 ntpd[17297]: can't open /var/log/ntpstats/peerstats.20240514: Permission denied 2024-05-14T01:19:28.473 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:28 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:28.473 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:28 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:28.473 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:28 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:28.473 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:28 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:28.473 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:28 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:28.473 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:28 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:28.473 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:28 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-14T01:19:28.473 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:28 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240514: Permission denied 2024-05-14T01:19:28.473 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:28 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:28.473 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:28 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:28.473 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:28 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-14T01:19:28.473 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:28 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240514: Permission denied 2024-05-14T01:19:29.446 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:29 ntpd[17297]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:29.446 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:29 ntpd[17297]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:30.446 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:30 ntpd[17297]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:30.446 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:30 ntpd[17297]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:30.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:30 ntpd[17297]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:30.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:30 ntpd[17297]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:30.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:30 ntpd[17297]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-14T01:19:30.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:30 ntpd[17297]: can't open /var/log/ntpstats/peerstats.20240514: Permission denied 2024-05-14T01:19:30.473 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:30 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:30.473 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:30 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:30.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:30 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:30.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:30 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:30.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:30 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:30.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:30 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:30.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:30 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:30.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:30 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:30.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:30 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-14T01:19:30.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:30 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240514: Permission denied 2024-05-14T01:19:30.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:30 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:30.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:30 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:30.475 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:30 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-14T01:19:30.475 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:30 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240514: Permission denied 2024-05-14T01:19:31.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:31 ntpd[17297]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:31.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:31 ntpd[17297]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:31.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:31 ntpd[17297]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:31.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:31 ntpd[17297]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:31.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:31 ntpd[17297]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:31.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:31 ntpd[17297]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:31.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:31 ntpd[17297]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-14T01:19:31.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:31 ntpd[17297]: can't open /var/log/ntpstats/peerstats.20240514: Permission denied 2024-05-14T01:19:31.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:31 ntpd[17297]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:31.448 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:31 ntpd[17297]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:31.448 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:31 ntpd[17297]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-14T01:19:31.448 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:31 ntpd[17297]: can't open /var/log/ntpstats/peerstats.20240514: Permission denied 2024-05-14T01:19:32.446 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:32 ntpd[17297]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:32.446 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:32 ntpd[17297]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:32.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:32 ntpd[17297]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:32.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:32 ntpd[17297]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:32.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:32 ntpd[17297]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-14T01:19:32.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:32 ntpd[17297]: can't open /var/log/ntpstats/peerstats.20240514: Permission denied 2024-05-14T01:19:32.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:32 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:32.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:32 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:32.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:32 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:32.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:32 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:32.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:32 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:32.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:32 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:32.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:32 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:32.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:32 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:32.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:32 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-14T01:19:32.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:32 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240514: Permission denied 2024-05-14T01:19:32.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:32 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:32.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:32 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:32.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:32 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-14T01:19:32.475 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:32 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240514: Permission denied 2024-05-14T01:19:32.475 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:32 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:32.475 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:32 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:32.475 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:32 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-14T01:19:32.475 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:32 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240514: Permission denied 2024-05-14T01:19:33.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:33 ntpd[17297]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:33.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:33 ntpd[17297]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:33.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:33 ntpd[17297]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:33.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:33 ntpd[17297]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:33.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:33 ntpd[17297]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:33.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:33 ntpd[17297]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:33.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:33 ntpd[17297]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-14T01:19:33.448 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:33 ntpd[17297]: can't open /var/log/ntpstats/peerstats.20240514: Permission denied 2024-05-14T01:19:33.448 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:33 ntpd[17297]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:33.448 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:33 ntpd[17297]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:33.448 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:33 ntpd[17297]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-14T01:19:33.448 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:33 ntpd[17297]: can't open /var/log/ntpstats/peerstats.20240514: Permission denied 2024-05-14T01:19:34.446 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:34 ntpd[17297]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:34.446 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:34 ntpd[17297]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:34.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:34 ntpd[17297]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:34.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:34 ntpd[17297]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:34.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:34 ntpd[17297]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-14T01:19:34.447 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:34 ntpd[17297]: can't open /var/log/ntpstats/peerstats.20240514: Permission denied 2024-05-14T01:19:34.447 INFO:teuthology.orchestra.run.smithi154.stdout:14 May 01:19:34 ntpd[17297]: ntpd: time slew -0.003219 s 2024-05-14T01:19:34.447 INFO:teuthology.orchestra.run.smithi154.stdout:ntpd: time slew -0.003219s 2024-05-14T01:19:34.448 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:34 ntpd[17297]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-14T01:19:34.448 INFO:teuthology.orchestra.run.smithi154.stderr:14 May 01:19:34 ntpd[17297]: can't open /var/log/ntpstats/loopstats.20240514: Permission denied 2024-05-14T01:19:34.473 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:34 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:34.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:34 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:34.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:34 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:34.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:34 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:34.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:34 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:34.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:34 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:34.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:34 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:34.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:34 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:34.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:34 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-14T01:19:34.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:34 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240514: Permission denied 2024-05-14T01:19:34.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:34 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-14T01:19:34.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:34 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240514: Permission denied 2024-05-14T01:19:34.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:34 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-14T01:19:34.474 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:34 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240514: Permission denied 2024-05-14T01:19:34.475 INFO:teuthology.orchestra.run.smithi176.stdout:14 May 01:19:34 ntpd[17235]: ntpd: time slew +0.000283 s 2024-05-14T01:19:34.475 INFO:teuthology.orchestra.run.smithi176.stdout:ntpd: time slew +0.000283s 2024-05-14T01:19:34.475 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:34 ntpd[17235]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-14T01:19:34.475 INFO:teuthology.orchestra.run.smithi176.stderr:14 May 01:19:34 ntpd[17235]: can't open /var/log/ntpstats/loopstats.20240514: Permission denied 2024-05-14T01:19:34.494 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2024-05-14T01:19:34.494 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2024-05-14T01:19:34.494 INFO:teuthology.orchestra.run.smithi154.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-14T01:19:34.494 INFO:teuthology.orchestra.run.smithi154.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-14T01:19:34.494 INFO:teuthology.orchestra.run.smithi154.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-14T01:19:34.494 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-14T01:19:34.543 INFO:teuthology.orchestra.run.smithi176.stdout: remote refid st t when poll reach delay offset jitter 2024-05-14T01:19:34.543 INFO:teuthology.orchestra.run.smithi176.stdout:============================================================================== 2024-05-14T01:19:34.543 INFO:teuthology.orchestra.run.smithi176.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-14T01:19:34.543 INFO:teuthology.orchestra.run.smithi176.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-14T01:19:34.543 INFO:teuthology.orchestra.run.smithi176.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-14T01:19:34.543 INFO:teuthology.orchestra.run.smithi176.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-14T01:19:34.544 INFO:teuthology.run_tasks:Running task install... 2024-05-14T01:19:34.553 DEBUG:teuthology.task.install:project ceph 2024-05-14T01:19:34.553 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2ba596c3826798bb3a2f22bc9b02848b92dbe579'}} 2024-05-14T01:19:34.553 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2ba596c3826798bb3a2f22bc9b02848b92dbe579'} 2024-05-14T01:19:34.553 INFO:teuthology.task.install:Using flavor: default 2024-05-14T01:19:34.559 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-14T01:19:34.559 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-14T01:19:34.559 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-key list | grep Ceph 2024-05-14T01:19:34.560 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-key list | grep Ceph 2024-05-14T01:19:34.617 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-14T01:19:34.645 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-14T01:19:34.645 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph.com (release key) 2024-05-14T01:19:34.646 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-14T01:19:34.646 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-14T01:19:34.646 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ba596c3826798bb3a2f22bc9b02848b92dbe579 2024-05-14T01:19:34.651 INFO:teuthology.orchestra.run.smithi176.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-14T01:19:34.679 INFO:teuthology.orchestra.run.smithi176.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-14T01:19:34.679 INFO:teuthology.orchestra.run.smithi176.stdout:uid [ unknown] Ceph.com (release key) 2024-05-14T01:19:34.679 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-14T01:19:34.680 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-14T01:19:34.680 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ba596c3826798bb3a2f22bc9b02848b92dbe579 2024-05-14T01:19:34.865 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default/ 2024-05-14T01:19:34.866 INFO:teuthology.task.install.deb:Package version is 19.0.0-2569-g2ba596c3-1jammy 2024-05-14T01:19:34.894 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default/ 2024-05-14T01:19:34.894 INFO:teuthology.task.install.deb:Package version is 19.0.0-2569-g2ba596c3-1jammy 2024-05-14T01:19:35.154 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:19:35.154 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-14T01:19:35.168 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-05-14T01:19:35.216 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:19:35.216 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-14T01:19:35.229 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get update 2024-05-14T01:19:35.363 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-14T01:19:35.400 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-14T01:19:35.400 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-14T01:19:35.413 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-14T01:19:35.433 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-14T01:19:35.477 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-14T01:19:35.561 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-14T01:19:35.636 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy InRelease 2024-05-14T01:19:35.640 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-14T01:19:35.641 INFO:teuthology.orchestra.run.smithi176.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy InRelease 2024-05-14T01:19:35.716 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-14T01:19:35.726 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-14T01:19:35.788 INFO:teuthology.orchestra.run.smithi176.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-14T01:19:35.811 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-14T01:19:35.815 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-05-14T01:19:35.863 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2024-05-14T01:19:35.870 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2024-05-14T01:19:35.936 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-05-14T01:19:35.954 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 28.9 kB in 1s (54.8 kB/s) 2024-05-14T01:19:36.082 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 28.9 kB in 1s (39.9 kB/s) 2024-05-14T01:19:36.947 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-05-14T01:19:36.963 DEBUG:teuthology.orchestra.run.smithi176:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2569-g2ba596c3-1jammy cephadm=19.0.0-2569-g2ba596c3-1jammy ceph-mds=19.0.0-2569-g2ba596c3-1jammy ceph-mgr=19.0.0-2569-g2ba596c3-1jammy ceph-common=19.0.0-2569-g2ba596c3-1jammy ceph-fuse=19.0.0-2569-g2ba596c3-1jammy ceph-test=19.0.0-2569-g2ba596c3-1jammy ceph-volume=19.0.0-2569-g2ba596c3-1jammy radosgw=19.0.0-2569-g2ba596c3-1jammy python3-rados=19.0.0-2569-g2ba596c3-1jammy python3-rgw=19.0.0-2569-g2ba596c3-1jammy python3-cephfs=19.0.0-2569-g2ba596c3-1jammy python3-rbd=19.0.0-2569-g2ba596c3-1jammy libcephfs2=19.0.0-2569-g2ba596c3-1jammy libcephfs-dev=19.0.0-2569-g2ba596c3-1jammy librados2=19.0.0-2569-g2ba596c3-1jammy librbd1=19.0.0-2569-g2ba596c3-1jammy rbd-fuse=19.0.0-2569-g2ba596c3-1jammy python3-cephfs=19.0.0-2569-g2ba596c3-1jammy cephfs-shell=19.0.0-2569-g2ba596c3-1jammy cephfs-top=19.0.0-2569-g2ba596c3-1jammy cephfs-mirror=19.0.0-2569-g2ba596c3-1jammy 2024-05-14T01:19:37.014 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-05-14T01:19:37.040 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-05-14T01:19:37.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2569-g2ba596c3-1jammy cephadm=19.0.0-2569-g2ba596c3-1jammy ceph-mds=19.0.0-2569-g2ba596c3-1jammy ceph-mgr=19.0.0-2569-g2ba596c3-1jammy ceph-common=19.0.0-2569-g2ba596c3-1jammy ceph-fuse=19.0.0-2569-g2ba596c3-1jammy ceph-test=19.0.0-2569-g2ba596c3-1jammy ceph-volume=19.0.0-2569-g2ba596c3-1jammy radosgw=19.0.0-2569-g2ba596c3-1jammy python3-rados=19.0.0-2569-g2ba596c3-1jammy python3-rgw=19.0.0-2569-g2ba596c3-1jammy python3-cephfs=19.0.0-2569-g2ba596c3-1jammy python3-rbd=19.0.0-2569-g2ba596c3-1jammy libcephfs2=19.0.0-2569-g2ba596c3-1jammy libcephfs-dev=19.0.0-2569-g2ba596c3-1jammy librados2=19.0.0-2569-g2ba596c3-1jammy librbd1=19.0.0-2569-g2ba596c3-1jammy rbd-fuse=19.0.0-2569-g2ba596c3-1jammy python3-cephfs=19.0.0-2569-g2ba596c3-1jammy cephfs-shell=19.0.0-2569-g2ba596c3-1jammy cephfs-top=19.0.0-2569-g2ba596c3-1jammy cephfs-mirror=19.0.0-2569-g2ba596c3-1jammy 2024-05-14T01:19:37.115 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-05-14T01:19:37.194 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2024-05-14T01:19:37.194 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2024-05-14T01:19:37.315 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-05-14T01:19:37.315 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-05-14T01:19:37.370 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages were automatically installed and are no longer required: 2024-05-14T01:19:37.371 INFO:teuthology.orchestra.run.smithi176.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-14T01:19:37.371 INFO:teuthology.orchestra.run.smithi176.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-14T01:19:37.371 INFO:teuthology.orchestra.run.smithi176.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-14T01:19:37.371 INFO:teuthology.orchestra.run.smithi176.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-14T01:19:37.371 INFO:teuthology.orchestra.run.smithi176.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-14T01:19:37.371 INFO:teuthology.orchestra.run.smithi176.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-14T01:19:37.373 INFO:teuthology.orchestra.run.smithi176.stdout:The following additional packages will be installed: 2024-05-14T01:19:37.373 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-14T01:19:37.373 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-14T01:19:37.373 INFO:teuthology.orchestra.run.smithi176.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-14T01:19:37.373 INFO:teuthology.orchestra.run.smithi176.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-14T01:19:37.374 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-14T01:19:37.374 INFO:teuthology.orchestra.run.smithi176.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-14T01:19:37.374 INFO:teuthology.orchestra.run.smithi176.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-14T01:19:37.374 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-14T01:19:37.374 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-14T01:19:37.374 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-14T01:19:37.374 INFO:teuthology.orchestra.run.smithi176.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-14T01:19:37.374 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-14T01:19:37.374 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-14T01:19:37.375 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-14T01:19:37.375 INFO:teuthology.orchestra.run.smithi176.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-14T01:19:37.375 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-14T01:19:37.375 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-14T01:19:37.375 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-14T01:19:37.375 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-14T01:19:37.375 INFO:teuthology.orchestra.run.smithi176.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-14T01:19:37.375 INFO:teuthology.orchestra.run.smithi176.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-14T01:19:37.375 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-14T01:19:37.375 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-14T01:19:37.376 INFO:teuthology.orchestra.run.smithi176.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-14T01:19:37.376 INFO:teuthology.orchestra.run.smithi176.stdout:Suggested packages: 2024-05-14T01:19:37.376 INFO:teuthology.orchestra.run.smithi176.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-14T01:19:37.376 INFO:teuthology.orchestra.run.smithi176.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-14T01:19:37.376 INFO:teuthology.orchestra.run.smithi176.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-14T01:19:37.376 INFO:teuthology.orchestra.run.smithi176.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-14T01:19:37.376 INFO:teuthology.orchestra.run.smithi176.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-14T01:19:37.376 INFO:teuthology.orchestra.run.smithi176.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-14T01:19:37.377 INFO:teuthology.orchestra.run.smithi176.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-14T01:19:37.377 INFO:teuthology.orchestra.run.smithi176.stdout:Recommended packages: 2024-05-14T01:19:37.377 INFO:teuthology.orchestra.run.smithi176.stdout: btrfs-tools 2024-05-14T01:19:37.478 INFO:teuthology.orchestra.run.smithi176.stdout:The following NEW packages will be installed: 2024-05-14T01:19:37.479 INFO:teuthology.orchestra.run.smithi176.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-14T01:19:37.479 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-14T01:19:37.479 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-14T01:19:37.479 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-14T01:19:37.479 INFO:teuthology.orchestra.run.smithi176.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-14T01:19:37.479 INFO:teuthology.orchestra.run.smithi176.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-14T01:19:37.479 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-14T01:19:37.479 INFO:teuthology.orchestra.run.smithi176.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-14T01:19:37.479 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-14T01:19:37.479 INFO:teuthology.orchestra.run.smithi176.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-14T01:19:37.479 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-14T01:19:37.479 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-14T01:19:37.480 INFO:teuthology.orchestra.run.smithi176.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-14T01:19:37.480 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-14T01:19:37.480 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-14T01:19:37.480 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-14T01:19:37.480 INFO:teuthology.orchestra.run.smithi176.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-14T01:19:37.480 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-14T01:19:37.480 INFO:teuthology.orchestra.run.smithi176.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-14T01:19:37.480 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-14T01:19:37.480 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-14T01:19:37.480 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-14T01:19:37.480 INFO:teuthology.orchestra.run.smithi176.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-14T01:19:37.480 INFO:teuthology.orchestra.run.smithi176.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-14T01:19:37.480 INFO:teuthology.orchestra.run.smithi176.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-14T01:19:37.480 INFO:teuthology.orchestra.run.smithi176.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-14T01:19:37.481 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-14T01:19:37.481 INFO:teuthology.orchestra.run.smithi176.stdout: socat unzip xmlstarlet zip 2024-05-14T01:19:37.511 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-05-14T01:19:37.511 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-14T01:19:37.511 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-14T01:19:37.512 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-14T01:19:37.512 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-14T01:19:37.512 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-14T01:19:37.512 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-14T01:19:37.513 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-05-14T01:19:37.513 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-14T01:19:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-14T01:19:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-14T01:19:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-14T01:19:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-14T01:19:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-14T01:19:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-14T01:19:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-14T01:19:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-14T01:19:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-14T01:19:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-14T01:19:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-14T01:19:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-14T01:19:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-14T01:19:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-14T01:19:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-14T01:19:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-14T01:19:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-14T01:19:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-14T01:19:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-14T01:19:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-14T01:19:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-14T01:19:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-14T01:19:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-14T01:19:37.516 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-05-14T01:19:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-14T01:19:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-14T01:19:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-14T01:19:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-14T01:19:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-14T01:19:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-14T01:19:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-14T01:19:37.516 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2024-05-14T01:19:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: btrfs-tools 2024-05-14T01:19:37.621 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-05-14T01:19:37.621 INFO:teuthology.orchestra.run.smithi154.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-14T01:19:37.622 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-14T01:19:37.622 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-14T01:19:37.622 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-14T01:19:37.622 INFO:teuthology.orchestra.run.smithi154.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-14T01:19:37.622 INFO:teuthology.orchestra.run.smithi154.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-14T01:19:37.622 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-14T01:19:37.622 INFO:teuthology.orchestra.run.smithi154.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-14T01:19:37.622 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-14T01:19:37.622 INFO:teuthology.orchestra.run.smithi154.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-14T01:19:37.622 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-14T01:19:37.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-14T01:19:37.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-14T01:19:37.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-14T01:19:37.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-14T01:19:37.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-14T01:19:37.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-14T01:19:37.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-14T01:19:37.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-14T01:19:37.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-14T01:19:37.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-14T01:19:37.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-14T01:19:37.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-14T01:19:37.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-14T01:19:37.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-14T01:19:37.623 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-14T01:19:37.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-14T01:19:37.624 INFO:teuthology.orchestra.run.smithi154.stdout: socat unzip xmlstarlet zip 2024-05-14T01:19:37.667 INFO:teuthology.orchestra.run.smithi176.stdout:0 upgraded, 124 newly installed, 0 to remove and 307 not upgraded. 2024-05-14T01:19:37.667 INFO:teuthology.orchestra.run.smithi176.stdout:Need to get 180 MB of archives. 2024-05-14T01:19:37.667 INFO:teuthology.orchestra.run.smithi176.stdout:After this operation, 823 MB of additional disk space will be used. 2024-05-14T01:19:37.667 INFO:teuthology.orchestra.run.smithi176.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-14T01:19:37.688 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 124 newly installed, 0 to remove and 307 not upgraded. 2024-05-14T01:19:37.688 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 180 MB of archives. 2024-05-14T01:19:37.688 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 823 MB of additional disk space will be used. 2024-05-14T01:19:37.688 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-14T01:19:37.709 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-14T01:19:37.724 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-14T01:19:37.750 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-14T01:19:37.773 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-14T01:19:37.795 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-14T01:19:37.800 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-14T01:19:37.804 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-14T01:19:37.817 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-14T01:19:37.849 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2569-g2ba596c3-1jammy [3,546 kB] 2024-05-14T01:19:37.876 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-14T01:19:37.881 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-14T01:19:37.894 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-14T01:19:37.898 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-14T01:19:37.899 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-14T01:19:37.907 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-14T01:19:37.909 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2569-g2ba596c3-1jammy [3,546 kB] 2024-05-14T01:19:37.910 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-14T01:19:37.912 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-14T01:19:37.913 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-14T01:19:37.913 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-14T01:19:37.930 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-14T01:19:37.932 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-14T01:19:37.934 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-14T01:19:37.935 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-14T01:19:37.935 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-14T01:19:37.951 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-14T01:19:37.952 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-14T01:19:37.952 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-14T01:19:37.952 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-14T01:19:37.952 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-14T01:19:37.972 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-14T01:19:37.973 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-14T01:19:37.975 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-14T01:19:37.976 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-14T01:19:37.976 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-14T01:19:37.993 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-14T01:19:37.993 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-14T01:19:37.994 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-14T01:19:37.994 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-14T01:19:37.995 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-14T01:19:37.998 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-14T01:19:38.013 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-14T01:19:38.014 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-14T01:19:38.019 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-14T01:19:38.019 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-14T01:19:38.020 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-14T01:19:38.040 INFO:teuthology.orchestra.run.smithi154.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-14T01:19:38.041 INFO:teuthology.orchestra.run.smithi154.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-14T01:19:38.046 INFO:teuthology.orchestra.run.smithi154.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-14T01:19:38.046 INFO:teuthology.orchestra.run.smithi154.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-14T01:19:38.046 INFO:teuthology.orchestra.run.smithi154.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-14T01:19:38.060 INFO:teuthology.orchestra.run.smithi154.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-14T01:19:38.063 INFO:teuthology.orchestra.run.smithi154.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-14T01:19:38.063 INFO:teuthology.orchestra.run.smithi154.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-14T01:19:38.064 INFO:teuthology.orchestra.run.smithi154.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-14T01:19:38.067 INFO:teuthology.orchestra.run.smithi154.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-14T01:19:38.093 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-14T01:19:38.106 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-14T01:19:38.121 INFO:teuthology.orchestra.run.smithi154.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-14T01:19:38.122 INFO:teuthology.orchestra.run.smithi154.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-14T01:19:38.124 INFO:teuthology.orchestra.run.smithi154.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-14T01:19:38.124 INFO:teuthology.orchestra.run.smithi154.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-14T01:19:38.125 INFO:teuthology.orchestra.run.smithi154.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-14T01:19:38.146 INFO:teuthology.orchestra.run.smithi154.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-14T01:19:38.148 INFO:teuthology.orchestra.run.smithi154.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-14T01:19:38.149 INFO:teuthology.orchestra.run.smithi154.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-14T01:19:38.157 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-14T01:19:38.173 INFO:teuthology.orchestra.run.smithi154.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-14T01:19:38.174 INFO:teuthology.orchestra.run.smithi154.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-14T01:19:38.175 INFO:teuthology.orchestra.run.smithi154.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-14T01:19:38.175 INFO:teuthology.orchestra.run.smithi154.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-14T01:19:38.184 INFO:teuthology.orchestra.run.smithi154.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-14T01:19:38.185 INFO:teuthology.orchestra.run.smithi154.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-14T01:19:38.185 INFO:teuthology.orchestra.run.smithi154.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-14T01:19:38.186 INFO:teuthology.orchestra.run.smithi154.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-14T01:19:38.190 INFO:teuthology.orchestra.run.smithi154.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-14T01:19:38.205 INFO:teuthology.orchestra.run.smithi154.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-14T01:19:38.206 INFO:teuthology.orchestra.run.smithi154.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-14T01:19:38.207 INFO:teuthology.orchestra.run.smithi154.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-14T01:19:38.210 INFO:teuthology.orchestra.run.smithi154.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-14T01:19:38.213 INFO:teuthology.orchestra.run.smithi154.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-14T01:19:38.226 INFO:teuthology.orchestra.run.smithi154.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-14T01:19:38.226 INFO:teuthology.orchestra.run.smithi154.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-14T01:19:38.227 INFO:teuthology.orchestra.run.smithi154.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-14T01:19:38.231 INFO:teuthology.orchestra.run.smithi154.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-14T01:19:38.232 INFO:teuthology.orchestra.run.smithi154.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-14T01:19:38.250 INFO:teuthology.orchestra.run.smithi154.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-14T01:19:38.256 INFO:teuthology.orchestra.run.smithi154.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-14T01:19:38.265 INFO:teuthology.orchestra.run.smithi154.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-14T01:19:38.265 INFO:teuthology.orchestra.run.smithi154.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-14T01:19:38.267 INFO:teuthology.orchestra.run.smithi154.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-14T01:19:38.270 INFO:teuthology.orchestra.run.smithi154.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-14T01:19:38.278 INFO:teuthology.orchestra.run.smithi154.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-14T01:19:38.278 INFO:teuthology.orchestra.run.smithi154.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-14T01:19:38.278 INFO:teuthology.orchestra.run.smithi154.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-14T01:19:38.280 INFO:teuthology.orchestra.run.smithi154.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-14T01:19:38.291 INFO:teuthology.orchestra.run.smithi154.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-14T01:19:38.305 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2569-g2ba596c3-1jammy [3,216 kB] 2024-05-14T01:19:38.331 INFO:teuthology.orchestra.run.smithi176.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-14T01:19:38.340 INFO:teuthology.orchestra.run.smithi176.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-14T01:19:38.368 INFO:teuthology.orchestra.run.smithi176.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-14T01:19:38.377 INFO:teuthology.orchestra.run.smithi176.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-14T01:19:38.416 INFO:teuthology.orchestra.run.smithi154.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2569-g2ba596c3-1jammy [3,216 kB] 2024-05-14T01:19:38.541 INFO:teuthology.orchestra.run.smithi176.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-14T01:19:38.607 INFO:teuthology.orchestra.run.smithi176.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2569-g2ba596c3-1jammy [711 kB] 2024-05-14T01:19:38.684 INFO:teuthology.orchestra.run.smithi176.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2569-g2ba596c3-1jammy [356 kB] 2024-05-14T01:19:38.747 INFO:teuthology.orchestra.run.smithi176.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2569-g2ba596c3-1jammy [32.8 kB] 2024-05-14T01:19:38.749 INFO:teuthology.orchestra.run.smithi176.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2569-g2ba596c3-1jammy [180 kB] 2024-05-14T01:19:38.754 INFO:teuthology.orchestra.run.smithi176.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2569-g2ba596c3-1jammy [67.1 kB] 2024-05-14T01:19:38.756 INFO:teuthology.orchestra.run.smithi176.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2569-g2ba596c3-1jammy [334 kB] 2024-05-14T01:19:38.771 INFO:teuthology.orchestra.run.smithi176.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2569-g2ba596c3-1jammy [6,780 kB] 2024-05-14T01:19:39.117 INFO:teuthology.orchestra.run.smithi176.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-14T01:19:39.132 INFO:teuthology.orchestra.run.smithi176.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-14T01:19:39.148 INFO:teuthology.orchestra.run.smithi176.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-14T01:19:39.157 INFO:teuthology.orchestra.run.smithi176.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-14T01:19:39.157 INFO:teuthology.orchestra.run.smithi176.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-14T01:19:39.174 INFO:teuthology.orchestra.run.smithi176.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-14T01:19:39.211 INFO:teuthology.orchestra.run.smithi176.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-14T01:19:39.225 INFO:teuthology.orchestra.run.smithi176.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-14T01:19:39.228 INFO:teuthology.orchestra.run.smithi176.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-14T01:19:39.229 INFO:teuthology.orchestra.run.smithi176.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-14T01:19:39.400 INFO:teuthology.orchestra.run.smithi176.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-14T01:19:39.426 INFO:teuthology.orchestra.run.smithi176.stdout:Get:33 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2569-g2ba596c3-1jammy [112 kB] 2024-05-14T01:19:39.429 INFO:teuthology.orchestra.run.smithi176.stdout:Get:34 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2569-g2ba596c3-1jammy [466 kB] 2024-05-14T01:19:39.451 INFO:teuthology.orchestra.run.smithi176.stdout:Get:35 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2569-g2ba596c3-1jammy [25.6 MB] 2024-05-14T01:19:39.483 INFO:teuthology.orchestra.run.smithi176.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-14T01:19:39.490 INFO:teuthology.orchestra.run.smithi176.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-14T01:19:39.564 INFO:teuthology.orchestra.run.smithi176.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-14T01:19:39.589 INFO:teuthology.orchestra.run.smithi176.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-14T01:19:39.603 INFO:teuthology.orchestra.run.smithi154.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2569-g2ba596c3-1jammy [711 kB] 2024-05-14T01:19:39.605 INFO:teuthology.orchestra.run.smithi176.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-14T01:19:39.623 INFO:teuthology.orchestra.run.smithi176.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-14T01:19:39.814 INFO:teuthology.orchestra.run.smithi176.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-14T01:19:39.830 INFO:teuthology.orchestra.run.smithi176.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-14T01:19:39.832 INFO:teuthology.orchestra.run.smithi154.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2569-g2ba596c3-1jammy [356 kB] 2024-05-14T01:19:39.837 INFO:teuthology.orchestra.run.smithi176.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-14T01:19:39.842 INFO:teuthology.orchestra.run.smithi176.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-14T01:19:39.945 INFO:teuthology.orchestra.run.smithi154.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2569-g2ba596c3-1jammy [32.8 kB] 2024-05-14T01:19:39.953 INFO:teuthology.orchestra.run.smithi154.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2569-g2ba596c3-1jammy [180 kB] 2024-05-14T01:19:40.011 INFO:teuthology.orchestra.run.smithi154.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2569-g2ba596c3-1jammy [67.1 kB] 2024-05-14T01:19:40.024 INFO:teuthology.orchestra.run.smithi176.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-14T01:19:40.031 INFO:teuthology.orchestra.run.smithi154.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2569-g2ba596c3-1jammy [334 kB] 2024-05-14T01:19:40.108 INFO:teuthology.orchestra.run.smithi176.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-14T01:19:40.123 INFO:teuthology.orchestra.run.smithi176.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-14T01:19:40.140 INFO:teuthology.orchestra.run.smithi154.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2569-g2ba596c3-1jammy [6,780 kB] 2024-05-14T01:19:40.309 INFO:teuthology.orchestra.run.smithi176.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-14T01:19:40.360 INFO:teuthology.orchestra.run.smithi176.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-14T01:19:40.373 INFO:teuthology.orchestra.run.smithi176.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-14T01:19:40.531 INFO:teuthology.orchestra.run.smithi176.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-14T01:19:40.532 INFO:teuthology.orchestra.run.smithi176.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-14T01:19:40.537 INFO:teuthology.orchestra.run.smithi176.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-14T01:19:40.542 INFO:teuthology.orchestra.run.smithi176.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-14T01:19:40.556 INFO:teuthology.orchestra.run.smithi176.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-14T01:19:40.741 INFO:teuthology.orchestra.run.smithi176.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-14T01:19:41.005 INFO:teuthology.orchestra.run.smithi176.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-14T01:19:41.121 INFO:teuthology.orchestra.run.smithi176.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-14T01:19:41.164 INFO:teuthology.orchestra.run.smithi176.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-14T01:19:41.246 INFO:teuthology.orchestra.run.smithi176.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-14T01:19:41.258 INFO:teuthology.orchestra.run.smithi176.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-14T01:19:41.271 INFO:teuthology.orchestra.run.smithi176.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-14T01:19:41.311 INFO:teuthology.orchestra.run.smithi176.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-14T01:19:41.658 INFO:teuthology.orchestra.run.smithi176.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-14T01:19:41.658 INFO:teuthology.orchestra.run.smithi176.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2569-g2ba596c3-1jammy [5,085 kB] 2024-05-14T01:19:41.660 INFO:teuthology.orchestra.run.smithi176.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-14T01:19:41.663 INFO:teuthology.orchestra.run.smithi176.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-14T01:19:41.827 INFO:teuthology.orchestra.run.smithi176.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-14T01:19:41.981 INFO:teuthology.orchestra.run.smithi176.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2569-g2ba596c3-1jammy [244 kB] 2024-05-14T01:19:41.988 INFO:teuthology.orchestra.run.smithi176.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2569-g2ba596c3-1jammy [124 kB] 2024-05-14T01:19:41.993 INFO:teuthology.orchestra.run.smithi176.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2569-g2ba596c3-1jammy [1,526 kB] 2024-05-14T01:19:42.141 INFO:teuthology.orchestra.run.smithi176.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2569-g2ba596c3-1jammy [6,246 kB] 2024-05-14T01:19:42.152 INFO:teuthology.orchestra.run.smithi176.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-14T01:19:42.351 INFO:teuthology.orchestra.run.smithi154.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2569-g2ba596c3-1jammy [112 kB] 2024-05-14T01:19:42.382 INFO:teuthology.orchestra.run.smithi154.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2569-g2ba596c3-1jammy [466 kB] 2024-05-14T01:19:42.546 INFO:teuthology.orchestra.run.smithi154.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2569-g2ba596c3-1jammy [25.6 MB] 2024-05-14T01:19:42.571 INFO:teuthology.orchestra.run.smithi176.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-14T01:19:42.582 INFO:teuthology.orchestra.run.smithi176.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-14T01:19:42.583 INFO:teuthology.orchestra.run.smithi176.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-14T01:19:42.638 INFO:teuthology.orchestra.run.smithi176.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2569-g2ba596c3-1jammy [22.7 MB] 2024-05-14T01:19:42.651 INFO:teuthology.orchestra.run.smithi176.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-14T01:19:42.652 INFO:teuthology.orchestra.run.smithi176.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-14T01:19:42.654 INFO:teuthology.orchestra.run.smithi176.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-14T01:19:42.655 INFO:teuthology.orchestra.run.smithi176.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-14T01:19:42.664 INFO:teuthology.orchestra.run.smithi176.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-14T01:19:42.830 INFO:teuthology.orchestra.run.smithi176.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-14T01:19:42.921 INFO:teuthology.orchestra.run.smithi176.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-14T01:19:43.049 INFO:teuthology.orchestra.run.smithi176.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-14T01:19:43.318 INFO:teuthology.orchestra.run.smithi176.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-14T01:19:43.360 INFO:teuthology.orchestra.run.smithi176.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-14T01:19:43.385 INFO:teuthology.orchestra.run.smithi176.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-14T01:19:43.393 INFO:teuthology.orchestra.run.smithi176.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-14T01:19:43.440 INFO:teuthology.orchestra.run.smithi176.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-14T01:19:43.465 INFO:teuthology.orchestra.run.smithi176.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-14T01:19:43.467 INFO:teuthology.orchestra.run.smithi176.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-14T01:19:43.473 INFO:teuthology.orchestra.run.smithi176.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-14T01:19:43.639 INFO:teuthology.orchestra.run.smithi176.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-14T01:19:44.174 INFO:teuthology.orchestra.run.smithi176.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-14T01:19:44.180 INFO:teuthology.orchestra.run.smithi176.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-14T01:19:44.219 INFO:teuthology.orchestra.run.smithi176.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-14T01:19:44.219 INFO:teuthology.orchestra.run.smithi176.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-14T01:19:44.226 INFO:teuthology.orchestra.run.smithi176.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-14T01:19:44.228 INFO:teuthology.orchestra.run.smithi176.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-14T01:19:44.269 INFO:teuthology.orchestra.run.smithi176.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-14T01:19:44.279 INFO:teuthology.orchestra.run.smithi176.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-14T01:19:44.356 INFO:teuthology.orchestra.run.smithi176.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-14T01:19:44.357 INFO:teuthology.orchestra.run.smithi176.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-14T01:19:44.468 INFO:teuthology.orchestra.run.smithi176.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2569-g2ba596c3-1jammy [14.0 kB] 2024-05-14T01:19:44.469 INFO:teuthology.orchestra.run.smithi176.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2569-g2ba596c3-1jammy [869 kB] 2024-05-14T01:19:44.486 INFO:teuthology.orchestra.run.smithi176.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2569-g2ba596c3-1jammy [2,437 kB] 2024-05-14T01:19:44.522 INFO:teuthology.orchestra.run.smithi176.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-14T01:19:44.656 INFO:teuthology.orchestra.run.smithi176.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2569-g2ba596c3-1jammy [792 kB] 2024-05-14T01:19:44.732 INFO:teuthology.orchestra.run.smithi176.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2569-g2ba596c3-1jammy [148 kB] 2024-05-14T01:19:44.736 INFO:teuthology.orchestra.run.smithi176.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2569-g2ba596c3-1jammy [2,324 kB] 2024-05-14T01:19:44.916 INFO:teuthology.orchestra.run.smithi176.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2569-g2ba596c3-1jammy [8,625 kB] 2024-05-14T01:19:44.956 INFO:teuthology.orchestra.run.smithi176.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-14T01:19:44.971 INFO:teuthology.orchestra.run.smithi176.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-14T01:19:45.623 INFO:teuthology.orchestra.run.smithi176.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2569-g2ba596c3-1jammy [14.2 kB] 2024-05-14T01:19:45.624 INFO:teuthology.orchestra.run.smithi176.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2569-g2ba596c3-1jammy [50.7 MB] 2024-05-14T01:19:49.566 INFO:teuthology.orchestra.run.smithi176.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2569-g2ba596c3-1jammy [121 kB] 2024-05-14T01:19:49.579 INFO:teuthology.orchestra.run.smithi176.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2569-g2ba596c3-1jammy [229 kB] 2024-05-14T01:19:49.584 INFO:teuthology.orchestra.run.smithi176.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2569-g2ba596c3-1jammy [33.9 kB] 2024-05-14T01:19:49.590 INFO:teuthology.orchestra.run.smithi176.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2569-g2ba596c3-1jammy [23.4 kB] 2024-05-14T01:19:49.592 INFO:teuthology.orchestra.run.smithi176.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2569-g2ba596c3-1jammy [38.9 kB] 2024-05-14T01:19:49.592 INFO:teuthology.orchestra.run.smithi176.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2569-g2ba596c3-1jammy [13.4 MB] 2024-05-14T01:19:49.709 INFO:teuthology.orchestra.run.smithi154.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2569-g2ba596c3-1jammy [5,085 kB] 2024-05-14T01:19:50.618 INFO:teuthology.orchestra.run.smithi176.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2569-g2ba596c3-1jammy [91.4 kB] 2024-05-14T01:19:50.772 INFO:teuthology.orchestra.run.smithi154.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2569-g2ba596c3-1jammy [244 kB] 2024-05-14T01:19:50.784 INFO:teuthology.orchestra.run.smithi154.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2569-g2ba596c3-1jammy [124 kB] 2024-05-14T01:19:50.809 INFO:teuthology.orchestra.run.smithi154.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2569-g2ba596c3-1jammy [1,526 kB] 2024-05-14T01:19:51.026 INFO:teuthology.orchestra.run.smithi154.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2569-g2ba596c3-1jammy [6,246 kB] 2024-05-14T01:19:51.233 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 180 MB in 13s (13.7 MB/s) 2024-05-14T01:19:51.353 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-14T01:19:51.450 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-14T01:19:51.455 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-14T01:19:51.501 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-14T01:19:51.770 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-14T01:19:51.785 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-14T01:19:51.820 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-14T01:19:51.900 INFO:teuthology.orchestra.run.smithi154.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2569-g2ba596c3-1jammy [22.7 MB] 2024-05-14T01:19:52.123 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cmd2. 2024-05-14T01:19:52.150 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-14T01:19:52.190 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-14T01:19:52.534 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-14T01:19:52.550 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-14T01:19:52.634 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-14T01:19:52.988 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-14T01:19:53.003 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-14T01:19:53.046 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-14T01:19:53.324 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-14T01:19:53.351 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-14T01:19:53.382 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-14T01:19:53.827 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-14T01:19:53.854 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-14T01:19:53.902 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-14T01:19:54.297 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-14T01:19:54.323 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-14T01:19:54.363 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-14T01:19:54.675 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-14T01:19:54.701 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-14T01:19:54.733 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-14T01:19:54.910 INFO:teuthology.orchestra.run.smithi154.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2569-g2ba596c3-1jammy [14.0 kB] 2024-05-14T01:19:54.911 INFO:teuthology.orchestra.run.smithi154.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2569-g2ba596c3-1jammy [869 kB] 2024-05-14T01:19:54.964 INFO:teuthology.orchestra.run.smithi154.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2569-g2ba596c3-1jammy [2,437 kB] 2024-05-14T01:19:55.303 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-14T01:19:55.330 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-14T01:19:55.343 INFO:teuthology.orchestra.run.smithi154.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2569-g2ba596c3-1jammy [792 kB] 2024-05-14T01:19:55.370 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-14T01:19:55.463 INFO:teuthology.orchestra.run.smithi154.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2569-g2ba596c3-1jammy [148 kB] 2024-05-14T01:19:55.487 INFO:teuthology.orchestra.run.smithi154.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2569-g2ba596c3-1jammy [2,324 kB] 2024-05-14T01:19:55.738 INFO:teuthology.orchestra.run.smithi154.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2569-g2ba596c3-1jammy [8,625 kB] 2024-05-14T01:19:55.846 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librados2. 2024-05-14T01:19:55.873 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../010-librados2_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:19:55.939 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librados2 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:19:56.257 INFO:teuthology.orchestra.run.smithi154.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2569-g2ba596c3-1jammy [14.2 kB] 2024-05-14T01:19:56.258 INFO:teuthology.orchestra.run.smithi154.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2569-g2ba596c3-1jammy [50.7 MB] 2024-05-14T01:19:56.383 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librbd1. 2024-05-14T01:19:56.410 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../011-librbd1_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:19:56.441 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librbd1 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:19:56.844 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libcephfs2. 2024-05-14T01:19:56.871 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:19:56.911 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libcephfs2 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:19:57.188 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rados. 2024-05-14T01:19:57.204 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:19:57.246 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rados (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:19:57.566 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-14T01:19:57.594 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:19:57.632 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-ceph-argparse (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:19:57.860 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cephfs. 2024-05-14T01:19:57.876 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:19:57.926 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cephfs (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:19:58.213 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-14T01:19:58.240 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:19:58.297 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-ceph-common (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:19:58.632 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-prettytable. 2024-05-14T01:19:58.659 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-14T01:19:58.698 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-14T01:19:58.959 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rbd. 2024-05-14T01:19:58.975 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:19:59.018 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rbd (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:19:59.412 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-14T01:19:59.439 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-14T01:19:59.479 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-14T01:19:59.740 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-14T01:19:59.755 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-14T01:19:59.789 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-14T01:20:00.084 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-14T01:20:00.102 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-14T01:20:00.143 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-14T01:20:00.471 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package lua5.1. 2024-05-14T01:20:00.498 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-14T01:20:00.537 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-14T01:20:00.857 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package lua-any. 2024-05-14T01:20:00.872 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-14T01:20:00.915 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-14T01:20:01.201 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package zip. 2024-05-14T01:20:01.228 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-14T01:20:01.268 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking zip (3.0-12build2) ... 2024-05-14T01:20:01.587 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package unzip. 2024-05-14T01:20:01.614 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-14T01:20:01.654 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-14T01:20:02.033 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package luarocks. 2024-05-14T01:20:02.059 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-14T01:20:02.099 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-14T01:20:02.490 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librgw2. 2024-05-14T01:20:02.517 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../027-librgw2_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:02.557 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librgw2 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:03.076 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rgw. 2024-05-14T01:20:03.091 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:03.151 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rgw (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:03.479 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-14T01:20:03.506 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-14T01:20:03.545 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-14T01:20:03.667 INFO:teuthology.orchestra.run.smithi154.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2569-g2ba596c3-1jammy [121 kB] 2024-05-14T01:20:03.669 INFO:teuthology.orchestra.run.smithi154.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2569-g2ba596c3-1jammy [229 kB] 2024-05-14T01:20:03.674 INFO:teuthology.orchestra.run.smithi154.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2569-g2ba596c3-1jammy [33.9 kB] 2024-05-14T01:20:03.675 INFO:teuthology.orchestra.run.smithi154.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2569-g2ba596c3-1jammy [23.4 kB] 2024-05-14T01:20:03.676 INFO:teuthology.orchestra.run.smithi154.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2569-g2ba596c3-1jammy [38.9 kB] 2024-05-14T01:20:03.677 INFO:teuthology.orchestra.run.smithi154.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2569-g2ba596c3-1jammy [13.4 MB] 2024-05-14T01:20:03.856 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libradosstriper1. 2024-05-14T01:20:03.883 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:03.923 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libradosstriper1 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:04.293 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-common. 2024-05-14T01:20:04.320 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:04.360 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-common (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:05.041 INFO:teuthology.orchestra.run.smithi154.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-04-29-0642/2ba596c3826798bb3a2f22bc9b02848b92dbe579/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2569-g2ba596c3-1jammy [91.4 kB] 2024-05-14T01:20:05.661 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 180 MB in 27s (6,566 kB/s) 2024-05-14T01:20:05.706 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-base. 2024-05-14T01:20:05.733 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:05.782 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-base (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:05.790 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-14T01:20:05.847 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-14T01:20:05.852 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-14T01:20:05.889 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-14T01:20:06.176 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-14T01:20:06.202 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-14T01:20:06.243 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-14T01:20:06.504 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cmd2. 2024-05-14T01:20:06.530 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-14T01:20:06.552 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-14T01:20:06.562 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-14T01:20:06.579 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-14T01:20:06.619 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-14T01:20:06.882 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-14T01:20:06.908 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-14T01:20:06.922 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cheroot. 2024-05-14T01:20:06.949 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-14T01:20:06.990 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-14T01:20:07.005 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-14T01:20:07.308 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-14T01:20:07.335 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-14T01:20:07.344 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-14T01:20:07.366 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-14T01:20:07.371 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-14T01:20:07.410 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-14T01:20:07.652 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-14T01:20:07.679 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-14T01:20:07.719 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-14T01:20:07.755 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-14T01:20:07.782 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-14T01:20:07.822 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-14T01:20:08.022 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-14T01:20:08.049 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-14T01:20:08.105 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-14T01:20:08.192 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-14T01:20:08.219 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-14T01:20:08.267 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-14T01:20:08.408 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-tempora. 2024-05-14T01:20:08.434 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-14T01:20:08.483 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-14T01:20:08.695 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-14T01:20:08.722 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-14T01:20:08.735 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-portend. 2024-05-14T01:20:08.762 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-14T01:20:08.763 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-14T01:20:08.802 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-14T01:20:09.105 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-14T01:20:09.107 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-14T01:20:09.132 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-14T01:20:09.133 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-14T01:20:09.171 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-14T01:20:09.173 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-14T01:20:09.474 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-14T01:20:09.501 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-14T01:20:09.510 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-14T01:20:09.537 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-14T01:20:09.549 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-14T01:20:09.577 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-14T01:20:09.861 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-natsort. 2024-05-14T01:20:09.877 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-14T01:20:09.896 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librados2. 2024-05-14T01:20:09.911 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-14T01:20:09.923 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../010-librados2_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:09.963 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librados2 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:10.189 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-logutils. 2024-05-14T01:20:10.216 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-14T01:20:10.255 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-14T01:20:10.858 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librbd1. 2024-05-14T01:20:10.885 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../011-librbd1_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:11.317 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-14T01:20:11.344 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-14T01:20:11.374 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librbd1 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:11.384 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-14T01:20:11.687 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-mako. 2024-05-14T01:20:11.714 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-14T01:20:11.753 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-14T01:20:11.819 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs2. 2024-05-14T01:20:11.846 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:11.877 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs2 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:12.056 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-14T01:20:12.083 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-14T01:20:12.114 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-14T01:20:12.146 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rados. 2024-05-14T01:20:12.169 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:12.213 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rados (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:12.401 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-14T01:20:12.428 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-14T01:20:12.467 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-14T01:20:12.566 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-14T01:20:12.592 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:20:12.632 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-argparse (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:12.770 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-webob. 2024-05-14T01:20:12.797 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-14T01:20:12.836 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-14T01:20:12.885 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cephfs. 2024-05-14T01:20:12.911 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:12.952 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cephfs (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:13.181 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-waitress. 2024-05-14T01:20:13.208 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-14T01:20:13.221 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-14T01:20:13.237 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:20:13.251 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-14T01:20:13.271 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-common (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:13.528 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-tempita. 2024-05-14T01:20:13.555 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-14T01:20:13.558 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-prettytable. 2024-05-14T01:20:13.585 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-14T01:20:13.586 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-14T01:20:13.624 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-14T01:20:13.894 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rbd. 2024-05-14T01:20:13.897 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-paste. 2024-05-14T01:20:13.909 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:13.924 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-14T01:20:13.952 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rbd (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:13.963 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-14T01:20:14.275 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-14T01:20:14.302 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-14T01:20:14.305 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-14T01:20:14.331 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-14T01:20:14.333 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-14T01:20:14.371 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-14T01:20:14.619 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-14T01:20:14.632 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-14T01:20:14.646 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-14T01:20:14.650 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-14T01:20:14.682 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-14T01:20:14.694 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-14T01:20:14.969 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-14T01:20:14.985 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-14T01:20:14.997 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-webtest. 2024-05-14T01:20:15.024 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-14T01:20:15.027 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-14T01:20:15.064 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-14T01:20:15.356 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua5.1. 2024-05-14T01:20:15.375 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pecan. 2024-05-14T01:20:15.382 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-14T01:20:15.402 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-14T01:20:15.422 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-14T01:20:15.441 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-14T01:20:15.725 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-any. 2024-05-14T01:20:15.752 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-14T01:20:15.804 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-certifi. 2024-05-14T01:20:15.832 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-14T01:20:15.870 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-14T01:20:15.947 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-14T01:20:16.157 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-idna. 2024-05-14T01:20:16.178 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package zip. 2024-05-14T01:20:16.184 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-05-14T01:20:16.193 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-14T01:20:16.215 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-14T01:20:16.236 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking zip (3.0-12build2) ... 2024-05-14T01:20:16.518 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-urllib3. 2024-05-14T01:20:16.545 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-14T01:20:16.581 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package unzip. 2024-05-14T01:20:16.584 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-14T01:20:16.608 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-14T01:20:16.648 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-14T01:20:17.044 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package luarocks. 2024-05-14T01:20:17.070 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-14T01:20:17.080 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-requests. 2024-05-14T01:20:17.107 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-14T01:20:17.110 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-14T01:20:17.146 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-14T01:20:17.457 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-14T01:20:17.484 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-14T01:20:17.518 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librgw2. 2024-05-14T01:20:17.523 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-14T01:20:17.545 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../027-librgw2_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:17.585 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librgw2 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:17.809 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-14T01:20:17.825 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:20:17.868 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:18.154 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rgw. 2024-05-14T01:20:18.169 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:18.220 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rgw (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:18.248 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-14T01:20:18.275 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:18.314 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:18.632 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-14T01:20:18.633 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-14T01:20:18.659 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-14T01:20:18.661 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-14T01:20:18.700 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-14T01:20:18.706 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-14T01:20:18.986 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-openssl. 2024-05-14T01:20:19.014 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-14T01:20:19.018 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libradosstriper1. 2024-05-14T01:20:19.044 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-14T01:20:19.045 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:19.084 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libradosstriper1 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:19.358 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr. 2024-05-14T01:20:19.383 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:19.422 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:19.513 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-common. 2024-05-14T01:20:19.539 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:19.588 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-common (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:19.825 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mon. 2024-05-14T01:20:19.853 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:19.892 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mon (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:20.496 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-osd. 2024-05-14T01:20:20.523 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:20.562 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-osd (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:21.252 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-base. 2024-05-14T01:20:21.279 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:21.336 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-base (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:21.590 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph. 2024-05-14T01:20:21.606 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../068-ceph_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:21.648 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:21.881 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-14T01:20:21.897 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-14T01:20:21.931 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-14T01:20:21.950 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-fuse. 2024-05-14T01:20:21.978 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:22.017 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-fuse (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:22.234 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cheroot. 2024-05-14T01:20:22.261 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-14T01:20:22.300 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-14T01:20:22.529 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mds. 2024-05-14T01:20:22.556 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:22.595 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mds (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:22.637 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-14T01:20:22.664 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-14T01:20:22.704 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-14T01:20:22.956 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephadm. 2024-05-14T01:20:22.972 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../071-cephadm_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:23.006 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephadm (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:23.007 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-14T01:20:23.033 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-14T01:20:23.073 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-14T01:20:23.292 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-14T01:20:23.319 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-14T01:20:23.326 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-14T01:20:23.352 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-14T01:20:23.358 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-14T01:20:23.384 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-14T01:20:23.661 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-14T01:20:23.688 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-14T01:20:23.695 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempora. 2024-05-14T01:20:23.722 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-14T01:20:23.736 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-14T01:20:23.762 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-14T01:20:24.099 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-portend. 2024-05-14T01:20:24.125 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-14T01:20:24.165 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-14T01:20:24.451 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-14T01:20:24.478 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-14T01:20:24.509 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-14T01:20:24.658 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-babel. 2024-05-14T01:20:24.685 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-14T01:20:24.715 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-14T01:20:24.796 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-14T01:20:24.823 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-14T01:20:24.862 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-14T01:20:25.002 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jinja2. 2024-05-14T01:20:25.029 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-14T01:20:25.068 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-14T01:20:25.208 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-natsort. 2024-05-14T01:20:25.235 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-14T01:20:25.274 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-14T01:20:25.422 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-14T01:20:25.449 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:20:25.488 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:25.561 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-logutils. 2024-05-14T01:20:25.588 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-14T01:20:25.627 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-14T01:20:25.833 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-14T01:20:25.860 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-14T01:20:25.899 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-14T01:20:25.931 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-14T01:20:25.957 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-14T01:20:25.997 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-14T01:20:26.252 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-routes. 2024-05-14T01:20:26.279 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-14T01:20:26.308 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-mako. 2024-05-14T01:20:26.327 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-14T01:20:26.335 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-14T01:20:26.391 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-14T01:20:26.695 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-14T01:20:26.697 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-14T01:20:26.711 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-14T01:20:26.724 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:20:26.745 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-14T01:20:26.771 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:27.023 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-14T01:20:27.049 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-14T01:20:27.089 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-14T01:20:27.359 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webob. 2024-05-14T01:20:27.385 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-14T01:20:27.425 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-14T01:20:27.745 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-waitress. 2024-05-14T01:20:27.772 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-14T01:20:27.840 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-14T01:20:28.002 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-14T01:20:28.029 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-14T01:20:28.068 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-14T01:20:28.148 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempita. 2024-05-14T01:20:28.175 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-14T01:20:28.215 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-14T01:20:28.476 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-paste. 2024-05-14T01:20:28.503 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-14T01:20:28.534 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-14T01:20:28.538 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-joblib. 2024-05-14T01:20:28.554 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-14T01:20:28.588 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-14T01:20:28.838 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-14T01:20:28.853 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-14T01:20:28.896 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-14T01:20:28.950 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-14T01:20:28.977 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-14T01:20:29.102 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-14T01:20:29.157 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-14T01:20:29.172 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-14T01:20:29.207 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-14T01:20:29.371 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-sklearn. 2024-05-14T01:20:29.402 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-14T01:20:29.429 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-14T01:20:29.468 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webtest. 2024-05-14T01:20:29.495 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-14T01:20:29.535 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-14T01:20:29.855 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pecan. 2024-05-14T01:20:29.881 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-14T01:20:29.921 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-14T01:20:30.189 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-14T01:20:30.219 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:20:30.255 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:30.276 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-certifi. 2024-05-14T01:20:30.303 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-14T01:20:30.342 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-14T01:20:30.671 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-idna. 2024-05-14T01:20:30.697 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-05-14T01:20:30.737 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-14T01:20:31.015 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-urllib3. 2024-05-14T01:20:31.042 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-14T01:20:31.073 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-14T01:20:31.200 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cachetools. 2024-05-14T01:20:31.227 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-14T01:20:31.266 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-14T01:20:31.544 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-14T01:20:31.551 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests. 2024-05-14T01:20:31.560 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-14T01:20:31.575 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-14T01:20:31.593 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-14T01:20:31.609 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-14T01:20:32.081 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-14T01:20:32.096 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-14T01:20:32.108 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-14T01:20:32.123 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-14T01:20:32.147 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-14T01:20:32.163 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-14T01:20:32.424 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-14T01:20:32.451 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:20:32.458 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rsa. 2024-05-14T01:20:32.482 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:32.485 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-14T01:20:32.524 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-14T01:20:32.863 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-14T01:20:32.889 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:32.929 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:33.028 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-google-auth. 2024-05-14T01:20:33.056 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-14T01:20:33.086 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-14T01:20:33.240 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-14T01:20:33.267 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-14T01:20:33.307 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-14T01:20:33.365 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-14T01:20:33.392 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-14T01:20:33.431 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-14T01:20:33.593 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-openssl. 2024-05-14T01:20:33.620 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-14T01:20:33.659 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-14T01:20:33.742 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-websocket. 2024-05-14T01:20:33.770 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-14T01:20:33.809 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-14T01:20:33.971 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr. 2024-05-14T01:20:33.998 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:34.037 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:34.162 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-14T01:20:34.190 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-14T01:20:34.229 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-14T01:20:34.449 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mon. 2024-05-14T01:20:34.476 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:34.519 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mon (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:34.892 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-14T01:20:34.920 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:20:34.959 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:35.144 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-osd. 2024-05-14T01:20:35.170 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:35.210 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-osd (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:35.295 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-14T01:20:35.322 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-14T01:20:35.361 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-14T01:20:35.698 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-14T01:20:35.725 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-14T01:20:35.764 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-14T01:20:36.017 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package jq. 2024-05-14T01:20:36.044 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-14T01:20:36.083 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-14T01:20:36.264 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph. 2024-05-14T01:20:36.279 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../068-ceph_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:36.322 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:36.336 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package socat. 2024-05-14T01:20:36.363 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-14T01:20:36.402 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-14T01:20:36.667 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-fuse. 2024-05-14T01:20:36.693 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:36.714 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package xmlstarlet. 2024-05-14T01:20:36.730 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-14T01:20:36.733 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-fuse (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:36.772 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-14T01:20:37.136 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mds. 2024-05-14T01:20:37.143 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-test. 2024-05-14T01:20:37.163 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:37.170 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:37.203 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mds (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:37.209 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-test (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:37.564 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephadm. 2024-05-14T01:20:37.580 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../071-cephadm_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:37.622 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephadm (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:37.951 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-14T01:20:37.977 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-14T01:20:38.017 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-14T01:20:38.345 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-14T01:20:38.371 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-14T01:20:38.411 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-14T01:20:39.356 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-volume. 2024-05-14T01:20:39.384 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:20:39.422 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-volume (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:39.483 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-babel. 2024-05-14T01:20:39.511 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-14T01:20:39.550 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-14T01:20:39.793 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-14T01:20:39.821 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:39.858 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephfs-mirror (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:39.886 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jinja2. 2024-05-14T01:20:39.913 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-14T01:20:39.953 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-14T01:20:40.170 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-colorama. 2024-05-14T01:20:40.198 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-14T01:20:40.236 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-14T01:20:40.323 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-14T01:20:40.350 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:20:40.390 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:40.472 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephfs-shell. 2024-05-14T01:20:40.489 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:20:40.522 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephfs-shell (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:40.726 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-14T01:20:40.753 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-14T01:20:40.758 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephfs-top. 2024-05-14T01:20:40.786 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:20:40.792 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-14T01:20:40.824 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephfs-top (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:41.077 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-14T01:20:41.093 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:41.095 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-routes. 2024-05-14T01:20:41.122 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-14T01:20:41.135 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libcephfs-dev (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:41.170 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-14T01:20:41.463 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-14T01:20:41.490 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-14T01:20:41.491 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-14T01:20:41.517 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:20:41.554 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-14T01:20:41.556 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:41.867 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-14T01:20:41.895 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-14T01:20:41.933 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-14T01:20:42.287 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package nvme-cli. 2024-05-14T01:20:42.316 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-14T01:20:42.353 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-14T01:20:42.792 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package pkg-config. 2024-05-14T01:20:42.821 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-14T01:20:42.858 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-14T01:20:42.970 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-14T01:20:42.986 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-14T01:20:43.028 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-14T01:20:43.119 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-14T01:20:43.136 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-14T01:20:43.178 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-14T01:20:43.542 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-joblib. 2024-05-14T01:20:43.569 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-14T01:20:43.598 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-14T01:20:43.608 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-14T01:20:43.626 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-14T01:20:43.664 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-14T01:20:43.967 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pastescript. 2024-05-14T01:20:43.987 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-14T01:20:43.995 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-14T01:20:44.014 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-14T01:20:44.033 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-14T01:20:44.139 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-14T01:20:44.336 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pluggy. 2024-05-14T01:20:44.365 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-14T01:20:44.403 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-14T01:20:44.459 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn. 2024-05-14T01:20:44.486 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-14T01:20:44.525 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-14T01:20:44.681 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-psutil. 2024-05-14T01:20:44.709 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-14T01:20:44.747 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-14T01:20:45.109 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-py. 2024-05-14T01:20:45.137 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-14T01:20:45.183 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-14T01:20:45.235 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-14T01:20:45.263 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:20:45.301 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:45.503 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pygments. 2024-05-14T01:20:45.532 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-14T01:20:45.570 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-14T01:20:46.016 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-14T01:20:46.044 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-14T01:20:46.082 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-14T01:20:46.288 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cachetools. 2024-05-14T01:20:46.315 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-14T01:20:46.354 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-14T01:20:46.376 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-toml. 2024-05-14T01:20:46.405 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-14T01:20:46.442 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-14T01:20:46.624 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-14T01:20:46.651 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-14T01:20:46.690 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-14T01:20:46.745 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pytest. 2024-05-14T01:20:46.774 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-14T01:20:46.812 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-14T01:20:47.019 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-14T01:20:47.046 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-14T01:20:47.085 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-14T01:20:47.165 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-simplejson. 2024-05-14T01:20:47.194 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-14T01:20:47.232 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-14T01:20:47.422 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rsa. 2024-05-14T01:20:47.449 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-14T01:20:47.484 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-14T01:20:47.488 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-14T01:20:47.501 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-14T01:20:47.542 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-14T01:20:47.801 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-google-auth. 2024-05-14T01:20:47.828 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-14T01:20:47.867 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-14T01:20:48.187 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-14T01:20:48.214 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-14T01:20:48.253 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-14T01:20:48.530 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package radosgw. 2024-05-14T01:20:48.531 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-websocket. 2024-05-14T01:20:48.558 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../122-radosgw_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:48.559 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-14T01:20:48.598 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-14T01:20:48.604 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking radosgw (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:48.926 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-14T01:20:48.954 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-14T01:20:48.993 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-14T01:20:49.350 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package rbd-fuse. 2024-05-14T01:20:49.365 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:49.399 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking rbd-fuse (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:49.674 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-14T01:20:49.702 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:20:49.712 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-14T01:20:49.740 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:49.979 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-14T01:20:50.060 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-14T01:20:50.087 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-14T01:20:50.113 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-14T01:20:50.126 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-14T01:20:50.372 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-14T01:20:50.404 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-14T01:20:50.420 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-14T01:20:50.454 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-14T01:20:50.708 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-14T01:20:50.723 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package jq. 2024-05-14T01:20:50.751 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-14T01:20:50.790 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-14T01:20:51.042 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package socat. 2024-05-14T01:20:51.058 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-14T01:20:51.111 INFO:teuthology.orchestra.run.smithi176.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-14T01:20:51.124 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-14T01:20:51.173 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephadm (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:51.479 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package xmlstarlet. 2024-05-14T01:20:51.507 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-14T01:20:51.545 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-14T01:20:51.689 INFO:teuthology.orchestra.run.smithi176.stdout:Adding system user cephadm....done 2024-05-14T01:20:51.871 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-14T01:20:52.125 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-test. 2024-05-14T01:20:52.147 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-14T01:20:52.153 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:52.191 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-test (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:52.390 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-14T01:20:52.491 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-14T01:20:52.717 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-14T01:20:52.968 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-14T01:20:53.119 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-14T01:20:53.421 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-14T01:20:53.790 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-14T01:20:54.057 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-14T01:20:54.284 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-14T01:20:54.543 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-14T01:20:54.554 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-volume. 2024-05-14T01:20:54.582 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:20:54.637 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-volume (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:54.811 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-14T01:20:55.062 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-14T01:20:55.092 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-14T01:20:55.120 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:55.166 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephfs-mirror (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:55.332 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-14T01:20:55.553 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-colorama. 2024-05-14T01:20:55.558 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-ceph-argparse (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:55.581 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-14T01:20:55.628 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-14T01:20:55.909 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-14T01:20:55.922 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephfs-shell. 2024-05-14T01:20:55.938 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:20:55.980 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephfs-shell (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:56.035 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-14T01:20:56.161 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-14T01:20:56.224 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephfs-top. 2024-05-14T01:20:56.240 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2569-g2ba596c3-1jammy_all.deb ... 2024-05-14T01:20:56.283 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephfs-top (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:56.429 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-14T01:20:56.536 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-14T01:20:56.554 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-14T01:20:56.563 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:20:56.602 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs-dev (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:20:56.814 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-14T01:20:56.872 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-14T01:20:56.899 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-14T01:20:56.929 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-14T01:20:57.237 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-14T01:20:57.267 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-14T01:20:57.270 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-14T01:20:57.295 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-14T01:20:57.334 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-14T01:20:57.334 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-14T01:20:57.476 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-14T01:20:57.747 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package nvme-cli. 2024-05-14T01:20:57.774 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-14T01:20:57.813 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-14T01:20:57.844 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-14T01:20:57.970 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-14T01:20:58.218 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package pkg-config. 2024-05-14T01:20:58.238 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-14T01:20:58.246 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-14T01:20:58.284 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-14T01:20:58.505 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-14T01:20:58.538 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-14T01:20:58.565 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-14T01:20:58.604 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-14T01:20:58.798 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up zip (3.0-12build2) ... 2024-05-14T01:20:58.899 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-14T01:20:59.050 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-14T01:20:59.076 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-14T01:20:59.124 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-14T01:20:59.377 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastescript. 2024-05-14T01:20:59.404 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-14T01:20:59.443 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-14T01:20:59.560 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-14T01:20:59.755 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pluggy. 2024-05-14T01:20:59.782 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-14T01:20:59.819 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-14T01:20:59.821 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-14T01:20:59.945 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-14T01:21:00.071 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-14T01:21:00.141 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-psutil. 2024-05-14T01:21:00.169 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-14T01:21:00.207 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-14T01:21:00.372 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-14T01:21:00.536 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-py. 2024-05-14T01:21:00.563 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-14T01:21:00.602 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-14T01:21:00.773 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-14T01:21:00.922 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pygments. 2024-05-14T01:21:00.950 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-14T01:21:00.988 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-14T01:21:01.024 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-14T01:21:01.384 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-14T01:21:01.443 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-14T01:21:01.470 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-14T01:21:01.521 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-14T01:21:01.685 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-14T01:21:01.761 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-toml. 2024-05-14T01:21:01.778 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-14T01:21:01.837 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-14T01:21:01.986 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-14T01:21:02.140 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pytest. 2024-05-14T01:21:02.167 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-14T01:21:02.206 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-14T01:21:02.321 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-14T01:21:02.572 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-14T01:21:02.697 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-ceph-common (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:02.768 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplejson. 2024-05-14T01:21:02.796 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-14T01:21:02.826 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-14T01:21:03.032 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-idna (3.3-1) ... 2024-05-14T01:21:03.070 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-14T01:21:03.098 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-14T01:21:03.137 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-14T01:21:03.333 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-14T01:21:03.883 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package radosgw. 2024-05-14T01:21:03.910 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../122-radosgw_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:21:03.957 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking radosgw (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:04.539 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-14T01:21:04.752 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package rbd-fuse. 2024-05-14T01:21:04.769 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2569-g2ba596c3-1jammy_amd64.deb ... 2024-05-14T01:21:04.802 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking rbd-fuse (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:04.824 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-14T01:21:04.933 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-14T01:21:05.091 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-14T01:21:05.176 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-14T01:21:05.302 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-14T01:21:05.349 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-14T01:21:05.428 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-14T01:21:05.475 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-14T01:21:05.719 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-14T01:21:05.729 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-14T01:21:05.988 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-14T01:21:06.062 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-14T01:21:06.239 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-14T01:21:06.340 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-14T01:21:06.488 INFO:teuthology.orchestra.run.smithi154.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-14T01:21:06.552 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephadm (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:06.625 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-14T01:21:06.859 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-14T01:21:07.043 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user cephadm....done 2024-05-14T01:21:07.119 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-14T01:21:07.200 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-14T01:21:07.370 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-14T01:21:07.476 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-14T01:21:07.621 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-14T01:21:07.727 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-14T01:21:07.870 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-14T01:21:07.888 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-14T01:21:08.014 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-14T01:21:08.121 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-14T01:21:08.282 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-14T01:21:08.383 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-14T01:21:08.389 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-14T01:21:08.515 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-14T01:21:08.693 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-14T01:21:08.825 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-14T01:21:09.169 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-14T01:21:09.202 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-14T01:21:09.412 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-14T01:21:09.461 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-14T01:21:09.587 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-14T01:21:09.671 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-14T01:21:09.713 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-14T01:21:09.802 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-14T01:21:09.939 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-14T01:21:10.040 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-14T01:21:10.166 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-14T01:21:10.183 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-14T01:21:10.442 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-14T01:21:10.526 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-14T01:21:10.701 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-14T01:21:10.785 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-14T01:21:10.911 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-14T01:21:10.952 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-argparse (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:11.179 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-14T01:21:11.203 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-14T01:21:11.313 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-14T01:21:11.330 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-14T01:21:11.456 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-14T01:21:11.647 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-14T01:21:11.723 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-14T01:21:11.850 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-14T01:21:11.965 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-14T01:21:12.126 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-14T01:21:12.262 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-14T01:21:12.469 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-14T01:21:12.506 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-14T01:21:12.532 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-14T01:21:12.595 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-14T01:21:12.722 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-14T01:21:12.762 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-14T01:21:13.047 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-14T01:21:13.089 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-14T01:21:13.224 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-14T01:21:13.339 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-14T01:21:13.500 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-14T01:21:13.716 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-14T01:21:13.760 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-14T01:21:13.993 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-14T01:21:14.044 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up zip (3.0-12build2) ... 2024-05-14T01:21:14.195 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-14T01:21:14.320 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-14T01:21:14.446 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librados2 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:14.572 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:14.698 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-14T01:21:14.847 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-14T01:21:14.967 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libcephfs2 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:15.077 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libradosstriper1 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:15.115 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-14T01:21:15.203 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-14T01:21:15.249 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-14T01:21:15.375 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-14T01:21:15.479 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librbd1 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:15.605 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-modules-core (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:15.668 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-14T01:21:15.731 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-fuse (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:15.924 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-14T01:21:15.925 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-14T01:21:16.044 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-14T01:21:16.279 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-14T01:21:16.391 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libcephfs-dev (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:16.492 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rados (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:16.593 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librgw2 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:16.664 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-14T01:21:16.710 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephfs-top (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:16.836 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-14T01:21:16.965 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-14T01:21:17.266 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-14T01:21:17.617 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-14T01:21:17.860 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-14T01:21:18.022 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-common (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:18.048 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rbd (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:18.174 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up rbd-fuse (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:18.275 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rgw (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:18.313 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-idna (3.3-1) ... 2024-05-14T01:21:18.384 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cephfs (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:18.510 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephfs-shell (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:18.630 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-14T01:21:18.636 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-common (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:19.162 INFO:teuthology.orchestra.run.smithi176.stdout:Adding group ceph....done 2024-05-14T01:21:19.522 INFO:teuthology.orchestra.run.smithi176.stdout:Adding system user ceph....done 2024-05-14T01:21:19.674 INFO:teuthology.orchestra.run.smithi176.stdout:Setting system user ceph properties....done 2024-05-14T01:21:19.691 INFO:teuthology.orchestra.run.smithi176.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-14T01:21:19.803 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-14T01:21:19.824 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-14T01:21:20.030 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-14T01:21:20.119 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-14T01:21:20.164 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-14T01:21:20.432 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-14T01:21:20.566 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-14T01:21:20.570 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephfs-mirror (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:20.684 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-14T01:21:20.776 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-14T01:21:20.776 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-14T01:21:20.969 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-14T01:21:21.220 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-14T01:21:21.263 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-test (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:21.389 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up radosgw (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:21.462 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-14T01:21:21.588 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-14T01:21:21.868 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-14T01:21:21.868 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-14T01:21:21.882 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-14T01:21:22.133 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-14T01:21:22.358 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-base (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:22.392 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-14T01:21:22.643 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-14T01:21:22.689 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-14T01:21:22.894 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-14T01:21:23.219 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mds (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:23.422 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-14T01:21:23.444 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-14T01:21:23.444 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-14T01:21:23.546 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-14T01:21:23.831 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-14T01:21:23.913 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:23.940 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-14T01:21:24.173 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-14T01:21:24.173 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-14T01:21:24.216 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-14T01:21:24.518 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-14T01:21:24.714 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-osd (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:24.777 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-14T01:21:24.886 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-14T01:21:24.987 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-14T01:21:25.064 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-14T01:21:25.064 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-14T01:21:25.068 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-14T01:21:25.322 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-14T01:21:25.440 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-14T01:21:25.510 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:25.636 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:25.787 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mon (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:25.808 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-14T01:21:25.998 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-14T01:21:25.998 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-14T01:21:26.068 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-14T01:21:26.194 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-14T01:21:26.445 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-14T01:21:26.455 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-cephadm (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:26.546 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-14T01:21:26.606 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:26.724 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-dashboard (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:26.867 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-volume (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:26.872 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-14T01:21:27.148 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-14T01:21:27.194 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-14T01:21:27.303 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-14T01:21:27.408 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-14T01:21:27.456 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-14T01:21:27.628 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-14T01:21:27.887 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-14T01:21:28.163 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-14T01:21:28.172 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-14T01:21:28.432 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-14T01:21:28.802 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-14T01:21:28.822 INFO:teuthology.orchestra.run.smithi176.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-14T01:21:28.825 DEBUG:teuthology.orchestra.run.smithi176:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-14T01:21:28.921 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-05-14T01:21:29.078 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-14T01:21:29.124 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2024-05-14T01:21:29.125 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2024-05-14T01:21:29.319 INFO:teuthology.orchestra.run.smithi176.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-14T01:21:29.319 INFO:teuthology.orchestra.run.smithi176.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-14T01:21:29.319 INFO:teuthology.orchestra.run.smithi176.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-14T01:21:29.319 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages were automatically installed and are no longer required: 2024-05-14T01:21:29.320 INFO:teuthology.orchestra.run.smithi176.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-14T01:21:29.320 INFO:teuthology.orchestra.run.smithi176.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-14T01:21:29.320 INFO:teuthology.orchestra.run.smithi176.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-14T01:21:29.320 INFO:teuthology.orchestra.run.smithi176.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-14T01:21:29.320 INFO:teuthology.orchestra.run.smithi176.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-14T01:21:29.320 INFO:teuthology.orchestra.run.smithi176.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-14T01:21:29.321 INFO:teuthology.orchestra.run.smithi176.stdout:The following additional packages will be installed: 2024-05-14T01:21:29.321 INFO:teuthology.orchestra.run.smithi176.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-14T01:21:29.321 INFO:teuthology.orchestra.run.smithi176.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-14T01:21:29.322 INFO:teuthology.orchestra.run.smithi176.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-14T01:21:29.322 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-14T01:21:29.322 INFO:teuthology.orchestra.run.smithi176.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-14T01:21:29.323 INFO:teuthology.orchestra.run.smithi176.stdout:Suggested packages: 2024-05-14T01:21:29.323 INFO:teuthology.orchestra.run.smithi176.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-14T01:21:29.323 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-14T01:21:29.323 INFO:teuthology.orchestra.run.smithi176.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-14T01:21:29.366 INFO:teuthology.orchestra.run.smithi176.stdout:The following NEW packages will be installed: 2024-05-14T01:21:29.367 INFO:teuthology.orchestra.run.smithi176.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-14T01:21:29.367 INFO:teuthology.orchestra.run.smithi176.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-14T01:21:29.367 INFO:teuthology.orchestra.run.smithi176.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-14T01:21:29.367 INFO:teuthology.orchestra.run.smithi176.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-14T01:21:29.367 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-14T01:21:29.368 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-14T01:21:29.368 INFO:teuthology.orchestra.run.smithi176.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-14T01:21:29.369 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages will be upgraded: 2024-05-14T01:21:29.370 INFO:teuthology.orchestra.run.smithi176.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-14T01:21:29.406 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-14T01:21:29.540 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librados2 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:29.551 INFO:teuthology.orchestra.run.smithi176.stdout:4 upgraded, 39 newly installed, 0 to remove and 303 not upgraded. 2024-05-14T01:21:29.551 INFO:teuthology.orchestra.run.smithi176.stdout:Need to get 55.7 MB of archives. 2024-05-14T01:21:29.551 INFO:teuthology.orchestra.run.smithi176.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-14T01:21:29.551 INFO:teuthology.orchestra.run.smithi176.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-14T01:21:29.650 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:29.776 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-14T01:21:30.112 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs2 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:30.188 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-14T01:21:30.204 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-14T01:21:30.238 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libradosstriper1 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:30.331 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-14T01:21:30.332 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-14T01:21:30.334 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-14T01:21:30.360 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-14T01:21:30.362 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-14T01:21:30.364 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-14T01:21:30.365 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-14T01:21:30.368 INFO:teuthology.orchestra.run.smithi176.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-14T01:21:30.368 INFO:teuthology.orchestra.run.smithi176.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-14T01:21:30.536 INFO:teuthology.orchestra.run.smithi176.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-14T01:21:30.632 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librbd1 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:30.758 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-modules-core (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:30.831 INFO:teuthology.orchestra.run.smithi176.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-14T01:21:30.839 INFO:teuthology.orchestra.run.smithi176.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-14T01:21:30.844 INFO:teuthology.orchestra.run.smithi176.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-14T01:21:30.884 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-fuse (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:30.931 INFO:teuthology.orchestra.run.smithi176.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-14T01:21:31.099 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-14T01:21:31.099 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-14T01:21:31.594 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs-dev (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:31.703 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rados (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:31.813 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librgw2 (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:31.939 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephfs-top (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:32.011 INFO:teuthology.orchestra.run.smithi176.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-14T01:21:32.016 INFO:teuthology.orchestra.run.smithi176.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-14T01:21:32.016 INFO:teuthology.orchestra.run.smithi176.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-14T01:21:32.023 INFO:teuthology.orchestra.run.smithi176.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-14T01:21:32.023 INFO:teuthology.orchestra.run.smithi176.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-14T01:21:32.034 INFO:teuthology.orchestra.run.smithi176.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-14T01:21:32.065 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-14T01:21:32.205 INFO:teuthology.orchestra.run.smithi176.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-14T01:21:32.866 INFO:teuthology.orchestra.run.smithi176.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-14T01:21:32.867 INFO:teuthology.orchestra.run.smithi176.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-14T01:21:33.059 INFO:teuthology.orchestra.run.smithi176.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-14T01:21:33.060 INFO:teuthology.orchestra.run.smithi176.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-14T01:21:33.105 INFO:teuthology.orchestra.run.smithi176.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-14T01:21:33.158 INFO:teuthology.orchestra.run.smithi176.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-14T01:21:33.166 INFO:teuthology.orchestra.run.smithi176.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-14T01:21:33.171 INFO:teuthology.orchestra.run.smithi176.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-14T01:21:33.173 INFO:teuthology.orchestra.run.smithi176.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-14T01:21:33.174 INFO:teuthology.orchestra.run.smithi176.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-14T01:21:33.319 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rbd (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:33.376 INFO:teuthology.orchestra.run.smithi176.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-14T01:21:33.470 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up rbd-fuse (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:33.571 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rgw (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:33.688 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cephfs (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:33.779 INFO:teuthology.orchestra.run.smithi176.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-14T01:21:33.814 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephfs-shell (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:33.940 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-common (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:34.492 INFO:teuthology.orchestra.run.smithi154.stdout:Adding group ceph....done 2024-05-14T01:21:34.570 INFO:teuthology.orchestra.run.smithi176.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-14T01:21:34.571 INFO:teuthology.orchestra.run.smithi176.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-14T01:21:34.571 INFO:teuthology.orchestra.run.smithi176.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-14T01:21:34.611 INFO:teuthology.orchestra.run.smithi176.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-14T01:21:34.611 INFO:teuthology.orchestra.run.smithi176.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-14T01:21:34.611 INFO:teuthology.orchestra.run.smithi176.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-14T01:21:34.642 INFO:teuthology.orchestra.run.smithi176.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-14T01:21:34.643 INFO:teuthology.orchestra.run.smithi176.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-14T01:21:34.868 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user ceph....done 2024-05-14T01:21:34.986 INFO:teuthology.orchestra.run.smithi154.stdout:Setting system user ceph properties....done 2024-05-14T01:21:35.003 INFO:teuthology.orchestra.run.smithi154.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-14T01:21:35.047 INFO:teuthology.orchestra.run.smithi176.stdout:Preconfiguring packages ... 2024-05-14T01:21:35.138 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-14T01:21:35.217 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 55.7 MB in 5s (10.6 MB/s) 2024-05-14T01:21:35.442 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-14T01:21:35.562 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173979 files and directories currently installed.) 2024-05-14T01:21:35.568 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-14T01:21:35.722 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-14T01:21:35.900 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephfs-mirror (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:36.109 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-14T01:21:36.109 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-14T01:21:36.342 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-14T01:21:36.618 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-test (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:36.744 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up radosgw (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:37.260 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-14T01:21:37.260 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-14T01:21:37.365 INFO:teuthology.orchestra.run.smithi176.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-14T01:21:37.635 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package flex. 2024-05-14T01:21:37.738 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173979 files and directories currently installed.) 2024-05-14T01:21:37.744 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-14T01:21:37.746 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-base (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:37.783 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-14T01:21:38.070 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-14T01:21:38.307 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-14T01:21:38.480 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-14T01:21:38.874 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-14T01:21:38.884 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mds (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:39.219 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-14T01:21:39.220 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-14T01:21:39.424 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174052 files and directories currently installed.) 2024-05-14T01:21:39.429 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-14T01:21:39.554 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-14T01:21:39.662 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:39.875 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-14T01:21:39.875 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-14T01:21:39.962 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-14T01:21:40.102 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-14T01:21:40.364 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-osd (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:40.455 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-14T01:21:40.620 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-14T01:21:40.620 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-14T01:21:40.820 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package bison. 2024-05-14T01:21:40.924 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174052 files and directories currently installed.) 2024-05-14T01:21:40.929 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-14T01:21:40.980 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-14T01:21:41.048 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:41.174 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:41.334 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mon (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:41.372 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-14T01:21:41.401 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-14T01:21:41.438 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-14T01:21:41.537 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-14T01:21:41.537 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-14T01:21:41.950 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package dump. 2024-05-14T01:21:41.979 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-14T01:21:42.017 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking dump (0.4b47-3) ... 2024-05-14T01:21:42.027 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-cephadm (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:42.153 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:42.279 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-dashboard (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:42.303 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package indent. 2024-05-14T01:21:42.320 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-14T01:21:42.362 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-14T01:21:42.430 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-volume (19.0.0-2569-g2ba596c3-1jammy) ... 2024-05-14T01:21:42.598 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-14T01:21:42.614 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-14T01:21:42.656 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-14T01:21:42.783 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-14T01:21:42.900 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-14T01:21:43.002 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-14T01:21:43.030 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-14T01:21:43.068 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-14T01:21:43.069 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-14T01:21:43.337 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-14T01:21:43.354 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-14T01:21:43.395 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-14T01:21:43.724 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-14T01:21:43.752 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-14T01:21:43.790 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-14T01:21:44.045 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-14T01:21:44.073 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-14T01:21:44.111 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-14T01:21:44.322 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libjson-perl. 2024-05-14T01:21:44.338 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-14T01:21:44.349 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-14T01:21:44.372 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-14T01:21:44.709 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-14T01:21:44.736 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-14T01:21:44.775 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-14T01:21:44.989 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-14T01:21:44.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-14T01:21:45.045 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-05-14T01:21:45.234 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-05-14T01:21:45.235 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-05-14T01:21:45.410 INFO:teuthology.orchestra.run.smithi154.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-14T01:21:45.410 INFO:teuthology.orchestra.run.smithi154.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-14T01:21:45.410 INFO:teuthology.orchestra.run.smithi154.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-14T01:21:45.410 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-05-14T01:21:45.410 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-14T01:21:45.410 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-14T01:21:45.411 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-14T01:21:45.411 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-14T01:21:45.411 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-14T01:21:45.411 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-14T01:21:45.412 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-05-14T01:21:45.412 INFO:teuthology.orchestra.run.smithi154.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-14T01:21:45.412 INFO:teuthology.orchestra.run.smithi154.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-14T01:21:45.412 INFO:teuthology.orchestra.run.smithi154.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-14T01:21:45.412 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-14T01:21:45.412 INFO:teuthology.orchestra.run.smithi154.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-14T01:21:45.413 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-05-14T01:21:45.413 INFO:teuthology.orchestra.run.smithi154.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-14T01:21:45.413 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-14T01:21:45.413 INFO:teuthology.orchestra.run.smithi154.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-14T01:21:45.452 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-05-14T01:21:45.453 INFO:teuthology.orchestra.run.smithi154.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-14T01:21:45.453 INFO:teuthology.orchestra.run.smithi154.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-14T01:21:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-14T01:21:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-14T01:21:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-14T01:21:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-14T01:21:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-14T01:21:45.455 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages will be upgraded: 2024-05-14T01:21:45.455 INFO:teuthology.orchestra.run.smithi154.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-14T01:21:45.522 INFO:teuthology.orchestra.run.smithi154.stdout:4 upgraded, 39 newly installed, 0 to remove and 303 not upgraded. 2024-05-14T01:21:45.522 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 55.7 MB of archives. 2024-05-14T01:21:45.522 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-14T01:21:45.523 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-14T01:21:45.765 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-14T01:21:45.774 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-14T01:21:45.838 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-14T01:21:45.839 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-14T01:21:45.840 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-14T01:21:45.854 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-14T01:21:45.856 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-14T01:21:45.858 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-14T01:21:45.860 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-14T01:21:45.861 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-14T01:21:45.863 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-14T01:21:45.870 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-14T01:21:45.894 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-14T01:21:45.895 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-14T01:21:45.895 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-14T01:21:46.453 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-14T01:21:46.481 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-14T01:21:46.520 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-14T01:21:46.589 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-14T01:21:46.594 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-14T01:21:46.594 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-14T01:21:46.601 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-14T01:21:46.602 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-14T01:21:46.613 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-14T01:21:46.616 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-14T01:21:46.634 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-14T01:21:46.634 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-14T01:21:46.669 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-14T01:21:46.670 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-14T01:21:46.682 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-14T01:21:46.726 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-14T01:21:46.732 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-14T01:21:46.733 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-14T01:21:46.735 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-14T01:21:46.735 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-14T01:21:46.763 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-14T01:21:46.764 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-14T01:21:46.767 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-14T01:21:46.780 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-14T01:21:46.847 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-14T01:21:47.150 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-14T01:21:47.178 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-14T01:21:47.216 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-14T01:21:47.221 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-14T01:21:47.221 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-14T01:21:47.221 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-14T01:21:47.221 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-14T01:21:47.221 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-14T01:21:47.222 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-14T01:21:47.238 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-14T01:21:47.238 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-14T01:21:47.570 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-14T01:21:47.598 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-14T01:21:47.636 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-14T01:21:47.646 INFO:teuthology.orchestra.run.smithi154.stdout:Preconfiguring packages ... 2024-05-14T01:21:47.801 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 55.7 MB in 2s (31.4 MB/s) 2024-05-14T01:21:47.939 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-14T01:21:47.967 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-14T01:21:47.997 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-14T01:21:48.120 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173979 files and directories currently installed.) 2024-05-14T01:21:48.126 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-14T01:21:48.273 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-14T01:21:48.317 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-14T01:21:48.345 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-14T01:21:48.383 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-14T01:21:48.736 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-14T01:21:48.764 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-14T01:21:48.803 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-14T01:21:48.910 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-14T01:21:49.105 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-14T01:21:49.122 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-14T01:21:49.163 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-14T01:21:49.382 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-14T01:21:49.398 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-14T01:21:49.432 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-14T01:21:49.903 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-14T01:21:49.931 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-14T01:21:49.945 INFO:teuthology.orchestra.run.smithi154.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-14T01:21:49.961 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-14T01:21:50.193 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package flex. 2024-05-14T01:21:50.256 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173979 files and directories currently installed.) 2024-05-14T01:21:50.262 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-14T01:21:50.308 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-14T01:21:50.314 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package modemmanager. 2024-05-14T01:21:50.342 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-14T01:21:50.380 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-14T01:21:50.817 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-14T01:21:51.045 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package network-manager. 2024-05-14T01:21:51.073 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-14T01:21:51.109 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-14T01:21:51.120 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-14T01:21:51.643 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-14T01:21:51.711 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ppp. 2024-05-14T01:21:51.738 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-14T01:21:52.017 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-14T01:21:52.212 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174052 files and directories currently installed.) 2024-05-14T01:21:52.218 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-14T01:21:52.348 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-14T01:21:52.349 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package pptp-linux. 2024-05-14T01:21:52.377 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-14T01:21:52.423 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-14T01:21:52.726 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-14T01:21:52.740 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-14T01:21:52.754 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-14T01:21:52.793 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-14T01:21:52.896 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-14T01:21:53.113 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-14T01:21:53.141 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-14T01:21:53.179 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-client-common (238) ... 2024-05-14T01:21:53.225 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-14T01:21:53.467 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-14T01:21:53.494 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-14T01:21:53.533 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-14T01:21:53.589 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package bison. 2024-05-14T01:21:53.692 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174052 files and directories currently installed.) 2024-05-14T01:21:53.698 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-14T01:21:53.750 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-14T01:21:54.134 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-14T01:21:54.161 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-14T01:21:54.162 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-common. 2024-05-14T01:21:54.191 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-14T01:21:54.200 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-14T01:21:54.248 INFO:teuthology.orchestra.run.smithi176.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-14T01:21:54.277 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-common (238) ... 2024-05-14T01:21:54.545 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package dump. 2024-05-14T01:21:54.573 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-14T01:21:54.612 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking dump (0.4b47-3) ... 2024-05-14T01:21:54.686 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-14. 2024-05-14T01:21:54.714 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-14T01:21:54.748 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-14T01:21:54.890 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package indent. 2024-05-14T01:21:54.918 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-14T01:21:54.957 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-14T01:21:55.252 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-14T01:21:55.269 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-14T01:21:55.310 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-14T01:21:55.614 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-14T01:21:55.642 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-14T01:21:55.673 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-14T01:21:55.908 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-14T01:21:55.936 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-14T01:21:55.964 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql. 2024-05-14T01:21:55.975 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-14T01:21:55.980 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-14T01:21:56.022 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql (14+238) ... 2024-05-14T01:21:56.257 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-client. 2024-05-14T01:21:56.273 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-14T01:21:56.307 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-client (14+238) ... 2024-05-14T01:21:56.337 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-14T01:21:56.364 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-14T01:21:56.403 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-14T01:21:56.509 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-14T01:21:56.525 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-14T01:21:56.559 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-14T01:21:56.673 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-14T01:21:56.700 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-14T01:21:56.739 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-14T01:21:56.895 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package tcl8.6. 2024-05-14T01:21:56.923 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-14T01:21:56.961 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-14T01:21:56.966 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjson-perl. 2024-05-14T01:21:56.983 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-14T01:21:57.025 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-14T01:21:57.272 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package tcl. 2024-05-14T01:21:57.300 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-14T01:21:57.344 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-14T01:21:57.345 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-14T01:21:57.373 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-14T01:21:57.420 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-14T01:21:57.650 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package wpasupplicant. 2024-05-14T01:21:57.678 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-14T01:21:57.716 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-14T01:21:58.079 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-14T01:21:58.093 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-14T01:21:58.137 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-14T01:21:58.524 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-14T01:21:58.552 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-14T01:21:58.598 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-14T01:21:58.886 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-client-common (238) ... 2024-05-14T01:21:59.063 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-14T01:21:59.081 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-14T01:21:59.109 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-14T01:21:59.148 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-14T01:21:59.180 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-14T01:21:59.306 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-14T01:21:59.417 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-14T01:21:59.432 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-14T01:21:59.445 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-14T01:21:59.484 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-14T01:21:59.558 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-14T01:21:59.684 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-14T01:21:59.820 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-14T01:21:59.848 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-14T01:21:59.887 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-14T01:22:00.144 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-14T01:22:00.181 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-14T01:22:00.197 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-14T01:22:00.231 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-14T01:22:00.231 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-14T01:22:00.593 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-14T01:22:00.607 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-14T01:22:00.607 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-14T01:22:00.620 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-14T01:22:00.659 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-14T01:22:01.021 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-14T01:22:01.049 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-14T01:22:01.087 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-14T01:22:01.101 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-14T01:22:01.227 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-14T01:22:01.344 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-14T01:22:01.399 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-14T01:22:01.426 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-14T01:22:01.454 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-14T01:22:01.457 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-14T01:22:01.555 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-14T01:22:01.759 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-14T01:22:01.775 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-14T01:22:01.818 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-14T01:22:02.006 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-14T01:22:02.070 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-14T01:22:02.086 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-14T01:22:02.129 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-14T01:22:02.224 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-14T01:22:02.350 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-14T01:22:02.624 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-14T01:22:02.652 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-14T01:22:02.690 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-14T01:22:02.955 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-14T01:22:03.010 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package modemmanager. 2024-05-14T01:22:03.038 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-14T01:22:03.072 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up dump (0.4b47-3) ... 2024-05-14T01:22:03.077 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-14T01:22:03.166 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-14T01:22:03.232 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-14T01:22:03.358 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-14T01:22:03.484 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-14T01:22:03.610 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-14T01:22:03.709 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package network-manager. 2024-05-14T01:22:03.736 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-14T01:22:03.737 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-14T01:22:03.784 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-14T01:22:03.826 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-14T01:22:03.896 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-14T01:22:03.997 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-14T01:22:04.164 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-14T01:22:04.291 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-14T01:22:04.417 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-14T01:22:04.442 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ppp. 2024-05-14T01:22:04.469 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-14T01:22:04.585 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-client (14+238) ... 2024-05-14T01:22:04.710 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-14T01:22:04.747 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-14T01:22:05.169 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:05.169 INFO:teuthology.orchestra.run.smithi176.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-14T01:22:05.169 INFO:teuthology.orchestra.run.smithi176.stdout:which means they are currently configured by ifupdown: 2024-05-14T01:22:05.169 INFO:teuthology.orchestra.run.smithi176.stdout:- enp3s0f1 2024-05-14T01:22:05.169 INFO:teuthology.orchestra.run.smithi176.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-14T01:22:05.169 INFO:teuthology.orchestra.run.smithi176.stdout:remove their configuration from /etc/network/interfaces. 2024-05-14T01:22:05.169 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:05.172 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package pptp-linux. 2024-05-14T01:22:05.200 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-14T01:22:05.247 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-14T01:22:05.287 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-14T01:22:05.550 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-14T01:22:05.577 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-14T01:22:05.577 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-14T01:22:05.696 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-14T01:22:05.885 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-14T01:22:06.198 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-14T01:22:06.225 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-14T01:22:06.324 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-client-common (238) ... 2024-05-14T01:22:06.363 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-14T01:22:06.506 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-14T01:22:06.632 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-14T01:22:06.758 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-common (238) ... 2024-05-14T01:22:06.905 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-14T01:22:06.933 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-14T01:22:07.000 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-14T01:22:07.805 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-common. 2024-05-14T01:22:07.834 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-14T01:22:07.890 INFO:teuthology.orchestra.run.smithi154.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-14T01:22:07.920 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-common (238) ... 2024-05-14T01:22:08.066 INFO:teuthology.orchestra.run.smithi176.stdout:Adding user postgres to group ssl-cert 2024-05-14T01:22:08.293 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:08.293 INFO:teuthology.orchestra.run.smithi176.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-14T01:22:08.404 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-14. 2024-05-14T01:22:08.432 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-14T01:22:08.474 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-14T01:22:08.484 INFO:teuthology.orchestra.run.smithi176.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-14T01:22:08.484 INFO:teuthology.orchestra.run.smithi176.stdout:Removing obsolete dictionary files: 2024-05-14T01:22:09.017 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-14T01:22:09.393 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-14T01:22:09.729 INFO:teuthology.orchestra.run.smithi176.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-14T01:22:09.750 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-14T01:22:09.787 INFO:teuthology.orchestra.run.smithi176.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-14T01:22:09.787 INFO:teuthology.orchestra.run.smithi176.stdout:This user must also own the server process. 2024-05-14T01:22:09.787 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:09.787 INFO:teuthology.orchestra.run.smithi176.stdout:The database cluster will be initialized with locale "en_US". 2024-05-14T01:22:09.787 INFO:teuthology.orchestra.run.smithi176.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-14T01:22:09.787 INFO:teuthology.orchestra.run.smithi176.stdout:The default text search configuration will be set to "english". 2024-05-14T01:22:09.787 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:09.787 INFO:teuthology.orchestra.run.smithi176.stdout:Data page checksums are disabled. 2024-05-14T01:22:09.787 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:09.788 INFO:teuthology.orchestra.run.smithi176.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-14T01:22:09.788 INFO:teuthology.orchestra.run.smithi176.stdout:creating subdirectories ... ok 2024-05-14T01:22:09.788 INFO:teuthology.orchestra.run.smithi176.stdout:selecting dynamic shared memory implementation ... posix 2024-05-14T01:22:09.801 INFO:teuthology.orchestra.run.smithi176.stdout:selecting default max_connections ... 100 2024-05-14T01:22:09.822 INFO:teuthology.orchestra.run.smithi176.stdout:selecting default shared_buffers ... 128MB 2024-05-14T01:22:09.832 INFO:teuthology.orchestra.run.smithi176.stdout:selecting default time zone ... Etc/UTC 2024-05-14T01:22:09.833 INFO:teuthology.orchestra.run.smithi176.stdout:creating configuration files ... ok 2024-05-14T01:22:09.946 INFO:teuthology.orchestra.run.smithi176.stdout:running bootstrap script ... ok 2024-05-14T01:22:10.224 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql. 2024-05-14T01:22:10.253 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-14T01:22:10.290 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql (14+238) ... 2024-05-14T01:22:10.492 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-client. 2024-05-14T01:22:10.509 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-14T01:22:10.551 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-client (14+238) ... 2024-05-14T01:22:10.572 INFO:teuthology.orchestra.run.smithi176.stdout:performing post-bootstrap initialization ... ok 2024-05-14T01:22:10.794 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-14T01:22:10.811 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-14T01:22:10.853 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-14T01:22:11.197 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package tcl8.6. 2024-05-14T01:22:11.226 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-14T01:22:11.264 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-14T01:22:11.486 INFO:teuthology.orchestra.run.smithi176.stdout:syncing data to disk ... ok 2024-05-14T01:22:11.533 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package tcl. 2024-05-14T01:22:11.550 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-14T01:22:11.597 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-14T01:22:11.862 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-14T01:22:11.920 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package wpasupplicant. 2024-05-14T01:22:11.948 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-14T01:22:11.986 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-14T01:22:12.359 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-14T01:22:12.387 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-14T01:22:12.426 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-14T01:22:12.862 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-14T01:22:12.890 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-14T01:22:12.937 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-14T01:22:13.234 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-client-common (238) ... 2024-05-14T01:22:13.443 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-14T01:22:13.545 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-14T01:22:13.662 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-14T01:22:13.788 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-14T01:22:13.914 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-14T01:22:14.041 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-14T01:22:14.523 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-14T01:22:14.613 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-14T01:22:14.632 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-14T01:22:14.758 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-14T01:22:14.884 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql (14+238) ... 2024-05-14T01:22:15.008 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-14T01:22:15.008 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-14T01:22:15.010 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-14T01:22:15.136 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-14T01:22:15.383 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-14T01:22:15.384 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-14T01:22:15.716 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-14T01:22:15.867 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-14T01:22:15.930 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-14T01:22:15.977 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-14T01:22:16.022 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-14T01:22:16.086 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-14T01:22:16.195 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-14T01:22:16.321 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-14T01:22:16.324 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-14T01:22:16.472 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-14T01:22:16.485 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-14T01:22:16.607 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-14T01:22:17.212 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-14T01:22:17.338 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up dump (0.4b47-3) ... 2024-05-14T01:22:17.440 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-14T01:22:17.515 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-14T01:22:17.658 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-14T01:22:17.784 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-14T01:22:17.846 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-14T01:22:17.910 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-14T01:22:17.937 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-14T01:22:18.019 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-14T01:22:18.101 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-14T01:22:18.162 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-14T01:22:18.288 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-14T01:22:18.399 INFO:teuthology.orchestra.run.smithi176.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-14T01:22:18.405 DEBUG:teuthology.parallel:result is None 2024-05-14T01:22:18.465 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-14T01:22:18.591 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-14T01:22:18.717 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-14T01:22:18.885 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-client (14+238) ... 2024-05-14T01:22:19.002 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-14T01:22:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:19.436 INFO:teuthology.orchestra.run.smithi154.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-14T01:22:19.436 INFO:teuthology.orchestra.run.smithi154.stdout:which means they are currently configured by ifupdown: 2024-05-14T01:22:19.436 INFO:teuthology.orchestra.run.smithi154.stdout:- enp3s0f1 2024-05-14T01:22:19.436 INFO:teuthology.orchestra.run.smithi154.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-14T01:22:19.436 INFO:teuthology.orchestra.run.smithi154.stdout:remove their configuration from /etc/network/interfaces. 2024-05-14T01:22:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:19.554 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-14T01:22:19.830 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-14T01:22:20.170 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-14T01:22:20.688 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-14T01:22:20.857 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-14T01:22:20.983 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-14T01:22:21.109 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-common (238) ... 2024-05-14T01:22:22.067 INFO:teuthology.orchestra.run.smithi154.stdout:Adding user postgres to group ssl-cert 2024-05-14T01:22:22.294 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:22.294 INFO:teuthology.orchestra.run.smithi154.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-14T01:22:22.458 INFO:teuthology.orchestra.run.smithi154.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-14T01:22:22.459 INFO:teuthology.orchestra.run.smithi154.stdout:Removing obsolete dictionary files: 2024-05-14T01:22:23.013 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-14T01:22:23.369 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-14T01:22:23.686 INFO:teuthology.orchestra.run.smithi154.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-14T01:22:23.705 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-14T01:22:23.745 INFO:teuthology.orchestra.run.smithi154.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-14T01:22:23.746 INFO:teuthology.orchestra.run.smithi154.stdout:This user must also own the server process. 2024-05-14T01:22:23.746 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:23.746 INFO:teuthology.orchestra.run.smithi154.stdout:The database cluster will be initialized with locale "en_US". 2024-05-14T01:22:23.746 INFO:teuthology.orchestra.run.smithi154.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-14T01:22:23.746 INFO:teuthology.orchestra.run.smithi154.stdout:The default text search configuration will be set to "english". 2024-05-14T01:22:23.746 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:23.746 INFO:teuthology.orchestra.run.smithi154.stdout:Data page checksums are disabled. 2024-05-14T01:22:23.746 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:23.747 INFO:teuthology.orchestra.run.smithi154.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-14T01:22:23.747 INFO:teuthology.orchestra.run.smithi154.stdout:creating subdirectories ... ok 2024-05-14T01:22:23.747 INFO:teuthology.orchestra.run.smithi154.stdout:selecting dynamic shared memory implementation ... posix 2024-05-14T01:22:23.758 INFO:teuthology.orchestra.run.smithi154.stdout:selecting default max_connections ... 100 2024-05-14T01:22:23.776 INFO:teuthology.orchestra.run.smithi154.stdout:selecting default shared_buffers ... 128MB 2024-05-14T01:22:23.786 INFO:teuthology.orchestra.run.smithi154.stdout:selecting default time zone ... Etc/UTC 2024-05-14T01:22:23.787 INFO:teuthology.orchestra.run.smithi154.stdout:creating configuration files ... ok 2024-05-14T01:22:23.897 INFO:teuthology.orchestra.run.smithi154.stdout:running bootstrap script ... ok 2024-05-14T01:22:24.551 INFO:teuthology.orchestra.run.smithi154.stdout:performing post-bootstrap initialization ... ok 2024-05-14T01:22:25.505 INFO:teuthology.orchestra.run.smithi154.stdout:syncing data to disk ... ok 2024-05-14T01:22:25.871 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-14T01:22:28.634 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-14T01:22:28.743 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-14T01:22:28.845 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql (14+238) ... 2024-05-14T01:22:28.970 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-14T01:22:29.096 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-14T01:22:29.358 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-14T01:22:29.358 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-14T01:22:29.933 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-14T01:22:30.033 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-14T01:22:30.344 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-14T01:22:30.496 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-14T01:22:31.691 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-14T01:22:31.798 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-14T01:22:32.309 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-14T01:22:32.314 DEBUG:teuthology.parallel:result is None 2024-05-14T01:22:32.314 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ba596c3826798bb3a2f22bc9b02848b92dbe579 2024-05-14T01:22:32.608 DEBUG:teuthology.orchestra.run.smithi154:> dpkg-query -W -f '${Version}' ceph 2024-05-14T01:22:32.627 INFO:teuthology.orchestra.run.smithi154.stdout:19.0.0-2569-g2ba596c3-1jammy 2024-05-14T01:22:32.628 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2569-g2ba596c3-1jammy 2024-05-14T01:22:32.628 INFO:teuthology.task.install:The correct ceph version 19.0.0-2569-g2ba596c3-1jammy is installed. 2024-05-14T01:22:32.630 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ba596c3826798bb3a2f22bc9b02848b92dbe579 2024-05-14T01:22:32.892 DEBUG:teuthology.orchestra.run.smithi176:> dpkg-query -W -f '${Version}' ceph 2024-05-14T01:22:32.911 INFO:teuthology.orchestra.run.smithi176.stdout:19.0.0-2569-g2ba596c3-1jammy 2024-05-14T01:22:32.912 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2569-g2ba596c3-1jammy 2024-05-14T01:22:32.912 INFO:teuthology.task.install:The correct ceph version 19.0.0-2569-g2ba596c3-1jammy is installed. 2024-05-14T01:22:32.913 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-14T01:22:32.914 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:22:32.914 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-14T01:22:32.928 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:22:32.928 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-14T01:22:32.965 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-14T01:22:32.966 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:22:32.966 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-05-14T01:22:32.982 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-14T01:22:33.037 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:22:33.037 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/daemon-helper 2024-05-14T01:22:33.050 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-14T01:22:33.104 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-14T01:22:33.104 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:22:33.105 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-14T01:22:33.117 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-14T01:22:33.172 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:22:33.173 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-14T01:22:33.186 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-14T01:22:33.240 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-14T01:22:33.240 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:22:33.240 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-05-14T01:22:33.254 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-14T01:22:33.308 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:22:33.308 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/stdin-killer 2024-05-14T01:22:33.321 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-14T01:22:33.376 INFO:teuthology.run_tasks:Running task ceph... 2024-05-14T01:22:33.462 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-14T01:22:33.462 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2024-05-14T01:22:33.465 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 777 /var/log/ceph 2024-05-14T01:22:33.477 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-14T01:22:33.478 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-14T01:22:33.519 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-14T01:22:33.532 INFO:tasks.ceph:Creating extra log directories... 2024-05-14T01:22:33.533 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-14T01:22:33.575 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-14T01:22:33.595 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-14T01:22:33.595 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-14T01:22:33.595 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-14T01:22:33.595 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:22:33.595 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-14T01:22:33.634 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-14T01:22:33.710 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:22:33.710 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-14T01:22:33.715 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-14T01:22:33.794 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-14T01:22:33.794 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-14T01:22:33.794 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi/7705395', 'branch': 'wip-yuri4-testing-2024-04-29-0642', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7705395', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2024-04-29-0642'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '2ba596c3826798bb3a2f22bc9b02848b92dbe579'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2ba596c3826798bb3a2f22bc9b02848b92dbe579'}}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2024-04-29-0642', 'sha1': '2ba596c3826798bb3a2f22bc9b02848b92dbe579'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 99, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1311, 'sha1': '2ba596c3826798bb3a2f22bc9b02848b92dbe579', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri4-testing-2024-04-29-0642', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_2ba596c3826798bb3a2f22bc9b02848b92dbe579/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '2ba596c3826798bb3a2f22bc9b02848b92dbe579', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi154.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHs4J0mm8zx8a3J4L2rvdMTA/33DT2sz01pZKEX5gziVhadzlKnXKRttkVSc5otyuWH95KlxYvPeyK/8iOLZtKM=', 'smithi176.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE874pIG9yhkkKXVMjdZHAjPMQcXOXGYm66jv3txQQE3SckErXMjv6Wo6Vet8hmuDtnhVpwpy5bu+j1eEPSkuXU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2ba596c3826798bb3a2f22bc9b02848b92dbe579'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '2ba596c3826798bb3a2f22bc9b02848b92dbe579', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-14_00:30:07', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-14T01:22:33.795 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-14T01:22:33.797 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-14T01:22:33.837 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2024-05-14T01:22:33.846 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/run/ceph 2024-05-14T01:22:33.893 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:22:33.893 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-05-14T01:22:33.905 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-14T01:22:33.906 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-05-14T01:22:33.954 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-14T01:22:33.954 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T01:22:33.954 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 871 Links: 1 2024-05-14T01:22:33.954 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T01:22:33.954 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-05-14 01:16:10.620951073 +0000 2024-05-14T01:22:33.954 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-05-14 01:16:10.348953500 +0000 2024-05-14T01:22:33.954 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-05-14 01:16:10.348953500 +0000 2024-05-14T01:22:33.955 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-05-14T01:22:33.955 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-14T01:22:34.008 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-05-14T01:22:34.008 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-05-14T01:22:34.008 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000428635 s, 1.2 MB/s 2024-05-14T01:22:34.009 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-14T01:22:34.059 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-05-14T01:22:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-14T01:22:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T01:22:34.106 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-05-14T01:22:34.106 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T01:22:34.106 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-05-14 01:16:11.112946685 +0000 2024-05-14T01:22:34.106 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-05-14 01:16:10.848949040 +0000 2024-05-14T01:22:34.106 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-05-14 01:16:10.848949040 +0000 2024-05-14T01:22:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-05-14T01:22:34.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-14T01:22:34.160 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-05-14T01:22:34.160 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-05-14T01:22:34.160 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000442646 s, 1.2 MB/s 2024-05-14T01:22:34.161 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-14T01:22:34.211 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-05-14T01:22:34.257 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-14T01:22:34.258 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T01:22:34.258 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-05-14T01:22:34.258 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T01:22:34.258 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-05-14 01:16:11.620942153 +0000 2024-05-14T01:22:34.258 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-05-14 01:16:11.332944722 +0000 2024-05-14T01:22:34.258 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-05-14 01:16:11.332944722 +0000 2024-05-14T01:22:34.258 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-05-14T01:22:34.258 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-14T01:22:34.312 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-05-14T01:22:34.312 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-05-14T01:22:34.312 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000367801 s, 1.4 MB/s 2024-05-14T01:22:34.314 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-14T01:22:34.363 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-05-14T01:22:34.410 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-14T01:22:34.410 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T01:22:34.410 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-05-14T01:22:34.410 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T01:22:34.410 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-05-14 01:16:12.064938192 +0000 2024-05-14T01:22:34.410 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-05-14 01:16:11.832940261 +0000 2024-05-14T01:22:34.410 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-05-14 01:16:11.832940261 +0000 2024-05-14T01:22:34.410 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-05-14T01:22:34.411 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-14T01:22:34.464 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-05-14T01:22:34.464 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-05-14T01:22:34.464 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000326434 s, 1.6 MB/s 2024-05-14T01:22:34.465 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-14T01:22:34.515 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T01:22:34.515 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:22:34.515 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/scratch_devs of=/dev/stdout 2024-05-14T01:22:34.521 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-14T01:22:34.521 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_1 2024-05-14T01:22:34.570 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-14T01:22:34.570 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T01:22:34.570 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-05-14T01:22:34.570 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T01:22:34.570 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-05-14 01:16:10.939275353 +0000 2024-05-14T01:22:34.571 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-05-14 01:16:10.659277852 +0000 2024-05-14T01:22:34.571 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-05-14 01:16:10.659277852 +0000 2024-05-14T01:22:34.571 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2024-05-14T01:22:34.571 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-14T01:22:34.625 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-05-14T01:22:34.626 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-05-14T01:22:34.626 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.00035835 s, 1.4 MB/s 2024-05-14T01:22:34.627 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-14T01:22:34.675 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_2 2024-05-14T01:22:34.721 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-14T01:22:34.721 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T01:22:34.722 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 901 Links: 1 2024-05-14T01:22:34.722 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T01:22:34.722 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-05-14 01:16:11.431270965 +0000 2024-05-14T01:22:34.722 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-05-14 01:16:11.191273106 +0000 2024-05-14T01:22:34.722 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-05-14 01:16:11.191273106 +0000 2024-05-14T01:22:34.722 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2024-05-14T01:22:34.722 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-14T01:22:34.776 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-05-14T01:22:34.776 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-05-14T01:22:34.776 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000385086 s, 1.3 MB/s 2024-05-14T01:22:34.777 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-14T01:22:34.827 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_3 2024-05-14T01:22:34.877 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-14T01:22:34.877 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T01:22:34.878 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 919 Links: 1 2024-05-14T01:22:34.878 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T01:22:34.878 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-05-14 01:16:11.899266790 +0000 2024-05-14T01:22:34.878 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-05-14 01:16:11.651269002 +0000 2024-05-14T01:22:34.878 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-05-14 01:16:11.651269002 +0000 2024-05-14T01:22:34.878 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2024-05-14T01:22:34.878 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-14T01:22:34.932 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-05-14T01:22:34.932 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-05-14T01:22:34.932 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000374527 s, 1.4 MB/s 2024-05-14T01:22:34.933 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-14T01:22:34.983 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_4 2024-05-14T01:22:35.029 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-14T01:22:35.029 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T01:22:35.030 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-05-14T01:22:35.030 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T01:22:35.030 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-05-14 01:16:12.407262259 +0000 2024-05-14T01:22:35.030 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-05-14 01:16:12.143264614 +0000 2024-05-14T01:22:35.030 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-05-14 01:16:12.143264614 +0000 2024-05-14T01:22:35.030 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2024-05-14T01:22:35.030 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-14T01:22:35.084 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-05-14T01:22:35.084 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-05-14T01:22:35.084 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000383677 s, 1.3 MB/s 2024-05-14T01:22:35.086 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-14T01:22:35.134 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T01:22:35.134 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-14T01:22:35.134 INFO:tasks.ceph:Generating config... 2024-05-14T01:22:35.136 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-14T01:22:35.136 INFO:tasks.ceph:[client] debug client = 20 2024-05-14T01:22:35.136 INFO:tasks.ceph:[client] debug ms = 1 2024-05-14T01:22:35.136 INFO:tasks.ceph:[client] pid file = 2024-05-14T01:22:35.136 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-14T01:22:35.136 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-14T01:22:35.136 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-14T01:22:35.136 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-14T01:22:35.136 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-14T01:22:35.136 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-14T01:22:35.136 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-14T01:22:35.136 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-14T01:22:35.137 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-14T01:22:35.137 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-14T01:22:35.137 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-14T01:22:35.137 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-14T01:22:35.137 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-14T01:22:35.137 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-14T01:22:35.137 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-14T01:22:35.137 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-14T01:22:35.137 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-14T01:22:35.137 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-14T01:22:35.137 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-14T01:22:35.137 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-14T01:22:35.137 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-14T01:22:35.137 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-14T01:22:35.138 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-14T01:22:35.138 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-14T01:22:35.138 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-14T01:22:35.138 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-14T01:22:35.138 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-14T01:22:35.138 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-14T01:22:35.138 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-14T01:22:35.138 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-14T01:22:35.138 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-14T01:22:35.138 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-14T01:22:35.138 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-14T01:22:35.138 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-14T01:22:35.138 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-14T01:22:35.139 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-14T01:22:35.139 INFO:tasks.ceph:Setting up mon.a... 2024-05-14T01:22:35.139 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-14T01:22:35.172 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.keyring 2024-05-14T01:22:35.252 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-14T01:22:35.330 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-14T01:22:35.385 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.154'), ('mon.b', '172.21.15.176'), ('mon.c', '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]')] 2024-05-14T01:22:35.386 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.154,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-14T01:22:35.387 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:22:35.387 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-14T01:22:35.434 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.154 --add b 172.21.15.176 --addv c '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-14T01:22:35.519 INFO:teuthology.orchestra.run.smithi154.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-14T01:22:35.519 INFO:teuthology.orchestra.run.smithi154.stdout:monmaptool: generated fsid ed6da4f4-feae-4641-a379-d93fb409ad95 2024-05-14T01:22:35.519 INFO:teuthology.orchestra.run.smithi154.stdout:setting min_mon_release = quincy 2024-05-14T01:22:35.519 INFO:teuthology.orchestra.run.smithi154.stdout:epoch 0 2024-05-14T01:22:35.519 INFO:teuthology.orchestra.run.smithi154.stdout:fsid ed6da4f4-feae-4641-a379-d93fb409ad95 2024-05-14T01:22:35.519 INFO:teuthology.orchestra.run.smithi154.stdout:last_changed 2024-05-14T01:22:35.540307+0000 2024-05-14T01:22:35.519 INFO:teuthology.orchestra.run.smithi154.stdout:created 2024-05-14T01:22:35.540307+0000 2024-05-14T01:22:35.519 INFO:teuthology.orchestra.run.smithi154.stdout:min_mon_release 17 (quincy) 2024-05-14T01:22:35.519 INFO:teuthology.orchestra.run.smithi154.stdout:election_strategy: 1 2024-05-14T01:22:35.519 INFO:teuthology.orchestra.run.smithi154.stdout:0: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.a 2024-05-14T01:22:35.519 INFO:teuthology.orchestra.run.smithi154.stdout:1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.b 2024-05-14T01:22:35.520 INFO:teuthology.orchestra.run.smithi154.stdout:2: [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] mon.c 2024-05-14T01:22:35.520 INFO:teuthology.orchestra.run.smithi154.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-14T01:22:35.521 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-14T01:22:35.569 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ed6da4f4-feae-4641-a379-d93fb409ad95... 2024-05-14T01:22:35.570 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-14T01:22:35.614 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-14T01:22:35.642 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2024-05-14T01:22:35.643 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2024-05-14T01:22:35.643 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-14T01:22:35.643 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2024-05-14T01:22:35.643 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.643 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2024-05-14T01:22:35.643 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.643 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2024-05-14T01:22:35.643 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.643 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2024-05-14T01:22:35.643 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2024-05-14T01:22:35.643 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.643 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2024-05-14T01:22:35.643 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2024-05-14T01:22:35.643 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.643 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-14T01:22:35.643 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2024-05-14T01:22:35.644 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.644 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2024-05-14T01:22:35.644 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-14T01:22:35.644 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.644 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2024-05-14T01:22:35.644 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.644 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2024-05-14T01:22:35.644 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2024-05-14T01:22:35.644 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2024-05-14T01:22:35.644 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2024-05-14T01:22:35.644 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2024-05-14T01:22:35.644 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2024-05-14T01:22:35.644 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2024-05-14T01:22:35.644 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-14T01:22:35.645 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-14T01:22:35.645 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2024-05-14T01:22:35.645 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.645 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-14T01:22:35.645 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.645 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2024-05-14T01:22:35.645 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.645 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2024-05-14T01:22:35.645 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.645 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2024-05-14T01:22:35.645 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2024-05-14T01:22:35.645 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2024-05-14T01:22:35.645 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.154,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-05-14T01:22:35.645 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = ed6da4f4-feae-4641-a379-d93fb409ad95 2024-05-14T01:22:35.645 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.645 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2024-05-14T01:22:35.646 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2024-05-14T01:22:35.646 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.646 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2024-05-14T01:22:35.646 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2024-05-14T01:22:35.646 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2024-05-14T01:22:35.646 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.646 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2024-05-14T01:22:35.646 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2024-05-14T01:22:35.646 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.646 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2024-05-14T01:22:35.646 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2024-05-14T01:22:35.646 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2024-05-14T01:22:35.646 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug trim objects = true 2024-05-14T01:22:35.646 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.646 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2024-05-14T01:22:35.647 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2024-05-14T01:22:35.647 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.647 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2024-05-14T01:22:35.647 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.647 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2024-05-14T01:22:35.647 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.647 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2024-05-14T01:22:35.647 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.647 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2024-05-14T01:22:35.647 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2024-05-14T01:22:35.647 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.647 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2024-05-14T01:22:35.647 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2024-05-14T01:22:35.647 INFO:teuthology.orchestra.run.smithi154.stdout: bdev async discard = True 2024-05-14T01:22:35.648 INFO:teuthology.orchestra.run.smithi154.stdout: bdev enable discard = True 2024-05-14T01:22:35.648 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore allocator = bitmap 2024-05-14T01:22:35.648 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2024-05-14T01:22:35.648 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2024-05-14T01:22:35.648 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2024-05-14T01:22:35.648 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2024-05-14T01:22:35.648 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-05-14T01:22:35.648 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2024-05-14T01:22:35.648 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2024-05-14T01:22:35.648 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2024-05-14T01:22:35.648 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2024-05-14T01:22:35.648 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2024-05-14T01:22:35.648 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2024-05-14T01:22:35.648 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2024-05-14T01:22:35.649 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2024-05-14T01:22:35.649 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.649 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2024-05-14T01:22:35.649 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-05-14T01:22:35.649 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2024-05-14T01:22:35.649 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-05-14T01:22:35.649 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-05-14T01:22:35.649 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-05-14T01:22:35.649 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-05-14T01:22:35.649 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2024-05-14T01:22:35.649 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2024-05-14T01:22:35.649 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.649 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2024-05-14T01:22:35.649 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-05-14T01:22:35.649 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-05-14T01:22:35.649 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2024-05-14T01:22:35.650 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-05-14T01:22:35.650 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2024-05-14T01:22:35.650 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2024-05-14T01:22:35.650 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-05-14T01:22:35.650 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2024-05-14T01:22:35.650 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2024-05-14T01:22:35.650 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-05-14T01:22:35.650 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.650 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-14T01:22:35.650 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2024-05-14T01:22:35.650 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2024-05-14T01:22:35.650 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.650 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2024-05-14T01:22:35.650 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-14T01:22:35.651 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-14T01:22:35.651 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.651 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2024-05-14T01:22:35.651 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2024-05-14T01:22:35.651 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.651 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2024-05-14T01:22:35.651 INFO:teuthology.orchestra.run.smithi154.stdout: mon down mkfs grace = 300 2024-05-14T01:22:35.651 INFO:teuthology.orchestra.run.smithi154.stdout: mon op complaint time = 120 2024-05-14T01:22:35.651 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:22:35.651 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2024-05-14T01:22:35.651 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2024-05-14T01:22:35.651 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2024-05-14T01:22:35.651 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2024-05-14T01:22:35.651 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-14T01:22:35.651 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-14T01:22:35.651 INFO:teuthology.orchestra.run.smithi154.stdout: client mount timeout = 600 2024-05-14T01:22:35.652 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2024-05-14T01:22:35.652 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-05-14T01:22:35.652 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = "" 2024-05-14T01:22:35.652 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2024-05-14T01:22:35.652 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2024-05-14T01:22:35.652 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2024-05-14T01:22:35.652 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2024-05-14T01:22:35.652 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2024-05-14T01:22:35.652 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2024-05-14T01:22:35.652 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2024-05-14T01:22:35.652 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2024-05-14T01:22:35.652 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2024-05-14T01:22:35.652 INFO:teuthology.orchestra.run.smithi154.stdout:[mds] 2024-05-14T01:22:35.652 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds = 20 2024-05-14T01:22:35.652 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds balancer = 20 2024-05-14T01:22:35.652 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-05-14T01:22:35.653 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug frag = True 2024-05-14T01:22:35.653 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug scatterstat = True 2024-05-14T01:22:35.653 INFO:teuthology.orchestra.run.smithi154.stdout: mds op complaint time = 180 2024-05-14T01:22:35.653 INFO:teuthology.orchestra.run.smithi154.stdout: mds verify scatter = True 2024-05-14T01:22:35.653 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2024-05-14T01:22:35.653 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2024-05-14T01:22:35.653 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2024-05-14T01:22:35.654 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2024-05-14T01:22:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2024-05-14T01:22:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-14T01:22:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2024-05-14T01:22:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2024-05-14T01:22:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2024-05-14T01:22:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2024-05-14T01:22:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2024-05-14T01:22:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2024-05-14T01:22:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2024-05-14T01:22:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-14T01:22:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2024-05-14T01:22:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2024-05-14T01:22:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-14T01:22:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2024-05-14T01:22:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2024-05-14T01:22:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2024-05-14T01:22:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2024-05-14T01:22:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2024-05-14T01:22:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2024-05-14T01:22:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2024-05-14T01:22:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2024-05-14T01:22:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-14T01:22:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-14T01:22:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2024-05-14T01:22:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-14T01:22:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2024-05-14T01:22:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2024-05-14T01:22:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2024-05-14T01:22:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2024-05-14T01:22:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2024-05-14T01:22:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = "172.21.15.154,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-05-14T01:22:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = ed6da4f4-feae-4641-a379-d93fb409ad95 2024-05-14T01:22:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.657 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2024-05-14T01:22:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2024-05-14T01:22:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2024-05-14T01:22:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2024-05-14T01:22:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: osd mclock profile = high_recovery_ops 2024-05-14T01:22:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2024-05-14T01:22:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2024-05-14T01:22:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2024-05-14T01:22:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2024-05-14T01:22:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2024-05-14T01:22:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug trim objects = true 2024-05-14T01:22:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2024-05-14T01:22:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2024-05-14T01:22:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2024-05-14T01:22:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2024-05-14T01:22:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2024-05-14T01:22:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2024-05-14T01:22:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2024-05-14T01:22:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2024-05-14T01:22:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2024-05-14T01:22:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: bdev async discard = True 2024-05-14T01:22:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: bdev enable discard = True 2024-05-14T01:22:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore allocator = bitmap 2024-05-14T01:22:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore block size = 96636764160 2024-05-14T01:22:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore fsck on mount = True 2024-05-14T01:22:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluefs = 1/20 2024-05-14T01:22:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluestore = 1/20 2024-05-14T01:22:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-05-14T01:22:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2024-05-14T01:22:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: debug rocksdb = 4/10 2024-05-14T01:22:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd backfillfull_ratio = 0.85 2024-05-14T01:22:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd full ratio = 0.9 2024-05-14T01:22:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd nearfull ratio = 0.8 2024-05-14T01:22:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: osd failsafe full ratio = 0.95 2024-05-14T01:22:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = bluestore 2024-05-14T01:22:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2024-05-14T01:22:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.660 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2024-05-14T01:22:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-05-14T01:22:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2024-05-14T01:22:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-05-14T01:22:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-05-14T01:22:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-05-14T01:22:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-05-14T01:22:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2024-05-14T01:22:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2024-05-14T01:22:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.661 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2024-05-14T01:22:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-05-14T01:22:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-05-14T01:22:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2024-05-14T01:22:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-05-14T01:22:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2024-05-14T01:22:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2024-05-14T01:22:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-05-14T01:22:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2024-05-14T01:22:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2024-05-14T01:22:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-05-14T01:22:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-14T01:22:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2024-05-14T01:22:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2024-05-14T01:22:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2024-05-14T01:22:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-14T01:22:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-14T01:22:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2024-05-14T01:22:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2024-05-14T01:22:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2024-05-14T01:22:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: mon down mkfs grace = 300 2024-05-14T01:22:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: mon op complaint time = 120 2024-05-14T01:22:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-05-14T01:22:35.663 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2024-05-14T01:22:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2024-05-14T01:22:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2024-05-14T01:22:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2024-05-14T01:22:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-14T01:22:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-14T01:22:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: client mount timeout = 600 2024-05-14T01:22:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2024-05-14T01:22:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-05-14T01:22:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = "" 2024-05-14T01:22:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2024-05-14T01:22:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2024-05-14T01:22:35.663 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2024-05-14T01:22:35.663 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.b] 2024-05-14T01:22:35.663 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.c] 2024-05-14T01:22:35.663 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-05-14T01:22:35.664 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-05-14T01:22:35.664 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-05-14T01:22:35.664 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-05-14T01:22:35.664 INFO:teuthology.orchestra.run.smithi176.stdout:[mds] 2024-05-14T01:22:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds = 20 2024-05-14T01:22:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds balancer = 20 2024-05-14T01:22:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-05-14T01:22:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug frag = True 2024-05-14T01:22:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug scatterstat = True 2024-05-14T01:22:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: mds op complaint time = 180 2024-05-14T01:22:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: mds verify scatter = True 2024-05-14T01:22:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2024-05-14T01:22:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2024-05-14T01:22:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2024-05-14T01:22:35.665 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-14T01:22:35.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-14T01:22:35.744 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-14T01:22:35.744 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:22:35.744 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-14T01:22:35.790 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:22:35.790 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-14T01:22:35.837 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2024-05-14T01:22:35.837 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:22:35.837 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-14T01:22:35.837 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-14T01:22:35.901 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:22:35.901 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-14T01:22:35.949 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi176.front.sepia.ceph.com 2024-05-14T01:22:35.950 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:22:35.950 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-14T01:22:35.950 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-14T01:22:35.974 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:22:35.974 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-14T01:22:36.026 INFO:tasks.ceph:Setting up mon nodes... 2024-05-14T01:22:36.026 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-14T01:22:36.026 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-14T01:22:36.070 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-14T01:22:36.073 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-14T01:22:36.117 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-14T01:22:36.138 INFO:tasks.ceph:Setting up mds nodes... 2024-05-14T01:22:36.138 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-14T01:22:36.181 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-14T01:22:36.184 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-14T01:22:36.238 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-14T01:22:36.323 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-14T01:22:36.326 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-14T01:22:36.381 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-14T01:22:36.426 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-14T01:22:36.429 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-14T01:22:36.441 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-14T01:22:36.524 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-14T01:22:36.527 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-14T01:22:36.580 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-14T01:22:36.580 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-14T01:22:36.617 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-14T01:22:36.629 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-14T01:22:36.706 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-14T01:22:36.715 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-14T01:22:36.751 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-14T01:22:36.762 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-14T01:22:36.839 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-14T01:22:36.848 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-14T01:22:36.849 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-14T01:22:36.849 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-14T01:22:36.863 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T01:22:36.863 INFO:tasks.ceph:role: osd.0 2024-05-14T01:22:36.863 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2024-05-14T01:22:36.863 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-14T01:22:36.926 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T01:22:36.926 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T01:22:36.926 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T01:22:36.926 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-14T01:22:36.926 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T01:22:36.926 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-05-14T01:22:36.926 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T01:22:36.926 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-14T01:22:36.927 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T01:22:36.927 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T01:22:37.379 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-05-14T01:22:37.381 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-05-14T01:22:37.381 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-14T01:22:37.480 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-14T01:22:37.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T01:22:37.490 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-05-14T01:22:37.490 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-14T01:22:37.544 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T01:22:37.544 INFO:tasks.ceph:role: osd.1 2024-05-14T01:22:37.544 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com 2024-05-14T01:22:37.545 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-14T01:22:37.607 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T01:22:37.607 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T01:22:37.607 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T01:22:37.607 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-14T01:22:37.607 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T01:22:37.607 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-05-14T01:22:37.607 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T01:22:37.607 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-14T01:22:37.607 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T01:22:37.608 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T01:22:38.076 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-05-14T01:22:38.079 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-05-14T01:22:38.079 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-14T01:22:38.241 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-14T01:22:38.253 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-05-14T01:22:38.253 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T01:22:38.254 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-14T01:22:38.309 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T01:22:38.310 INFO:tasks.ceph:role: osd.2 2024-05-14T01:22:38.310 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com 2024-05-14T01:22:38.310 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-14T01:22:38.374 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T01:22:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T01:22:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T01:22:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-14T01:22:38.374 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T01:22:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-05-14T01:22:38.375 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T01:22:38.375 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-14T01:22:38.375 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T01:22:38.375 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T01:22:38.853 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-05-14T01:22:38.855 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-05-14T01:22:38.855 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-14T01:22:38.994 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-14T01:22:39.005 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T01:22:39.006 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-05-14T01:22:39.006 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-14T01:22:39.061 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T01:22:39.061 INFO:tasks.ceph:role: osd.3 2024-05-14T01:22:39.061 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com 2024-05-14T01:22:39.061 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-14T01:22:39.126 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T01:22:39.126 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T01:22:39.126 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T01:22:39.126 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-14T01:22:39.126 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T01:22:39.126 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-05-14T01:22:39.126 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T01:22:39.126 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-14T01:22:39.127 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T01:22:39.127 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T01:22:39.552 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-05-14T01:22:39.555 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-05-14T01:22:39.555 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-14T01:22:39.645 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-14T01:22:39.698 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-05-14T01:22:39.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T01:22:39.700 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T01:22:39.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:39.828+0000 7f8298b487c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-14T01:22:39.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:39.832+0000 7f8298b487c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-14T01:22:39.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:39.832+0000 7f8298b487c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-14T01:22:39.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:39.832+0000 7f8298b487c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-14T01:22:39.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:39.832+0000 7f8298b487c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-14T01:22:39.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:39.836+0000 7f8298b487c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-14T01:22:42.798 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-14T01:22:42.811 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T01:22:42.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:42.908+0000 7f9e804ff7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-14T01:22:42.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:42.908+0000 7f9e804ff7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-14T01:22:42.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:42.908+0000 7f9e804ff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-14T01:22:42.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:42.908+0000 7f9e804ff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-14T01:22:42.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:42.908+0000 7f9e804ff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-14T01:22:42.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:42.908+0000 7f9e804ff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-14T01:22:45.869 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-14T01:22:45.926 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T01:22:46.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:46.024+0000 7f9402fc77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-14T01:22:46.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:46.024+0000 7f9402fc77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-14T01:22:46.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:46.024+0000 7f9402fc77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-14T01:22:46.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:46.024+0000 7f9402fc77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-14T01:22:46.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:46.024+0000 7f9402fc77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-14T01:22:46.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:46.024+0000 7f9402fc77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-14T01:22:48.977 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-14T01:22:49.038 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T01:22:49.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:49.136+0000 7fbac184d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-14T01:22:49.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:49.136+0000 7fbac184d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-14T01:22:49.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:49.136+0000 7fbac184d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-14T01:22:49.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:49.136+0000 7fbac184d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-14T01:22:49.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:49.136+0000 7fbac184d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-14T01:22:49.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:22:49.136+0000 7fbac184d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-14T01:22:52.098 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-14T01:22:52.155 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-14T01:22:52.170 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T01:22:52.170 INFO:tasks.ceph:role: osd.4 2024-05-14T01:22:52.170 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com 2024-05-14T01:22:52.170 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-14T01:22:52.233 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T01:22:52.233 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T01:22:52.233 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T01:22:52.233 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-14T01:22:52.234 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T01:22:52.234 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-05-14T01:22:52.234 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T01:22:52.234 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-14T01:22:52.234 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T01:22:52.234 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T01:22:52.694 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-05-14T01:22:52.696 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-05-14T01:22:52.696 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-14T01:22:52.791 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-14T01:22:52.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T01:22:52.801 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: /sbin/restorecon: command not found 2024-05-14T01:22:52.801 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-14T01:22:52.857 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T01:22:52.857 INFO:tasks.ceph:role: osd.5 2024-05-14T01:22:52.857 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com 2024-05-14T01:22:52.857 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-14T01:22:52.916 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T01:22:52.916 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T01:22:52.917 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T01:22:52.917 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-14T01:22:52.917 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T01:22:52.917 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-05-14T01:22:52.917 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T01:22:52.917 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-14T01:22:52.917 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T01:22:52.917 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T01:22:53.391 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-05-14T01:22:53.394 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-05-14T01:22:53.394 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-14T01:22:53.567 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-14T01:22:53.578 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: /sbin/restorecon: command not found 2024-05-14T01:22:53.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T01:22:53.580 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-14T01:22:53.634 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T01:22:53.635 INFO:tasks.ceph:role: osd.6 2024-05-14T01:22:53.635 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com 2024-05-14T01:22:53.635 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-14T01:22:53.697 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T01:22:53.698 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T01:22:53.698 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T01:22:53.698 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-14T01:22:53.698 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T01:22:53.698 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-05-14T01:22:53.698 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T01:22:53.698 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-14T01:22:53.698 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T01:22:53.699 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T01:22:54.177 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-05-14T01:22:54.179 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-05-14T01:22:54.179 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-14T01:22:54.329 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-14T01:22:54.340 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: /sbin/restorecon: command not found 2024-05-14T01:22:54.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T01:22:54.342 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-14T01:22:54.398 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T01:22:54.398 INFO:tasks.ceph:role: osd.7 2024-05-14T01:22:54.398 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com 2024-05-14T01:22:54.398 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-14T01:22:54.461 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T01:22:54.461 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T01:22:54.461 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T01:22:54.461 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-14T01:22:54.461 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T01:22:54.462 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-05-14T01:22:54.462 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T01:22:54.462 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-14T01:22:54.462 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T01:22:54.462 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T01:22:54.889 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-05-14T01:22:54.890 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-05-14T01:22:54.891 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-14T01:22:54.979 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-14T01:22:54.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T01:22:54.989 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: /sbin/restorecon: command not found 2024-05-14T01:22:54.989 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T01:22:55.106 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:22:55.124+0000 7fa2114f67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-14T01:22:55.111 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:22:55.128+0000 7fa2114f67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-14T01:22:55.111 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:22:55.128+0000 7fa2114f67c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-14T01:22:55.111 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:22:55.128+0000 7fa2114f67c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-14T01:22:55.111 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:22:55.128+0000 7fa2114f67c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-14T01:22:55.114 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:22:55.132+0000 7fa2114f67c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-14T01:22:58.087 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-14T01:22:58.101 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T01:22:58.184 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:22:58.200+0000 7f37715f27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-14T01:22:58.185 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:22:58.200+0000 7f37715f27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-14T01:22:58.185 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:22:58.200+0000 7f37715f27c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-14T01:22:58.185 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:22:58.200+0000 7f37715f27c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-14T01:22:58.185 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:22:58.200+0000 7f37715f27c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-14T01:22:58.186 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:22:58.204+0000 7f37715f27c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-14T01:23:01.171 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-14T01:23:01.231 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T01:23:01.313 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:01.327+0000 7f44714377c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-14T01:23:01.314 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:01.331+0000 7f44714377c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-14T01:23:01.314 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:01.331+0000 7f44714377c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-14T01:23:01.314 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:01.331+0000 7f44714377c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-14T01:23:01.314 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:01.331+0000 7f44714377c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-14T01:23:01.314 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:01.331+0000 7f44714377c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-14T01:23:03.796 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:23:03.799 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:23:04.289 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-14T01:23:04.303 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T01:23:04.383 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:04.399+0000 7f5f1cc477c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-14T01:23:04.384 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:04.399+0000 7f5f1cc477c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-14T01:23:04.384 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:04.399+0000 7f5f1cc477c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-14T01:23:04.384 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:04.399+0000 7f5f1cc477c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-14T01:23:04.384 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:04.399+0000 7f5f1cc477c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-14T01:23:04.384 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:04.399+0000 7f5f1cc477c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-14T01:23:07.352 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-14T01:23:07.406 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-14T01:23:07.407 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:23:07.407 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-14T01:23:07.420 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:23:07.421 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-14T01:23:07.475 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:23:07.475 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-14T01:23:07.530 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:23:07.530 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-14T01:23:07.583 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:23:07.583 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-14T01:23:07.638 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:23:07.638 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-14T01:23:07.690 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:23:07.690 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-14T01:23:07.742 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:23:07.742 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-14T01:23:07.756 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:23:07.756 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-14T01:23:07.819 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:23:07.819 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-14T01:23:07.874 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:23:07.874 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-14T01:23:07.930 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:23:07.930 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-14T01:23:07.985 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:23:07.985 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-14T01:23:08.038 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:23:08.038 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-14T01:23:08.093 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:23:08.093 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-14T01:23:08.099 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:23:08.099 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-14T01:23:08.147 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:23:08.147 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-14T01:23:08.153 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:23:08.153 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-14T01:23:08.198 INFO:tasks.ceph:Adding keys to all mons... 2024-05-14T01:23:08.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-14T01:23:08.201 DEBUG:teuthology.orchestra.run.smithi176:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-14T01:23:08.244 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.y] 2024-05-14T01:23:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDcvEJmDDN4BRAA6pr95tSCM6KDCvT2Ls+eFw== 2024-05-14T01:23:08.245 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2024-05-14T01:23:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDcvEJm7yoWDBAA8w2pr2DrTNaVR+wz+Nl/Fg== 2024-05-14T01:23:08.245 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2024-05-14T01:23:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDcvEJmixGGFBAA5lz67GiLOTlmScmPnHMz7Q== 2024-05-14T01:23:08.245 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.0] 2024-05-14T01:23:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDfvEJm6Ye1MRAAwALBzMFgiY3+GhhvAoK+nA== 2024-05-14T01:23:08.245 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.1] 2024-05-14T01:23:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDivEJm33htNhAAzuBgsc1mOZzSBTQDi+/E3Q== 2024-05-14T01:23:08.245 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.2] 2024-05-14T01:23:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDmvEJm6pO1ARAAshV/uir1lPGJ9aVZ7/FVGQ== 2024-05-14T01:23:08.245 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.3] 2024-05-14T01:23:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDpvEJm1vBkCBAAsgyM/byd+Xlj5HjcXzSlvQ== 2024-05-14T01:23:08.246 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.x] 2024-05-14T01:23:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDcvEJmNwwvCBAAA57XzKvJ/C+mHdhWfZjcfA== 2024-05-14T01:23:08.246 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2024-05-14T01:23:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDcvEJmKSudGhAAwRxetNNW0nPruXpmia03aQ== 2024-05-14T01:23:08.246 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2024-05-14T01:23:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDcvEJmI3RvIBAAtnj8wt+Yr6xzHaWOBMa/WA== 2024-05-14T01:23:08.246 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.4] 2024-05-14T01:23:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDvvEJmOoV7BxAA/xpGtzo9DnnUMIu5bgai1g== 2024-05-14T01:23:08.246 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.5] 2024-05-14T01:23:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDyvEJmLBcmDBAAUFs3E6N9NsQJ3vgO/IDRpw== 2024-05-14T01:23:08.246 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.6] 2024-05-14T01:23:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD1vEJmHHrSExAARmp8A//JBhz9SVsOHTbOnQ== 2024-05-14T01:23:08.246 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.7] 2024-05-14T01:23:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD4vEJmkjX8FxAA2++ZWYuV3xaHAcZCx4S1UQ== 2024-05-14T01:23:08.247 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2024-05-14T01:23:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDcvEJmzNwUJhAAZcH888XeSsgDX/xMggOZcg== 2024-05-14T01:23:08.247 INFO:teuthology.orchestra.run.smithi154.stdout:[client.2] 2024-05-14T01:23:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDcvEJmE/tKKxAARhrvkbA+AiYwwDR9zVJ0vg== 2024-05-14T01:23:08.247 INFO:teuthology.orchestra.run.smithi154.stdout:[client.1] 2024-05-14T01:23:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDcvEJmC7X5LRAA0eJUntNY5LzW27HXKMpkPw== 2024-05-14T01:23:08.247 INFO:teuthology.orchestra.run.smithi154.stdout:[client.3] 2024-05-14T01:23:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDcvEJm11A8MxAAlDminVpItJRLzHA6tshdXg== 2024-05-14T01:23:08.253 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.y] 2024-05-14T01:23:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDcvEJmDDN4BRAA6pr95tSCM6KDCvT2Ls+eFw== 2024-05-14T01:23:08.253 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-05-14T01:23:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDcvEJm7yoWDBAA8w2pr2DrTNaVR+wz+Nl/Fg== 2024-05-14T01:23:08.253 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-05-14T01:23:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDcvEJmixGGFBAA5lz67GiLOTlmScmPnHMz7Q== 2024-05-14T01:23:08.253 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.0] 2024-05-14T01:23:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDfvEJm6Ye1MRAAwALBzMFgiY3+GhhvAoK+nA== 2024-05-14T01:23:08.253 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.1] 2024-05-14T01:23:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDivEJm33htNhAAzuBgsc1mOZzSBTQDi+/E3Q== 2024-05-14T01:23:08.253 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.2] 2024-05-14T01:23:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDmvEJm6pO1ARAAshV/uir1lPGJ9aVZ7/FVGQ== 2024-05-14T01:23:08.253 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.3] 2024-05-14T01:23:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDpvEJm1vBkCBAAsgyM/byd+Xlj5HjcXzSlvQ== 2024-05-14T01:23:08.254 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.x] 2024-05-14T01:23:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDcvEJmNwwvCBAAA57XzKvJ/C+mHdhWfZjcfA== 2024-05-14T01:23:08.254 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-05-14T01:23:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDcvEJmKSudGhAAwRxetNNW0nPruXpmia03aQ== 2024-05-14T01:23:08.254 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-05-14T01:23:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDcvEJmI3RvIBAAtnj8wt+Yr6xzHaWOBMa/WA== 2024-05-14T01:23:08.254 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.4] 2024-05-14T01:23:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDvvEJmOoV7BxAA/xpGtzo9DnnUMIu5bgai1g== 2024-05-14T01:23:08.254 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.5] 2024-05-14T01:23:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDyvEJmLBcmDBAAUFs3E6N9NsQJ3vgO/IDRpw== 2024-05-14T01:23:08.254 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.6] 2024-05-14T01:23:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQD1vEJmHHrSExAARmp8A//JBhz9SVsOHTbOnQ== 2024-05-14T01:23:08.255 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.7] 2024-05-14T01:23:08.255 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQD4vEJmkjX8FxAA2++ZWYuV3xaHAcZCx4S1UQ== 2024-05-14T01:23:08.255 INFO:teuthology.orchestra.run.smithi176.stdout:[client.0] 2024-05-14T01:23:08.255 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDcvEJmzNwUJhAAZcH888XeSsgDX/xMggOZcg== 2024-05-14T01:23:08.255 INFO:teuthology.orchestra.run.smithi176.stdout:[client.2] 2024-05-14T01:23:08.255 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDcvEJmE/tKKxAARhrvkbA+AiYwwDR9zVJ0vg== 2024-05-14T01:23:08.255 INFO:teuthology.orchestra.run.smithi176.stdout:[client.1] 2024-05-14T01:23:08.255 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDcvEJmC7X5LRAA0eJUntNY5LzW27HXKMpkPw== 2024-05-14T01:23:08.255 INFO:teuthology.orchestra.run.smithi176.stdout:[client.3] 2024-05-14T01:23:08.255 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDcvEJm11A8MxAAlDminVpItJRLzHA6tshdXg== 2024-05-14T01:23:08.256 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-14T01:23:08.293 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-14T01:23:08.348 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T01:23:08.350 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T01:23:08.394 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T01:23:08.436 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T01:23:08.478 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T01:23:08.524 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T01:23:08.565 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T01:23:08.612 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T01:23:08.656 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T01:23:08.658 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T01:23:08.735 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T01:23:08.740 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T01:23:08.817 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-14T01:23:08.828 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-14T01:23:08.899 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T01:23:08.912 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T01:23:08.989 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T01:23:08.996 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T01:23:09.041 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T01:23:09.043 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T01:23:09.116 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T01:23:09.124 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T01:23:09.196 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T01:23:09.208 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T01:23:09.281 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T01:23:09.296 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T01:23:09.366 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T01:23:09.376 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T01:23:09.457 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T01:23:09.460 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T01:23:09.501 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T01:23:09.544 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T01:23:09.590 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T01:23:09.628 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T01:23:09.675 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-14T01:23:09.675 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-14T01:23:09.687 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-14T01:23:09.776 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-14T01:23:09.786 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-14T01:23:09.800 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-14T01:23:09.891 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-14T01:23:09.901 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-14T01:23:09.952 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-14T01:23:10.043 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-14T01:23:10.053 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-14T01:23:10.056 DEBUG:teuthology.orchestra.run.smithi176:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-14T01:23:10.102 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-14T01:23:10.103 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-14T01:23:10.103 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-14T01:23:10.105 INFO:tasks.ceph.mon.a:Started 2024-05-14T01:23:10.105 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-14T01:23:10.105 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-14T01:23:10.148 INFO:tasks.ceph.mon.b:Started 2024-05-14T01:23:10.148 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-14T01:23:10.149 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-14T01:23:10.151 INFO:tasks.ceph.mon.c:Started 2024-05-14T01:23:10.151 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-14T01:23:10.151 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-14T01:23:10.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-14T01:23:10.153 INFO:tasks.ceph.mgr.y:Started 2024-05-14T01:23:10.153 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-14T01:23:10.154 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-14T01:23:10.155 INFO:tasks.ceph.mgr.x:Started 2024-05-14T01:23:10.156 INFO:tasks.ceph:Setting crush tunables to default 2024-05-14T01:23:10.156 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd crush tunables default 2024-05-14T01:23:10.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.283+0000 7f3b9a969640 1 Processor -- start 2024-05-14T01:23:10.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.283+0000 7f3b9a969640 1 -- start start 2024-05-14T01:23:10.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.287+0000 7f3b9a969640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3b9415bfe0 0x7f3b940d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:10.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.287+0000 7f3b9a969640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b940aea00 0x7f3b940d1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:10.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.287+0000 7f3b9a969640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b940cc770 con 0x7f3b940d2240 2024-05-14T01:23:10.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.287+0000 7f3b9a969640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3b940d2690 con 0x7f3b9415bfe0 2024-05-14T01:23:10.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.287+0000 7f3b9a969640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b940af1e0 con 0x7f3b940aea00 2024-05-14T01:23:10.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.287+0000 7f3b98f06640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3b940d2240 0x7f3b940b1ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50952/0 (socket says 172.21.15.154:50952) 2024-05-14T01:23:10.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.287+0000 7f3b98f06640 1 -- 172.21.15.154:0/3710737417 learned_addr learned my addr 172.21.15.154:0/3710737417 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:10.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.287+0000 7f3b937fe640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b940aea00 0x7f3b940d1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:10.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.287+0000 7f3b93fff640 1 --2- 172.21.15.154:0/3710737417 >> v2:172.21.15.176:3300/0 conn(0x7f3b9415bfe0 0x7f3b940d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:10.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.287+0000 7f3b937fe640 1 -- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b940aea00 msgr2=0x7f3b940d1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-14T01:23:10.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.287+0000 7f3b937fe640 1 -- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b940aea00 msgr2=0x7f3b940d1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T01:23:10.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.287+0000 7f3b937fe640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b940aea00 0x7f3b940d1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T01:23:10.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.287+0000 7f3b937fe640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b940aea00 0x7f3b940d1d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T01:23:10.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.287+0000 7f3b93fff640 1 -- 172.21.15.154:0/3710737417 >> v2:172.21.15.176:3300/0 conn(0x7f3b9415bfe0 msgr2=0x7f3b940d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-14T01:23:10.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.287+0000 7f3b93fff640 1 -- 172.21.15.154:0/3710737417 >> v2:172.21.15.176:3300/0 conn(0x7f3b9415bfe0 msgr2=0x7f3b940d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T01:23:10.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.287+0000 7f3b93fff640 1 --2- 172.21.15.154:0/3710737417 >> v2:172.21.15.176:3300/0 conn(0x7f3b9415bfe0 0x7f3b940d0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T01:23:10.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.287+0000 7f3b93fff640 1 --2- 172.21.15.154:0/3710737417 >> v2:172.21.15.176:3300/0 conn(0x7f3b9415bfe0 0x7f3b940d0790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T01:23:10.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.491+0000 7f3b93fff640 1 --2- 172.21.15.154:0/3710737417 >> v2:172.21.15.176:3300/0 conn(0x7f3b9415bfe0 0x7f3b940d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:10.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.491+0000 7f3b937fe640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b940aea00 0x7f3b940d1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:10.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.491+0000 7f3b937fe640 1 -- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b940aea00 msgr2=0x7f3b940d1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-14T01:23:10.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.491+0000 7f3b937fe640 1 -- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b940aea00 msgr2=0x7f3b940d1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T01:23:10.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.491+0000 7f3b937fe640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b940aea00 0x7f3b940d1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T01:23:10.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.491+0000 7f3b93fff640 1 -- 172.21.15.154:0/3710737417 >> v2:172.21.15.176:3300/0 conn(0x7f3b9415bfe0 msgr2=0x7f3b940d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-14T01:23:10.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.491+0000 7f3b93fff640 1 -- 172.21.15.154:0/3710737417 >> v2:172.21.15.176:3300/0 conn(0x7f3b9415bfe0 msgr2=0x7f3b940d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T01:23:10.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.491+0000 7f3b93fff640 1 --2- 172.21.15.154:0/3710737417 >> v2:172.21.15.176:3300/0 conn(0x7f3b9415bfe0 0x7f3b940d0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T01:23:10.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.491+0000 7f3b937fe640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b940aea00 0x7f3b940d1d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T01:23:10.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.491+0000 7f3b93fff640 1 --2- 172.21.15.154:0/3710737417 >> v2:172.21.15.176:3300/0 conn(0x7f3b9415bfe0 0x7f3b940d0790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T01:23:10.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b92ffd640 1 -- 172.21.15.154:0/3710737417 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3546661208 0 0) 0x7f3b840014a0 con 0x7f3b940d2240 2024-05-14T01:23:10.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b92ffd640 1 -- 172.21.15.154:0/3710737417 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b7c003530 con 0x7f3b940d2240 2024-05-14T01:23:10.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b92ffd640 1 -- 172.21.15.154:0/3710737417 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3408124794 0 0) 0x7f3b7c003530 con 0x7f3b940d2240 2024-05-14T01:23:10.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b92ffd640 1 -- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b940aea00 msgr2=0x7f3b940d1d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T01:23:10.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b92ffd640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b940aea00 0x7f3b940d1d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:10.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b92ffd640 1 -- 172.21.15.154:0/3710737417 >> v2:172.21.15.176:3300/0 conn(0x7f3b9415bfe0 msgr2=0x7f3b940d0790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T01:23:10.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b92ffd640 1 --2- 172.21.15.154:0/3710737417 >> v2:172.21.15.176:3300/0 conn(0x7f3b9415bfe0 0x7f3b940d0790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:10.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b92ffd640 1 -- 172.21.15.154:0/3710737417 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b940af4c0 con 0x7f3b940d2240 2024-05-14T01:23:10.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b92ffd640 1 -- 172.21.15.154:0/3710737417 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f3b84001bd0 con 0x7f3b940d2240 2024-05-14T01:23:10.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b92ffd640 1 -- 172.21.15.154:0/3710737417 >> v1:172.21.15.154:6789/0 conn(0x7f3b940d2240 legacy=0x7f3b940b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:10.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b92ffd640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b940aea00 0x7f3b7c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:10.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b92ffd640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b7c003ff0 0x7f3b7c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:10.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b92ffd640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b7c004d50 0x7f3b7c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:10.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b92ffd640 1 -- 172.21.15.154:0/3710737417 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3b940d2690 con 0x7f3b7c003ff0 2024-05-14T01:23:10.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b92ffd640 1 -- 172.21.15.154:0/3710737417 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3b940af1e0 con 0x7f3b7c004d50 2024-05-14T01:23:10.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b92ffd640 1 -- 172.21.15.154:0/3710737417 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b7c00bb90 con 0x7f3b940aea00 2024-05-14T01:23:10.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b937fe640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b7c003ff0 0x7f3b7c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:10.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b93fff640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b940aea00 0x7f3b7c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:10.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b98f06640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b7c004d50 0x7f3b7c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:10.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b937fe640 1 -- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b940aea00 msgr2=0x7f3b7c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:10.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b937fe640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b940aea00 0x7f3b7c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:10.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b937fe640 1 -- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b7c004d50 msgr2=0x7f3b7c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:10.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b937fe640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b7c004d50 0x7f3b7c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:10.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.539+0000 7f3b937fe640 1 -- 172.21.15.154:0/3710737417 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c003530 con 0x7f3b7c003ff0 2024-05-14T01:23:10.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.543+0000 7f3b98f06640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b7c004d50 0x7f3b7c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:10.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.543+0000 7f3b93fff640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b940aea00 0x7f3b7c0039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:23:10.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.547+0000 7f3b937fe640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b7c003ff0 0x7f3b7c004810 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800e8d0 tx=0x7f3b8801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4607eedccd872fab server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:10.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.547+0000 7f3b92ffd640 1 -- 172.21.15.154:0/3710737417 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8800f040 con 0x7f3b7c003ff0 2024-05-14T01:23:10.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.547+0000 7f3b92ffd640 1 -- 172.21.15.154:0/3710737417 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b880b0070 con 0x7f3b7c003ff0 2024-05-14T01:23:10.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.547+0000 7f3b92ffd640 1 -- 172.21.15.154:0/3710737417 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b880ab8f0 con 0x7f3b7c003ff0 2024-05-14T01:23:10.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.547+0000 7f3b9a969640 1 -- 172.21.15.154:0/3710737417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b7c003ff0 msgr2=0x7f3b7c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:10.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.547+0000 7f3b9a969640 1 --2- 172.21.15.154:0/3710737417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b7c003ff0 0x7f3b7c004810 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800e8d0 tx=0x7f3b8801c870 comp rx=0 tx=0).stop 2024-05-14T01:23:10.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.547+0000 7f3b98f06640 1 -- 172.21.15.154:0/3710737417 reap_dead start 2024-05-14T01:23:10.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.547+0000 7f3b9a969640 1 -- 172.21.15.154:0/3710737417 shutdown_connections 2024-05-14T01:23:10.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.547+0000 7f3b9a969640 1 -- 172.21.15.154:0/3710737417 >> 172.21.15.154:0/3710737417 conn(0x7f3b9409aa10 msgr2=0x7f3b9409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:10.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.547+0000 7f3b9a969640 1 -- 172.21.15.154:0/3710737417 shutdown_connections 2024-05-14T01:23:10.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.547+0000 7f3b9a969640 1 -- 172.21.15.154:0/3710737417 wait complete. 2024-05-14T01:23:10.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.551+0000 7f3b9a969640 1 Processor -- start 2024-05-14T01:23:10.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.551+0000 7f3b9a969640 1 -- start start 2024-05-14T01:23:10.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.551+0000 7f3b9a969640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b7c003ff0 0x7f3b941621b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:10.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.551+0000 7f3b9a969640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b940c8e40 0x7f3b940b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.551+0000 7f3b9a969640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b9406c8a0 0x7f3b940b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.551+0000 7f3b9a969640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3b940aef80 con 0x7f3b7c003ff0 2024-05-14T01:23:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.551+0000 7f3b9a969640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3b940aee00 con 0x7f3b940c8e40 2024-05-14T01:23:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.551+0000 7f3b9a969640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b940b1290 con 0x7f3b9406c8a0 2024-05-14T01:23:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.551+0000 7f3b93fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b7c003ff0 0x7f3b941621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.551+0000 7f3b93fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b7c003ff0 0x7f3b941621b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47482/0 (socket says 172.21.15.154:47482) 2024-05-14T01:23:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.551+0000 7f3b93fff640 1 -- 172.21.15.154:0/2093744719 learned_addr learned my addr 172.21.15.154:0/2093744719 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.551+0000 7f3b937fe640 1 --2- 172.21.15.154:0/2093744719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b940c8e40 0x7f3b940b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.551+0000 7f3b98f06640 1 --2- 172.21.15.154:0/2093744719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b9406c8a0 0x7f3b940b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.551+0000 7f3b93fff640 1 -- 172.21.15.154:0/2093744719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b9406c8a0 msgr2=0x7f3b940b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.551+0000 7f3b93fff640 1 --2- 172.21.15.154:0/2093744719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b9406c8a0 0x7f3b940b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.555+0000 7f3b93fff640 1 -- 172.21.15.154:0/2093744719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b940c8e40 msgr2=0x7f3b940b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.555+0000 7f3b93fff640 1 --2- 172.21.15.154:0/2093744719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b940c8e40 0x7f3b940b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.555+0000 7f3b93fff640 1 -- 172.21.15.154:0/2093744719 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b940c9300 con 0x7f3b7c003ff0 2024-05-14T01:23:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.555+0000 7f3b93fff640 1 --2- 172.21.15.154:0/2093744719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b7c003ff0 0x7f3b941621b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0129b0 tx=0x7f3b8c012e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.555+0000 7f3b90ff9640 1 -- 172.21.15.154:0/2093744719 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c019070 con 0x7f3b7c003ff0 2024-05-14T01:23:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.555+0000 7f3b90ff9640 1 -- 172.21.15.154:0/2093744719 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8c010c40 con 0x7f3b7c003ff0 2024-05-14T01:23:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.555+0000 7f3b9a969640 1 -- 172.21.15.154:0/2093744719 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b9406bdc0 con 0x7f3b7c003ff0 2024-05-14T01:23:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.555+0000 7f3b90ff9640 1 -- 172.21.15.154:0/2093744719 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c00f040 con 0x7f3b7c003ff0 2024-05-14T01:23:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.555+0000 7f3b9a969640 1 -- 172.21.15.154:0/2093744719 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b940c95e0 con 0x7f3b7c003ff0 2024-05-14T01:23:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.555+0000 7f3b90ff9640 1 -- 172.21.15.154:0/2093744719 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3b8c01c070 con 0x7f3b7c003ff0 2024-05-14T01:23:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.555+0000 7f3b90ff9640 1 -- 172.21.15.154:0/2093744719 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3b8c01e790 con 0x7f3b7c003ff0 2024-05-14T01:23:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.555+0000 7f3b9a969640 1 -- 172.21.15.154:0/2093744719 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b94068360 con 0x7f3b7c003ff0 2024-05-14T01:23:10.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.575+0000 7f3b90ff9640 1 -- 172.21.15.154:0/2093744719 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3b8c003d00 con 0x7f3b7c003ff0 2024-05-14T01:23:10.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.643+0000 7f3b9a969640 1 -- 172.21.15.154:0/2093744719 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f3b940cc0a0 con 0x7f3b7c003ff0 2024-05-14T01:23:10.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.647+0000 7f3b90ff9640 1 -- 172.21.15.154:0/2093744719 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f3b8c003620 con 0x7f3b7c003ff0 2024-05-14T01:23:10.631 INFO:teuthology.orchestra.run.smithi154.stderr:adjusted tunables profile to default 2024-05-14T01:23:10.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.647+0000 7f3b9a969640 1 -- 172.21.15.154:0/2093744719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b7c003ff0 msgr2=0x7f3b941621b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:10.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.647+0000 7f3b9a969640 1 --2- 172.21.15.154:0/2093744719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b7c003ff0 0x7f3b941621b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0129b0 tx=0x7f3b8c012e70 comp rx=0 tx=0).stop 2024-05-14T01:23:10.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.647+0000 7f3b9a969640 1 -- 172.21.15.154:0/2093744719 shutdown_connections 2024-05-14T01:23:10.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.647+0000 7f3b9a969640 1 --2- 172.21.15.154:0/2093744719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b9406c8a0 0x7f3b940b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:10.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.647+0000 7f3b9a969640 1 --2- 172.21.15.154:0/2093744719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b940c8e40 0x7f3b940b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:10.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.647+0000 7f3b9a969640 1 --2- 172.21.15.154:0/2093744719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b7c003ff0 0x7f3b941621b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:10.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.647+0000 7f3b9a969640 1 -- 172.21.15.154:0/2093744719 >> 172.21.15.154:0/2093744719 conn(0x7f3b9409aa10 msgr2=0x7f3b940704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:10.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.647+0000 7f3b9a969640 1 -- 172.21.15.154:0/2093744719 shutdown_connections 2024-05-14T01:23:10.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:10.647+0000 7f3b9a969640 1 -- 172.21.15.154:0/2093744719 wait complete. 2024-05-14T01:23:10.650 INFO:tasks.ceph:check_enable_crimson: False 2024-05-14T01:23:10.650 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-14T01:23:10.651 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:23:10.651 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-14T01:23:10.661 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:23:10.662 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-14T01:23:10.717 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:23:10.717 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-14T01:23:10.760 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:10.775+0000 7fe1714db180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T01:23:10.770 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:23:10.771 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-14T01:23:10.822 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:10.839+0000 7fdb485fd180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T01:23:10.825 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:23:10.825 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-14T01:23:10.838 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:23:10.838 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-14T01:23:10.893 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:23:10.893 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-14T01:23:10.945 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:23:10.945 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-14T01:23:10.997 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 1bb2b6f1-d560-4244-88f8-d99ce0e30e7f 0 2024-05-14T01:23:11.160 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.175+0000 7fc961caf640 1 Processor -- start 2024-05-14T01:23:11.161 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.175+0000 7fc961caf640 1 -- start start 2024-05-14T01:23:11.162 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.175+0000 7fc961caf640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc95c15a630 0x7fc95c0716b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.162 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.175+0000 7fc961caf640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc95c15aa10 0x7fc95c15aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.162 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.175+0000 7fc961caf640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc95c06de10 con 0x7fc95c0b3900 2024-05-14T01:23:11.162 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.175+0000 7fc961caf640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc95c0b3760 con 0x7fc95c15aa10 2024-05-14T01:23:11.162 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.175+0000 7fc961caf640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc95c06dbc0 con 0x7fc95c15a630 2024-05-14T01:23:11.162 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.175+0000 7fc95b7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc95c15a630 0x7fc95c0716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.162 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.175+0000 7fc95bfff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc95c15aa10 0x7fc95c15aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.175+0000 7fc95bfff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc95c15aa10 0x7fc95c15aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:47056/0 (socket says 172.21.15.176:47056) 2024-05-14T01:23:11.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.175+0000 7fc95b7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc95c15a630 0x7fc95c0716b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:52444/0 (socket says 172.21.15.176:52444) 2024-05-14T01:23:11.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.175+0000 7fc95bfff640 1 -- 172.21.15.176:0/530884699 learned_addr learned my addr 172.21.15.176:0/530884699 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-14T01:23:11.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.175+0000 7fc95affd640 1 --1- 172.21.15.176:0/530884699 >> v1:172.21.15.176:6789/0 conn(0x7fc95c0b3900 0x7fc95c071bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:45544/0 (socket says 172.21.15.176:45544) 2024-05-14T01:23:11.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.179+0000 7fc95bfff640 1 -- 172.21.15.176:0/530884699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc95c15a630 msgr2=0x7fc95c0716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:11.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.179+0000 7fc95bfff640 1 --2- 172.21.15.176:0/530884699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc95c15a630 0x7fc95c0716b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.179+0000 7fc95bfff640 1 -- 172.21.15.176:0/530884699 >> v1:172.21.15.176:6789/0 conn(0x7fc95c0b3900 legacy=0x7fc95c071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.179+0000 7fc95bfff640 1 -- 172.21.15.176:0/530884699 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95c06e0f0 con 0x7fc95c15aa10 2024-05-14T01:23:11.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.179+0000 7fc95a7fc640 1 -- 172.21.15.176:0/530884699 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2918423968 0 0) 0x7fc95c06de10 con 0x7fc95c0b3900 2024-05-14T01:23:11.163 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.179+0000 7fc95b7fe640 1 --2- 172.21.15.176:0/530884699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc95c15a630 0x7fc95c0716b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:23:11.164 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.179+0000 7fc95bfff640 1 --2- 172.21.15.176:0/530884699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc95c15aa10 0x7fc95c15aea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009870 tx=0x7fc94c01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f035ab14e61bf55 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:11.164 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.179+0000 7fc95a7fc640 1 -- 172.21.15.176:0/530884699 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c0aa610 con 0x7fc95c15aa10 2024-05-14T01:23:11.164 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.179+0000 7fc95a7fc640 1 -- 172.21.15.176:0/530884699 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94c0af070 con 0x7fc95c15aa10 2024-05-14T01:23:11.164 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.179+0000 7fc95a7fc640 1 -- 172.21.15.176:0/530884699 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c0aa9d0 con 0x7fc95c15aa10 2024-05-14T01:23:11.165 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.179+0000 7fc961caf640 1 -- 172.21.15.176:0/530884699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc95c15aa10 msgr2=0x7fc95c15aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.165 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.179+0000 7fc961caf640 1 --2- 172.21.15.176:0/530884699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc95c15aa10 0x7fc95c15aea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009870 tx=0x7fc94c01c530 comp rx=0 tx=0).stop 2024-05-14T01:23:11.165 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.179+0000 7fc961caf640 1 -- 172.21.15.176:0/530884699 shutdown_connections 2024-05-14T01:23:11.165 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.179+0000 7fc961caf640 1 --2- 172.21.15.176:0/530884699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc95c15aa10 0x7fc95c15aea0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.165 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.179+0000 7fc961caf640 1 --2- 172.21.15.176:0/530884699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc95c15a630 0x7fc95c0716b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.165 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.179+0000 7fc961caf640 1 -- 172.21.15.176:0/530884699 >> 172.21.15.176:0/530884699 conn(0x7fc95c0b21b0 msgr2=0x7fc95c0b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:11.165 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.179+0000 7fc961caf640 1 -- 172.21.15.176:0/530884699 shutdown_connections 2024-05-14T01:23:11.166 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.179+0000 7fc961caf640 1 -- 172.21.15.176:0/530884699 wait complete. 2024-05-14T01:23:11.166 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc961caf640 1 Processor -- start 2024-05-14T01:23:11.166 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc961caf640 1 -- start start 2024-05-14T01:23:11.168 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc961caf640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc95c0b3900 0x7fc95c0ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.168 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc961caf640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc95c15a630 0x7fc95c14e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.168 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc961caf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc95c15aa10 0x7fc95c14e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.168 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc961caf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc95c072300 con 0x7fc95c15aa10 2024-05-14T01:23:11.168 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc961caf640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc95c06eeb0 con 0x7fc95c0b3900 2024-05-14T01:23:11.168 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc961caf640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc95c072480 con 0x7fc95c15a630 2024-05-14T01:23:11.168 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc95affd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc95c15a630 0x7fc95c14e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc95b7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc95c0b3900 0x7fc95c0ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc95affd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc95c15a630 0x7fc95c14e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:52450/0 (socket says 172.21.15.176:52450) 2024-05-14T01:23:11.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc95affd640 1 -- 172.21.15.176:0/602804927 learned_addr learned my addr 172.21.15.176:0/602804927 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-14T01:23:11.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc95b7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc95c0b3900 0x7fc95c0ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:47058/0 (socket says 172.21.15.176:47058) 2024-05-14T01:23:11.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc95bfff640 1 --2- 172.21.15.176:0/602804927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc95c15aa10 0x7fc95c14e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc95affd640 1 -- 172.21.15.176:0/602804927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc95c0b3900 msgr2=0x7fc95c0ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc95affd640 1 --2- 172.21.15.176:0/602804927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc95c0b3900 0x7fc95c0ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc95affd640 1 -- 172.21.15.176:0/602804927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc95c15aa10 msgr2=0x7fc95c14e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc95affd640 1 --2- 172.21.15.176:0/602804927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc95c15aa10 0x7fc95c14e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc95affd640 1 -- 172.21.15.176:0/602804927 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95c0cd2d0 con 0x7fc95c15a630 2024-05-14T01:23:11.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc95bfff640 1 --2- 172.21.15.176:0/602804927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc95c15aa10 0x7fc95c14e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:23:11.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc95b7fe640 1 --2- 172.21.15.176:0/602804927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc95c0b3900 0x7fc95c0ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:23:11.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc95affd640 1 --2- 172.21.15.176:0/602804927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc95c15a630 0x7fc95c14e340 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc95000c520 tx=0x7fc95000c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:11.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc943fff640 1 -- 172.21.15.176:0/602804927 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950017070 con 0x7fc95c15a630 2024-05-14T01:23:11.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc943fff640 1 -- 172.21.15.176:0/602804927 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc950006480 con 0x7fc95c15a630 2024-05-14T01:23:11.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc961caf640 1 -- 172.21.15.176:0/602804927 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc95c0cd5b0 con 0x7fc95c15a630 2024-05-14T01:23:11.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc943fff640 1 -- 172.21.15.176:0/602804927 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950004a10 con 0x7fc95c15a630 2024-05-14T01:23:11.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc961caf640 1 -- 172.21.15.176:0/602804927 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc95c0cdb70 con 0x7fc95c15a630 2024-05-14T01:23:11.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc943fff640 1 -- 172.21.15.176:0/602804927 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc95001a070 con 0x7fc95c15a630 2024-05-14T01:23:11.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc943fff640 1 -- 172.21.15.176:0/602804927 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fc950012740 con 0x7fc95c15a630 2024-05-14T01:23:11.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.183+0000 7fc961caf640 1 -- 172.21.15.176:0/602804927 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc95c068360 con 0x7fc95c15a630 2024-05-14T01:23:11.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.187+0000 7fc943fff640 1 -- 172.21.15.176:0/602804927 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc950021020 con 0x7fc95c15a630 2024-05-14T01:23:11.239 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:11.251+0000 7fe1714db180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T01:23:11.239 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.255+0000 7fc961caf640 1 -- 172.21.15.176:0/602804927 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1bb2b6f1-d560-4244-88f8-d99ce0e30e7f", "id": 0} v 0) -- 0x7fc95c0b4640 con 0x7fc95c15a630 2024-05-14T01:23:11.247 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.263+0000 7fc943fff640 1 -- 172.21.15.176:0/602804927 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1bb2b6f1-d560-4244-88f8-d99ce0e30e7f", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fc950004d00 con 0x7fc95c15a630 2024-05-14T01:23:11.247 INFO:teuthology.orchestra.run.smithi176.stdout:0 2024-05-14T01:23:11.248 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.263+0000 7fc961caf640 1 -- 172.21.15.176:0/602804927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc95c15a630 msgr2=0x7fc95c14e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.248 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.263+0000 7fc961caf640 1 --2- 172.21.15.176:0/602804927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc95c15a630 0x7fc95c14e340 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc95000c520 tx=0x7fc95000c9e0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.248 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.263+0000 7fc961caf640 1 -- 172.21.15.176:0/602804927 shutdown_connections 2024-05-14T01:23:11.249 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.263+0000 7fc961caf640 1 --2- 172.21.15.176:0/602804927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc95c15aa10 0x7fc95c14e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.249 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.263+0000 7fc961caf640 1 --2- 172.21.15.176:0/602804927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc95c15a630 0x7fc95c14e340 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.249 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.263+0000 7fc961caf640 1 --2- 172.21.15.176:0/602804927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc95c0b3900 0x7fc95c0ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.249 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.263+0000 7fc961caf640 1 -- 172.21.15.176:0/602804927 >> 172.21.15.176:0/602804927 conn(0x7fc95c0b21b0 msgr2=0x7fc95c0b0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:11.249 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.263+0000 7fc961caf640 1 -- 172.21.15.176:0/602804927 shutdown_connections 2024-05-14T01:23:11.249 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.263+0000 7fc961caf640 1 -- 172.21.15.176:0/602804927 wait complete. 2024-05-14T01:23:11.265 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 2af40f44-8490-45f0-9471-5d348625a2bf 1 2024-05-14T01:23:11.324 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:11.339+0000 7fdb485fd180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T01:23:11.385 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.399+0000 7fc65fb33640 1 Processor -- start 2024-05-14T01:23:11.385 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.399+0000 7fc65fb33640 1 -- start start 2024-05-14T01:23:11.388 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65fb33640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc6580d02a0 0x7fc6580d0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.388 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65fb33640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6580b3fc0 con 0x7fc658143340 2024-05-14T01:23:11.388 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65fb33640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc658161f00 con 0x7fc658143720 2024-05-14T01:23:11.388 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65fb33640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc658161cb0 con 0x7fc6580d02a0 2024-05-14T01:23:11.388 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65e0d0640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fc658143720 0x7fc658143b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:45546/0 (socket says 172.21.15.176:45546) 2024-05-14T01:23:11.388 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65e0d0640 1 -- 172.21.15.176:0/631869051 learned_addr learned my addr 172.21.15.176:0/631869051 (peer_addr_for_me v1:172.21.15.176:0/0) 2024-05-14T01:23:11.388 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65d0ce640 1 --2- 172.21.15.176:0/631869051 >> v2:172.21.15.154:3300/0 conn(0x7fc6580d02a0 0x7fc6580d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.388 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65c8cd640 1 -- 172.21.15.176:0/631869051 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 139297506 0 0) 0x7fc658161f00 con 0x7fc658143720 2024-05-14T01:23:11.389 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65c8cd640 1 -- 172.21.15.176:0/631869051 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc644003530 con 0x7fc658143720 2024-05-14T01:23:11.389 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65c8cd640 1 -- 172.21.15.176:0/631869051 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2790707712 0 0) 0x7fc644003530 con 0x7fc658143720 2024-05-14T01:23:11.389 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65c8cd640 1 -- 172.21.15.176:0/631869051 >> v2:172.21.15.154:3300/0 conn(0x7fc6580d02a0 msgr2=0x7fc6580d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:11.389 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65c8cd640 1 --2- 172.21.15.176:0/631869051 >> v2:172.21.15.154:3300/0 conn(0x7fc6580d02a0 0x7fc6580d0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.389 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65c8cd640 1 -- 172.21.15.176:0/631869051 >> v1:172.21.15.154:6789/0 conn(0x7fc658143340 legacy=0x7fc6580b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.389 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65c8cd640 1 -- 172.21.15.176:0/631869051 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6581621e0 con 0x7fc658143720 2024-05-14T01:23:11.389 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65c8cd640 1 -- 172.21.15.176:0/631869051 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fc650001a00 con 0x7fc658143720 2024-05-14T01:23:11.389 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65c8cd640 1 -- 172.21.15.176:0/631869051 >> v1:172.21.15.176:6789/0 conn(0x7fc658143720 legacy=0x7fc658143b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.389 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65c8cd640 1 --2- 172.21.15.176:0/631869051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6440039c0 0x7fc644003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.389 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65c8cd640 1 --2- 172.21.15.176:0/631869051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc644004810 0x7fc644004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.389 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65c8cd640 1 --2- 172.21.15.176:0/631869051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6440051d0 0x7fc64400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.389 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65c8cd640 1 -- 172.21.15.176:0/631869051 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc658161cb0 con 0x7fc644004810 2024-05-14T01:23:11.389 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65c8cd640 1 -- 172.21.15.176:0/631869051 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc64400c170 con 0x7fc6440039c0 2024-05-14T01:23:11.389 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65c8cd640 1 -- 172.21.15.176:0/631869051 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc64400c370 con 0x7fc6440051d0 2024-05-14T01:23:11.390 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65e0d0640 1 --2- 172.21.15.176:0/631869051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6440051d0 0x7fc64400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.390 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65d0ce640 1 --2- 172.21.15.176:0/631869051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc644004810 0x7fc644004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.390 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65d8cf640 1 --2- 172.21.15.176:0/631869051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6440039c0 0x7fc644003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.390 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65e0d0640 1 -- 172.21.15.176:0/631869051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6440039c0 msgr2=0x7fc644003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:11.390 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65e0d0640 1 --2- 172.21.15.176:0/631869051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6440039c0 0x7fc644003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.390 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65e0d0640 1 -- 172.21.15.176:0/631869051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc644004810 msgr2=0x7fc644004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:11.390 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65e0d0640 1 --2- 172.21.15.176:0/631869051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc644004810 0x7fc644004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.390 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65e0d0640 1 -- 172.21.15.176:0/631869051 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc644003530 con 0x7fc6440051d0 2024-05-14T01:23:11.391 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65e0d0640 1 -- 172.21.15.176:0/631869051 reap_dead start 2024-05-14T01:23:11.391 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.403+0000 7fc65e0d0640 1 --2- 172.21.15.176:0/631869051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6440051d0 0x7fc64400b9d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc65000a850 tx=0x7fc65001d350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76d43da574e74479 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:11.392 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.407+0000 7fc65c8cd640 1 -- 172.21.15.176:0/631869051 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65000a4a0 con 0x7fc6440051d0 2024-05-14T01:23:11.392 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.407+0000 7fc65c8cd640 1 -- 172.21.15.176:0/631869051 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6500ad650 con 0x7fc6440051d0 2024-05-14T01:23:11.392 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.407+0000 7fc65c8cd640 1 -- 172.21.15.176:0/631869051 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6500ada40 con 0x7fc6440051d0 2024-05-14T01:23:11.392 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.407+0000 7fc65fb33640 1 -- 172.21.15.176:0/631869051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6440051d0 msgr2=0x7fc64400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.392 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.407+0000 7fc65fb33640 1 --2- 172.21.15.176:0/631869051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6440051d0 0x7fc64400b9d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc65000a850 tx=0x7fc65001d350 comp rx=0 tx=0).stop 2024-05-14T01:23:11.392 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.407+0000 7fc65fb33640 1 -- 172.21.15.176:0/631869051 shutdown_connections 2024-05-14T01:23:11.392 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.407+0000 7fc65fb33640 1 --2- 172.21.15.176:0/631869051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6440051d0 0x7fc64400b9d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.392 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.407+0000 7fc65fb33640 1 -- 172.21.15.176:0/631869051 >> 172.21.15.176:0/631869051 conn(0x7fc6580b21b0 msgr2=0x7fc6580b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:11.392 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.407+0000 7fc65fb33640 1 -- 172.21.15.176:0/631869051 shutdown_connections 2024-05-14T01:23:11.392 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.407+0000 7fc65fb33640 1 -- 172.21.15.176:0/631869051 wait complete. 2024-05-14T01:23:11.393 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.407+0000 7fc65fb33640 1 Processor -- start 2024-05-14T01:23:11.393 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.407+0000 7fc65fb33640 1 -- start start 2024-05-14T01:23:11.396 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65fb33640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6440051d0 0x7fc6581553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.396 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65fb33640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc658140720 0x7fc65806b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.396 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65fb33640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc65806bb30 0x7fc65815a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.396 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65fb33640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc6580b3dd0 con 0x7fc65806bb30 2024-05-14T01:23:11.396 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65fb33640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc658162bd0 con 0x7fc658140720 2024-05-14T01:23:11.396 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65fb33640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc6580d06b0 con 0x7fc6440051d0 2024-05-14T01:23:11.396 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65d8cf640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6440051d0 0x7fc6581553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.396 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65d8cf640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6440051d0 0x7fc6581553e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:52470/0 (socket says 172.21.15.176:52470) 2024-05-14T01:23:11.396 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65d0ce640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc658140720 0x7fc65806b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.396 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65d8cf640 1 -- 172.21.15.176:0/375276685 learned_addr learned my addr 172.21.15.176:0/375276685 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-14T01:23:11.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65e0d0640 1 --2- 172.21.15.176:0/375276685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc65806bb30 0x7fc65815a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65d0ce640 1 -- 172.21.15.176:0/375276685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6440051d0 msgr2=0x7fc6581553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65d0ce640 1 --2- 172.21.15.176:0/375276685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6440051d0 0x7fc6581553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65d0ce640 1 -- 172.21.15.176:0/375276685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc65806bb30 msgr2=0x7fc65815a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65d0ce640 1 --2- 172.21.15.176:0/375276685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc65806bb30 0x7fc65815a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65d0ce640 1 -- 172.21.15.176:0/375276685 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc658142ea0 con 0x7fc658140720 2024-05-14T01:23:11.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65e0d0640 1 --2- 172.21.15.176:0/375276685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc65806bb30 0x7fc65815a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:23:11.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65d0ce640 1 --2- 172.21.15.176:0/375276685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc658140720 0x7fc65806b5f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc648011960 tx=0x7fc648011d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:11.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc64e7fc640 1 -- 172.21.15.176:0/375276685 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64800fa30 con 0x7fc658140720 2024-05-14T01:23:11.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc64e7fc640 1 -- 172.21.15.176:0/375276685 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc64800fbd0 con 0x7fc658140720 2024-05-14T01:23:11.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65fb33640 1 -- 172.21.15.176:0/375276685 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6580cfb80 con 0x7fc658140720 2024-05-14T01:23:11.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc64e7fc640 1 -- 172.21.15.176:0/375276685 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc648014440 con 0x7fc658140720 2024-05-14T01:23:11.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65fb33640 1 -- 172.21.15.176:0/375276685 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc65806db20 con 0x7fc658140720 2024-05-14T01:23:11.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc64e7fc640 1 -- 172.21.15.176:0/375276685 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc648012040 con 0x7fc658140720 2024-05-14T01:23:11.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc64e7fc640 1 -- 172.21.15.176:0/375276685 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fc64801d8d0 con 0x7fc658140720 2024-05-14T01:23:11.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.411+0000 7fc65fb33640 1 -- 172.21.15.176:0/375276685 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc658068360 con 0x7fc658140720 2024-05-14T01:23:11.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.415+0000 7fc64e7fc640 1 -- 172.21.15.176:0/375276685 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc64802b020 con 0x7fc658140720 2024-05-14T01:23:11.437 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:11.451+0000 7fe1714db180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T01:23:11.466 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.483+0000 7fc65fb33640 1 -- 172.21.15.176:0/375276685 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2af40f44-8490-45f0-9471-5d348625a2bf", "id": 1} v 0) -- 0x7fc658067930 con 0x7fc658140720 2024-05-14T01:23:11.471 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.487+0000 7fc64e7fc640 1 -- 172.21.15.176:0/375276685 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2af40f44-8490-45f0-9471-5d348625a2bf", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fc648019030 con 0x7fc658140720 2024-05-14T01:23:11.472 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-05-14T01:23:11.473 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.487+0000 7fc65fb33640 1 -- 172.21.15.176:0/375276685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc658140720 msgr2=0x7fc65806b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.473 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.487+0000 7fc65fb33640 1 --2- 172.21.15.176:0/375276685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc658140720 0x7fc65806b5f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc648011960 tx=0x7fc648011d60 comp rx=0 tx=0).stop 2024-05-14T01:23:11.473 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.487+0000 7fc65fb33640 1 -- 172.21.15.176:0/375276685 shutdown_connections 2024-05-14T01:23:11.473 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.487+0000 7fc65fb33640 1 --2- 172.21.15.176:0/375276685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc65806bb30 0x7fc65815a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.473 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.487+0000 7fc65fb33640 1 --2- 172.21.15.176:0/375276685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc658140720 0x7fc65806b5f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.473 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.487+0000 7fc65fb33640 1 --2- 172.21.15.176:0/375276685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6440051d0 0x7fc6581553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.473 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.487+0000 7fc65fb33640 1 -- 172.21.15.176:0/375276685 >> 172.21.15.176:0/375276685 conn(0x7fc6580b21b0 msgr2=0x7fc65815dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:11.474 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.487+0000 7fc65fb33640 1 -- 172.21.15.176:0/375276685 shutdown_connections 2024-05-14T01:23:11.474 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.487+0000 7fc65fb33640 1 -- 172.21.15.176:0/375276685 wait complete. 2024-05-14T01:23:11.490 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new eed269d0-e759-492e-adb4-b1d0cc90550c 2 2024-05-14T01:23:11.566 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:11.579+0000 7fdb485fd180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T01:23:11.614 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.627+0000 7f76a3092640 1 Processor -- start 2024-05-14T01:23:11.614 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.627+0000 7f76a3092640 1 -- start start 2024-05-14T01:23:11.616 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76a3092640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f769c151c30 0x7f769c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.616 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76a3092640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c06f8b0 0x7f769c15ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.616 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76a3092640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f769c0ced80 con 0x7f769c15e8c0 2024-05-14T01:23:11.616 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76a3092640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f769c15f260 con 0x7f769c151c30 2024-05-14T01:23:11.616 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76a3092640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f769c0cfc60 con 0x7f769c06f8b0 2024-05-14T01:23:11.616 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76a162f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c06f8b0 0x7f769c15ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.616 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76a162f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c06f8b0 0x7f769c15ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:52474/0 (socket says 172.21.15.176:52474) 2024-05-14T01:23:11.616 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76a162f640 1 -- 172.21.15.176:0/4286250998 learned_addr learned my addr 172.21.15.176:0/4286250998 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-14T01:23:11.616 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76a0e2e640 1 --2- 172.21.15.176:0/4286250998 >> v2:172.21.15.154:3300/0 conn(0x7f769c151c30 0x7f769c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.616 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76937fe640 1 -- 172.21.15.176:0/4286250998 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 912134073 0 0) 0x7f769c0ced80 con 0x7f769c15e8c0 2024-05-14T01:23:11.616 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76937fe640 1 -- 172.21.15.176:0/4286250998 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7684003530 con 0x7f769c15e8c0 2024-05-14T01:23:11.617 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76a162f640 1 -- 172.21.15.176:0/4286250998 >> v2:172.21.15.154:3300/0 conn(0x7f769c151c30 msgr2=0x7f769c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:11.617 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76a162f640 1 --2- 172.21.15.176:0/4286250998 >> v2:172.21.15.154:3300/0 conn(0x7f769c151c30 0x7f769c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.617 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76a162f640 1 -- 172.21.15.176:0/4286250998 >> v1:172.21.15.176:6789/0 conn(0x7f769c15e8c0 legacy=0x7f769c15b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.617 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76a162f640 1 -- 172.21.15.176:0/4286250998 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c0cf050 con 0x7f769c06f8b0 2024-05-14T01:23:11.617 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76a162f640 1 --2- 172.21.15.176:0/4286250998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c06f8b0 0x7f769c15ed20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f769400d150 tx=0x7f769401ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e97c62a824743e32 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:11.618 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76937fe640 1 -- 172.21.15.176:0/4286250998 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76940a7cd0 con 0x7f769c06f8b0 2024-05-14T01:23:11.618 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76937fe640 1 -- 172.21.15.176:0/4286250998 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769400b0d0 con 0x7f769c06f8b0 2024-05-14T01:23:11.618 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.631+0000 7f76937fe640 1 -- 172.21.15.176:0/4286250998 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694009600 con 0x7f769c06f8b0 2024-05-14T01:23:11.619 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a3092640 1 -- 172.21.15.176:0/4286250998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c06f8b0 msgr2=0x7f769c15ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.619 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a3092640 1 --2- 172.21.15.176:0/4286250998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c06f8b0 0x7f769c15ed20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f769400d150 tx=0x7f769401ec00 comp rx=0 tx=0).stop 2024-05-14T01:23:11.619 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a3092640 1 -- 172.21.15.176:0/4286250998 shutdown_connections 2024-05-14T01:23:11.619 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a3092640 1 --2- 172.21.15.176:0/4286250998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c06f8b0 0x7f769c15ed20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.619 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a3092640 1 --2- 172.21.15.176:0/4286250998 >> v2:172.21.15.154:3300/0 conn(0x7f769c151c30 0x7f769c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.619 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a3092640 1 -- 172.21.15.176:0/4286250998 >> 172.21.15.176:0/4286250998 conn(0x7f769c0cd6f0 msgr2=0x7f769c0cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:11.619 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a3092640 1 -- 172.21.15.176:0/4286250998 shutdown_connections 2024-05-14T01:23:11.619 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a3092640 1 -- 172.21.15.176:0/4286250998 wait complete. 2024-05-14T01:23:11.620 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a3092640 1 Processor -- start 2024-05-14T01:23:11.620 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a3092640 1 -- start start 2024-05-14T01:23:11.622 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a3092640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f769c06f8b0 0x7f769c14ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.622 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a3092640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c151c30 0x7f769c1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.622 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a3092640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c15e8c0 0x7f769c154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.622 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a3092640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f769c152190 con 0x7f769c151c30 2024-05-14T01:23:11.622 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a3092640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f769c152010 con 0x7f769c06f8b0 2024-05-14T01:23:11.623 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a3092640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f769c074280 con 0x7f769c15e8c0 2024-05-14T01:23:11.623 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a0e2e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f769c06f8b0 0x7f769c14ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.623 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a0e2e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f769c06f8b0 0x7f769c14ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:47092/0 (socket says 172.21.15.176:47092) 2024-05-14T01:23:11.623 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a162f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c15e8c0 0x7f769c154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.623 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a0e2e640 1 -- 172.21.15.176:0/960256514 learned_addr learned my addr 172.21.15.176:0/960256514 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-14T01:23:11.623 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f7693fff640 1 --2- 172.21.15.176:0/960256514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c151c30 0x7f769c1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.623 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a0e2e640 1 -- 172.21.15.176:0/960256514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c15e8c0 msgr2=0x7f769c154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.623 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a0e2e640 1 --2- 172.21.15.176:0/960256514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c15e8c0 0x7f769c154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.623 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a0e2e640 1 -- 172.21.15.176:0/960256514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c151c30 msgr2=0x7f769c1548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.623 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a0e2e640 1 --2- 172.21.15.176:0/960256514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c151c30 0x7f769c1548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.623 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a0e2e640 1 -- 172.21.15.176:0/960256514 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c0c49b0 con 0x7f769c06f8b0 2024-05-14T01:23:11.623 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a162f640 1 --2- 172.21.15.176:0/960256514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c15e8c0 0x7f769c154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:23:11.624 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a0e2e640 1 --2- 172.21.15.176:0/960256514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f769c06f8b0 0x7f769c14ac50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f769800e9b0 tx=0x7f769800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:11.624 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76917fa640 1 -- 172.21.15.176:0/960256514 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7698017070 con 0x7f769c06f8b0 2024-05-14T01:23:11.624 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76917fa640 1 -- 172.21.15.176:0/960256514 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769800c9a0 con 0x7f769c06f8b0 2024-05-14T01:23:11.624 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a3092640 1 -- 172.21.15.176:0/960256514 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f769c0c4c90 con 0x7f769c06f8b0 2024-05-14T01:23:11.624 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76917fa640 1 -- 172.21.15.176:0/960256514 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769800cd70 con 0x7f769c06f8b0 2024-05-14T01:23:11.624 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76a3092640 1 -- 172.21.15.176:0/960256514 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f769c0c5250 con 0x7f769c06f8b0 2024-05-14T01:23:11.624 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76917fa640 1 -- 172.21.15.176:0/960256514 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f769801a070 con 0x7f769c06f8b0 2024-05-14T01:23:11.624 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.635+0000 7f76917fa640 1 -- 172.21.15.176:0/960256514 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f7698006660 con 0x7f769c06f8b0 2024-05-14T01:23:11.625 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.639+0000 7f76a3092640 1 -- 172.21.15.176:0/960256514 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f769c067cd0 con 0x7f769c06f8b0 2024-05-14T01:23:11.625 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.639+0000 7f76917fa640 1 -- 172.21.15.176:0/960256514 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7698006020 con 0x7f769c06f8b0 2024-05-14T01:23:11.693 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.707+0000 7f76a3092640 1 -- 172.21.15.176:0/960256514 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "eed269d0-e759-492e-adb4-b1d0cc90550c", "id": 2} v 0) -- 0x7f769c068360 con 0x7f769c06f8b0 2024-05-14T01:23:11.700 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.715+0000 7f76917fa640 1 -- 172.21.15.176:0/960256514 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eed269d0-e759-492e-adb4-b1d0cc90550c", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f76980059a0 con 0x7f769c06f8b0 2024-05-14T01:23:11.700 INFO:teuthology.orchestra.run.smithi176.stdout:2 2024-05-14T01:23:11.701 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.715+0000 7f76a3092640 1 -- 172.21.15.176:0/960256514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f769c06f8b0 msgr2=0x7f769c14ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.701 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.715+0000 7f76a3092640 1 --2- 172.21.15.176:0/960256514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f769c06f8b0 0x7f769c14ac50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f769800e9b0 tx=0x7f769800ee70 comp rx=0 tx=0).stop 2024-05-14T01:23:11.701 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.715+0000 7f76a3092640 1 -- 172.21.15.176:0/960256514 shutdown_connections 2024-05-14T01:23:11.701 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.715+0000 7f76a3092640 1 --2- 172.21.15.176:0/960256514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c15e8c0 0x7f769c154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.702 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.715+0000 7f76a3092640 1 --2- 172.21.15.176:0/960256514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c151c30 0x7f769c1548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.702 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.715+0000 7f76a3092640 1 --2- 172.21.15.176:0/960256514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f769c06f8b0 0x7f769c14ac50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.702 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.715+0000 7f76a3092640 1 -- 172.21.15.176:0/960256514 >> 172.21.15.176:0/960256514 conn(0x7f769c0cd6f0 msgr2=0x7f769c0d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:11.702 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.715+0000 7f76a3092640 1 -- 172.21.15.176:0/960256514 shutdown_connections 2024-05-14T01:23:11.702 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.715+0000 7f76a3092640 1 -- 172.21.15.176:0/960256514 wait complete. 2024-05-14T01:23:11.723 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 9dae72b4-5aba-4b16-b66a-fc6f8585ae22 3 2024-05-14T01:23:11.845 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.859+0000 7fb6b005f640 1 Processor -- start 2024-05-14T01:23:11.845 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.859+0000 7fb6b005f640 1 -- start start 2024-05-14T01:23:11.847 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.859+0000 7fb6b005f640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb6a815aca0 0x7fb6a806d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.847 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.859+0000 7fb6b005f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6a80b4e00 0x7fb6a806ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.847 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.859+0000 7fb6b005f640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a80b3fd0 con 0x7fb6a806f2d0 2024-05-14T01:23:11.847 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.859+0000 7fb6b005f640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb6a806e900 con 0x7fb6a815aca0 2024-05-14T01:23:11.847 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.859+0000 7fb6b005f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb6a806dcf0 con 0x7fb6a80b4e00 2024-05-14T01:23:11.847 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.859+0000 7fb6addfb640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb6a815aca0 0x7fb6a806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.847 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.859+0000 7fb6ae5fc640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fb6a806f2d0 0x7fb6a80716b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:45562/0 (socket says 172.21.15.176:45562) 2024-05-14T01:23:11.847 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.859+0000 7fb6ae5fc640 1 -- 172.21.15.176:0/2980116797 learned_addr learned my addr 172.21.15.176:0/2980116797 (peer_addr_for_me v1:172.21.15.176:0/0) 2024-05-14T01:23:11.847 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6ad5fa640 1 --2- 172.21.15.176:0/2980116797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6a80b4e00 0x7fb6a806ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.847 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6acdf9640 1 -- 172.21.15.176:0/2980116797 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 938894484 0 0) 0x7fb6a80b3fd0 con 0x7fb6a806f2d0 2024-05-14T01:23:11.847 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6acdf9640 1 -- 172.21.15.176:0/2980116797 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb694003530 con 0x7fb6a806f2d0 2024-05-14T01:23:11.848 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6addfb640 1 -- 172.21.15.176:0/2980116797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6a80b4e00 msgr2=0x7fb6a806ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:11.848 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6addfb640 1 --2- 172.21.15.176:0/2980116797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6a80b4e00 0x7fb6a806ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.848 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6addfb640 1 -- 172.21.15.176:0/2980116797 >> v1:172.21.15.176:6789/0 conn(0x7fb6a806f2d0 legacy=0x7fb6a80716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.848 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6addfb640 1 -- 172.21.15.176:0/2980116797 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a806dfd0 con 0x7fb6a815aca0 2024-05-14T01:23:11.849 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6addfb640 1 --2- 172.21.15.176:0/2980116797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6a815aca0 0x7fb6a806d710 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb6a00097c0 tx=0x7fb6a001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3846361cb1fd3868 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:11.849 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6acdf9640 1 -- 172.21.15.176:0/2980116797 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a00b2070 con 0x7fb6a815aca0 2024-05-14T01:23:11.849 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6acdf9640 1 -- 172.21.15.176:0/2980116797 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a00ad640 con 0x7fb6a815aca0 2024-05-14T01:23:11.849 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6acdf9640 1 -- 172.21.15.176:0/2980116797 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a00ada10 con 0x7fb6a815aca0 2024-05-14T01:23:11.850 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6b005f640 1 -- 172.21.15.176:0/2980116797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6a815aca0 msgr2=0x7fb6a806d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.850 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6b005f640 1 --2- 172.21.15.176:0/2980116797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6a815aca0 0x7fb6a806d710 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb6a00097c0 tx=0x7fb6a001c4a0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.850 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6b005f640 1 -- 172.21.15.176:0/2980116797 shutdown_connections 2024-05-14T01:23:11.850 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6b005f640 1 --2- 172.21.15.176:0/2980116797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6a80b4e00 0x7fb6a806ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.850 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6b005f640 1 --2- 172.21.15.176:0/2980116797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6a815aca0 0x7fb6a806d710 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.850 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6b005f640 1 -- 172.21.15.176:0/2980116797 >> 172.21.15.176:0/2980116797 conn(0x7fb6a80b21b0 msgr2=0x7fb6a80b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:11.850 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6b005f640 1 -- 172.21.15.176:0/2980116797 shutdown_connections 2024-05-14T01:23:11.850 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.863+0000 7fb6b005f640 1 -- 172.21.15.176:0/2980116797 wait complete. 2024-05-14T01:23:11.853 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6b005f640 1 Processor -- start 2024-05-14T01:23:11.853 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6b005f640 1 -- start start 2024-05-14T01:23:11.853 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6b005f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6a80b4e00 0x7fb6a80d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.853 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6b005f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6a815aca0 0x7fb6a80d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.854 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6b005f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6a815b360 0x7fb6a814ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:11.854 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6b005f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a80ce450 con 0x7fb6a80b4e00 2024-05-14T01:23:11.854 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6b005f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a80ce2d0 con 0x7fb6a815b360 2024-05-14T01:23:11.854 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6b005f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb6a8071dc0 con 0x7fb6a815aca0 2024-05-14T01:23:11.854 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6ad5fa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6a815aca0 0x7fb6a80d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.854 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6ae5fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6a815b360 0x7fb6a814ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.854 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6ad5fa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6a815aca0 0x7fb6a80d05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:52494/0 (socket says 172.21.15.176:52494) 2024-05-14T01:23:11.854 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6ad5fa640 1 -- 172.21.15.176:0/615851442 learned_addr learned my addr 172.21.15.176:0/615851442 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-14T01:23:11.854 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6addfb640 1 --2- 172.21.15.176:0/615851442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6a80b4e00 0x7fb6a80d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:11.855 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6ad5fa640 1 -- 172.21.15.176:0/615851442 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6a815b360 msgr2=0x7fb6a814ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.855 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6ad5fa640 1 --2- 172.21.15.176:0/615851442 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6a815b360 0x7fb6a814ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.855 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6ad5fa640 1 -- 172.21.15.176:0/615851442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6a80b4e00 msgr2=0x7fb6a80d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.855 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6ad5fa640 1 --2- 172.21.15.176:0/615851442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6a80b4e00 0x7fb6a80d00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.855 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6ad5fa640 1 -- 172.21.15.176:0/615851442 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a815b7f0 con 0x7fb6a815aca0 2024-05-14T01:23:11.855 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6addfb640 1 --2- 172.21.15.176:0/615851442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6a80b4e00 0x7fb6a80d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:11.855 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6ad5fa640 1 --2- 172.21.15.176:0/615851442 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6a815aca0 0x7fb6a80d05e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb69800e960 tx=0x7fb69800ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:11.855 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb69e7fc640 1 -- 172.21.15.176:0/615851442 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb698017070 con 0x7fb6a815aca0 2024-05-14T01:23:11.855 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb69e7fc640 1 -- 172.21.15.176:0/615851442 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69800ca00 con 0x7fb6a815aca0 2024-05-14T01:23:11.855 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6b005f640 1 -- 172.21.15.176:0/615851442 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a815bad0 con 0x7fb6a815aca0 2024-05-14T01:23:11.856 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb69e7fc640 1 -- 172.21.15.176:0/615851442 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69800cdb0 con 0x7fb6a815aca0 2024-05-14T01:23:11.856 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6b005f640 1 -- 172.21.15.176:0/615851442 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6a815c090 con 0x7fb6a815aca0 2024-05-14T01:23:11.856 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb69e7fc640 1 -- 172.21.15.176:0/615851442 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb69801a070 con 0x7fb6a815aca0 2024-05-14T01:23:11.857 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb6b005f640 1 -- 172.21.15.176:0/615851442 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6a8068360 con 0x7fb6a815aca0 2024-05-14T01:23:11.857 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.867+0000 7fb69e7fc640 1 -- 172.21.15.176:0/615851442 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fb698013900 con 0x7fb6a815aca0 2024-05-14T01:23:11.857 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.871+0000 7fb69e7fc640 1 -- 172.21.15.176:0/615851442 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb698013470 con 0x7fb6a815aca0 2024-05-14T01:23:11.924 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.939+0000 7fb6b005f640 1 -- 172.21.15.176:0/615851442 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9dae72b4-5aba-4b16-b66a-fc6f8585ae22", "id": 3} v 0) -- 0x7fb6a806c690 con 0x7fb6a815aca0 2024-05-14T01:23:11.931 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.947+0000 7fb69e7fc640 1 -- 172.21.15.176:0/615851442 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9dae72b4-5aba-4b16-b66a-fc6f8585ae22", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fb6980059a0 con 0x7fb6a815aca0 2024-05-14T01:23:11.932 INFO:teuthology.orchestra.run.smithi176.stdout:3 2024-05-14T01:23:11.933 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.947+0000 7fb6b005f640 1 -- 172.21.15.176:0/615851442 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6a815aca0 msgr2=0x7fb6a80d05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:11.933 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.947+0000 7fb6b005f640 1 --2- 172.21.15.176:0/615851442 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6a815aca0 0x7fb6a80d05e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb69800e960 tx=0x7fb69800ee20 comp rx=0 tx=0).stop 2024-05-14T01:23:11.933 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.947+0000 7fb6b005f640 1 -- 172.21.15.176:0/615851442 shutdown_connections 2024-05-14T01:23:11.933 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.947+0000 7fb6b005f640 1 --2- 172.21.15.176:0/615851442 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6a815b360 0x7fb6a814ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.933 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.947+0000 7fb6b005f640 1 --2- 172.21.15.176:0/615851442 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6a815aca0 0x7fb6a80d05e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.933 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.947+0000 7fb6b005f640 1 --2- 172.21.15.176:0/615851442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6a80b4e00 0x7fb6a80d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:11.933 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.947+0000 7fb6b005f640 1 -- 172.21.15.176:0/615851442 >> 172.21.15.176:0/615851442 conn(0x7fb6a80b21b0 msgr2=0x7fb6a80b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:11.933 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.947+0000 7fb6b005f640 1 -- 172.21.15.176:0/615851442 shutdown_connections 2024-05-14T01:23:11.934 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:11.947+0000 7fb6b005f640 1 -- 172.21.15.176:0/615851442 wait complete. 2024-05-14T01:23:11.949 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new a39bb975-8482-4309-b709-9eae6f0e8eb3 4 2024-05-14T01:23:11.993 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:12.007+0000 7fe1714db180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T01:23:12.047 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:12.063+0000 7fe1714db180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T01:23:12.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.079+0000 7f0bd65db640 1 Processor -- start 2024-05-14T01:23:12.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.079+0000 7f0bd65db640 1 -- start start 2024-05-14T01:23:12.067 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd65db640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0bd006d710 0x7f0bd00b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.067 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd65db640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bd00716b0 0x7f0bd0071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.067 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd65db640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bd00b3fd0 con 0x7f0bd015aca0 2024-05-14T01:23:12.067 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd65db640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0bd006e900 con 0x7f0bd006d710 2024-05-14T01:23:12.067 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd65db640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0bd0072000 con 0x7f0bd00716b0 2024-05-14T01:23:12.067 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd4b78640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bd00716b0 0x7f0bd0071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.067 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd4b78640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bd00716b0 0x7f0bd0071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:33710/0 (socket says 172.21.15.176:33710) 2024-05-14T01:23:12.067 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd4b78640 1 -- 172.21.15.176:0/863987092 learned_addr learned my addr 172.21.15.176:0/863987092 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-14T01:23:12.067 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bcf7fe640 1 --2- 172.21.15.176:0/863987092 >> v2:172.21.15.154:3300/0 conn(0x7f0bd006d710 0x7f0bd00b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.067 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd4b78640 1 -- 172.21.15.176:0/863987092 >> v2:172.21.15.154:3300/0 conn(0x7f0bd006d710 msgr2=0x7f0bd00b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:12.067 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd4b78640 1 --2- 172.21.15.176:0/863987092 >> v2:172.21.15.154:3300/0 conn(0x7f0bd006d710 0x7f0bd00b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.067 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd4b78640 1 -- 172.21.15.176:0/863987092 >> v1:172.21.15.154:6789/0 conn(0x7f0bd015aca0 legacy=0x7f0bd006ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.067 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd4b78640 1 -- 172.21.15.176:0/863987092 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd006f4a0 con 0x7f0bd00716b0 2024-05-14T01:23:12.069 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd4b78640 1 --2- 172.21.15.176:0/863987092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bd00716b0 0x7f0bd0071ac0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0009e50 tx=0x7f0bc001ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91b798ae9235cef4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:12.069 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bceffd640 1 -- 172.21.15.176:0/863987092 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc00a57e0 con 0x7f0bd00716b0 2024-05-14T01:23:12.069 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bceffd640 1 -- 172.21.15.176:0/863987092 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bc00a5980 con 0x7f0bd00716b0 2024-05-14T01:23:12.069 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bceffd640 1 -- 172.21.15.176:0/863987092 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc00a5d50 con 0x7f0bd00716b0 2024-05-14T01:23:12.070 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd65db640 1 -- 172.21.15.176:0/863987092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bd00716b0 msgr2=0x7f0bd0071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.070 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd65db640 1 --2- 172.21.15.176:0/863987092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bd00716b0 0x7f0bd0071ac0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0009e50 tx=0x7f0bc001ca00 comp rx=0 tx=0).stop 2024-05-14T01:23:12.070 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd65db640 1 -- 172.21.15.176:0/863987092 shutdown_connections 2024-05-14T01:23:12.070 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd65db640 1 --2- 172.21.15.176:0/863987092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bd00716b0 0x7f0bd0071ac0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.070 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd65db640 1 --2- 172.21.15.176:0/863987092 >> v2:172.21.15.154:3300/0 conn(0x7f0bd006d710 0x7f0bd00b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.070 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd65db640 1 -- 172.21.15.176:0/863987092 >> 172.21.15.176:0/863987092 conn(0x7f0bd00b21b0 msgr2=0x7f0bd00b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:12.070 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd65db640 1 -- 172.21.15.176:0/863987092 shutdown_connections 2024-05-14T01:23:12.070 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.083+0000 7f0bd65db640 1 -- 172.21.15.176:0/863987092 wait complete. 2024-05-14T01:23:12.071 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bd65db640 1 Processor -- start 2024-05-14T01:23:12.071 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bd65db640 1 -- start start 2024-05-14T01:23:12.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bd65db640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bd006d710 0x7f0bd014d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bd65db640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bd00716b0 0x7f0bd01540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bd65db640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bd015aca0 0x7f0bd00ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bd65db640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd015b080 con 0x7f0bd015aca0 2024-05-14T01:23:12.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bd65db640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd006e590 con 0x7f0bd006d710 2024-05-14T01:23:12.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bd65db640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0bd0167a50 con 0x7f0bd00716b0 2024-05-14T01:23:12.074 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bcf7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bd00716b0 0x7f0bd01540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.074 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bcf7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bd00716b0 0x7f0bd01540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:33722/0 (socket says 172.21.15.176:33722) 2024-05-14T01:23:12.074 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bcffff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bd006d710 0x7f0bd014d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.074 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bcf7fe640 1 -- 172.21.15.176:0/1002781657 learned_addr learned my addr 172.21.15.176:0/1002781657 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-14T01:23:12.074 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bd4b78640 1 --2- 172.21.15.176:0/1002781657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bd015aca0 0x7f0bd00ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.074 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bcf7fe640 1 -- 172.21.15.176:0/1002781657 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bd006d710 msgr2=0x7f0bd014d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.074 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bcf7fe640 1 --2- 172.21.15.176:0/1002781657 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bd006d710 0x7f0bd014d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.074 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bcf7fe640 1 -- 172.21.15.176:0/1002781657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bd015aca0 msgr2=0x7f0bd00ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.074 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bcf7fe640 1 --2- 172.21.15.176:0/1002781657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bd015aca0 0x7f0bd00ceda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.074 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bcf7fe640 1 -- 172.21.15.176:0/1002781657 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd014e200 con 0x7f0bd00716b0 2024-05-14T01:23:12.074 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bcf7fe640 1 --2- 172.21.15.176:0/1002781657 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bd00716b0 0x7f0bd01540c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8010b40 tx=0x7f0bb800e360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:12.074 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bccff9640 1 -- 172.21.15.176:0/1002781657 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb801e070 con 0x7f0bd00716b0 2024-05-14T01:23:12.074 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bccff9640 1 -- 172.21.15.176:0/1002781657 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb8011450 con 0x7f0bd00716b0 2024-05-14T01:23:12.075 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bd65db640 1 -- 172.21.15.176:0/1002781657 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd014e4e0 con 0x7f0bd00716b0 2024-05-14T01:23:12.075 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bccff9640 1 -- 172.21.15.176:0/1002781657 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8011800 con 0x7f0bd00716b0 2024-05-14T01:23:12.075 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bd65db640 1 -- 172.21.15.176:0/1002781657 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd014eaa0 con 0x7f0bd00716b0 2024-05-14T01:23:12.075 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bccff9640 1 -- 172.21.15.176:0/1002781657 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0bb8021070 con 0x7f0bd00716b0 2024-05-14T01:23:12.075 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bccff9640 1 -- 172.21.15.176:0/1002781657 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f0bb8006580 con 0x7f0bd00716b0 2024-05-14T01:23:12.075 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.087+0000 7f0bd65db640 1 -- 172.21.15.176:0/1002781657 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bd0068360 con 0x7f0bd00716b0 2024-05-14T01:23:12.075 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.091+0000 7f0bccff9640 1 -- 172.21.15.176:0/1002781657 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0bb8028070 con 0x7f0bd00716b0 2024-05-14T01:23:12.100 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:12.115+0000 7fe1714db180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T01:23:12.143 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.159+0000 7f0bd65db640 1 -- 172.21.15.176:0/1002781657 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a39bb975-8482-4309-b709-9eae6f0e8eb3", "id": 4} v 0) -- 0x7f0bd006c690 con 0x7f0bd00716b0 2024-05-14T01:23:12.149 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.163+0000 7f0bccff9640 1 -- 172.21.15.176:0/1002781657 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a39bb975-8482-4309-b709-9eae6f0e8eb3", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f0bb80119a0 con 0x7f0bd00716b0 2024-05-14T01:23:12.149 INFO:teuthology.orchestra.run.smithi176.stdout:4 2024-05-14T01:23:12.150 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.163+0000 7f0bd65db640 1 -- 172.21.15.176:0/1002781657 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bd00716b0 msgr2=0x7f0bd01540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.150 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.163+0000 7f0bd65db640 1 --2- 172.21.15.176:0/1002781657 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bd00716b0 0x7f0bd01540c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8010b40 tx=0x7f0bb800e360 comp rx=0 tx=0).stop 2024-05-14T01:23:12.150 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.163+0000 7f0bd65db640 1 -- 172.21.15.176:0/1002781657 shutdown_connections 2024-05-14T01:23:12.150 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.163+0000 7f0bd65db640 1 --2- 172.21.15.176:0/1002781657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bd015aca0 0x7f0bd00ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.150 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.163+0000 7f0bd65db640 1 --2- 172.21.15.176:0/1002781657 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bd00716b0 0x7f0bd01540c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.150 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.163+0000 7f0bd65db640 1 --2- 172.21.15.176:0/1002781657 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bd006d710 0x7f0bd014d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.150 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.163+0000 7f0bd65db640 1 -- 172.21.15.176:0/1002781657 >> 172.21.15.176:0/1002781657 conn(0x7f0bd00b21b0 msgr2=0x7f0bd00af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:12.150 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.163+0000 7f0bd65db640 1 -- 172.21.15.176:0/1002781657 shutdown_connections 2024-05-14T01:23:12.150 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.163+0000 7f0bd65db640 1 -- 172.21.15.176:0/1002781657 wait complete. 2024-05-14T01:23:12.166 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new d2078781-fe45-40b3-b4e4-3e692eb55436 5 2024-05-14T01:23:12.178 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:12.191+0000 7fe1714db180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T01:23:12.180 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:12.195+0000 7fdb485fd180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T01:23:12.230 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:12.243+0000 7fe1714db180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T01:23:12.237 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:12.251+0000 7fdb485fd180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T01:23:12.282 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.295+0000 7f731fb2d640 1 Processor -- start 2024-05-14T01:23:12.282 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.295+0000 7f731fb2d640 1 -- start start 2024-05-14T01:23:12.283 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.299+0000 7f731fb2d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f731815aca0 0x7f731806d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.283 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.299+0000 7f731fb2d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f73180b4e00 0x7f731806ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.283 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.299+0000 7f731fb2d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73180b3fd0 con 0x7f731806f2d0 2024-05-14T01:23:12.283 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.299+0000 7f731fb2d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f731806e900 con 0x7f73180b4e00 2024-05-14T01:23:12.283 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.299+0000 7f731fb2d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f731806dcf0 con 0x7f731815aca0 2024-05-14T01:23:12.284 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.299+0000 7f731d0c8640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f73180b4e00 0x7f731806ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.284 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.299+0000 7f731e0ca640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f731806f2d0 0x7f73180716b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:46968/0 (socket says 172.21.15.176:46968) 2024-05-14T01:23:12.284 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.299+0000 7f731e0ca640 1 -- 172.21.15.176:0/1537857808 learned_addr learned my addr 172.21.15.176:0/1537857808 (peer_addr_for_me v1:172.21.15.176:0/0) 2024-05-14T01:23:12.284 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.299+0000 7f731d8c9640 1 --2- 172.21.15.176:0/1537857808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f731815aca0 0x7f731806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.284 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.299+0000 7f731d0c8640 1 -- 172.21.15.176:0/1537857808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f731815aca0 msgr2=0x7f731806d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:12.284 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.299+0000 7f731d0c8640 1 --2- 172.21.15.176:0/1537857808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f731815aca0 0x7f731806d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.284 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.299+0000 7f731d0c8640 1 -- 172.21.15.176:0/1537857808 >> v1:172.21.15.176:6789/0 conn(0x7f731806f2d0 legacy=0x7f73180716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.284 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.299+0000 7f731d0c8640 1 -- 172.21.15.176:0/1537857808 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f731806dfd0 con 0x7f73180b4e00 2024-05-14T01:23:12.285 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.299+0000 7f731d0c8640 1 --2- 172.21.15.176:0/1537857808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73180b4e00 0x7f731806ed90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f73080097c0 tx=0x7f730801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6a46fc370bc218c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:12.285 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.299+0000 7f731c8c7640 1 -- 172.21.15.176:0/1537857808 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73080b2070 con 0x7f73180b4e00 2024-05-14T01:23:12.286 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.299+0000 7f731c8c7640 1 -- 172.21.15.176:0/1537857808 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73080ad640 con 0x7f73180b4e00 2024-05-14T01:23:12.286 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.299+0000 7f731c8c7640 1 -- 172.21.15.176:0/1537857808 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73080ada10 con 0x7f73180b4e00 2024-05-14T01:23:12.286 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731fb2d640 1 -- 172.21.15.176:0/1537857808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73180b4e00 msgr2=0x7f731806ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.287 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731fb2d640 1 --2- 172.21.15.176:0/1537857808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73180b4e00 0x7f731806ed90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f73080097c0 tx=0x7f730801c4a0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.287 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731fb2d640 1 -- 172.21.15.176:0/1537857808 shutdown_connections 2024-05-14T01:23:12.287 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731fb2d640 1 --2- 172.21.15.176:0/1537857808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73180b4e00 0x7f731806ed90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.287 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731fb2d640 1 --2- 172.21.15.176:0/1537857808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f731815aca0 0x7f731806d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.287 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731fb2d640 1 -- 172.21.15.176:0/1537857808 >> 172.21.15.176:0/1537857808 conn(0x7f73180b21b0 msgr2=0x7f73180b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:12.287 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731fb2d640 1 -- 172.21.15.176:0/1537857808 shutdown_connections 2024-05-14T01:23:12.287 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731fb2d640 1 -- 172.21.15.176:0/1537857808 wait complete. 2024-05-14T01:23:12.287 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731fb2d640 1 Processor -- start 2024-05-14T01:23:12.288 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731fb2d640 1 -- start start 2024-05-14T01:23:12.290 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731fb2d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73180b4e00 0x7f73181fab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.290 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731fb2d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731815aca0 0x7f73180ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.290 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731fb2d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73181f6b10 0x7f731814ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.290 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731fb2d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f73180ce450 con 0x7f731815aca0 2024-05-14T01:23:12.290 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731fb2d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f73180ce2d0 con 0x7f73181f6b10 2024-05-14T01:23:12.290 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731fb2d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7318071dc0 con 0x7f73180b4e00 2024-05-14T01:23:12.290 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731d8c9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73180b4e00 0x7f73181fab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.290 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731e0ca640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73181f6b10 0x7f731814ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.290 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731d8c9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73180b4e00 0x7f73181fab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:33744/0 (socket says 172.21.15.176:33744) 2024-05-14T01:23:12.291 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731d8c9640 1 -- 172.21.15.176:0/2083822816 learned_addr learned my addr 172.21.15.176:0/2083822816 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-14T01:23:12.291 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731d0c8640 1 --2- 172.21.15.176:0/2083822816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731815aca0 0x7f73180ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.291 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731d8c9640 1 -- 172.21.15.176:0/2083822816 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73181f6b10 msgr2=0x7f731814ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.291 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731d8c9640 1 --2- 172.21.15.176:0/2083822816 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73181f6b10 0x7f731814ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.291 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731d8c9640 1 -- 172.21.15.176:0/2083822816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731815aca0 msgr2=0x7f73180ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.291 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731d8c9640 1 --2- 172.21.15.176:0/2083822816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731815aca0 0x7f73180ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.291 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731d8c9640 1 -- 172.21.15.176:0/2083822816 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73180cec30 con 0x7f73180b4e00 2024-05-14T01:23:12.291 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731e0ca640 1 --2- 172.21.15.176:0/2083822816 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73181f6b10 0x7f731814ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:23:12.291 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731d8c9640 1 --2- 172.21.15.176:0/2083822816 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73180b4e00 0x7f73181fab20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f731400e8a0 tx=0x7f731400eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:12.291 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f730e7fc640 1 -- 172.21.15.176:0/2083822816 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314017070 con 0x7f73180b4e00 2024-05-14T01:23:12.291 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f730e7fc640 1 -- 172.21.15.176:0/2083822816 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731400c940 con 0x7f73180b4e00 2024-05-14T01:23:12.291 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f730e7fc640 1 -- 172.21.15.176:0/2083822816 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731400ccf0 con 0x7f73180b4e00 2024-05-14T01:23:12.291 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731fb2d640 1 -- 172.21.15.176:0/2083822816 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73180cef00 con 0x7f73180b4e00 2024-05-14T01:23:12.291 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f731fb2d640 1 -- 172.21.15.176:0/2083822816 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7318153f40 con 0x7f73180b4e00 2024-05-14T01:23:12.292 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f730e7fc640 1 -- 172.21.15.176:0/2083822816 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f731401a070 con 0x7f73180b4e00 2024-05-14T01:23:12.292 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.303+0000 7f730e7fc640 1 -- 172.21.15.176:0/2083822816 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f7314013470 con 0x7f73180b4e00 2024-05-14T01:23:12.292 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.307+0000 7f731fb2d640 1 -- 172.21.15.176:0/2083822816 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7318068360 con 0x7f73180b4e00 2024-05-14T01:23:12.292 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:12.307+0000 7fdb485fd180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T01:23:12.293 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.307+0000 7f730e7fc640 1 -- 172.21.15.176:0/2083822816 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7314006000 con 0x7f73180b4e00 2024-05-14T01:23:12.306 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:12.319+0000 7fe1714db180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T01:23:12.359 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:12.375+0000 7fe1714db180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T01:23:12.360 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.375+0000 7f731fb2d640 1 -- 172.21.15.176:0/2083822816 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d2078781-fe45-40b3-b4e4-3e692eb55436", "id": 5} v 0) -- 0x7f7318153cf0 con 0x7f73180b4e00 2024-05-14T01:23:12.368 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.383+0000 7f730e7fc640 1 -- 172.21.15.176:0/2083822816 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2078781-fe45-40b3-b4e4-3e692eb55436", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f7314006480 con 0x7f73180b4e00 2024-05-14T01:23:12.368 INFO:teuthology.orchestra.run.smithi176.stdout:5 2024-05-14T01:23:12.369 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.383+0000 7f731fb2d640 1 -- 172.21.15.176:0/2083822816 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73180b4e00 msgr2=0x7f73181fab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.369 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.383+0000 7f731fb2d640 1 --2- 172.21.15.176:0/2083822816 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73180b4e00 0x7f73181fab20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f731400e8a0 tx=0x7f731400eca0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.370 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.383+0000 7f731fb2d640 1 -- 172.21.15.176:0/2083822816 shutdown_connections 2024-05-14T01:23:12.370 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.383+0000 7f731fb2d640 1 --2- 172.21.15.176:0/2083822816 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73181f6b10 0x7f731814ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.370 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.383+0000 7f731fb2d640 1 --2- 172.21.15.176:0/2083822816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731815aca0 0x7f73180ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.370 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.383+0000 7f731fb2d640 1 --2- 172.21.15.176:0/2083822816 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73180b4e00 0x7f73181fab20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.370 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.383+0000 7f731fb2d640 1 -- 172.21.15.176:0/2083822816 >> 172.21.15.176:0/2083822816 conn(0x7f73180b21b0 msgr2=0x7f73180af880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:12.370 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.383+0000 7f731fb2d640 1 -- 172.21.15.176:0/2083822816 shutdown_connections 2024-05-14T01:23:12.370 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.383+0000 7f731fb2d640 1 -- 172.21.15.176:0/2083822816 wait complete. 2024-05-14T01:23:12.371 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:12.387+0000 7fdb485fd180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T01:23:12.385 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 1423b44b-3748-40df-a393-123342bf02eb 6 2024-05-14T01:23:12.425 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:12.439+0000 7fdb485fd180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T01:23:12.505 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:12.519+0000 7fdb485fd180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T01:23:12.508 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:12.523+0000 7fe1714db180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T01:23:12.536 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.551+0000 7f5f0b218640 1 Processor -- start 2024-05-14T01:23:12.536 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.551+0000 7f5f0b218640 1 -- start start 2024-05-14T01:23:12.538 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.551+0000 7f5f0b218640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f040d0350 0x7f5f040d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.538 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.551+0000 7f5f0b218640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f0415d420 con 0x7f5f0406f370 2024-05-14T01:23:12.538 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.551+0000 7f5f0b218640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f0406e530 con 0x7f5f040720c0 2024-05-14T01:23:12.539 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.551+0000 7f5f0b218640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5f040725a0 con 0x7f5f040d0350 2024-05-14T01:23:12.539 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.555+0000 7f5f08fb4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f040d0350 0x7f5f040d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.539 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.555+0000 7f5f097b5640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f5f040720c0 0x7f5f0406de20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:46982/0 (socket says 172.21.15.176:46982) 2024-05-14T01:23:12.539 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.555+0000 7f5f097b5640 1 -- 172.21.15.176:0/1196277165 learned_addr learned my addr 172.21.15.176:0/1196277165 (peer_addr_for_me v1:172.21.15.176:0/0) 2024-05-14T01:23:12.539 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.555+0000 7f5f08fb4640 1 -- 172.21.15.176:0/1196277165 >> v1:172.21.15.176:6789/0 conn(0x7f5f040720c0 legacy=0x7f5f0406de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.539 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.555+0000 7f5f08fb4640 1 -- 172.21.15.176:0/1196277165 >> v1:172.21.15.154:6789/0 conn(0x7f5f0406f370 legacy=0x7f5f0406d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:12.539 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.555+0000 7f5f037fe640 1 -- 172.21.15.176:0/1196277165 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 417275143 0 0) 0x7f5f0406e530 con 0x7f5f040720c0 2024-05-14T01:23:12.539 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.555+0000 7f5f08fb4640 1 -- 172.21.15.176:0/1196277165 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f040d0c70 con 0x7f5f040d0350 2024-05-14T01:23:12.540 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.555+0000 7f5f08fb4640 1 --2- 172.21.15.176:0/1196277165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f040d0350 0x7f5f040d0730 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80097f0 tx=0x7f5ef801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5735377570fc2e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:12.541 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.555+0000 7f5f037fe640 1 -- 172.21.15.176:0/1196277165 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef80b1070 con 0x7f5f040d0350 2024-05-14T01:23:12.541 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.555+0000 7f5f037fe640 1 -- 172.21.15.176:0/1196277165 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef80ac630 con 0x7f5f040d0350 2024-05-14T01:23:12.541 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.555+0000 7f5f037fe640 1 -- 172.21.15.176:0/1196277165 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef80a8050 con 0x7f5f040d0350 2024-05-14T01:23:12.541 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.555+0000 7f5f0b218640 1 -- 172.21.15.176:0/1196277165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f040d0350 msgr2=0x7f5f040d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.542 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.555+0000 7f5f0b218640 1 --2- 172.21.15.176:0/1196277165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f040d0350 0x7f5f040d0730 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80097f0 tx=0x7f5ef801c4e0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.542 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.555+0000 7f5f0b218640 1 -- 172.21.15.176:0/1196277165 shutdown_connections 2024-05-14T01:23:12.542 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.555+0000 7f5f0b218640 1 --2- 172.21.15.176:0/1196277165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f040d0350 0x7f5f040d0730 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.542 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.555+0000 7f5f0b218640 1 -- 172.21.15.176:0/1196277165 >> 172.21.15.176:0/1196277165 conn(0x7f5f040b21b0 msgr2=0x7f5f040b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:12.542 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.555+0000 7f5f0b218640 1 -- 172.21.15.176:0/1196277165 shutdown_connections 2024-05-14T01:23:12.542 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.555+0000 7f5f0b218640 1 -- 172.21.15.176:0/1196277165 wait complete. 2024-05-14T01:23:12.542 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f0b218640 1 Processor -- start 2024-05-14T01:23:12.543 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f0b218640 1 -- start start 2024-05-14T01:23:12.545 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f0b218640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f0406f370 0x7f5f04140840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.545 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f0b218640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f040720c0 0x7f5f0415da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.545 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f0b218640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f040d0350 0x7f5f040ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.545 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f0b218640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5f04159e90 con 0x7f5f040720c0 2024-05-14T01:23:12.545 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f0b218640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0415cf00 con 0x7f5f040d0350 2024-05-14T01:23:12.545 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f0b218640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5f040ceb70 con 0x7f5f0406f370 2024-05-14T01:23:12.545 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f097b5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f040d0350 0x7f5f040ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.545 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f08fb4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f0406f370 0x7f5f04140840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.545 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f097b5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f040d0350 0x7f5f040ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:48498/0 (socket says 172.21.15.176:48498) 2024-05-14T01:23:12.545 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f08fb4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f0406f370 0x7f5f04140840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:33754/0 (socket says 172.21.15.176:33754) 2024-05-14T01:23:12.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f097b5640 1 -- 172.21.15.176:0/2251935883 learned_addr learned my addr 172.21.15.176:0/2251935883 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-14T01:23:12.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f03fff640 1 --2- 172.21.15.176:0/2251935883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f040720c0 0x7f5f0415da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f08fb4640 1 -- 172.21.15.176:0/2251935883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f040d0350 msgr2=0x7f5f040ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f08fb4640 1 --2- 172.21.15.176:0/2251935883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f040d0350 0x7f5f040ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f08fb4640 1 -- 172.21.15.176:0/2251935883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f040720c0 msgr2=0x7f5f0415da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f08fb4640 1 --2- 172.21.15.176:0/2251935883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f040720c0 0x7f5f0415da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f08fb4640 1 -- 172.21.15.176:0/2251935883 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f040b4060 con 0x7f5f0406f370 2024-05-14T01:23:12.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f097b5640 1 --2- 172.21.15.176:0/2251935883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f040d0350 0x7f5f040ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:23:12.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f08fb4640 1 --2- 172.21.15.176:0/2251935883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f0406f370 0x7f5f04140840 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80ac000 tx=0x7f5ef8019280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:12.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f017fa640 1 -- 172.21.15.176:0/2251935883 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef80b1040 con 0x7f5f0406f370 2024-05-14T01:23:12.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f017fa640 1 -- 172.21.15.176:0/2251935883 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef80ac430 con 0x7f5f0406f370 2024-05-14T01:23:12.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f0b218640 1 -- 172.21.15.176:0/2251935883 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f040b4340 con 0x7f5f0406f370 2024-05-14T01:23:12.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f017fa640 1 -- 172.21.15.176:0/2251935883 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef80b8680 con 0x7f5f0406f370 2024-05-14T01:23:12.546 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f0b218640 1 -- 172.21.15.176:0/2251935883 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f04141610 con 0x7f5f0406f370 2024-05-14T01:23:12.547 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f017fa640 1 -- 172.21.15.176:0/2251935883 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5ef80c1030 con 0x7f5f0406f370 2024-05-14T01:23:12.547 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f017fa640 1 -- 172.21.15.176:0/2251935883 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f5ef80b6de0 con 0x7f5f0406f370 2024-05-14T01:23:12.547 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.559+0000 7f5f0b218640 1 -- 172.21.15.176:0/2251935883 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f04068360 con 0x7f5f0406f370 2024-05-14T01:23:12.547 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.563+0000 7f5f017fa640 1 -- 172.21.15.176:0/2251935883 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5ef80c8060 con 0x7f5f0406f370 2024-05-14T01:23:12.563 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:12.579+0000 7fdb485fd180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T01:23:12.571 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:12.587+0000 7fe1714db180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T01:23:12.612 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.627+0000 7f5f0b218640 1 -- 172.21.15.176:0/2251935883 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1423b44b-3748-40df-a393-123342bf02eb", "id": 6} v 0) -- 0x7f5f040d1210 con 0x7f5f0406f370 2024-05-14T01:23:12.619 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.635+0000 7f5f017fa640 1 -- 172.21.15.176:0/2251935883 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1423b44b-3748-40df-a393-123342bf02eb", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f5ef80160d0 con 0x7f5f0406f370 2024-05-14T01:23:12.619 INFO:teuthology.orchestra.run.smithi176.stdout:6 2024-05-14T01:23:12.620 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.635+0000 7f5f0b218640 1 -- 172.21.15.176:0/2251935883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f0406f370 msgr2=0x7f5f04140840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.620 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.635+0000 7f5f0b218640 1 --2- 172.21.15.176:0/2251935883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f0406f370 0x7f5f04140840 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80ac000 tx=0x7f5ef8019280 comp rx=0 tx=0).stop 2024-05-14T01:23:12.620 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.635+0000 7f5f0b218640 1 -- 172.21.15.176:0/2251935883 shutdown_connections 2024-05-14T01:23:12.621 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.635+0000 7f5f0b218640 1 --2- 172.21.15.176:0/2251935883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f040d0350 0x7f5f040ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.621 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.635+0000 7f5f0b218640 1 --2- 172.21.15.176:0/2251935883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f040720c0 0x7f5f0415da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.621 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.635+0000 7f5f0b218640 1 --2- 172.21.15.176:0/2251935883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f0406f370 0x7f5f04140840 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.621 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.635+0000 7f5f0b218640 1 -- 172.21.15.176:0/2251935883 >> 172.21.15.176:0/2251935883 conn(0x7f5f040b21b0 msgr2=0x7f5f0415af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:12.621 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.635+0000 7f5f0b218640 1 -- 172.21.15.176:0/2251935883 shutdown_connections 2024-05-14T01:23:12.621 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.635+0000 7f5f0b218640 1 -- 172.21.15.176:0/2251935883 wait complete. 2024-05-14T01:23:12.635 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new a6d835cb-f3c9-4734-b70a-61be7a216526 7 2024-05-14T01:23:12.718 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:12.731+0000 7fdb485fd180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T01:23:12.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f912949e640 1 Processor -- start 2024-05-14T01:23:12.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f912949e640 1 -- start start 2024-05-14T01:23:12.745 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f912949e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f912415e420 0x7f91240d3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.745 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f912949e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91240cf060 0x7f91240cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.745 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f912949e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9124162050 0x7f91241624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.745 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f912949e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9124162da0 con 0x7f91240cf060 2024-05-14T01:23:12.745 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f912949e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f91240d23c0 con 0x7f912415e420 2024-05-14T01:23:12.745 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f912949e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f91240d26a0 con 0x7f9124162050 2024-05-14T01:23:12.745 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f9122ffd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f912415e420 0x7f91240d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.745 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f91237fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9124162050 0x7f91241624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.745 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f91237fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9124162050 0x7f91241624e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:33770/0 (socket says 172.21.15.176:33770) 2024-05-14T01:23:12.745 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f9122ffd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f912415e420 0x7f91240d3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:48510/0 (socket says 172.21.15.176:48510) 2024-05-14T01:23:12.745 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f91237fe640 1 -- 172.21.15.176:0/450882319 learned_addr learned my addr 172.21.15.176:0/450882319 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-14T01:23:12.745 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f91237fe640 1 -- 172.21.15.176:0/450882319 >> v2:172.21.15.176:3300/0 conn(0x7f912415e420 msgr2=0x7f91240d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:12.745 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f91237fe640 1 --2- 172.21.15.176:0/450882319 >> v2:172.21.15.176:3300/0 conn(0x7f912415e420 0x7f91240d3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.746 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f91237fe640 1 -- 172.21.15.176:0/450882319 >> v2:172.21.15.154:3300/0 conn(0x7f91240cf060 msgr2=0x7f91240cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:12.746 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f911bfff640 1 --2- 172.21.15.176:0/450882319 >> v2:172.21.15.154:3300/0 conn(0x7f91240cf060 0x7f91240cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.746 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f91237fe640 1 --2- 172.21.15.176:0/450882319 >> v2:172.21.15.154:3300/0 conn(0x7f91240cf060 0x7f91240cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.746 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f91237fe640 1 -- 172.21.15.176:0/450882319 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91240d2980 con 0x7f9124162050 2024-05-14T01:23:12.746 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f9122ffd640 1 --2- 172.21.15.176:0/450882319 >> v2:172.21.15.176:3300/0 conn(0x7f912415e420 0x7f91240d3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:23:12.746 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.759+0000 7f911bfff640 1 --2- 172.21.15.176:0/450882319 >> v2:172.21.15.154:3300/0 conn(0x7f91240cf060 0x7f91240cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:12.747 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f91237fe640 1 --2- 172.21.15.176:0/450882319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9124162050 0x7f91241624e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f912408d440 tx=0x7f911c01c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5110b6857c3c6cd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:12.747 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f91227fc640 1 -- 172.21.15.176:0/450882319 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c0a5780 con 0x7f9124162050 2024-05-14T01:23:12.747 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f91227fc640 1 -- 172.21.15.176:0/450882319 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f911c0a5920 con 0x7f9124162050 2024-05-14T01:23:12.747 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f91227fc640 1 -- 172.21.15.176:0/450882319 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c0a5cf0 con 0x7f9124162050 2024-05-14T01:23:12.747 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f912949e640 1 -- 172.21.15.176:0/450882319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9124162050 msgr2=0x7f91241624e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.747 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f912949e640 1 --2- 172.21.15.176:0/450882319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9124162050 0x7f91241624e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f912408d440 tx=0x7f911c01c9f0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.748 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f912949e640 1 -- 172.21.15.176:0/450882319 shutdown_connections 2024-05-14T01:23:12.748 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f912949e640 1 --2- 172.21.15.176:0/450882319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9124162050 0x7f91241624e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.748 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f912949e640 1 --2- 172.21.15.176:0/450882319 >> v2:172.21.15.154:3300/0 conn(0x7f91240cf060 0x7f91240cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.748 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f912949e640 1 --2- 172.21.15.176:0/450882319 >> v2:172.21.15.176:3300/0 conn(0x7f912415e420 0x7f91240d3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.748 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f912949e640 1 -- 172.21.15.176:0/450882319 >> 172.21.15.176:0/450882319 conn(0x7f912406b280 msgr2=0x7f912406b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:12.748 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f912949e640 1 -- 172.21.15.176:0/450882319 shutdown_connections 2024-05-14T01:23:12.748 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f912949e640 1 -- 172.21.15.176:0/450882319 wait complete. 2024-05-14T01:23:12.748 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f912949e640 1 Processor -- start 2024-05-14T01:23:12.749 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f912949e640 1 -- start start 2024-05-14T01:23:12.751 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f912949e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91240cf060 0x7f912415d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.751 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f912949e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f912415e420 0x7f91240b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.751 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f912949e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9124162050 0x7f91241569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:12.751 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f912949e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f91240b7cb0 con 0x7f9124162050 2024-05-14T01:23:12.751 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f912949e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9124162a20 con 0x7f912415e420 2024-05-14T01:23:12.751 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f912949e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f91240b7e30 con 0x7f91240cf060 2024-05-14T01:23:12.751 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f9122ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91240cf060 0x7f912415d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.751 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f911bfff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f912415e420 0x7f91240b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.751 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f9122ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91240cf060 0x7f912415d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:33782/0 (socket says 172.21.15.176:33782) 2024-05-14T01:23:12.751 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f911bfff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f912415e420 0x7f91240b6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:48520/0 (socket says 172.21.15.176:48520) 2024-05-14T01:23:12.751 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f9122ffd640 1 -- 172.21.15.176:0/2880987281 learned_addr learned my addr 172.21.15.176:0/2880987281 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-05-14T01:23:12.752 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f91237fe640 1 --2- 172.21.15.176:0/2880987281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9124162050 0x7f91241569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:12.752 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f9122ffd640 1 -- 172.21.15.176:0/2880987281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f912415e420 msgr2=0x7f91240b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.752 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f9122ffd640 1 --2- 172.21.15.176:0/2880987281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f912415e420 0x7f91240b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.752 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f9122ffd640 1 -- 172.21.15.176:0/2880987281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9124162050 msgr2=0x7f91241569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.752 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f9122ffd640 1 --2- 172.21.15.176:0/2880987281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9124162050 0x7f91241569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.752 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f9122ffd640 1 -- 172.21.15.176:0/2880987281 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91240ca040 con 0x7f91240cf060 2024-05-14T01:23:12.752 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f911bfff640 1 --2- 172.21.15.176:0/2880987281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f912415e420 0x7f91240b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:23:12.752 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f9122ffd640 1 --2- 172.21.15.176:0/2880987281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91240cf060 0x7f912415d0a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f911400ec10 tx=0x7f911400c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:12.752 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f911b7fe640 1 -- 172.21.15.176:0/2880987281 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9114017070 con 0x7f91240cf060 2024-05-14T01:23:12.752 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f911b7fe640 1 -- 172.21.15.176:0/2880987281 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f911400cc30 con 0x7f91240cf060 2024-05-14T01:23:12.752 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f912949e640 1 -- 172.21.15.176:0/2880987281 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91240ca320 con 0x7f91240cf060 2024-05-14T01:23:12.752 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.763+0000 7f911b7fe640 1 -- 172.21.15.176:0/2880987281 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9114013470 con 0x7f91240cf060 2024-05-14T01:23:12.752 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.767+0000 7f912949e640 1 -- 172.21.15.176:0/2880987281 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f912415d5e0 con 0x7f91240cf060 2024-05-14T01:23:12.752 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.767+0000 7f911b7fe640 1 -- 172.21.15.176:0/2880987281 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f911401a070 con 0x7f91240cf060 2024-05-14T01:23:12.753 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.767+0000 7f911b7fe640 1 -- 172.21.15.176:0/2880987281 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f911401cb50 con 0x7f91240cf060 2024-05-14T01:23:12.753 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.767+0000 7f912949e640 1 -- 172.21.15.176:0/2880987281 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9124068360 con 0x7f91240cf060 2024-05-14T01:23:12.754 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.771+0000 7f911b7fe640 1 -- 172.21.15.176:0/2880987281 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f911401c4f0 con 0x7f91240cf060 2024-05-14T01:23:12.783 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:12.799+0000 7fdb485fd180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T01:23:12.818 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.831+0000 7f912949e640 1 -- 172.21.15.176:0/2880987281 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a6d835cb-f3c9-4734-b70a-61be7a216526", "id": 7} v 0) -- 0x7f91240d1f70 con 0x7f91240cf060 2024-05-14T01:23:12.828 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.843+0000 7f911b7fe640 1 -- 172.21.15.176:0/2880987281 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a6d835cb-f3c9-4734-b70a-61be7a216526", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f911401c6d0 con 0x7f91240cf060 2024-05-14T01:23:12.828 INFO:teuthology.orchestra.run.smithi176.stdout:7 2024-05-14T01:23:12.829 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.843+0000 7f912949e640 1 -- 172.21.15.176:0/2880987281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91240cf060 msgr2=0x7f912415d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:12.830 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.843+0000 7f912949e640 1 --2- 172.21.15.176:0/2880987281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91240cf060 0x7f912415d0a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f911400ec10 tx=0x7f911400c520 comp rx=0 tx=0).stop 2024-05-14T01:23:12.830 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.843+0000 7f912949e640 1 -- 172.21.15.176:0/2880987281 shutdown_connections 2024-05-14T01:23:12.830 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.843+0000 7f912949e640 1 --2- 172.21.15.176:0/2880987281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9124162050 0x7f91241569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.830 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.843+0000 7f912949e640 1 --2- 172.21.15.176:0/2880987281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f912415e420 0x7f91240b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.830 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.843+0000 7f912949e640 1 --2- 172.21.15.176:0/2880987281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91240cf060 0x7f912415d0a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:12.830 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.843+0000 7f912949e640 1 -- 172.21.15.176:0/2880987281 >> 172.21.15.176:0/2880987281 conn(0x7f912406b280 msgr2=0x7f912415f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:12.830 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.843+0000 7f912949e640 1 -- 172.21.15.176:0/2880987281 shutdown_connections 2024-05-14T01:23:12.830 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:12.843+0000 7f912949e640 1 -- 172.21.15.176:0/2880987281 wait complete. 2024-05-14T01:23:12.845 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-14T01:23:12.845 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-14T01:23:12.848 INFO:tasks.ceph.osd.0:Started 2024-05-14T01:23:12.848 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-14T01:23:12.848 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-14T01:23:12.853 INFO:tasks.ceph.osd.1:Started 2024-05-14T01:23:12.853 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-14T01:23:12.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-14T01:23:12.855 INFO:tasks.ceph.osd.2:Started 2024-05-14T01:23:12.855 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-14T01:23:12.855 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-14T01:23:12.857 INFO:tasks.ceph.osd.3:Started 2024-05-14T01:23:12.857 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-14T01:23:12.858 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-14T01:23:12.859 INFO:tasks.ceph.osd.4:Started 2024-05-14T01:23:12.859 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-14T01:23:12.859 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-14T01:23:12.861 INFO:tasks.ceph.osd.5:Started 2024-05-14T01:23:12.861 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-14T01:23:12.861 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-14T01:23:12.863 INFO:tasks.ceph.osd.6:Started 2024-05-14T01:23:12.863 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-14T01:23:12.863 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-14T01:23:12.865 INFO:tasks.ceph.osd.7:Started 2024-05-14T01:23:12.865 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:23:13.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9fc70640 1 Processor -- start 2024-05-14T01:23:13.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9fc70640 1 -- start start 2024-05-14T01:23:13.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9fc70640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc980af900 0x7fdc980cc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:13.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9fc70640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc980cc690 con 0x7fdc9806e930 2024-05-14T01:23:13.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9fc70640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc9815b580 con 0x7fdc980cbd70 2024-05-14T01:23:13.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9fc70640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdc9815c190 con 0x7fdc980af900 2024-05-14T01:23:13.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9e20d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fdc9806e930 0x7fdc9806edc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50976/0 (socket says 172.21.15.154:50976) 2024-05-14T01:23:13.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9e20d640 1 -- 172.21.15.154:0/3103451604 learned_addr learned my addr 172.21.15.154:0/3103451604 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:13.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9d20b640 1 --2- 172.21.15.154:0/3103451604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc980af900 0x7fdc980cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:13.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9ca0a640 1 -- 172.21.15.154:0/3103451604 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4257620054 0 0) 0x7fdc980cc690 con 0x7fdc9806e930 2024-05-14T01:23:13.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9ca0a640 1 -- 172.21.15.154:0/3103451604 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc80003530 con 0x7fdc9806e930 2024-05-14T01:23:13.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9ca0a640 1 -- 172.21.15.154:0/3103451604 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4267375767 0 0) 0x7fdc80003530 con 0x7fdc9806e930 2024-05-14T01:23:13.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9ca0a640 1 -- 172.21.15.154:0/3103451604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc980af900 msgr2=0x7fdc980cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:13.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9ca0a640 1 --2- 172.21.15.154:0/3103451604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc980af900 0x7fdc980cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:13.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9ca0a640 1 -- 172.21.15.154:0/3103451604 >> v1:172.21.15.176:6789/0 conn(0x7fdc980cbd70 legacy=0x7fdc9815f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:13.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9ca0a640 1 -- 172.21.15.154:0/3103451604 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9815b860 con 0x7fdc9806e930 2024-05-14T01:23:13.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9ca0a640 1 -- 172.21.15.154:0/3103451604 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fdc88001a00 con 0x7fdc9806e930 2024-05-14T01:23:13.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9ca0a640 1 -- 172.21.15.154:0/3103451604 >> v1:172.21.15.154:6789/0 conn(0x7fdc9806e930 legacy=0x7fdc9806edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:13.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9ca0a640 1 --2- 172.21.15.154:0/3103451604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc800039f0 0x7fdc80003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:13.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9ca0a640 1 --2- 172.21.15.154:0/3103451604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc800043a0 0x7fdc80004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:13.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9ca0a640 1 --2- 172.21.15.154:0/3103451604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc980af900 0x7fdc800050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:13.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9ca0a640 1 -- 172.21.15.154:0/3103451604 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9815c190 con 0x7fdc800039f0 2024-05-14T01:23:13.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9ca0a640 1 -- 172.21.15.154:0/3103451604 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8000b9d0 con 0x7fdc800043a0 2024-05-14T01:23:13.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9ca0a640 1 -- 172.21.15.154:0/3103451604 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdc8000bbd0 con 0x7fdc980af900 2024-05-14T01:23:13.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9da0c640 1 --2- 172.21.15.154:0/3103451604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc800039f0 0x7fdc80003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:13.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9e20d640 1 --2- 172.21.15.154:0/3103451604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc980af900 0x7fdc800050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:13.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9d20b640 1 --2- 172.21.15.154:0/3103451604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc800043a0 0x7fdc80004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:13.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9da0c640 1 -- 172.21.15.154:0/3103451604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc980af900 msgr2=0x7fdc800050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:13.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9da0c640 1 --2- 172.21.15.154:0/3103451604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc980af900 0x7fdc800050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:13.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9da0c640 1 -- 172.21.15.154:0/3103451604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc800043a0 msgr2=0x7fdc80004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:13.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9da0c640 1 --2- 172.21.15.154:0/3103451604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc800043a0 0x7fdc80004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:13.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9da0c640 1 -- 172.21.15.154:0/3103451604 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc80003530 con 0x7fdc800039f0 2024-05-14T01:23:13.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.047+0000 7fdc9d20b640 1 --2- 172.21.15.154:0/3103451604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc800043a0 0x7fdc80004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:13.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.051+0000 7fdc9da0c640 1 --2- 172.21.15.154:0/3103451604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc800039f0 0x7fdc80003dd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdc90001860 tx=0x7fdc9001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f9bcc8a3cbd8c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:13.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.051+0000 7fdc9ca0a640 1 -- 172.21.15.154:0/3103451604 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc900b0070 con 0x7fdc800039f0 2024-05-14T01:23:13.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.051+0000 7fdc9ca0a640 1 -- 172.21.15.154:0/3103451604 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc900ab600 con 0x7fdc800039f0 2024-05-14T01:23:13.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.051+0000 7fdc9ca0a640 1 -- 172.21.15.154:0/3103451604 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90001460 con 0x7fdc800039f0 2024-05-14T01:23:13.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.051+0000 7fdc9fc70640 1 -- 172.21.15.154:0/3103451604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc800039f0 msgr2=0x7fdc80003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:13.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.051+0000 7fdc9fc70640 1 --2- 172.21.15.154:0/3103451604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc800039f0 0x7fdc80003dd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdc90001860 tx=0x7fdc9001c520 comp rx=0 tx=0).stop 2024-05-14T01:23:13.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.051+0000 7fdc9e20d640 1 -- 172.21.15.154:0/3103451604 reap_dead start 2024-05-14T01:23:13.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.051+0000 7fdc9fc70640 1 -- 172.21.15.154:0/3103451604 shutdown_connections 2024-05-14T01:23:13.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.051+0000 7fdc9fc70640 1 -- 172.21.15.154:0/3103451604 >> 172.21.15.154:0/3103451604 conn(0x7fdc980ccef0 msgr2=0x7fdc980cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:13.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.051+0000 7fdc9fc70640 1 -- 172.21.15.154:0/3103451604 shutdown_connections 2024-05-14T01:23:13.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.051+0000 7fdc9fc70640 1 -- 172.21.15.154:0/3103451604 wait complete. 2024-05-14T01:23:13.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.051+0000 7fdc9fc70640 1 Processor -- start 2024-05-14T01:23:13.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.051+0000 7fdc9fc70640 1 -- start start 2024-05-14T01:23:13.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.051+0000 7fdc9fc70640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc800039f0 0x7fdc981471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:13.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.051+0000 7fdc9fc70640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc981650e0 0x7fdc981500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:13.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc9fc70640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc980b5a50 0x7fdc98159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:13.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc9fc70640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdc98166d20 con 0x7fdc980b5a50 2024-05-14T01:23:13.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc9fc70640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdc98155890 con 0x7fdc981650e0 2024-05-14T01:23:13.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc9fc70640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdc98166ea0 con 0x7fdc800039f0 2024-05-14T01:23:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc9e20d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc980b5a50 0x7fdc98159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc9e20d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc980b5a50 0x7fdc98159e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47518/0 (socket says 172.21.15.154:47518) 2024-05-14T01:23:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc9e20d640 1 -- 172.21.15.154:0/2247779844 learned_addr learned my addr 172.21.15.154:0/2247779844 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc9da0c640 1 --2- 172.21.15.154:0/2247779844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc800039f0 0x7fdc981471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc9e20d640 1 -- 172.21.15.154:0/2247779844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc800039f0 msgr2=0x7fdc981471f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc9e20d640 1 --2- 172.21.15.154:0/2247779844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc800039f0 0x7fdc981471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc9e20d640 1 -- 172.21.15.154:0/2247779844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc981650e0 msgr2=0x7fdc981500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc9e20d640 1 --2- 172.21.15.154:0/2247779844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc981650e0 0x7fdc981500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc9e20d640 1 -- 172.21.15.154:0/2247779844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc98165540 con 0x7fdc980b5a50 2024-05-14T01:23:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc9e20d640 1 --2- 172.21.15.154:0/2247779844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc980b5a50 0x7fdc98159e20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdc98070250 tx=0x7fdc88007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc967fc640 1 -- 172.21.15.154:0/2247779844 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8800ead0 con 0x7fdc980b5a50 2024-05-14T01:23:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc967fc640 1 -- 172.21.15.154:0/2247779844 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc8800ec70 con 0x7fdc980b5a50 2024-05-14T01:23:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc967fc640 1 -- 172.21.15.154:0/2247779844 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8800ee60 con 0x7fdc980b5a50 2024-05-14T01:23:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc9fc70640 1 -- 172.21.15.154:0/2247779844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc98165810 con 0x7fdc980b5a50 2024-05-14T01:23:13.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc9fc70640 1 -- 172.21.15.154:0/2247779844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc9814f8c0 con 0x7fdc980b5a50 2024-05-14T01:23:13.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc967fc640 1 -- 172.21.15.154:0/2247779844 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdc8801a020 con 0x7fdc980b5a50 2024-05-14T01:23:13.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc967fc640 1 -- 172.21.15.154:0/2247779844 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fdc88012380 con 0x7fdc980b5a50 2024-05-14T01:23:13.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc9fc70640 1 -- 172.21.15.154:0/2247779844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc98165d30 con 0x7fdc980b5a50 2024-05-14T01:23:13.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.055+0000 7fdc967fc640 1 -- 172.21.15.154:0/2247779844 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fdc98165d30 con 0x7fdc980b5a50 2024-05-14T01:23:13.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.111+0000 7fdc9fc70640 1 -- 172.21.15.154:0/2247779844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdc98068360 con 0x7fdc980b5a50 2024-05-14T01:23:13.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.111+0000 7fdc967fc640 1 -- 172.21.15.154:0/2247779844 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fdc88021020 con 0x7fdc980b5a50 2024-05-14T01:23:13.098 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:13.098 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":10,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:12.838865+0000","last_up_change":"0.000000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:23:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.111+0000 7fdc9fc70640 1 -- 172.21.15.154:0/2247779844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc980b5a50 msgr2=0x7fdc98159e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.111+0000 7fdc9fc70640 1 --2- 172.21.15.154:0/2247779844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc980b5a50 0x7fdc98159e20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdc98070250 tx=0x7fdc88007bc0 comp rx=0 tx=0).stop 2024-05-14T01:23:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.115+0000 7fdc9fc70640 1 -- 172.21.15.154:0/2247779844 shutdown_connections 2024-05-14T01:23:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.115+0000 7fdc9fc70640 1 --2- 172.21.15.154:0/2247779844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc980b5a50 0x7fdc98159e20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.115+0000 7fdc9fc70640 1 --2- 172.21.15.154:0/2247779844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc981650e0 0x7fdc981500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.115+0000 7fdc9fc70640 1 --2- 172.21.15.154:0/2247779844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc800039f0 0x7fdc981471f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.115+0000 7fdc9fc70640 1 -- 172.21.15.154:0/2247779844 >> 172.21.15.154:0/2247779844 conn(0x7fdc980ccef0 msgr2=0x7fdc980b1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.115+0000 7fdc9fc70640 1 -- 172.21.15.154:0/2247779844 shutdown_connections 2024-05-14T01:23:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:13.115+0000 7fdc9fc70640 1 -- 172.21.15.154:0/2247779844 wait complete. 2024-05-14T01:23:13.113 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-14T01:23:13.113 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-14T01:23:13.198 INFO:tasks.ceph.mgr.y.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-14T01:23:13.199 INFO:tasks.ceph.mgr.y.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-14T01:23:13.199 INFO:tasks.ceph.mgr.y.smithi154.stderr: from numpy import show_config as show_numpy_config 2024-05-14T01:23:13.247 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:13.263+0000 7fe1714db180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T01:23:13.379 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:13.395+0000 7fe1714db180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T01:23:13.423 INFO:tasks.ceph.mgr.x.smithi176.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-14T01:23:13.423 INFO:tasks.ceph.mgr.x.smithi176.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-14T01:23:13.423 INFO:tasks.ceph.mgr.x.smithi176.stderr: from numpy import show_config as show_numpy_config 2024-05-14T01:23:13.476 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T01:23:13.491+0000 7f9bb703a7c0 -1 Falling back to public interface 2024-05-14T01:23:13.477 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-05-14T01:23:13.491+0000 7f7565efd7c0 -1 Falling back to public interface 2024-05-14T01:23:13.477 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-05-14T01:23:13.491+0000 7f7564ebd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-05-14T01:23:13.477 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T01:23:13.491+0000 7f9bb5ffa640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2024-05-14T01:23:13.491 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-05-14T01:23:13.507+0000 7f3970dac7c0 -1 Falling back to public interface 2024-05-14T01:23:13.500 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:13.515+0000 7fdb485fd180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T01:23:13.507 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-05-14T01:23:13.523+0000 7f01bda2e7c0 -1 Falling back to public interface 2024-05-14T01:23:13.516 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T01:23:13.531+0000 7fa168be77c0 -1 Falling back to public interface 2024-05-14T01:23:13.532 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-05-14T01:23:13.547+0000 7f7af9f1f7c0 -1 Falling back to public interface 2024-05-14T01:23:13.532 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T01:23:13.547+0000 7fef94a6f7c0 -1 Falling back to public interface 2024-05-14T01:23:13.543 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:13.559+0000 7fe1714db180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T01:23:13.543 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-05-14T01:23:13.559+0000 7f7aaaed67c0 -1 Falling back to public interface 2024-05-14T01:23:13.607 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:13.623+0000 7fe1714db180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T01:23:13.670 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:13.683+0000 7fdb485fd180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T01:23:13.741 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:13.755+0000 7fe1714db180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T01:23:13.815 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:13.831+0000 7fdb485fd180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T01:23:13.878 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:13.895+0000 7fdb485fd180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T01:23:13.918 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-14T01:23:14.014 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:14.031+0000 7fdb485fd180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T01:23:14.023 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.039+0000 7f25dc82c640 1 Processor -- start 2024-05-14T01:23:14.025 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.039+0000 7f25dc82c640 1 -- start start 2024-05-14T01:23:14.025 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.039+0000 7f25dc82c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f25d80ae710 0x7f25d806de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:14.025 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.039+0000 7f25dc82c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25d81626f0 0x7f25d806b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:14.026 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.039+0000 7f25dc82c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25d80add90 0x7f25d80aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:14.026 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.039+0000 7f25dc82c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f25d806e3b0 con 0x7f25d81626f0 2024-05-14T01:23:14.026 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.039+0000 7f25dc82c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f25d806bb50 con 0x7f25d80ae710 2024-05-14T01:23:14.026 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.039+0000 7f25dc82c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f25d80b49d0 con 0x7f25d80add90 2024-05-14T01:23:14.026 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.039+0000 7f25d5d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25d81626f0 0x7f25d806b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:14.026 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.039+0000 7f25d5d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25d81626f0 0x7f25d806b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47528/0 (socket says 172.21.15.154:47528) 2024-05-14T01:23:14.026 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.039+0000 7f25d5d9b640 1 -- 172.21.15.154:0/1733779423 learned_addr learned my addr 172.21.15.154:0/1733779423 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:14.026 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.039+0000 7f25d659c640 1 --2- 172.21.15.154:0/1733779423 >> v2:172.21.15.176:3300/0 conn(0x7f25d80ae710 0x7f25d806de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:14.026 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.039+0000 7f25d5d9b640 1 -- 172.21.15.154:0/1733779423 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25d80add90 msgr2=0x7f25d80aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:14.026 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.039+0000 7f25d5d9b640 1 --2- 172.21.15.154:0/1733779423 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25d80add90 0x7f25d80aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:14.026 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.039+0000 7f25d5d9b640 1 -- 172.21.15.154:0/1733779423 >> v2:172.21.15.176:3300/0 conn(0x7f25d80ae710 msgr2=0x7f25d806de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:14.026 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.039+0000 7f25d5d9b640 1 --2- 172.21.15.154:0/1733779423 >> v2:172.21.15.176:3300/0 conn(0x7f25d80ae710 0x7f25d806de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:14.026 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.039+0000 7f25d5d9b640 1 -- 172.21.15.154:0/1733779423 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d80b4cb0 con 0x7f25d81626f0 2024-05-14T01:23:14.028 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.039+0000 7f25d5d9b640 1 --2- 172.21.15.154:0/1733779423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d81626f0 0x7f25d806b300 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f25d8071a50 tx=0x7f25cc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67ef854f9cab414 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:14.028 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25d559a640 1 -- 172.21.15.154:0/1733779423 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc0b2070 con 0x7f25d81626f0 2024-05-14T01:23:14.028 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25d559a640 1 -- 172.21.15.154:0/1733779423 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25cc0ad640 con 0x7f25d81626f0 2024-05-14T01:23:14.028 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25d559a640 1 -- 172.21.15.154:0/1733779423 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc0ada10 con 0x7f25d81626f0 2024-05-14T01:23:14.028 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 -- 172.21.15.154:0/1733779423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d81626f0 msgr2=0x7f25d806b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:14.028 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 --2- 172.21.15.154:0/1733779423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d81626f0 0x7f25d806b300 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f25d8071a50 tx=0x7f25cc01c520 comp rx=0 tx=0).stop 2024-05-14T01:23:14.028 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 -- 172.21.15.154:0/1733779423 shutdown_connections 2024-05-14T01:23:14.028 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 --2- 172.21.15.154:0/1733779423 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25d80add90 0x7f25d80aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:14.028 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 --2- 172.21.15.154:0/1733779423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d81626f0 0x7f25d806b300 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:14.028 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 --2- 172.21.15.154:0/1733779423 >> v2:172.21.15.176:3300/0 conn(0x7f25d80ae710 0x7f25d806de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:14.028 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 -- 172.21.15.154:0/1733779423 >> 172.21.15.154:0/1733779423 conn(0x7f25d806c410 msgr2=0x7f25d806c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:14.028 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 -- 172.21.15.154:0/1733779423 shutdown_connections 2024-05-14T01:23:14.028 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 -- 172.21.15.154:0/1733779423 wait complete. 2024-05-14T01:23:14.029 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 Processor -- start 2024-05-14T01:23:14.029 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 -- start start 2024-05-14T01:23:14.031 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d80add90 0x7f25d8147760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:14.031 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25d80ae710 0x7f25d8144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:14.031 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25d81626f0 0x7f25d80b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:14.031 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f25d80b5e40 con 0x7f25d80add90 2024-05-14T01:23:14.031 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f25d80b5cc0 con 0x7f25d80ae710 2024-05-14T01:23:14.031 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f25d80b5fc0 con 0x7f25d81626f0 2024-05-14T01:23:14.031 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25d659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d80add90 0x7f25d8147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:14.032 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25d659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d80add90 0x7f25d8147760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47536/0 (socket says 172.21.15.154:47536) 2024-05-14T01:23:14.032 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25d659c640 1 -- 172.21.15.154:0/2093754854 learned_addr learned my addr 172.21.15.154:0/2093754854 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:14.032 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25d5d9b640 1 --2- 172.21.15.154:0/2093754854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25d80ae710 0x7f25d8144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:14.032 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25d6d9d640 1 --2- 172.21.15.154:0/2093754854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25d81626f0 0x7f25d80b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:14.032 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25d659c640 1 -- 172.21.15.154:0/2093754854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25d81626f0 msgr2=0x7f25d80b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:14.032 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25d659c640 1 --2- 172.21.15.154:0/2093754854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25d81626f0 0x7f25d80b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:14.032 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25d659c640 1 -- 172.21.15.154:0/2093754854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25d80ae710 msgr2=0x7f25d8144630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:14.032 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25d659c640 1 --2- 172.21.15.154:0/2093754854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25d80ae710 0x7f25d8144630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:14.032 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25d659c640 1 -- 172.21.15.154:0/2093754854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d8146740 con 0x7f25d80add90 2024-05-14T01:23:14.032 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25d659c640 1 --2- 172.21.15.154:0/2093754854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d80add90 0x7f25d8147760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f25c800c7f0 tx=0x7f25c800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:14.032 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25c6ffd640 1 -- 172.21.15.154:0/2093754854 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c8015070 con 0x7f25d80add90 2024-05-14T01:23:14.032 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25c6ffd640 1 -- 172.21.15.154:0/2093754854 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c8004240 con 0x7f25d80add90 2024-05-14T01:23:14.032 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25c6ffd640 1 -- 172.21.15.154:0/2093754854 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c8003620 con 0x7f25d80add90 2024-05-14T01:23:14.032 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 -- 172.21.15.154:0/2093754854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25d81469c0 con 0x7f25d80add90 2024-05-14T01:23:14.032 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25dc82c640 1 -- 172.21.15.154:0/2093754854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25d8146f60 con 0x7f25d80add90 2024-05-14T01:23:14.033 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25c6ffd640 1 -- 172.21.15.154:0/2093754854 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f25c80039d0 con 0x7f25d80add90 2024-05-14T01:23:14.033 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.043+0000 7f25c6ffd640 1 -- 172.21.15.154:0/2093754854 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f25c8019b20 con 0x7f25d80add90 2024-05-14T01:23:14.033 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.047+0000 7f25dc82c640 1 -- 172.21.15.154:0/2093754854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25d8068d00 con 0x7f25d80add90 2024-05-14T01:23:14.033 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.047+0000 7f25c6ffd640 1 -- 172.21.15.154:0/2093754854 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f25d8146740 con 0x7f25d80add90 2024-05-14T01:23:14.090 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.103+0000 7f25dc82c640 1 -- 172.21.15.154:0/2093754854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25d806bf00 con 0x7f25d80add90 2024-05-14T01:23:14.091 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.107+0000 7f25c6ffd640 1 -- 172.21.15.154:0/2093754854 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f25c8019450 con 0x7f25d80add90 2024-05-14T01:23:14.092 INFO:teuthology.misc.health.smithi154.stdout: 2024-05-14T01:23:14.092 INFO:teuthology.misc.health.smithi154.stdout:{"epoch":10,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:12.838865+0000","last_up_change":"0.000000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:23:14.093 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.107+0000 7f25dc82c640 1 -- 172.21.15.154:0/2093754854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d80add90 msgr2=0x7f25d8147760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:14.093 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.107+0000 7f25dc82c640 1 --2- 172.21.15.154:0/2093754854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d80add90 0x7f25d8147760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f25c800c7f0 tx=0x7f25c800ccb0 comp rx=0 tx=0).stop 2024-05-14T01:23:14.093 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.107+0000 7f25dc82c640 1 -- 172.21.15.154:0/2093754854 shutdown_connections 2024-05-14T01:23:14.093 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.107+0000 7f25dc82c640 1 --2- 172.21.15.154:0/2093754854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25d81626f0 0x7f25d80b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:14.094 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.107+0000 7f25dc82c640 1 --2- 172.21.15.154:0/2093754854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25d80ae710 0x7f25d8144630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:14.094 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.107+0000 7f25dc82c640 1 --2- 172.21.15.154:0/2093754854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d80add90 0x7f25d8147760 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:14.094 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.107+0000 7f25dc82c640 1 -- 172.21.15.154:0/2093754854 >> 172.21.15.154:0/2093754854 conn(0x7f25d806c410 msgr2=0x7f25d815fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:14.094 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.107+0000 7f25dc82c640 1 -- 172.21.15.154:0/2093754854 shutdown_connections 2024-05-14T01:23:14.094 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:14.107+0000 7f25dc82c640 1 -- 172.21.15.154:0/2093754854 wait complete. 2024-05-14T01:23:14.107 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-14T01:23:14.366 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:14.379+0000 7fe1714db180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T01:23:14.441 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:14.455+0000 7fe1714db180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T01:23:14.624 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:14.639+0000 7fe1714db180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T01:23:14.658 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:14.671+0000 7fdb485fd180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T01:23:14.696 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:14.711+0000 7fe1714db180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T01:23:14.733 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:14.747+0000 7fdb485fd180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T01:23:14.914 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:14.927+0000 7fdb485fd180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T01:23:14.986 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:14.999+0000 7fe1714db180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T01:23:14.987 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:15.003+0000 7fdb485fd180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T01:23:15.048 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:15.063+0000 7fe1714db180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T01:23:15.284 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:15.299+0000 7fdb485fd180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T01:23:15.345 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-05-14T01:23:15.359+0000 7fdb485fd180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T01:23:16.094 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:16.107+0000 7fe118921640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-14T01:23:16.094 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-05-14T01:23:16.107+0000 7fe118921640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-14T01:23:17.255 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T01:23:17.271+0000 7f9bb703a7c0 -1 osd.7 0 log_to_monitors true 2024-05-14T01:23:17.338 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-05-14T01:23:17.355+0000 7f7565efd7c0 -1 osd.6 0 log_to_monitors true 2024-05-14T01:23:17.348 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-05-14T01:23:17.363+0000 7f3970dac7c0 -1 osd.4 0 log_to_monitors true 2024-05-14T01:23:17.401 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T01:23:17.415+0000 7fa168be77c0 -1 osd.2 0 log_to_monitors true 2024-05-14T01:23:17.412 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-05-14T01:23:17.427+0000 7f01bda2e7c0 -1 osd.5 0 log_to_monitors true 2024-05-14T01:23:17.472 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T01:23:17.487+0000 7fef94a6f7c0 -1 osd.1 0 log_to_monitors true 2024-05-14T01:23:17.505 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-05-14T01:23:17.519+0000 7f7aaaed67c0 -1 osd.0 0 log_to_monitors true 2024-05-14T01:23:17.545 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-05-14T01:23:17.559+0000 7f7af9f1f7c0 -1 osd.3 0 log_to_monitors true 2024-05-14T01:23:20.914 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-14T01:23:21.083 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.094+0000 7f9d10a54640 1 Processor -- start 2024-05-14T01:23:21.083 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.094+0000 7f9d10a54640 1 -- start start 2024-05-14T01:23:21.086 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.098+0000 7f9d10a54640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9d040e1020 0x7f9d04039df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:21.086 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.098+0000 7f9d10a54640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9d0404bba0 0x7f9d0403a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:21.086 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.098+0000 7f9d10a54640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d04050e10 con 0x7f9d040339c0 2024-05-14T01:23:21.086 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.098+0000 7f9d10a54640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9d0403a870 con 0x7f9d0404bba0 2024-05-14T01:23:21.086 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.098+0000 7f9d10a54640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9d040510f0 con 0x7f9d040e1020 2024-05-14T01:23:21.086 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.098+0000 7f9d0affd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9d0404bba0 0x7f9d0403a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:21.086 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.098+0000 7f9d0affd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9d0404bba0 0x7f9d0403a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56880/0 (socket says 172.21.15.154:56880) 2024-05-14T01:23:21.086 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.098+0000 7f9d0affd640 1 -- 172.21.15.154:0/388423625 learned_addr learned my addr 172.21.15.154:0/388423625 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:21.086 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.098+0000 7f9d0b7fe640 1 --2- 172.21.15.154:0/388423625 >> v2:172.21.15.176:3300/0 conn(0x7f9d040e1020 0x7f9d04039df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:21.086 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.098+0000 7f9d0affd640 1 -- 172.21.15.154:0/388423625 >> v2:172.21.15.176:3300/0 conn(0x7f9d040e1020 msgr2=0x7f9d04039df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:21.087 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.098+0000 7f9d0affd640 1 --2- 172.21.15.154:0/388423625 >> v2:172.21.15.176:3300/0 conn(0x7f9d040e1020 0x7f9d04039df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:21.087 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.098+0000 7f9d0affd640 1 -- 172.21.15.154:0/388423625 >> v1:172.21.15.154:6789/0 conn(0x7f9d040339c0 legacy=0x7f9d0404f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:21.087 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.098+0000 7f9d0affd640 1 -- 172.21.15.154:0/388423625 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d04005ea0 con 0x7f9d0404bba0 2024-05-14T01:23:21.090 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.102+0000 7f9d0affd640 1 --2- 172.21.15.154:0/388423625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d0404bba0 0x7f9d0403a330 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9d04052580 tx=0x7f9cf801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57661769017edf99 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:21.090 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.102+0000 7f9d0a7fc640 1 -- 172.21.15.154:0/388423625 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf80b1070 con 0x7f9d0404bba0 2024-05-14T01:23:21.090 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.102+0000 7f9d0a7fc640 1 -- 172.21.15.154:0/388423625 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cf80ac630 con 0x7f9d0404bba0 2024-05-14T01:23:21.090 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.102+0000 7f9d0a7fc640 1 -- 172.21.15.154:0/388423625 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf80a8050 con 0x7f9d0404bba0 2024-05-14T01:23:21.092 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.106+0000 7f9d10a54640 1 -- 172.21.15.154:0/388423625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d0404bba0 msgr2=0x7f9d0403a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:21.092 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.106+0000 7f9d10a54640 1 --2- 172.21.15.154:0/388423625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d0404bba0 0x7f9d0403a330 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9d04052580 tx=0x7f9cf801c4e0 comp rx=0 tx=0).stop 2024-05-14T01:23:21.092 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.106+0000 7f9d10a54640 1 -- 172.21.15.154:0/388423625 shutdown_connections 2024-05-14T01:23:21.092 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.106+0000 7f9d10a54640 1 --2- 172.21.15.154:0/388423625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d0404bba0 0x7f9d0403a330 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9d04052580 tx=0x7f9cf801c4e0 comp rx=0 tx=0).stop 2024-05-14T01:23:21.092 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.106+0000 7f9d10a54640 1 --2- 172.21.15.154:0/388423625 >> v2:172.21.15.176:3300/0 conn(0x7f9d040e1020 0x7f9d04039df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:21.092 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.106+0000 7f9d10a54640 1 -- 172.21.15.154:0/388423625 >> 172.21.15.154:0/388423625 conn(0x7f9d04009fc0 msgr2=0x7f9d0400a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:21.092 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.106+0000 7f9d10a54640 1 -- 172.21.15.154:0/388423625 shutdown_connections 2024-05-14T01:23:21.092 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.106+0000 7f9d10a54640 1 -- 172.21.15.154:0/388423625 wait complete. 2024-05-14T01:23:21.094 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.106+0000 7f9d10a54640 1 Processor -- start 2024-05-14T01:23:21.094 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.106+0000 7f9d10a54640 1 -- start start 2024-05-14T01:23:21.096 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d10a54640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d040339c0 0x7f9d040d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:21.096 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d10a54640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d040e1020 0x7f9d040d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:21.097 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d0b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d040339c0 0x7f9d040d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:21.097 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d0b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d040339c0 0x7f9d040d02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56882/0 (socket says 172.21.15.154:56882) 2024-05-14T01:23:21.097 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d0b7fe640 1 -- 172.21.15.154:0/2205574176 learned_addr learned my addr 172.21.15.154:0/2205574176 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:21.097 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d10a54640 1 --2- 172.21.15.154:0/2205574176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d040d8ff0 0x7f9d040dece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:21.097 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d0affd640 1 --2- 172.21.15.154:0/2205574176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d040e1020 0x7f9d040d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:21.097 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d10a54640 1 -- 172.21.15.154:0/2205574176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d04052790 con 0x7f9d040339c0 2024-05-14T01:23:21.097 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d10a54640 1 -- 172.21.15.154:0/2205574176 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9d04052610 con 0x7f9d040d8ff0 2024-05-14T01:23:21.097 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d10a54640 1 -- 172.21.15.154:0/2205574176 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9d04052910 con 0x7f9d040e1020 2024-05-14T01:23:21.098 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d0affd640 1 -- 172.21.15.154:0/2205574176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d040d8ff0 msgr2=0x7f9d040dece0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T01:23:21.098 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d0affd640 1 --2- 172.21.15.154:0/2205574176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d040d8ff0 0x7f9d040dece0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:21.098 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d0affd640 1 -- 172.21.15.154:0/2205574176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d040339c0 msgr2=0x7f9d040d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:21.098 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d0affd640 1 --2- 172.21.15.154:0/2205574176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d040339c0 0x7f9d040d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:21.098 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d0affd640 1 -- 172.21.15.154:0/2205574176 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d040ddc40 con 0x7f9d040e1020 2024-05-14T01:23:21.098 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d0b7fe640 1 --2- 172.21.15.154:0/2205574176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d040339c0 0x7f9d040d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:23:21.099 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d0affd640 1 --2- 172.21.15.154:0/2205574176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d040e1020 0x7f9d040d2d40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9d04008690 tx=0x7f9cf8019280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:21.099 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9cf7fff640 1 -- 172.21.15.154:0/2205574176 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf80bc070 con 0x7f9d040e1020 2024-05-14T01:23:21.099 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9cf7fff640 1 -- 172.21.15.154:0/2205574176 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cf8004030 con 0x7f9d040e1020 2024-05-14T01:23:21.099 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d10a54640 1 -- 172.21.15.154:0/2205574176 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d040ddf20 con 0x7f9d040e1020 2024-05-14T01:23:21.099 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9cf7fff640 1 -- 172.21.15.154:0/2205574176 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf80b1070 con 0x7f9d040e1020 2024-05-14T01:23:21.099 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.110+0000 7f9d10a54640 1 -- 172.21.15.154:0/2205574176 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d040de4e0 con 0x7f9d040e1020 2024-05-14T01:23:21.100 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.114+0000 7f9d10a54640 1 -- 172.21.15.154:0/2205574176 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d040089e0 con 0x7f9d040e1020 2024-05-14T01:23:21.100 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.114+0000 7f9cf7fff640 1 -- 172.21.15.154:0/2205574176 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f9cf8003620 con 0x7f9d040e1020 2024-05-14T01:23:21.101 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.114+0000 7f9cf7fff640 1 --2- 172.21.15.154:0/2205574176 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9cf0067830 0x7f9cf0069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:21.101 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.114+0000 7f9cf7fff640 1 -- 172.21.15.154:0/2205574176 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f9cf811e830 con 0x7f9d040e1020 2024-05-14T01:23:21.101 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.114+0000 7f9d0b7fe640 1 --2- 172.21.15.154:0/2205574176 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9cf0067830 0x7f9cf0069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:21.102 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.114+0000 7f9d0b7fe640 1 --2- 172.21.15.154:0/2205574176 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9cf0067830 0x7f9cf0069cf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9d00007e60 tx=0x7f9d00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:21.106 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-05-14T01:23:21.118+0000 7f7af56a5640 -1 osd.3 0 waiting for initial osdmap 2024-05-14T01:23:21.111 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.122+0000 7f9cf7fff640 1 -- 172.21.15.154:0/2205574176 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f9cf80160d0 con 0x7f9d040e1020 2024-05-14T01:23:21.145 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-05-14T01:23:21.158+0000 7f7aedcec640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T01:23:21.247 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T01:23:21.262+0000 7fef901f5640 -1 osd.1 0 waiting for initial osdmap 2024-05-14T01:23:21.258 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T01:23:21.270+0000 7fa16436d640 -1 osd.2 0 waiting for initial osdmap 2024-05-14T01:23:21.272 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T01:23:21.286+0000 7fef8883c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T01:23:21.284 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T01:23:21.298+0000 7fa15c9b4640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T01:23:21.290 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-05-14T01:23:21.307+0000 7f01ba9ea640 -1 osd.5 0 waiting for initial osdmap 2024-05-14T01:23:21.293 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-05-14T01:23:21.307+0000 7f7561683640 -1 osd.6 0 waiting for initial osdmap 2024-05-14T01:23:21.294 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T01:23:21.311+0000 7f9bb27c0640 -1 osd.7 0 waiting for initial osdmap 2024-05-14T01:23:21.296 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-05-14T01:23:21.311+0000 7f396dd68640 -1 osd.4 0 waiting for initial osdmap 2024-05-14T01:23:21.307 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-05-14T01:23:21.323+0000 7f01b17fb640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T01:23:21.319 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-05-14T01:23:21.335+0000 7f7559cca640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T01:23:21.319 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T01:23:21.335+0000 7f9baae07640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T01:23:21.323 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-05-14T01:23:21.338+0000 7f7aa665c640 -1 osd.0 0 waiting for initial osdmap 2024-05-14T01:23:21.331 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-05-14T01:23:21.347+0000 7f3964b79640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T01:23:21.344 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-05-14T01:23:21.358+0000 7f7a9eca3640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T01:23:21.356 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.370+0000 7f9d10a54640 1 -- 172.21.15.154:0/2205574176 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d0403a4c0 con 0x7f9d040e1020 2024-05-14T01:23:21.357 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.370+0000 7f9cf7fff640 1 -- 172.21.15.154:0/2205574176 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f9cf80efb00 con 0x7f9d040e1020 2024-05-14T01:23:21.357 INFO:teuthology.misc.health.smithi154.stdout: 2024-05-14T01:23:21.357 INFO:teuthology.misc.health.smithi154.stdout:{"epoch":12,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:19.112913+0000","last_up_change":"0.000000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:23:21.359 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.370+0000 7f9d10a54640 1 -- 172.21.15.154:0/2205574176 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9cf0067830 msgr2=0x7f9cf0069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:21.359 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.370+0000 7f9d10a54640 1 --2- 172.21.15.154:0/2205574176 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9cf0067830 0x7f9cf0069cf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9d00007e60 tx=0x7f9d00008040 comp rx=0 tx=0).stop 2024-05-14T01:23:21.359 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.370+0000 7f9d10a54640 1 -- 172.21.15.154:0/2205574176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d040e1020 msgr2=0x7f9d040d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:21.359 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.370+0000 7f9d10a54640 1 --2- 172.21.15.154:0/2205574176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d040e1020 0x7f9d040d2d40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9d04008690 tx=0x7f9cf8019280 comp rx=0 tx=0).stop 2024-05-14T01:23:21.359 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.370+0000 7f9d10a54640 1 -- 172.21.15.154:0/2205574176 shutdown_connections 2024-05-14T01:23:21.359 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.370+0000 7f9d10a54640 1 --2- 172.21.15.154:0/2205574176 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9cf0067830 0x7f9cf0069cf0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:21.359 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.370+0000 7f9d10a54640 1 --2- 172.21.15.154:0/2205574176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d040d8ff0 0x7f9d040dece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:21.360 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.370+0000 7f9d10a54640 1 --2- 172.21.15.154:0/2205574176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d040e1020 0x7f9d040d2d40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:21.360 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.370+0000 7f9d10a54640 1 --2- 172.21.15.154:0/2205574176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d040339c0 0x7f9d040d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:21.360 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.370+0000 7f9d10a54640 1 -- 172.21.15.154:0/2205574176 >> 172.21.15.154:0/2205574176 conn(0x7f9d04009fc0 msgr2=0x7f9d0404d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:21.360 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.370+0000 7f9d10a54640 1 -- 172.21.15.154:0/2205574176 shutdown_connections 2024-05-14T01:23:21.360 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:21.370+0000 7f9d10a54640 1 -- 172.21.15.154:0/2205574176 wait complete. 2024-05-14T01:23:21.373 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-14T01:23:28.180 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-14T01:23:28.300 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.314+0000 7f37630d9640 1 Processor -- start 2024-05-14T01:23:28.300 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.314+0000 7f37630d9640 1 -- start start 2024-05-14T01:23:28.302 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.314+0000 7f37630d9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f375c15ed20 0x7f375c0ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:28.302 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.314+0000 7f37630d9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f375c15e180 0x7f375c15e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:28.302 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.314+0000 7f37630d9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f375c0b3930 con 0x7f375c15a570 2024-05-14T01:23:28.302 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.314+0000 7f37630d9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f375c15eb30 con 0x7f375c15ed20 2024-05-14T01:23:28.302 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.314+0000 7f37630d9640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f375c0b50a0 con 0x7f375c15e180 2024-05-14T01:23:28.302 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.314+0000 7f3760e75640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f375c15a570 0x7f375c0b4990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50086/0 (socket says 172.21.15.154:50086) 2024-05-14T01:23:28.302 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.314+0000 7f3760e75640 1 -- 172.21.15.154:0/2064958476 learned_addr learned my addr 172.21.15.154:0/2064958476 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:28.302 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.314+0000 7f375bfff640 1 --2- 172.21.15.154:0/2064958476 >> v2:172.21.15.154:3300/0 conn(0x7f375c15ed20 0x7f375c0ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:28.302 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.314+0000 7f375b7fe640 1 -- 172.21.15.154:0/2064958476 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1115733660 0 0) 0x7f375c0b3930 con 0x7f375c15a570 2024-05-14T01:23:28.302 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.314+0000 7f375b7fe640 1 -- 172.21.15.154:0/2064958476 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f374c003530 con 0x7f375c15a570 2024-05-14T01:23:28.303 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.314+0000 7f3761676640 1 --2- 172.21.15.154:0/2064958476 >> v2:172.21.15.176:3300/0 conn(0x7f375c15e180 0x7f375c15e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:28.303 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.314+0000 7f375bfff640 1 -- 172.21.15.154:0/2064958476 >> v2:172.21.15.176:3300/0 conn(0x7f375c15e180 msgr2=0x7f375c15e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:28.303 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.314+0000 7f375bfff640 1 --2- 172.21.15.154:0/2064958476 >> v2:172.21.15.176:3300/0 conn(0x7f375c15e180 0x7f375c15e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.303 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.314+0000 7f375bfff640 1 -- 172.21.15.154:0/2064958476 >> v1:172.21.15.154:6789/0 conn(0x7f375c15a570 legacy=0x7f375c0b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:28.303 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.314+0000 7f375b7fe640 1 -- 172.21.15.154:0/2064958476 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 371370325 0 0) 0x7f374c003530 con 0x7f375c15a570 2024-05-14T01:23:28.303 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.314+0000 7f375bfff640 1 -- 172.21.15.154:0/2064958476 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375c0b3bd0 con 0x7f375c15ed20 2024-05-14T01:23:28.305 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f375bfff640 1 --2- 172.21.15.154:0/2064958476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f375c15ed20 0x7f375c0ced20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f374800a960 tx=0x7f374801d690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91cfd5d20080a5d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:28.305 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f375b7fe640 1 -- 172.21.15.154:0/2064958476 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37480ad070 con 0x7f375c15ed20 2024-05-14T01:23:28.305 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f375b7fe640 1 -- 172.21.15.154:0/2064958476 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37480a7490 con 0x7f375c15ed20 2024-05-14T01:23:28.305 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f375b7fe640 1 -- 172.21.15.154:0/2064958476 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3750001680 con 0x7f375c15ed20 2024-05-14T01:23:28.306 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f37630d9640 1 -- 172.21.15.154:0/2064958476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f375c15ed20 msgr2=0x7f375c0ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:28.306 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f37630d9640 1 --2- 172.21.15.154:0/2064958476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f375c15ed20 0x7f375c0ced20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f374800a960 tx=0x7f374801d690 comp rx=0 tx=0).stop 2024-05-14T01:23:28.306 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f37630d9640 1 -- 172.21.15.154:0/2064958476 shutdown_connections 2024-05-14T01:23:28.306 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f37630d9640 1 --2- 172.21.15.154:0/2064958476 >> v2:172.21.15.176:3300/0 conn(0x7f375c15e180 0x7f375c15e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.306 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f37630d9640 1 --2- 172.21.15.154:0/2064958476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f375c15ed20 0x7f375c0ced20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.306 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f37630d9640 1 -- 172.21.15.154:0/2064958476 >> 172.21.15.154:0/2064958476 conn(0x7f375c0b1af0 msgr2=0x7f375c0b1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:28.306 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f37630d9640 1 -- 172.21.15.154:0/2064958476 shutdown_connections 2024-05-14T01:23:28.306 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f37630d9640 1 -- 172.21.15.154:0/2064958476 wait complete. 2024-05-14T01:23:28.307 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f37630d9640 1 Processor -- start 2024-05-14T01:23:28.307 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f37630d9640 1 -- start start 2024-05-14T01:23:28.310 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f37630d9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f375c15a570 0x7f375c137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:28.310 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f37630d9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f375c15e180 0x7f375c14c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:28.310 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f37630d9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f375c15ed20 0x7f375c152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:28.310 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f37630d9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f375c0cf260 con 0x7f375c15a570 2024-05-14T01:23:28.311 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f37630d9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f375c15a950 con 0x7f375c15e180 2024-05-14T01:23:28.311 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f37630d9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f375c0cf3e0 con 0x7f375c15ed20 2024-05-14T01:23:28.311 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f3760e75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f375c15a570 0x7f375c137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:28.311 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f3760e75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f375c15a570 0x7f375c137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59034/0 (socket says 172.21.15.154:59034) 2024-05-14T01:23:28.311 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f3760e75640 1 -- 172.21.15.154:0/2718040525 learned_addr learned my addr 172.21.15.154:0/2718040525 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:28.311 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f375bfff640 1 --2- 172.21.15.154:0/2718040525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f375c15e180 0x7f375c14c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:28.311 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f3761676640 1 --2- 172.21.15.154:0/2718040525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f375c15ed20 0x7f375c152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:28.311 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f3760e75640 1 -- 172.21.15.154:0/2718040525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f375c15ed20 msgr2=0x7f375c152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:28.311 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f3760e75640 1 --2- 172.21.15.154:0/2718040525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f375c15ed20 0x7f375c152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.311 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f3760e75640 1 -- 172.21.15.154:0/2718040525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f375c15e180 msgr2=0x7f375c14c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:28.311 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f3760e75640 1 --2- 172.21.15.154:0/2718040525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f375c15e180 0x7f375c14c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.311 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f3760e75640 1 -- 172.21.15.154:0/2718040525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375c14d370 con 0x7f375c15a570 2024-05-14T01:23:28.311 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f3761676640 1 --2- 172.21.15.154:0/2718040525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f375c15ed20 0x7f375c152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:28.312 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f375bfff640 1 --2- 172.21.15.154:0/2718040525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f375c15e180 0x7f375c14c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:28.312 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.318+0000 7f3760e75640 1 --2- 172.21.15.154:0/2718040525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f375c15a570 0x7f375c137ac0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f375000c6d0 tx=0x7f375000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:28.312 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.322+0000 7f37597fa640 1 -- 172.21.15.154:0/2718040525 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3750017070 con 0x7f375c15a570 2024-05-14T01:23:28.312 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.322+0000 7f37597fa640 1 -- 172.21.15.154:0/2718040525 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3750005ae0 con 0x7f375c15a570 2024-05-14T01:23:28.312 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.322+0000 7f37630d9640 1 -- 172.21.15.154:0/2718040525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f375c14d650 con 0x7f375c15a570 2024-05-14T01:23:28.312 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.322+0000 7f37597fa640 1 -- 172.21.15.154:0/2718040525 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3750007070 con 0x7f375c15a570 2024-05-14T01:23:28.315 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.322+0000 7f37630d9640 1 -- 172.21.15.154:0/2718040525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f375c14fdc0 con 0x7f375c15a570 2024-05-14T01:23:28.315 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.322+0000 7f37630d9640 1 -- 172.21.15.154:0/2718040525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f375c068d00 con 0x7f375c15a570 2024-05-14T01:23:28.315 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.322+0000 7f37597fa640 1 -- 172.21.15.154:0/2718040525 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f375001a070 con 0x7f375c15a570 2024-05-14T01:23:28.315 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.322+0000 7f37597fa640 1 --2- 172.21.15.154:0/2718040525 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f37400678c0 0x7f3740069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:28.315 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.322+0000 7f37597fa640 1 -- 172.21.15.154:0/2718040525 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f3750084dc0 con 0x7f375c15a570 2024-05-14T01:23:28.316 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.322+0000 7f375bfff640 1 --2- 172.21.15.154:0/2718040525 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f37400678c0 0x7f3740069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:28.316 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.322+0000 7f375bfff640 1 --2- 172.21.15.154:0/2718040525 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f37400678c0 0x7f3740069d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f37480af000 tx=0x7f37480a8000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:28.316 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.326+0000 7f37597fa640 1 -- 172.21.15.154:0/2718040525 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f3750055ce0 con 0x7f375c15a570 2024-05-14T01:23:28.475 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.486+0000 7f37630d9640 1 -- 172.21.15.154:0/2718040525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f375c0b2750 con 0x7f375c15a570 2024-05-14T01:23:28.477 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.490+0000 7f37597fa640 1 -- 172.21.15.154:0/2718040525 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12932 (secure 0 0 0) 0x7f37500555e0 con 0x7f375c15a570 2024-05-14T01:23:28.478 INFO:teuthology.misc.health.smithi154.stdout: 2024-05-14T01:23:28.478 INFO:teuthology.misc.health.smithi154.stdout:{"epoch":17,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:26.154968+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:23:28.480 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.490+0000 7f37630d9640 1 -- 172.21.15.154:0/2718040525 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f37400678c0 msgr2=0x7f3740069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:28.480 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.490+0000 7f37630d9640 1 --2- 172.21.15.154:0/2718040525 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f37400678c0 0x7f3740069d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f37480af000 tx=0x7f37480a8000 comp rx=0 tx=0).stop 2024-05-14T01:23:28.480 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.490+0000 7f37630d9640 1 -- 172.21.15.154:0/2718040525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f375c15a570 msgr2=0x7f375c137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:28.480 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.490+0000 7f37630d9640 1 --2- 172.21.15.154:0/2718040525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f375c15a570 0x7f375c137ac0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f375000c6d0 tx=0x7f375000cb90 comp rx=0 tx=0).stop 2024-05-14T01:23:28.480 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.490+0000 7f37630d9640 1 -- 172.21.15.154:0/2718040525 shutdown_connections 2024-05-14T01:23:28.480 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.490+0000 7f37630d9640 1 --2- 172.21.15.154:0/2718040525 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f37400678c0 0x7f3740069d80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.480 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.490+0000 7f37630d9640 1 --2- 172.21.15.154:0/2718040525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f375c15ed20 0x7f375c152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.481 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.490+0000 7f37630d9640 1 --2- 172.21.15.154:0/2718040525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f375c15e180 0x7f375c14c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.481 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.490+0000 7f37630d9640 1 --2- 172.21.15.154:0/2718040525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f375c15a570 0x7f375c137ac0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.481 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.490+0000 7f37630d9640 1 -- 172.21.15.154:0/2718040525 >> 172.21.15.154:0/2718040525 conn(0x7f375c0b1af0 msgr2=0x7f375c0b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:28.481 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.490+0000 7f37630d9640 1 -- 172.21.15.154:0/2718040525 shutdown_connections 2024-05-14T01:23:28.481 INFO:teuthology.misc.health.smithi154.stderr:2024-05-14T01:23:28.490+0000 7f37630d9640 1 -- 172.21.15.154:0/2718040525 wait complete. 2024-05-14T01:23:28.495 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-14T01:23:28.495 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-14T01:23:28.496 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-14T01:23:28.496 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-14T01:23:28.500 INFO:tasks.ceph.mds.a:Started 2024-05-14T01:23:28.500 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-14T01:23:28.500 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-14T01:23:28.502 INFO:tasks.ceph.mds.c:Started 2024-05-14T01:23:28.502 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-14T01:23:28.503 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-14T01:23:28.505 INFO:tasks.ceph.mds.b:Started 2024-05-14T01:23:28.505 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-14T01:23:28.506 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-14T01:23:28.508 INFO:tasks.ceph.mds.d:Started 2024-05-14T01:23:28.508 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-14T01:23:28.508 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:23:28.584 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2024-05-14T01:23:28.584 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2024-05-14T01:23:28.598 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-05-14T01:23:28.602 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-05-14T01:23:28.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.638+0000 7fd925633640 1 Processor -- start 2024-05-14T01:23:28.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.638+0000 7fd925633640 1 -- start start 2024-05-14T01:23:28.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.638+0000 7fd925633640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd92015e100 0x7fd9200d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:28.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.638+0000 7fd925633640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9200d29f0 con 0x7fd92015e4e0 2024-05-14T01:23:28.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.638+0000 7fd925633640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9200d2cd0 con 0x7fd9200cf520 2024-05-14T01:23:28.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.638+0000 7fd925633640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd9200d2fb0 con 0x7fd92015e100 2024-05-14T01:23:28.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.638+0000 7fd91e7fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd92015e4e0 0x7fd9200cee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50098/0 (socket says 172.21.15.154:50098) 2024-05-14T01:23:28.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.638+0000 7fd91e7fc640 1 -- 172.21.15.154:0/436434785 learned_addr learned my addr 172.21.15.154:0/436434785 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:28.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.638+0000 7fd91effd640 1 --2- 172.21.15.154:0/436434785 >> v2:172.21.15.176:3300/0 conn(0x7fd92015e100 0x7fd9200d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:28.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.638+0000 7fd91dffb640 1 -- 172.21.15.154:0/436434785 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 843827927 0 0) 0x7fd9200d29f0 con 0x7fd92015e4e0 2024-05-14T01:23:28.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.638+0000 7fd91dffb640 1 -- 172.21.15.154:0/436434785 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd908003530 con 0x7fd92015e4e0 2024-05-14T01:23:28.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.638+0000 7fd91effd640 1 -- 172.21.15.154:0/436434785 >> v1:172.21.15.176:6789/0 conn(0x7fd9200cf520 legacy=0x7fd9200b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:28.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.638+0000 7fd91dffb640 1 -- 172.21.15.154:0/436434785 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3266919213 0 0) 0x7fd9200d2cd0 con 0x7fd9200cf520 2024-05-14T01:23:28.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.638+0000 7fd91effd640 1 -- 172.21.15.154:0/436434785 >> v1:172.21.15.154:6789/0 conn(0x7fd92015e4e0 legacy=0x7fd9200cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:28.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.638+0000 7fd91effd640 1 -- 172.21.15.154:0/436434785 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9200d3290 con 0x7fd92015e100 2024-05-14T01:23:28.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.638+0000 7fd91effd640 1 --2- 172.21.15.154:0/436434785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd92015e100 0x7fd9200d22f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd9100097c0 tx=0x7fd91001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc79a634bb39f8d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:28.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.638+0000 7fd91dffb640 1 -- 172.21.15.154:0/436434785 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9100b5070 con 0x7fd92015e100 2024-05-14T01:23:28.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd91dffb640 1 -- 172.21.15.154:0/436434785 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9100a8990 con 0x7fd92015e100 2024-05-14T01:23:28.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd91dffb640 1 -- 172.21.15.154:0/436434785 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9100a8d60 con 0x7fd92015e100 2024-05-14T01:23:28.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd925633640 1 -- 172.21.15.154:0/436434785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd92015e100 msgr2=0x7fd9200d22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:28.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd925633640 1 --2- 172.21.15.154:0/436434785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd92015e100 0x7fd9200d22f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd9100097c0 tx=0x7fd91001ec90 comp rx=0 tx=0).stop 2024-05-14T01:23:28.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd925633640 1 -- 172.21.15.154:0/436434785 shutdown_connections 2024-05-14T01:23:28.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd925633640 1 --2- 172.21.15.154:0/436434785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd92015e100 0x7fd9200d22f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd925633640 1 -- 172.21.15.154:0/436434785 >> 172.21.15.154:0/436434785 conn(0x7fd9200b5b50 msgr2=0x7fd9200b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:28.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd925633640 1 -- 172.21.15.154:0/436434785 shutdown_connections 2024-05-14T01:23:28.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd925633640 1 -- 172.21.15.154:0/436434785 wait complete. 2024-05-14T01:23:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd925633640 1 Processor -- start 2024-05-14T01:23:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd925633640 1 -- start start 2024-05-14T01:23:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd925633640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9200cf520 0x7fd92014c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd925633640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd92015e100 0x7fd9200d1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd925633640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd92015e4e0 0x7fd920157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd925633640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd9200d3c10 con 0x7fd92015e4e0 2024-05-14T01:23:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd925633640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd9200d3a90 con 0x7fd9200cf520 2024-05-14T01:23:28.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd925633640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd9200ca9e0 con 0x7fd92015e100 2024-05-14T01:23:28.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd91f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd92015e4e0 0x7fd920157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:28.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd91f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd92015e4e0 0x7fd920157090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59068/0 (socket says 172.21.15.154:59068) 2024-05-14T01:23:28.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd91f7fe640 1 -- 172.21.15.154:0/3872800198 learned_addr learned my addr 172.21.15.154:0/3872800198 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:28.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd91effd640 1 --2- 172.21.15.154:0/3872800198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9200cf520 0x7fd92014c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:28.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd91e7fc640 1 --2- 172.21.15.154:0/3872800198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd92015e100 0x7fd9200d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:28.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd91f7fe640 1 -- 172.21.15.154:0/3872800198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd92015e100 msgr2=0x7fd9200d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:28.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd91f7fe640 1 --2- 172.21.15.154:0/3872800198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd92015e100 0x7fd9200d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd91f7fe640 1 -- 172.21.15.154:0/3872800198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9200cf520 msgr2=0x7fd92014c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd91f7fe640 1 --2- 172.21.15.154:0/3872800198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9200cf520 0x7fd92014c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd91f7fe640 1 -- 172.21.15.154:0/3872800198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9200ca180 con 0x7fd92015e4e0 2024-05-14T01:23:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd91f7fe640 1 --2- 172.21.15.154:0/3872800198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd92015e4e0 0x7fd920157090 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd91800c780 tx=0x7fd91800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd9077fe640 1 -- 172.21.15.154:0/3872800198 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918003db0 con 0x7fd92015e4e0 2024-05-14T01:23:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd9077fe640 1 -- 172.21.15.154:0/3872800198 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd918005070 con 0x7fd92015e4e0 2024-05-14T01:23:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd925633640 1 -- 172.21.15.154:0/3872800198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9200ca420 con 0x7fd92015e4e0 2024-05-14T01:23:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd9077fe640 1 -- 172.21.15.154:0/3872800198 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918005460 con 0x7fd92015e4e0 2024-05-14T01:23:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.642+0000 7fd925633640 1 -- 172.21.15.154:0/3872800198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9201575d0 con 0x7fd92015e4e0 2024-05-14T01:23:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.646+0000 7fd925633640 1 -- 172.21.15.154:0/3872800198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9200ca5f0 con 0x7fd92015e4e0 2024-05-14T01:23:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.646+0000 7fd9077fe640 1 -- 172.21.15.154:0/3872800198 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd918005600 con 0x7fd92015e4e0 2024-05-14T01:23:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.646+0000 7fd9077fe640 1 --2- 172.21.15.154:0/3872800198 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd90c0678c0 0x7fd90c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.646+0000 7fd9077fe640 1 -- 172.21.15.154:0/3872800198 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fd918085750 con 0x7fd92015e4e0 2024-05-14T01:23:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.646+0000 7fd91effd640 1 --2- 172.21.15.154:0/3872800198 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd90c0678c0 0x7fd90c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.646+0000 7fd91effd640 1 --2- 172.21.15.154:0/3872800198 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd90c0678c0 0x7fd90c069d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd9100b2000 tx=0x7fd910008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.650+0000 7fd9077fe640 1 -- 172.21.15.154:0/3872800198 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fd918056670 con 0x7fd92015e4e0 2024-05-14T01:23:28.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.810+0000 7fd925633640 1 -- 172.21.15.154:0/3872800198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd920075470 con 0x7fd92015e4e0 2024-05-14T01:23:28.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.810+0000 7fd9077fe640 1 -- 172.21.15.154:0/3872800198 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12932 (secure 0 0 0) 0x7fd918055f70 con 0x7fd92015e4e0 2024-05-14T01:23:28.799 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:28.800 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":17,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:26.154968+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:23:28.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.814+0000 7fd925633640 1 -- 172.21.15.154:0/3872800198 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd90c0678c0 msgr2=0x7fd90c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:28.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.814+0000 7fd925633640 1 --2- 172.21.15.154:0/3872800198 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd90c0678c0 0x7fd90c069d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd9100b2000 tx=0x7fd910008040 comp rx=0 tx=0).stop 2024-05-14T01:23:28.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.814+0000 7fd925633640 1 -- 172.21.15.154:0/3872800198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd92015e4e0 msgr2=0x7fd920157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:28.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.814+0000 7fd925633640 1 --2- 172.21.15.154:0/3872800198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd92015e4e0 0x7fd920157090 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd91800c780 tx=0x7fd91800cc40 comp rx=0 tx=0).stop 2024-05-14T01:23:28.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.814+0000 7fd925633640 1 -- 172.21.15.154:0/3872800198 shutdown_connections 2024-05-14T01:23:28.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.814+0000 7fd925633640 1 --2- 172.21.15.154:0/3872800198 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd90c0678c0 0x7fd90c069d80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.814+0000 7fd925633640 1 --2- 172.21.15.154:0/3872800198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd92015e4e0 0x7fd920157090 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.814+0000 7fd925633640 1 --2- 172.21.15.154:0/3872800198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd92015e100 0x7fd9200d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.814+0000 7fd925633640 1 --2- 172.21.15.154:0/3872800198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9200cf520 0x7fd92014c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.814+0000 7fd925633640 1 -- 172.21.15.154:0/3872800198 >> 172.21.15.154:0/3872800198 conn(0x7fd9200b5b50 msgr2=0x7fd9201540b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:28.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.814+0000 7fd925633640 1 -- 172.21.15.154:0/3872800198 shutdown_connections 2024-05-14T01:23:28.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.814+0000 7fd925633640 1 -- 172.21.15.154:0/3872800198 wait complete. 2024-05-14T01:23:28.833 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:23:28.834 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:23:28.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.986+0000 7f8553140640 1 Processor -- start 2024-05-14T01:23:28.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.986+0000 7f8553140640 1 -- start start 2024-05-14T01:23:28.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.986+0000 7f8553140640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f854c072c40 0x7f854c071f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:28.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.986+0000 7f8553140640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f854c0b3bb0 con 0x7f854c162370 2024-05-14T01:23:28.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.986+0000 7f8553140640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f854c0711c0 con 0x7f854c158920 2024-05-14T01:23:28.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.986+0000 7f8553140640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f854c071af0 con 0x7f854c072c40 2024-05-14T01:23:28.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.986+0000 7f85516dd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f854c072c40 0x7f854c071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:28.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.986+0000 7f85516dd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f854c072c40 0x7f854c071f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59084/0 (socket says 172.21.15.154:59084) 2024-05-14T01:23:28.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.986+0000 7f85516dd640 1 -- 172.21.15.154:0/2804314802 learned_addr learned my addr 172.21.15.154:0/2804314802 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:28.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.986+0000 7f85516dd640 1 -- 172.21.15.154:0/2804314802 >> v1:172.21.15.176:6789/0 conn(0x7f854c158920 legacy=0x7f854c161c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:28.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.986+0000 7f85516dd640 1 -- 172.21.15.154:0/2804314802 >> v1:172.21.15.154:6789/0 conn(0x7f854c162370 legacy=0x7f854c0ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:28.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.986+0000 7f85516dd640 1 -- 172.21.15.154:0/2804314802 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c0714a0 con 0x7f854c072c40 2024-05-14T01:23:28.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f85516dd640 1 --2- 172.21.15.154:0/2804314802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f854c072c40 0x7f854c071f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f853c009870 tx=0x7f853c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77497fe097b09aff server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:28.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f854b7fe640 1 -- 172.21.15.154:0/2804314802 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c0ab5f0 con 0x7f854c072c40 2024-05-14T01:23:28.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f854b7fe640 1 -- 172.21.15.154:0/2804314802 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f853c0b0070 con 0x7f854c072c40 2024-05-14T01:23:28.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f854b7fe640 1 -- 172.21.15.154:0/2804314802 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c0ab9b0 con 0x7f854c072c40 2024-05-14T01:23:28.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f8553140640 1 -- 172.21.15.154:0/2804314802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f854c072c40 msgr2=0x7f854c071f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:28.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f8553140640 1 --2- 172.21.15.154:0/2804314802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f854c072c40 0x7f854c071f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f853c009870 tx=0x7f853c01c520 comp rx=0 tx=0).stop 2024-05-14T01:23:28.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f8553140640 1 -- 172.21.15.154:0/2804314802 shutdown_connections 2024-05-14T01:23:28.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f8553140640 1 --2- 172.21.15.154:0/2804314802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f854c072c40 0x7f854c071f80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f8553140640 1 -- 172.21.15.154:0/2804314802 >> 172.21.15.154:0/2804314802 conn(0x7f854c0b1770 msgr2=0x7f854c0b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:28.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f8553140640 1 -- 172.21.15.154:0/2804314802 shutdown_connections 2024-05-14T01:23:28.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f8553140640 1 -- 172.21.15.154:0/2804314802 wait complete. 2024-05-14T01:23:28.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f8553140640 1 Processor -- start 2024-05-14T01:23:28.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f8553140640 1 -- start start 2024-05-14T01:23:28.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f8553140640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f854c072c40 0x7f854c06d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:28.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f8553140640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f854c162370 0x7f854c0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:28.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f8553140640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f854c14f5d0 0x7f854c144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:28.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f8553140640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f854c0ae520 con 0x7f854c072c40 2024-05-14T01:23:28.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f8553140640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f854c0ae3a0 con 0x7f854c162370 2024-05-14T01:23:28.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f8553140640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f854c16c820 con 0x7f854c14f5d0 2024-05-14T01:23:28.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f8550edc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f854c072c40 0x7f854c06d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:28.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f8550edc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f854c072c40 0x7f854c06d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59092/0 (socket says 172.21.15.154:59092) 2024-05-14T01:23:28.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.990+0000 7f8550edc640 1 -- 172.21.15.154:0/504003349 learned_addr learned my addr 172.21.15.154:0/504003349 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:28.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f8550edc640 1 -- 172.21.15.154:0/504003349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f854c14f5d0 msgr2=0x7f854c144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:28.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f8550edc640 1 --2- 172.21.15.154:0/504003349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f854c14f5d0 0x7f854c144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f854bfff640 1 --2- 172.21.15.154:0/504003349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f854c162370 0x7f854c0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:28.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f8550edc640 1 -- 172.21.15.154:0/504003349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f854c162370 msgr2=0x7f854c0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:28.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f8550edc640 1 --2- 172.21.15.154:0/504003349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f854c162370 0x7f854c0ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:28.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f8550edc640 1 -- 172.21.15.154:0/504003349 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c0cf3f0 con 0x7f854c072c40 2024-05-14T01:23:28.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f854bfff640 1 --2- 172.21.15.154:0/504003349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f854c162370 0x7f854c0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:28.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f8550edc640 1 --2- 172.21.15.154:0/504003349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f854c072c40 0x7f854c06d0e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f854400c7c0 tx=0x7f854400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:28.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f85497fa640 1 -- 172.21.15.154:0/504003349 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544016020 con 0x7f854c072c40 2024-05-14T01:23:28.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f85497fa640 1 -- 172.21.15.154:0/504003349 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854400aa50 con 0x7f854c072c40 2024-05-14T01:23:28.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f8553140640 1 -- 172.21.15.154:0/504003349 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854c14e810 con 0x7f854c072c40 2024-05-14T01:23:28.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f85497fa640 1 -- 172.21.15.154:0/504003349 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544012420 con 0x7f854c072c40 2024-05-14T01:23:28.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f8553140640 1 -- 172.21.15.154:0/504003349 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f854c14edd0 con 0x7f854c072c40 2024-05-14T01:23:28.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f8553140640 1 -- 172.21.15.154:0/504003349 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f854c075470 con 0x7f854c072c40 2024-05-14T01:23:28.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f85497fa640 1 -- 172.21.15.154:0/504003349 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8544019020 con 0x7f854c072c40 2024-05-14T01:23:28.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f85497fa640 1 --2- 172.21.15.154:0/504003349 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f85380678c0 0x7f8538069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:28.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f85497fa640 1 -- 172.21.15.154:0/504003349 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f85440859f0 con 0x7f854c072c40 2024-05-14T01:23:28.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f854bfff640 1 --2- 172.21.15.154:0/504003349 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f85380678c0 0x7f8538069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:28.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.994+0000 7f854bfff640 1 --2- 172.21.15.154:0/504003349 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f85380678c0 0x7f8538069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f854c14e740 tx=0x7f8540009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:28.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:28.998+0000 7f85497fa640 1 -- 172.21.15.154:0/504003349 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f8544020030 con 0x7f854c072c40 2024-05-14T01:23:29.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.150+0000 7f8553140640 1 -- 172.21.15.154:0/504003349 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f854c0b2180 con 0x7f854c072c40 2024-05-14T01:23:29.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.150+0000 7f85497fa640 1 -- 172.21.15.154:0/504003349 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f8544056880 con 0x7f854c072c40 2024-05-14T01:23:29.138 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:23:29.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.154+0000 7f8553140640 1 -- 172.21.15.154:0/504003349 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f85380678c0 msgr2=0x7f8538069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:29.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.154+0000 7f8553140640 1 --2- 172.21.15.154:0/504003349 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f85380678c0 0x7f8538069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f854c14e740 tx=0x7f8540009040 comp rx=0 tx=0).stop 2024-05-14T01:23:29.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.154+0000 7f8553140640 1 -- 172.21.15.154:0/504003349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f854c072c40 msgr2=0x7f854c06d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:29.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.154+0000 7f8553140640 1 --2- 172.21.15.154:0/504003349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f854c072c40 0x7f854c06d0e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f854400c7c0 tx=0x7f854400cc80 comp rx=0 tx=0).stop 2024-05-14T01:23:29.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.154+0000 7f8553140640 1 -- 172.21.15.154:0/504003349 shutdown_connections 2024-05-14T01:23:29.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.154+0000 7f8553140640 1 --2- 172.21.15.154:0/504003349 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f85380678c0 0x7f8538069d80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:29.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.154+0000 7f8553140640 1 --2- 172.21.15.154:0/504003349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f854c14f5d0 0x7f854c144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:29.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.154+0000 7f8553140640 1 --2- 172.21.15.154:0/504003349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f854c162370 0x7f854c0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:29.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.154+0000 7f8553140640 1 --2- 172.21.15.154:0/504003349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f854c072c40 0x7f854c06d0e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:29.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.154+0000 7f8553140640 1 -- 172.21.15.154:0/504003349 >> 172.21.15.154:0/504003349 conn(0x7f854c0b1770 msgr2=0x7f854c153f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:29.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.154+0000 7f8553140640 1 -- 172.21.15.154:0/504003349 shutdown_connections 2024-05-14T01:23:29.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.154+0000 7f8553140640 1 -- 172.21.15.154:0/504003349 wait complete. 2024-05-14T01:23:29.156 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T01:23:29.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99c1632640 1 Processor -- start 2024-05-14T01:23:29.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99c1632640 1 -- start start 2024-05-14T01:23:29.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99c1632640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f99bc1513c0 0x7f99bc0cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:29.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99c1632640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99bc15ee60 con 0x7f99bc06d470 2024-05-14T01:23:29.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99c1632640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99bc06dd70 con 0x7f99bc06d900 2024-05-14T01:23:29.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99c1632640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f99bc0cf9d0 con 0x7f99bc1513c0 2024-05-14T01:23:29.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99b3fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f99bc06d470 0x7f99bc15e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50114/0 (socket says 172.21.15.154:50114) 2024-05-14T01:23:29.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99b3fff640 1 -- 172.21.15.154:0/1065138909 learned_addr learned my addr 172.21.15.154:0/1065138909 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:29.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99baffd640 1 --2- 172.21.15.154:0/1065138909 >> v2:172.21.15.176:3300/0 conn(0x7f99bc1513c0 0x7f99bc0cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:29.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99ba7fc640 1 -- 172.21.15.154:0/1065138909 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1767990017 0 0) 0x7f99bc15ee60 con 0x7f99bc06d470 2024-05-14T01:23:29.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99ba7fc640 1 -- 172.21.15.154:0/1065138909 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99a8003530 con 0x7f99bc06d470 2024-05-14T01:23:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99ba7fc640 1 -- 172.21.15.154:0/1065138909 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1544325360 0 0) 0x7f99a8003530 con 0x7f99bc06d470 2024-05-14T01:23:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99ba7fc640 1 -- 172.21.15.154:0/1065138909 >> v2:172.21.15.176:3300/0 conn(0x7f99bc1513c0 msgr2=0x7f99bc0cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99ba7fc640 1 --2- 172.21.15.154:0/1065138909 >> v2:172.21.15.176:3300/0 conn(0x7f99bc1513c0 0x7f99bc0cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99ba7fc640 1 -- 172.21.15.154:0/1065138909 >> v1:172.21.15.176:6789/0 conn(0x7f99bc06d900 legacy=0x7f99bc15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99ba7fc640 1 -- 172.21.15.154:0/1065138909 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99bc0b2ec0 con 0x7f99bc06d470 2024-05-14T01:23:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99ba7fc640 1 -- 172.21.15.154:0/1065138909 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f99a4001680 con 0x7f99bc06d470 2024-05-14T01:23:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99ba7fc640 1 -- 172.21.15.154:0/1065138909 >> v1:172.21.15.154:6789/0 conn(0x7f99bc06d470 legacy=0x7f99bc15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99ba7fc640 1 --2- 172.21.15.154:0/1065138909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80039c0 0x7f99a8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99ba7fc640 1 --2- 172.21.15.154:0/1065138909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99a8004810 0x7f99a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99ba7fc640 1 --2- 172.21.15.154:0/1065138909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99a80051d0 0x7f99a80059a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99ba7fc640 1 -- 172.21.15.154:0/1065138909 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f99a8006010 con 0x7f99a80039c0 2024-05-14T01:23:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99ba7fc640 1 -- 172.21.15.154:0/1065138909 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f99a80061c0 con 0x7f99a8004810 2024-05-14T01:23:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99ba7fc640 1 -- 172.21.15.154:0/1065138909 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f99a80063c0 con 0x7f99a80051d0 2024-05-14T01:23:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99baffd640 1 --2- 172.21.15.154:0/1065138909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80039c0 0x7f99a8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99b3fff640 1 --2- 172.21.15.154:0/1065138909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99a8004810 0x7f99a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99bb7fe640 1 --2- 172.21.15.154:0/1065138909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99a80051d0 0x7f99a80059a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99baffd640 1 -- 172.21.15.154:0/1065138909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99a80051d0 msgr2=0x7f99a80059a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99baffd640 1 --2- 172.21.15.154:0/1065138909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99a80051d0 0x7f99a80059a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99baffd640 1 -- 172.21.15.154:0/1065138909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99a8004810 msgr2=0x7f99a8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99baffd640 1 --2- 172.21.15.154:0/1065138909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99a8004810 0x7f99a8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99baffd640 1 -- 172.21.15.154:0/1065138909 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a8003530 con 0x7f99a80039c0 2024-05-14T01:23:29.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99bb7fe640 1 --2- 172.21.15.154:0/1065138909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99a80051d0 0x7f99a80059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:29.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.290+0000 7f99bb7fe640 1 -- 172.21.15.154:0/1065138909 reap_dead start 2024-05-14T01:23:29.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99baffd640 1 --2- 172.21.15.154:0/1065138909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80039c0 0x7f99a8003de0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009ac0 tx=0x7f99ac01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c043eeaa56c750d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:29.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99ba7fc640 1 -- 172.21.15.154:0/1065138909 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac009690 con 0x7f99a80039c0 2024-05-14T01:23:29.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99ba7fc640 1 -- 172.21.15.154:0/1065138909 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99ac0a6440 con 0x7f99a80039c0 2024-05-14T01:23:29.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99ba7fc640 1 -- 172.21.15.154:0/1065138909 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0a6810 con 0x7f99a80039c0 2024-05-14T01:23:29.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99c1632640 1 -- 172.21.15.154:0/1065138909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80039c0 msgr2=0x7f99a8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:29.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99c1632640 1 --2- 172.21.15.154:0/1065138909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80039c0 0x7f99a8003de0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009ac0 tx=0x7f99ac01ca50 comp rx=0 tx=0).stop 2024-05-14T01:23:29.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99c1632640 1 -- 172.21.15.154:0/1065138909 shutdown_connections 2024-05-14T01:23:29.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99c1632640 1 --2- 172.21.15.154:0/1065138909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80039c0 0x7f99a8003de0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:29.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99c1632640 1 -- 172.21.15.154:0/1065138909 >> 172.21.15.154:0/1065138909 conn(0x7f99bc0b1850 msgr2=0x7f99bc0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:29.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99c1632640 1 -- 172.21.15.154:0/1065138909 shutdown_connections 2024-05-14T01:23:29.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99c1632640 1 -- 172.21.15.154:0/1065138909 wait complete. 2024-05-14T01:23:29.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99c1632640 1 Processor -- start 2024-05-14T01:23:29.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99c1632640 1 -- start start 2024-05-14T01:23:29.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99c1632640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80039c0 0x7f99bc15cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:29.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99c1632640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99bc157800 0x7f99bc14e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:29.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99c1632640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99bc157c80 0x7f99bc156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:29.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99c1632640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f99bc06e810 con 0x7f99a80039c0 2024-05-14T01:23:29.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99c1632640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f99bc0b2b50 con 0x7f99bc157c80 2024-05-14T01:23:29.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99c1632640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f99bc06e990 con 0x7f99bc157800 2024-05-14T01:23:29.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99baffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80039c0 0x7f99bc15cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:29.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99baffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80039c0 0x7f99bc15cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59108/0 (socket says 172.21.15.154:59108) 2024-05-14T01:23:29.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.294+0000 7f99baffd640 1 -- 172.21.15.154:0/2637483415 learned_addr learned my addr 172.21.15.154:0/2637483415 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:29.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99bb7fe640 1 --2- 172.21.15.154:0/2637483415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99bc157c80 0x7f99bc156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:29.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99b3fff640 1 --2- 172.21.15.154:0/2637483415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99bc157800 0x7f99bc14e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:29.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99baffd640 1 -- 172.21.15.154:0/2637483415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99bc157800 msgr2=0x7f99bc14e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:29.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99baffd640 1 --2- 172.21.15.154:0/2637483415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99bc157800 0x7f99bc14e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:29.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99baffd640 1 -- 172.21.15.154:0/2637483415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99bc157c80 msgr2=0x7f99bc156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:29.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99baffd640 1 --2- 172.21.15.154:0/2637483415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99bc157c80 0x7f99bc156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:29.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99baffd640 1 -- 172.21.15.154:0/2637483415 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99bc155290 con 0x7f99a80039c0 2024-05-14T01:23:29.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99baffd640 1 --2- 172.21.15.154:0/2637483415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80039c0 0x7f99bc15cb20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f99ac01c880 tx=0x7f99ac0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:29.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99b37fe640 1 -- 172.21.15.154:0/2637483415 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0a68b0 con 0x7f99a80039c0 2024-05-14T01:23:29.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99b37fe640 1 -- 172.21.15.154:0/2637483415 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99ac0a6a50 con 0x7f99a80039c0 2024-05-14T01:23:29.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99c1632640 1 -- 172.21.15.154:0/2637483415 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99bc155570 con 0x7f99a80039c0 2024-05-14T01:23:29.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99b37fe640 1 -- 172.21.15.154:0/2637483415 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0a6e40 con 0x7f99a80039c0 2024-05-14T01:23:29.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99c1632640 1 -- 172.21.15.154:0/2637483415 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99bc155b30 con 0x7f99a80039c0 2024-05-14T01:23:29.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99c1632640 1 -- 172.21.15.154:0/2637483415 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99bc075470 con 0x7f99a80039c0 2024-05-14T01:23:29.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99b37fe640 1 -- 172.21.15.154:0/2637483415 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f99ac0b9440 con 0x7f99a80039c0 2024-05-14T01:23:29.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99b37fe640 1 --2- 172.21.15.154:0/2637483415 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f999c0678f0 0x7f999c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:29.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99b3fff640 1 --2- 172.21.15.154:0/2637483415 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f999c0678f0 0x7f999c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:29.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99b37fe640 1 -- 172.21.15.154:0/2637483415 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f99ac11f490 con 0x7f99a80039c0 2024-05-14T01:23:29.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.298+0000 7f99b3fff640 1 --2- 172.21.15.154:0/2637483415 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f999c0678f0 0x7f999c069db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f99a4001ec0 tx=0x7f99a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:29.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.302+0000 7f99b37fe640 1 -- 172.21.15.154:0/2637483415 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f99ac0ac020 con 0x7f99a80039c0 2024-05-14T01:23:29.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.486+0000 7f99c1632640 1 -- 172.21.15.154:0/2637483415 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99bc073120 con 0x7f99a80039c0 2024-05-14T01:23:29.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.486+0000 7f99b37fe640 1 -- 172.21.15.154:0/2637483415 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7f99ac016760 con 0x7f99a80039c0 2024-05-14T01:23:29.473 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:29.473 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2575586302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2575586302},{"type":"v1","addr":"172.21.15.154:6836","nonce":2575586302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-14T01:23:29.474 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 2 2024-05-14T01:23:29.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.486+0000 7f99c1632640 1 -- 172.21.15.154:0/2637483415 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f999c0678f0 msgr2=0x7f999c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:29.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.486+0000 7f99c1632640 1 --2- 172.21.15.154:0/2637483415 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f999c0678f0 0x7f999c069db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f99a4001ec0 tx=0x7f99a4009040 comp rx=0 tx=0).stop 2024-05-14T01:23:29.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.486+0000 7f99c1632640 1 -- 172.21.15.154:0/2637483415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80039c0 msgr2=0x7f99bc15cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:29.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.486+0000 7f99c1632640 1 --2- 172.21.15.154:0/2637483415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80039c0 0x7f99bc15cb20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f99ac01c880 tx=0x7f99ac0197f0 comp rx=0 tx=0).stop 2024-05-14T01:23:29.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.486+0000 7f99c1632640 1 -- 172.21.15.154:0/2637483415 shutdown_connections 2024-05-14T01:23:29.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.486+0000 7f99c1632640 1 --2- 172.21.15.154:0/2637483415 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f999c0678f0 0x7f999c069db0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:29.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.486+0000 7f99c1632640 1 --2- 172.21.15.154:0/2637483415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99bc157c80 0x7f99bc156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:29.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.486+0000 7f99c1632640 1 --2- 172.21.15.154:0/2637483415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99bc157800 0x7f99bc14e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:29.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.486+0000 7f99c1632640 1 --2- 172.21.15.154:0/2637483415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80039c0 0x7f99bc15cb20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:29.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.486+0000 7f99c1632640 1 -- 172.21.15.154:0/2637483415 >> 172.21.15.154:0/2637483415 conn(0x7f99bc0b1850 msgr2=0x7f99bc15dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:29.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.486+0000 7f99c1632640 1 -- 172.21.15.154:0/2637483415 shutdown_connections 2024-05-14T01:23:29.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:29.486+0000 7f99c1632640 1 -- 172.21.15.154:0/2637483415 wait complete. 2024-05-14T01:23:31.493 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T01:23:31.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.638+0000 7f846c122640 1 Processor -- start 2024-05-14T01:23:31.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.638+0000 7f846c122640 1 -- start start 2024-05-14T01:23:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.638+0000 7f846c122640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8464070e60 0x7f84640b3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.638+0000 7f846c122640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84640b4820 0x7f846406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.638+0000 7f846c122640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8464071240 0x7f84640716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.638+0000 7f846c122640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f84640b2d60 con 0x7f8464070e60 2024-05-14T01:23:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.638+0000 7f846c122640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f84640ae1b0 con 0x7f8464071240 2024-05-14T01:23:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.638+0000 7f846c122640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f84640b3e40 con 0x7f84640b4820 2024-05-14T01:23:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.638+0000 7f8469ebe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8464070e60 0x7f84640b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.638+0000 7f8469ebe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8464070e60 0x7f84640b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59114/0 (socket says 172.21.15.154:59114) 2024-05-14T01:23:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.638+0000 7f8469ebe640 1 -- 172.21.15.154:0/1329627198 learned_addr learned my addr 172.21.15.154:0/1329627198 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.638+0000 7f84696bd640 1 --2- 172.21.15.154:0/1329627198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84640b4820 0x7f846406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:31.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.638+0000 7f846a6bf640 1 --2- 172.21.15.154:0/1329627198 >> v2:172.21.15.176:3300/0 conn(0x7f8464071240 0x7f84640716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:31.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.638+0000 7f8469ebe640 1 -- 172.21.15.154:0/1329627198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84640b4820 msgr2=0x7f846406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:31.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.638+0000 7f8469ebe640 1 --2- 172.21.15.154:0/1329627198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84640b4820 0x7f846406d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:31.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.638+0000 7f8469ebe640 1 -- 172.21.15.154:0/1329627198 >> v2:172.21.15.176:3300/0 conn(0x7f8464071240 msgr2=0x7f84640716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:31.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.638+0000 7f8469ebe640 1 --2- 172.21.15.154:0/1329627198 >> v2:172.21.15.176:3300/0 conn(0x7f8464071240 0x7f84640716d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:31.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.638+0000 7f8469ebe640 1 -- 172.21.15.154:0/1329627198 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84640b4110 con 0x7f8464070e60 2024-05-14T01:23:31.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f8469ebe640 1 --2- 172.21.15.154:0/1329627198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8464070e60 0x7f84640b3900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f84640b2be0 tx=0x7f846001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a31bcab8614eb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:31.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f8468ebc640 1 -- 172.21.15.154:0/1329627198 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84600b5070 con 0x7f8464070e60 2024-05-14T01:23:31.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f8468ebc640 1 -- 172.21.15.154:0/1329627198 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84600a89d0 con 0x7f8464070e60 2024-05-14T01:23:31.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f8468ebc640 1 -- 172.21.15.154:0/1329627198 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84600a8da0 con 0x7f8464070e60 2024-05-14T01:23:31.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f846c122640 1 -- 172.21.15.154:0/1329627198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8464070e60 msgr2=0x7f84640b3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:31.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f846c122640 1 --2- 172.21.15.154:0/1329627198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8464070e60 0x7f84640b3900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f84640b2be0 tx=0x7f846001ed10 comp rx=0 tx=0).stop 2024-05-14T01:23:31.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f846c122640 1 -- 172.21.15.154:0/1329627198 shutdown_connections 2024-05-14T01:23:31.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f846c122640 1 --2- 172.21.15.154:0/1329627198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84640b4820 0x7f846406d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:31.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f846c122640 1 --2- 172.21.15.154:0/1329627198 >> v2:172.21.15.176:3300/0 conn(0x7f8464071240 0x7f84640716d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:31.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f846c122640 1 --2- 172.21.15.154:0/1329627198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8464070e60 0x7f84640b3900 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:31.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f846c122640 1 -- 172.21.15.154:0/1329627198 >> 172.21.15.154:0/1329627198 conn(0x7f84640b1850 msgr2=0x7f84640b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:31.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f846c122640 1 -- 172.21.15.154:0/1329627198 shutdown_connections 2024-05-14T01:23:31.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f846c122640 1 -- 172.21.15.154:0/1329627198 wait complete. 2024-05-14T01:23:31.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f846c122640 1 Processor -- start 2024-05-14T01:23:31.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f846c122640 1 -- start start 2024-05-14T01:23:31.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f846c122640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8464070e60 0x7f8464155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:31.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f846c122640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8464071240 0x7f8464145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:31.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f846c122640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84640b4820 0x7f846415a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:31.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f846c122640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f84640ade40 con 0x7f8464071240 2024-05-14T01:23:31.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f846c122640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84640adb60 con 0x7f84640b4820 2024-05-14T01:23:31.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f846c122640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f846406d6b0 con 0x7f8464070e60 2024-05-14T01:23:31.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f84696bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8464071240 0x7f8464145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:31.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f84696bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8464071240 0x7f8464145200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59120/0 (socket says 172.21.15.154:59120) 2024-05-14T01:23:31.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f84696bd640 1 -- 172.21.15.154:0/117750794 learned_addr learned my addr 172.21.15.154:0/117750794 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:31.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.642+0000 7f846a6bf640 1 --2- 172.21.15.154:0/117750794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84640b4820 0x7f846415a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:31.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f8469ebe640 1 --2- 172.21.15.154:0/117750794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8464070e60 0x7f8464155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:31.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f84696bd640 1 -- 172.21.15.154:0/117750794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8464070e60 msgr2=0x7f8464155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:31.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f84696bd640 1 --2- 172.21.15.154:0/117750794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8464070e60 0x7f8464155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:31.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f84696bd640 1 -- 172.21.15.154:0/117750794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84640b4820 msgr2=0x7f846415a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:31.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f84696bd640 1 --2- 172.21.15.154:0/117750794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84640b4820 0x7f846415a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:31.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f84696bd640 1 -- 172.21.15.154:0/117750794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846415c0a0 con 0x7f8464071240 2024-05-14T01:23:31.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f846a6bf640 1 --2- 172.21.15.154:0/117750794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84640b4820 0x7f846415a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:31.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f84696bd640 1 --2- 172.21.15.154:0/117750794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8464071240 0x7f8464145200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f845400d830 tx=0x7f845400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:31.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f845a7fc640 1 -- 172.21.15.154:0/117750794 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845400b6c0 con 0x7f8464071240 2024-05-14T01:23:31.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f845a7fc640 1 -- 172.21.15.154:0/117750794 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8454019070 con 0x7f8464071240 2024-05-14T01:23:31.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f846c122640 1 -- 172.21.15.154:0/117750794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f846415c320 con 0x7f8464071240 2024-05-14T01:23:31.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f845a7fc640 1 -- 172.21.15.154:0/117750794 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845400bae0 con 0x7f8464071240 2024-05-14T01:23:31.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f846c122640 1 -- 172.21.15.154:0/117750794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f846415c8c0 con 0x7f8464071240 2024-05-14T01:23:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f846c122640 1 -- 172.21.15.154:0/117750794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8464075470 con 0x7f8464071240 2024-05-14T01:23:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f845a7fc640 1 -- 172.21.15.154:0/117750794 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f845401e460 con 0x7f8464071240 2024-05-14T01:23:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f845a7fc640 1 --2- 172.21.15.154:0/117750794 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f84480678c0 0x7f8448069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f845a7fc640 1 -- 172.21.15.154:0/117750794 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f8454086030 con 0x7f8464071240 2024-05-14T01:23:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f8469ebe640 1 --2- 172.21.15.154:0/117750794 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f84480678c0 0x7f8448069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:31.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.646+0000 7f8469ebe640 1 --2- 172.21.15.154:0/117750794 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f84480678c0 0x7f8448069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f84600b2000 tx=0x7f8460008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:31.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.650+0000 7f845a7fc640 1 -- 172.21.15.154:0/117750794 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f846415c0a0 con 0x7f8464071240 2024-05-14T01:23:31.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.846+0000 7f846c122640 1 -- 172.21.15.154:0/117750794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8464072e00 con 0x7f8464071240 2024-05-14T01:23:31.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.850+0000 7f845a7fc640 1 -- 172.21.15.154:0/117750794 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7f8454056ec0 con 0x7f8464071240 2024-05-14T01:23:31.837 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:31.837 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2575586302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2575586302},{"type":"v1","addr":"172.21.15.154:6836","nonce":2575586302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3108110937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3108110937},{"type":"v1","addr":"172.21.15.154:6837","nonce":3108110937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/77727941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":77727941},{"type":"v1","addr":"172.21.15.176:6833","nonce":77727941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2614790445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2614790445},{"type":"v1","addr":"172.21.15.176:6835","nonce":2614790445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-14T01:23:31.837 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 3 2024-05-14T01:23:31.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.850+0000 7f846c122640 1 -- 172.21.15.154:0/117750794 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f84480678c0 msgr2=0x7f8448069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:31.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.850+0000 7f846c122640 1 --2- 172.21.15.154:0/117750794 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f84480678c0 0x7f8448069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f84600b2000 tx=0x7f8460008040 comp rx=0 tx=0).stop 2024-05-14T01:23:31.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.850+0000 7f846c122640 1 -- 172.21.15.154:0/117750794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8464071240 msgr2=0x7f8464145200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:31.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.850+0000 7f846c122640 1 --2- 172.21.15.154:0/117750794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8464071240 0x7f8464145200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f845400d830 tx=0x7f845400dcf0 comp rx=0 tx=0).stop 2024-05-14T01:23:31.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.850+0000 7f846c122640 1 -- 172.21.15.154:0/117750794 shutdown_connections 2024-05-14T01:23:31.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.850+0000 7f846c122640 1 --2- 172.21.15.154:0/117750794 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f84480678c0 0x7f8448069d80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:31.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.850+0000 7f846c122640 1 --2- 172.21.15.154:0/117750794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84640b4820 0x7f846415a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:31.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.850+0000 7f846c122640 1 --2- 172.21.15.154:0/117750794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8464071240 0x7f8464145200 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:31.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.850+0000 7f846c122640 1 --2- 172.21.15.154:0/117750794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8464070e60 0x7f8464155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:31.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.850+0000 7f846c122640 1 -- 172.21.15.154:0/117750794 >> 172.21.15.154:0/117750794 conn(0x7f84640b1850 msgr2=0x7f84640ae640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:31.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.850+0000 7f846c122640 1 -- 172.21.15.154:0/117750794 shutdown_connections 2024-05-14T01:23:31.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.850+0000 7f846c122640 1 -- 172.21.15.154:0/117750794 wait complete. 2024-05-14T01:23:31.855 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:23:31.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.978+0000 7f5d7ff9f640 1 Processor -- start 2024-05-14T01:23:31.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.978+0000 7f5d7ff9f640 1 -- start start 2024-05-14T01:23:31.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7ff9f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5d7813ede0 0x7f5d781415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:31.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7ff9f640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5d780cea50 0x7f5d7806d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:31.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7ff9f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d780cf100 con 0x7f5d78141b30 2024-05-14T01:23:31.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7ff9f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f5d780ceee0 con 0x7f5d7813ede0 2024-05-14T01:23:31.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7ff9f640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f5d78141f90 con 0x7f5d780cea50 2024-05-14T01:23:31.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7dd3b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5d7813ede0 0x7f5d781415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:31.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7d53a640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5d78141b30 0x7f5d780ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50130/0 (socket says 172.21.15.154:50130) 2024-05-14T01:23:31.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7d53a640 1 -- 172.21.15.154:0/1553750119 learned_addr learned my addr 172.21.15.154:0/1553750119 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:31.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7e53c640 1 --2- 172.21.15.154:0/1553750119 >> v2:172.21.15.176:3300/0 conn(0x7f5d780cea50 0x7f5d7806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:31.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7cd39640 1 -- 172.21.15.154:0/1553750119 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 322667239 0 0) 0x7f5d780cf100 con 0x7f5d78141b30 2024-05-14T01:23:31.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7cd39640 1 -- 172.21.15.154:0/1553750119 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d64003530 con 0x7f5d78141b30 2024-05-14T01:23:31.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7dd3b640 1 -- 172.21.15.154:0/1553750119 >> v2:172.21.15.176:3300/0 conn(0x7f5d780cea50 msgr2=0x7f5d7806d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:31.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7dd3b640 1 --2- 172.21.15.154:0/1553750119 >> v2:172.21.15.176:3300/0 conn(0x7f5d780cea50 0x7f5d7806d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:31.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7dd3b640 1 -- 172.21.15.154:0/1553750119 >> v1:172.21.15.154:6789/0 conn(0x7f5d78141b30 legacy=0x7f5d780ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:31.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7dd3b640 1 -- 172.21.15.154:0/1553750119 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d780cf3e0 con 0x7f5d7813ede0 2024-05-14T01:23:31.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7dd3b640 1 --2- 172.21.15.154:0/1553750119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d7813ede0 0x7f5d781415f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5d740097f0 tx=0x7f5d7401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf3ec9e5c9a4e46 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:31.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7cd39640 1 -- 172.21.15.154:0/1553750119 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d740b0070 con 0x7f5d7813ede0 2024-05-14T01:23:31.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7cd39640 1 -- 172.21.15.154:0/1553750119 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d740ab600 con 0x7f5d7813ede0 2024-05-14T01:23:31.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.982+0000 7f5d7cd39640 1 -- 172.21.15.154:0/1553750119 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d740ab9b0 con 0x7f5d7813ede0 2024-05-14T01:23:31.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7ff9f640 1 -- 172.21.15.154:0/1553750119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d7813ede0 msgr2=0x7f5d781415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:31.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7ff9f640 1 --2- 172.21.15.154:0/1553750119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d7813ede0 0x7f5d781415f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5d740097f0 tx=0x7f5d7401c460 comp rx=0 tx=0).stop 2024-05-14T01:23:31.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7ff9f640 1 -- 172.21.15.154:0/1553750119 shutdown_connections 2024-05-14T01:23:31.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7ff9f640 1 --2- 172.21.15.154:0/1553750119 >> v2:172.21.15.176:3300/0 conn(0x7f5d780cea50 0x7f5d7806d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:31.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7ff9f640 1 --2- 172.21.15.154:0/1553750119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d7813ede0 0x7f5d781415f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:31.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7ff9f640 1 -- 172.21.15.154:0/1553750119 >> 172.21.15.154:0/1553750119 conn(0x7f5d780b1850 msgr2=0x7f5d780b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:31.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7ff9f640 1 -- 172.21.15.154:0/1553750119 shutdown_connections 2024-05-14T01:23:31.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7ff9f640 1 -- 172.21.15.154:0/1553750119 wait complete. 2024-05-14T01:23:31.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7ff9f640 1 Processor -- start 2024-05-14T01:23:31.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7ff9f640 1 -- start start 2024-05-14T01:23:31.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7ff9f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d780cea50 0x7f5d781372c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:31.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7ff9f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d7813ede0 0x7f5d781574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:31.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7ff9f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d78141b30 0x7f5d78138540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:31.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7ff9f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7806e350 con 0x7f5d7813ede0 2024-05-14T01:23:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7ff9f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7806e1d0 con 0x7f5d78141b30 2024-05-14T01:23:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7ff9f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5d7806e4d0 con 0x7f5d780cea50 2024-05-14T01:23:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7d53a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d7813ede0 0x7f5d781574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7d53a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d7813ede0 0x7f5d781574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59136/0 (socket says 172.21.15.154:59136) 2024-05-14T01:23:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7d53a640 1 -- 172.21.15.154:0/2122420295 learned_addr learned my addr 172.21.15.154:0/2122420295 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7e53c640 1 --2- 172.21.15.154:0/2122420295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d78141b30 0x7f5d78138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7dd3b640 1 --2- 172.21.15.154:0/2122420295 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d780cea50 0x7f5d781372c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7d53a640 1 -- 172.21.15.154:0/2122420295 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d780cea50 msgr2=0x7f5d781372c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7d53a640 1 --2- 172.21.15.154:0/2122420295 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d780cea50 0x7f5d781372c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7d53a640 1 -- 172.21.15.154:0/2122420295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d78141b30 msgr2=0x7f5d78138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7d53a640 1 --2- 172.21.15.154:0/2122420295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d78141b30 0x7f5d78138540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7d53a640 1 -- 172.21.15.154:0/2122420295 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d781568e0 con 0x7f5d7813ede0 2024-05-14T01:23:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7dd3b640 1 --2- 172.21.15.154:0/2122420295 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d780cea50 0x7f5d781372c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7e53c640 1 --2- 172.21.15.154:0/2122420295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d78141b30 0x7f5d78138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:31.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7d53a640 1 --2- 172.21.15.154:0/2122420295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d7813ede0 0x7f5d781574e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800c420 tx=0x7f5d6800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:31.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d6e7fc640 1 -- 172.21.15.154:0/2122420295 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d68017070 con 0x7f5d7813ede0 2024-05-14T01:23:31.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d6e7fc640 1 -- 172.21.15.154:0/2122420295 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d68005cf0 con 0x7f5d7813ede0 2024-05-14T01:23:31.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7ff9f640 1 -- 172.21.15.154:0/2122420295 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d78157a20 con 0x7f5d7813ede0 2024-05-14T01:23:31.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d6e7fc640 1 -- 172.21.15.154:0/2122420295 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d680072d0 con 0x7f5d7813ede0 2024-05-14T01:23:31.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.986+0000 7f5d7ff9f640 1 -- 172.21.15.154:0/2122420295 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d78156600 con 0x7f5d7813ede0 2024-05-14T01:23:31.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.990+0000 7f5d7ff9f640 1 -- 172.21.15.154:0/2122420295 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d78075470 con 0x7f5d7813ede0 2024-05-14T01:23:31.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.990+0000 7f5d6e7fc640 1 -- 172.21.15.154:0/2122420295 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5d6801a070 con 0x7f5d7813ede0 2024-05-14T01:23:31.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.990+0000 7f5d6e7fc640 1 --2- 172.21.15.154:0/2122420295 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f5d5c0678c0 0x7f5d5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:31.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.990+0000 7f5d6e7fc640 1 -- 172.21.15.154:0/2122420295 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f5d68084be0 con 0x7f5d7813ede0 2024-05-14T01:23:31.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.990+0000 7f5d7dd3b640 1 --2- 172.21.15.154:0/2122420295 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f5d5c0678c0 0x7f5d5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:31.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.990+0000 7f5d7dd3b640 1 --2- 172.21.15.154:0/2122420295 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f5d5c0678c0 0x7f5d5c069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5d740ad000 tx=0x7f5d74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:31.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:31.994+0000 7f5d6e7fc640 1 -- 172.21.15.154:0/2122420295 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f5d68055420 con 0x7f5d7813ede0 2024-05-14T01:23:32.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.154+0000 7f5d7ff9f640 1 -- 172.21.15.154:0/2122420295 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d7806f180 con 0x7f5d7813ede0 2024-05-14T01:23:32.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.154+0000 7f5d6e7fc640 1 -- 172.21.15.154:0/2122420295 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12932 (secure 0 0 0) 0x7f5d68059720 con 0x7f5d7813ede0 2024-05-14T01:23:32.142 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:32.142 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":17,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:26.154968+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:23:32.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.154+0000 7f5d7ff9f640 1 -- 172.21.15.154:0/2122420295 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f5d5c0678c0 msgr2=0x7f5d5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:32.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.158+0000 7f5d7ff9f640 1 --2- 172.21.15.154:0/2122420295 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f5d5c0678c0 0x7f5d5c069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5d740ad000 tx=0x7f5d74008040 comp rx=0 tx=0).stop 2024-05-14T01:23:32.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.158+0000 7f5d7ff9f640 1 -- 172.21.15.154:0/2122420295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d7813ede0 msgr2=0x7f5d781574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:32.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.158+0000 7f5d7ff9f640 1 --2- 172.21.15.154:0/2122420295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d7813ede0 0x7f5d781574e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800c420 tx=0x7f5d6800c8e0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.158+0000 7f5d7ff9f640 1 -- 172.21.15.154:0/2122420295 shutdown_connections 2024-05-14T01:23:32.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.158+0000 7f5d7ff9f640 1 --2- 172.21.15.154:0/2122420295 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f5d5c0678c0 0x7f5d5c069d80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.158+0000 7f5d7ff9f640 1 --2- 172.21.15.154:0/2122420295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d78141b30 0x7f5d78138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.158+0000 7f5d7ff9f640 1 --2- 172.21.15.154:0/2122420295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d7813ede0 0x7f5d781574e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.158+0000 7f5d7ff9f640 1 --2- 172.21.15.154:0/2122420295 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d780cea50 0x7f5d781372c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.158+0000 7f5d7ff9f640 1 -- 172.21.15.154:0/2122420295 >> 172.21.15.154:0/2122420295 conn(0x7f5d780b1850 msgr2=0x7f5d78140e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:32.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.158+0000 7f5d7ff9f640 1 -- 172.21.15.154:0/2122420295 shutdown_connections 2024-05-14T01:23:32.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.158+0000 7f5d7ff9f640 1 -- 172.21.15.154:0/2122420295 wait complete. 2024-05-14T01:23:32.160 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:23:32.161 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:23:32.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.294+0000 7f9ed8a89640 1 Processor -- start 2024-05-14T01:23:32.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.294+0000 7f9ed8a89640 1 -- start start 2024-05-14T01:23:32.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.294+0000 7f9ed8a89640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9ed4158920 0x7f9ed4072c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.294+0000 7f9ed8a89640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9ed4071f80 0x7f9ed40b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.294+0000 7f9ed8a89640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ed4072410 con 0x7f9ed4161c60 2024-05-14T01:23:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.294+0000 7f9ed8a89640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9ed4071af0 con 0x7f9ed4071f80 2024-05-14T01:23:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.294+0000 7f9ed8a89640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9ed40b3bb0 con 0x7f9ed4158920 2024-05-14T01:23:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.294+0000 7f9ed1d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9ed4071f80 0x7f9ed40b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.294+0000 7f9ed1d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9ed4071f80 0x7f9ed40b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59142/0 (socket says 172.21.15.154:59142) 2024-05-14T01:23:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.294+0000 7f9ed1d9b640 1 -- 172.21.15.154:0/2936970139 learned_addr learned my addr 172.21.15.154:0/2936970139 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.294+0000 7f9ed259c640 1 --2- 172.21.15.154:0/2936970139 >> v2:172.21.15.176:3300/0 conn(0x7f9ed4158920 0x7f9ed4072c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.294+0000 7f9ed1d9b640 1 -- 172.21.15.154:0/2936970139 >> v2:172.21.15.176:3300/0 conn(0x7f9ed4158920 msgr2=0x7f9ed4072c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.294+0000 7f9ed1d9b640 1 --2- 172.21.15.154:0/2936970139 >> v2:172.21.15.176:3300/0 conn(0x7f9ed4158920 0x7f9ed4072c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.294+0000 7f9ed1d9b640 1 -- 172.21.15.154:0/2936970139 >> v1:172.21.15.176:6789/0 conn(0x7f9ed4161c60 legacy=0x7f9ed40ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.294+0000 7f9ed1d9b640 1 -- 172.21.15.154:0/2936970139 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed40711c0 con 0x7f9ed4071f80 2024-05-14T01:23:32.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.294+0000 7f9ed259c640 1 --2- 172.21.15.154:0/2936970139 >> v2:172.21.15.176:3300/0 conn(0x7f9ed4158920 0x7f9ed4072c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:32.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.298+0000 7f9ed1d9b640 1 --2- 172.21.15.154:0/2936970139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ed4071f80 0x7f9ed40b3480 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40d0c30 tx=0x7f9ec801c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24ceb87e6c677fd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:32.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.298+0000 7f9ed159a640 1 -- 172.21.15.154:0/2936970139 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec80b0070 con 0x7f9ed4071f80 2024-05-14T01:23:32.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.298+0000 7f9ed159a640 1 -- 172.21.15.154:0/2936970139 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec80ab600 con 0x7f9ed4071f80 2024-05-14T01:23:32.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.298+0000 7f9ed159a640 1 -- 172.21.15.154:0/2936970139 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec80ab9d0 con 0x7f9ed4071f80 2024-05-14T01:23:32.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.298+0000 7f9ed8a89640 1 -- 172.21.15.154:0/2936970139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ed4071f80 msgr2=0x7f9ed40b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:32.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.298+0000 7f9ed8a89640 1 --2- 172.21.15.154:0/2936970139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ed4071f80 0x7f9ed40b3480 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40d0c30 tx=0x7f9ec801c300 comp rx=0 tx=0).stop 2024-05-14T01:23:32.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.298+0000 7f9ed8a89640 1 -- 172.21.15.154:0/2936970139 shutdown_connections 2024-05-14T01:23:32.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.298+0000 7f9ed8a89640 1 --2- 172.21.15.154:0/2936970139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ed4071f80 0x7f9ed40b3480 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.298+0000 7f9ed8a89640 1 --2- 172.21.15.154:0/2936970139 >> v2:172.21.15.176:3300/0 conn(0x7f9ed4158920 0x7f9ed4072c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.298+0000 7f9ed8a89640 1 -- 172.21.15.154:0/2936970139 >> 172.21.15.154:0/2936970139 conn(0x7f9ed40b1770 msgr2=0x7f9ed40b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:32.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.298+0000 7f9ed8a89640 1 -- 172.21.15.154:0/2936970139 shutdown_connections 2024-05-14T01:23:32.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.298+0000 7f9ed8a89640 1 -- 172.21.15.154:0/2936970139 wait complete. 2024-05-14T01:23:32.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed8a89640 1 Processor -- start 2024-05-14T01:23:32.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed8a89640 1 -- start start 2024-05-14T01:23:32.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed8a89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ed4071f80 0x7f9ed406ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed8a89640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ed4161c60 0x7f9ed414e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed8a89640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ed40cc680 0x7f9ed40ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed8a89640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed40ae520 con 0x7f9ed4071f80 2024-05-14T01:23:32.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed8a89640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed40ae3a0 con 0x7f9ed40cc680 2024-05-14T01:23:32.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed8a89640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed416b810 con 0x7f9ed4161c60 2024-05-14T01:23:32.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ed4071f80 0x7f9ed406ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ed4071f80 0x7f9ed406ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59158/0 (socket says 172.21.15.154:59158) 2024-05-14T01:23:32.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed259c640 1 -- 172.21.15.154:0/3961308422 learned_addr learned my addr 172.21.15.154:0/3961308422 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:32.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed2d9d640 1 --2- 172.21.15.154:0/3961308422 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ed40cc680 0x7f9ed40ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed259c640 1 -- 172.21.15.154:0/3961308422 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ed4161c60 msgr2=0x7f9ed414e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:32.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed1d9b640 1 --2- 172.21.15.154:0/3961308422 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ed4161c60 0x7f9ed414e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed259c640 1 --2- 172.21.15.154:0/3961308422 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ed4161c60 0x7f9ed414e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed259c640 1 -- 172.21.15.154:0/3961308422 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ed40cc680 msgr2=0x7f9ed40ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:32.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed259c640 1 --2- 172.21.15.154:0/3961308422 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ed40cc680 0x7f9ed40ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed259c640 1 -- 172.21.15.154:0/3961308422 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed4156560 con 0x7f9ed4071f80 2024-05-14T01:23:32.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed2d9d640 1 --2- 172.21.15.154:0/3961308422 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ed40cc680 0x7f9ed40ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:32.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed259c640 1 --2- 172.21.15.154:0/3961308422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ed4071f80 0x7f9ed406ceb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400c7c0 tx=0x7f9ec400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:32.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ec2ffd640 1 -- 172.21.15.154:0/3961308422 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4007a30 con 0x7f9ed4071f80 2024-05-14T01:23:32.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ec2ffd640 1 -- 172.21.15.154:0/3961308422 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec4007bd0 con 0x7f9ed4071f80 2024-05-14T01:23:32.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed8a89640 1 -- 172.21.15.154:0/3961308422 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed4156840 con 0x7f9ed4071f80 2024-05-14T01:23:32.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ec2ffd640 1 -- 172.21.15.154:0/3961308422 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec40113f0 con 0x7f9ed4071f80 2024-05-14T01:23:32.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed8a89640 1 -- 172.21.15.154:0/3961308422 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed414eb10 con 0x7f9ed4071f80 2024-05-14T01:23:32.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ed8a89640 1 -- 172.21.15.154:0/3961308422 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed4075470 con 0x7f9ed4071f80 2024-05-14T01:23:32.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.302+0000 7f9ec2ffd640 1 -- 172.21.15.154:0/3961308422 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9ec4011590 con 0x7f9ed4071f80 2024-05-14T01:23:32.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.306+0000 7f9ec2ffd640 1 --2- 172.21.15.154:0/3961308422 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9eb40678f0 0x7f9eb4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.306+0000 7f9ed1d9b640 1 --2- 172.21.15.154:0/3961308422 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9eb40678f0 0x7f9eb4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.306+0000 7f9ec2ffd640 1 -- 172.21.15.154:0/3961308422 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f9ec4085ad0 con 0x7f9ed4071f80 2024-05-14T01:23:32.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.306+0000 7f9ed1d9b640 1 --2- 172.21.15.154:0/3961308422 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9eb40678f0 0x7f9eb4069db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80ad000 tx=0x7f9ec8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:32.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.310+0000 7f9ec2ffd640 1 -- 172.21.15.154:0/3961308422 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f9ec4015020 con 0x7f9ed4071f80 2024-05-14T01:23:32.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.462+0000 7f9ed8a89640 1 -- 172.21.15.154:0/3961308422 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9ed40cf8d0 con 0x7f9ed4071f80 2024-05-14T01:23:32.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.462+0000 7f9ec2ffd640 1 -- 172.21.15.154:0/3961308422 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f9ec4056960 con 0x7f9ed4071f80 2024-05-14T01:23:32.451 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:23:32.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.466+0000 7f9ed8a89640 1 -- 172.21.15.154:0/3961308422 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9eb40678f0 msgr2=0x7f9eb4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:32.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.466+0000 7f9ed8a89640 1 --2- 172.21.15.154:0/3961308422 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9eb40678f0 0x7f9eb4069db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80ad000 tx=0x7f9ec8008040 comp rx=0 tx=0).stop 2024-05-14T01:23:32.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.466+0000 7f9ed8a89640 1 -- 172.21.15.154:0/3961308422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ed4071f80 msgr2=0x7f9ed406ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:32.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.466+0000 7f9ed8a89640 1 --2- 172.21.15.154:0/3961308422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ed4071f80 0x7f9ed406ceb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400c7c0 tx=0x7f9ec400cc80 comp rx=0 tx=0).stop 2024-05-14T01:23:32.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.466+0000 7f9ed8a89640 1 -- 172.21.15.154:0/3961308422 shutdown_connections 2024-05-14T01:23:32.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.466+0000 7f9ed8a89640 1 --2- 172.21.15.154:0/3961308422 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9eb40678f0 0x7f9eb4069db0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.466+0000 7f9ed8a89640 1 --2- 172.21.15.154:0/3961308422 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ed40cc680 0x7f9ed40ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.466+0000 7f9ed8a89640 1 --2- 172.21.15.154:0/3961308422 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ed4161c60 0x7f9ed414e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.466+0000 7f9ed8a89640 1 --2- 172.21.15.154:0/3961308422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ed4071f80 0x7f9ed406ceb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.466+0000 7f9ed8a89640 1 -- 172.21.15.154:0/3961308422 >> 172.21.15.154:0/3961308422 conn(0x7f9ed40b1770 msgr2=0x7f9ed4151300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:32.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.466+0000 7f9ed8a89640 1 -- 172.21.15.154:0/3961308422 shutdown_connections 2024-05-14T01:23:32.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.466+0000 7f9ed8a89640 1 -- 172.21.15.154:0/3961308422 wait complete. 2024-05-14T01:23:32.470 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-14T01:23:32.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.586+0000 7f8240e19640 1 Processor -- start 2024-05-14T01:23:32.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.586+0000 7f8240e19640 1 -- start start 2024-05-14T01:23:32.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.586+0000 7f8240e19640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f823c0cf520 0x7f823c0d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.586+0000 7f8240e19640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f823c15e4e0 0x7f823c0b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.586+0000 7f8240e19640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f823c0d29f0 con 0x7f823c15e100 2024-05-14T01:23:32.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.586+0000 7f8240e19640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f823c0d2cd0 con 0x7f823c15e4e0 2024-05-14T01:23:32.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.586+0000 7f8240e19640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f823c0d2fb0 con 0x7f823c0cf520 2024-05-14T01:23:32.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.586+0000 7f823ad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f823c15e4e0 0x7f823c0b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.586+0000 7f823ad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f823c15e4e0 0x7f823c0b9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59164/0 (socket says 172.21.15.154:59164) 2024-05-14T01:23:32.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.586+0000 7f823ad9d640 1 -- 172.21.15.154:0/3136827496 learned_addr learned my addr 172.21.15.154:0/3136827496 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:32.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.586+0000 7f8239d9b640 1 --2- 172.21.15.154:0/3136827496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f823c0cf520 0x7f823c0d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.586+0000 7f823ad9d640 1 -- 172.21.15.154:0/3136827496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f823c0cf520 msgr2=0x7f823c0d22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:32.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.586+0000 7f823ad9d640 1 --2- 172.21.15.154:0/3136827496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f823c0cf520 0x7f823c0d22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.586+0000 7f823ad9d640 1 -- 172.21.15.154:0/3136827496 >> v1:172.21.15.176:6789/0 conn(0x7f823c15e100 legacy=0x7f823c0cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:32.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.586+0000 7f823ad9d640 1 -- 172.21.15.154:0/3136827496 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823c0d3290 con 0x7f823c15e4e0 2024-05-14T01:23:32.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f823ad9d640 1 --2- 172.21.15.154:0/3136827496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f823c15e4e0 0x7f823c0b9b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8234009e50 tx=0x7f823401f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41a44bf40c947e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:32.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f823959a640 1 -- 172.21.15.154:0/3136827496 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82340b4070 con 0x7f823c15e4e0 2024-05-14T01:23:32.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f823959a640 1 -- 172.21.15.154:0/3136827496 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82340af400 con 0x7f823c15e4e0 2024-05-14T01:23:32.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f823959a640 1 -- 172.21.15.154:0/3136827496 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82340af7d0 con 0x7f823c15e4e0 2024-05-14T01:23:32.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f8240e19640 1 -- 172.21.15.154:0/3136827496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f823c15e4e0 msgr2=0x7f823c0b9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:32.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f8240e19640 1 --2- 172.21.15.154:0/3136827496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f823c15e4e0 0x7f823c0b9b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8234009e50 tx=0x7f823401f210 comp rx=0 tx=0).stop 2024-05-14T01:23:32.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f8240e19640 1 -- 172.21.15.154:0/3136827496 shutdown_connections 2024-05-14T01:23:32.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f8240e19640 1 --2- 172.21.15.154:0/3136827496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f823c15e4e0 0x7f823c0b9b20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f8240e19640 1 --2- 172.21.15.154:0/3136827496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f823c0cf520 0x7f823c0d22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f8240e19640 1 -- 172.21.15.154:0/3136827496 >> 172.21.15.154:0/3136827496 conn(0x7f823c0b5b50 msgr2=0x7f823c0b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:32.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f8240e19640 1 -- 172.21.15.154:0/3136827496 shutdown_connections 2024-05-14T01:23:32.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f8240e19640 1 -- 172.21.15.154:0/3136827496 wait complete. 2024-05-14T01:23:32.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f8240e19640 1 Processor -- start 2024-05-14T01:23:32.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f8240e19640 1 -- start start 2024-05-14T01:23:32.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f8240e19640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f823c0cf520 0x7f823c14e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f8240e19640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f823c15e100 0x7f823c15f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f8240e19640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f823c15e4e0 0x7f823c1f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f8240e19640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f823c0d3c10 con 0x7f823c15e100 2024-05-14T01:23:32.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f8240e19640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f823c0d3a90 con 0x7f823c0cf520 2024-05-14T01:23:32.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f8240e19640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f823c14e810 con 0x7f823c15e4e0 2024-05-14T01:23:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f8239d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f823c15e100 0x7f823c15f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.590+0000 7f8239d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f823c15e100 0x7f823c15f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59168/0 (socket says 172.21.15.154:59168) 2024-05-14T01:23:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f8239d9b640 1 -- 172.21.15.154:0/1017178733 learned_addr learned my addr 172.21.15.154:0/1017178733 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f823a59c640 1 --2- 172.21.15.154:0/1017178733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f823c0cf520 0x7f823c14e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f823ad9d640 1 --2- 172.21.15.154:0/1017178733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f823c15e4e0 0x7f823c1f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f8239d9b640 1 -- 172.21.15.154:0/1017178733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f823c15e4e0 msgr2=0x7f823c1f3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f8239d9b640 1 --2- 172.21.15.154:0/1017178733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f823c15e4e0 0x7f823c1f3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f8239d9b640 1 -- 172.21.15.154:0/1017178733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f823c0cf520 msgr2=0x7f823c14e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f8239d9b640 1 --2- 172.21.15.154:0/1017178733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f823c0cf520 0x7f823c14e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f8239d9b640 1 -- 172.21.15.154:0/1017178733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823c0cc5b0 con 0x7f823c15e100 2024-05-14T01:23:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f823a59c640 1 --2- 172.21.15.154:0/1017178733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f823c0cf520 0x7f823c14e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:32.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f8239d9b640 1 --2- 172.21.15.154:0/1017178733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f823c15e100 0x7f823c15f350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f823000d800 tx=0x7f823000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:32.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f822affd640 1 -- 172.21.15.154:0/1017178733 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823000b6c0 con 0x7f823c15e100 2024-05-14T01:23:32.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f822affd640 1 -- 172.21.15.154:0/1017178733 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8230019070 con 0x7f823c15e100 2024-05-14T01:23:32.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f8240e19640 1 -- 172.21.15.154:0/1017178733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f823c0cc890 con 0x7f823c15e100 2024-05-14T01:23:32.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f822affd640 1 -- 172.21.15.154:0/1017178733 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823000ba60 con 0x7f823c15e100 2024-05-14T01:23:32.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f8240e19640 1 -- 172.21.15.154:0/1017178733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f823c0cd130 con 0x7f823c15e100 2024-05-14T01:23:32.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f8240e19640 1 -- 172.21.15.154:0/1017178733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f823c075470 con 0x7f823c15e100 2024-05-14T01:23:32.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f822affd640 1 -- 172.21.15.154:0/1017178733 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f823000bc00 con 0x7f823c15e100 2024-05-14T01:23:32.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f822affd640 1 --2- 172.21.15.154:0/1017178733 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f821c0678c0 0x7f821c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f823a59c640 1 --2- 172.21.15.154:0/1017178733 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f821c0678c0 0x7f821c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f822affd640 1 -- 172.21.15.154:0/1017178733 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f8230085e00 con 0x7f823c15e100 2024-05-14T01:23:32.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.594+0000 7f823a59c640 1 --2- 172.21.15.154:0/1017178733 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f821c0678c0 0x7f821c069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f822c0016f0 tx=0x7f822c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:32.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.598+0000 7f822affd640 1 -- 172.21.15.154:0/1017178733 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f8230056c90 con 0x7f823c15e100 2024-05-14T01:23:32.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.754+0000 7f8240e19640 1 -- 172.21.15.154:0/1017178733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f823c0cca60 con 0x7f823c15e100 2024-05-14T01:23:32.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.754+0000 7f822affd640 1 -- 172.21.15.154:0/1017178733 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f8230056590 con 0x7f823c15e100 2024-05-14T01:23:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:32.742 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2024-05-14T01:23:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:23:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2024-05-14T01:23:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2024-05-14T01:23:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:23:32.742 INFO:teuthology.orchestra.run.smithi154.stdout:] 2024-05-14T01:23:32.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.754+0000 7f8240e19640 1 -- 172.21.15.154:0/1017178733 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f821c0678c0 msgr2=0x7f821c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:32.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.754+0000 7f8240e19640 1 --2- 172.21.15.154:0/1017178733 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f821c0678c0 0x7f821c069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f822c0016f0 tx=0x7f822c009040 comp rx=0 tx=0).stop 2024-05-14T01:23:32.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.754+0000 7f8240e19640 1 -- 172.21.15.154:0/1017178733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f823c15e100 msgr2=0x7f823c15f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:32.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.754+0000 7f8240e19640 1 --2- 172.21.15.154:0/1017178733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f823c15e100 0x7f823c15f350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f823000d800 tx=0x7f823000dcc0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.754+0000 7f8240e19640 1 -- 172.21.15.154:0/1017178733 shutdown_connections 2024-05-14T01:23:32.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.754+0000 7f8240e19640 1 --2- 172.21.15.154:0/1017178733 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f821c0678c0 0x7f821c069d80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.754+0000 7f8240e19640 1 --2- 172.21.15.154:0/1017178733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f823c15e4e0 0x7f823c1f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.754+0000 7f8240e19640 1 --2- 172.21.15.154:0/1017178733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f823c15e100 0x7f823c15f350 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.754+0000 7f8240e19640 1 --2- 172.21.15.154:0/1017178733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f823c0cf520 0x7f823c14e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.754+0000 7f8240e19640 1 -- 172.21.15.154:0/1017178733 >> 172.21.15.154:0/1017178733 conn(0x7f823c0b5b50 msgr2=0x7f823c0718a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:32.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.754+0000 7f8240e19640 1 -- 172.21.15.154:0/1017178733 shutdown_connections 2024-05-14T01:23:32.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.754+0000 7f8240e19640 1 -- 172.21.15.154:0/1017178733 wait complete. 2024-05-14T01:23:32.758 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-14T01:23:32.759 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-14T01:23:32.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa51ba49640 1 Processor -- start 2024-05-14T01:23:32.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa51ba49640 1 -- start start 2024-05-14T01:23:32.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa51ba49640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5141457c0 0x7fa5140b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa51ba49640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5140b3f40 con 0x7fa51415fa20 2024-05-14T01:23:32.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa51ba49640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5140b2df0 con 0x7fa51406e250 2024-05-14T01:23:32.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa51ba49640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa514145ba0 con 0x7fa5141457c0 2024-05-14T01:23:32.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa518fe4640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa51415fa20 0x7fa5140b3120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50142/0 (socket says 172.21.15.154:50142) 2024-05-14T01:23:32.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa518fe4640 1 -- 172.21.15.154:0/546974053 learned_addr learned my addr 172.21.15.154:0/546974053 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:32.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa5197e5640 1 --2- 172.21.15.154:0/546974053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5141457c0 0x7fa5140b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa50bfff640 1 -- 172.21.15.154:0/546974053 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2078645558 0 0) 0x7fa5140b3f40 con 0x7fa51415fa20 2024-05-14T01:23:32.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa50bfff640 1 -- 172.21.15.154:0/546974053 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa500003530 con 0x7fa51415fa20 2024-05-14T01:23:32.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa50bfff640 1 -- 172.21.15.154:0/546974053 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2687119793 0 0) 0x7fa500003530 con 0x7fa51415fa20 2024-05-14T01:23:32.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa50bfff640 1 -- 172.21.15.154:0/546974053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5141457c0 msgr2=0x7fa5140b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:32.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa50bfff640 1 --2- 172.21.15.154:0/546974053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5141457c0 0x7fa5140b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa50bfff640 1 -- 172.21.15.154:0/546974053 >> v1:172.21.15.176:6789/0 conn(0x7fa51406e250 legacy=0x7fa5140b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:32.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa50bfff640 1 -- 172.21.15.154:0/546974053 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5140cf230 con 0x7fa51415fa20 2024-05-14T01:23:32.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa50bfff640 1 -- 172.21.15.154:0/546974053 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fa504001680 con 0x7fa51415fa20 2024-05-14T01:23:32.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa50bfff640 1 -- 172.21.15.154:0/546974053 >> v1:172.21.15.154:6789/0 conn(0x7fa51415fa20 legacy=0x7fa5140b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:32.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.882+0000 7fa50bfff640 1 --2- 172.21.15.154:0/546974053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5000039f0 0x7fa500003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa50bfff640 1 --2- 172.21.15.154:0/546974053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa500004810 0x7fa500004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa50bfff640 1 --2- 172.21.15.154:0/546974053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5141457c0 0x7fa500005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa50bfff640 1 -- 172.21.15.154:0/546974053 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa514145ba0 con 0x7fa500004810 2024-05-14T01:23:32.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa50bfff640 1 -- 172.21.15.154:0/546974053 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa50000bb00 con 0x7fa5000039f0 2024-05-14T01:23:32.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa50bfff640 1 -- 172.21.15.154:0/546974053 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa50000bd00 con 0x7fa5141457c0 2024-05-14T01:23:32.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa518fe4640 1 --2- 172.21.15.154:0/546974053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa500004810 0x7fa500004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa5197e5640 1 --2- 172.21.15.154:0/546974053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5000039f0 0x7fa500003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa519fe6640 1 --2- 172.21.15.154:0/546974053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5141457c0 0x7fa500005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa518fe4640 1 -- 172.21.15.154:0/546974053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5141457c0 msgr2=0x7fa500005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:32.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa518fe4640 1 --2- 172.21.15.154:0/546974053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5141457c0 0x7fa500005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa518fe4640 1 -- 172.21.15.154:0/546974053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5000039f0 msgr2=0x7fa500003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:32.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa518fe4640 1 --2- 172.21.15.154:0/546974053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5000039f0 0x7fa500003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa518fe4640 1 -- 172.21.15.154:0/546974053 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa500003530 con 0x7fa500004810 2024-05-14T01:23:32.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa5197e5640 1 --2- 172.21.15.154:0/546974053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5000039f0 0x7fa500003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:23:32.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa518fe4640 1 --2- 172.21.15.154:0/546974053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa500004810 0x7fa500004c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa50400c210 tx=0x7fa50401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5688238eadd20b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:32.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa50bfff640 1 -- 172.21.15.154:0/546974053 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa504007d40 con 0x7fa500004810 2024-05-14T01:23:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa50bfff640 1 -- 172.21.15.154:0/546974053 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5040a9070 con 0x7fa500004810 2024-05-14T01:23:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa50bfff640 1 -- 172.21.15.154:0/546974053 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa504005d40 con 0x7fa500004810 2024-05-14T01:23:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa51ba49640 1 -- 172.21.15.154:0/546974053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa500004810 msgr2=0x7fa500004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa51ba49640 1 --2- 172.21.15.154:0/546974053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa500004810 0x7fa500004c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa50400c210 tx=0x7fa50401cca0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa519fe6640 1 -- 172.21.15.154:0/546974053 reap_dead start 2024-05-14T01:23:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa51ba49640 1 -- 172.21.15.154:0/546974053 shutdown_connections 2024-05-14T01:23:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa51ba49640 1 -- 172.21.15.154:0/546974053 >> 172.21.15.154:0/546974053 conn(0x7fa5140b1850 msgr2=0x7fa5140b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa51ba49640 1 -- 172.21.15.154:0/546974053 shutdown_connections 2024-05-14T01:23:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.886+0000 7fa51ba49640 1 -- 172.21.15.154:0/546974053 wait complete. 2024-05-14T01:23:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa51ba49640 1 Processor -- start 2024-05-14T01:23:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa51ba49640 1 -- start start 2024-05-14T01:23:32.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa51ba49640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa500004810 0x7fa51413d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa51ba49640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa514139050 0x7fa514167640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa51ba49640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa514136ed0 0x7fa514137350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa51ba49640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa5140cedc0 con 0x7fa514136ed0 2024-05-14T01:23:32.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa51ba49640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa5140b4f40 con 0x7fa500004810 2024-05-14T01:23:32.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa51ba49640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa5140cef40 con 0x7fa514139050 2024-05-14T01:23:32.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa519fe6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa514136ed0 0x7fa514137350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa519fe6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa514136ed0 0x7fa514137350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59180/0 (socket says 172.21.15.154:59180) 2024-05-14T01:23:32.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa519fe6640 1 -- 172.21.15.154:0/1772264694 learned_addr learned my addr 172.21.15.154:0/1772264694 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:32.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa5197e5640 1 --2- 172.21.15.154:0/1772264694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa500004810 0x7fa51413d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa518fe4640 1 --2- 172.21.15.154:0/1772264694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa514139050 0x7fa514167640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa519fe6640 1 -- 172.21.15.154:0/1772264694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa514139050 msgr2=0x7fa514167640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:32.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa519fe6640 1 --2- 172.21.15.154:0/1772264694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa514139050 0x7fa514167640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa519fe6640 1 -- 172.21.15.154:0/1772264694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa500004810 msgr2=0x7fa51413d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa519fe6640 1 --2- 172.21.15.154:0/1772264694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa500004810 0x7fa51413d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa519fe6640 1 -- 172.21.15.154:0/1772264694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51413ef60 con 0x7fa514136ed0 2024-05-14T01:23:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa518fe4640 1 --2- 172.21.15.154:0/1772264694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa514139050 0x7fa514167640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:23:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa519fe6640 1 --2- 172.21.15.154:0/1772264694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa514136ed0 0x7fa514137350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa50c000f90 tx=0x7fa50c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa509ffb640 1 -- 172.21.15.154:0/1772264694 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c019070 con 0x7fa514136ed0 2024-05-14T01:23:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa509ffb640 1 -- 172.21.15.154:0/1772264694 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa50c006b60 con 0x7fa514136ed0 2024-05-14T01:23:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa51ba49640 1 -- 172.21.15.154:0/1772264694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa514143350 con 0x7fa514136ed0 2024-05-14T01:23:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa509ffb640 1 -- 172.21.15.154:0/1772264694 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c003980 con 0x7fa514136ed0 2024-05-14T01:23:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa51ba49640 1 -- 172.21.15.154:0/1772264694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa514143910 con 0x7fa514136ed0 2024-05-14T01:23:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa51ba49640 1 -- 172.21.15.154:0/1772264694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa514075470 con 0x7fa514136ed0 2024-05-14T01:23:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa509ffb640 1 -- 172.21.15.154:0/1772264694 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa50c01c070 con 0x7fa514136ed0 2024-05-14T01:23:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa509ffb640 1 --2- 172.21.15.154:0/1772264694 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa4f80678c0 0x7fa4f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.890+0000 7fa509ffb640 1 -- 172.21.15.154:0/1772264694 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa50c084f00 con 0x7fa514136ed0 2024-05-14T01:23:32.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.894+0000 7fa5197e5640 1 --2- 172.21.15.154:0/1772264694 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa4f80678c0 0x7fa4f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:32.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.894+0000 7fa5197e5640 1 --2- 172.21.15.154:0/1772264694 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa4f80678c0 0x7fa4f8069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa510009b60 tx=0x7fa510008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:32.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:32.898+0000 7fa509ffb640 1 -- 172.21.15.154:0/1772264694 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fa50c0556b0 con 0x7fa514136ed0 2024-05-14T01:23:33.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.042+0000 7fa51ba49640 1 -- 172.21.15.154:0/1772264694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa51406e890 con 0x7fa514136ed0 2024-05-14T01:23:33.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.194+0000 7fa509ffb640 1 -- 172.21.15.154:0/1772264694 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fa50c0599b0 con 0x7fa514136ed0 2024-05-14T01:23:33.184 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2024-05-14T01:23:33.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.198+0000 7fa51ba49640 1 -- 172.21.15.154:0/1772264694 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa4f80678c0 msgr2=0x7fa4f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:33.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.198+0000 7fa51ba49640 1 --2- 172.21.15.154:0/1772264694 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa4f80678c0 0x7fa4f8069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa510009b60 tx=0x7fa510008040 comp rx=0 tx=0).stop 2024-05-14T01:23:33.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.198+0000 7fa51ba49640 1 -- 172.21.15.154:0/1772264694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa514136ed0 msgr2=0x7fa514137350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:33.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.198+0000 7fa51ba49640 1 --2- 172.21.15.154:0/1772264694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa514136ed0 0x7fa514137350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa50c000f90 tx=0x7fa50c00eb90 comp rx=0 tx=0).stop 2024-05-14T01:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.198+0000 7fa51ba49640 1 -- 172.21.15.154:0/1772264694 shutdown_connections 2024-05-14T01:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.198+0000 7fa51ba49640 1 --2- 172.21.15.154:0/1772264694 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa4f80678c0 0x7fa4f8069d80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.198+0000 7fa51ba49640 1 --2- 172.21.15.154:0/1772264694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa514136ed0 0x7fa514137350 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.198+0000 7fa51ba49640 1 --2- 172.21.15.154:0/1772264694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa514139050 0x7fa514167640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.198+0000 7fa51ba49640 1 --2- 172.21.15.154:0/1772264694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa500004810 0x7fa51413d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.198+0000 7fa51ba49640 1 -- 172.21.15.154:0/1772264694 >> 172.21.15.154:0/1772264694 conn(0x7fa5140b1850 msgr2=0x7fa514141d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.198+0000 7fa51ba49640 1 -- 172.21.15.154:0/1772264694 shutdown_connections 2024-05-14T01:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.198+0000 7fa51ba49640 1 -- 172.21.15.154:0/1772264694 wait complete. 2024-05-14T01:23:33.210 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-14T01:23:33.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.350+0000 7f76a1484640 1 Processor -- start 2024-05-14T01:23:33.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.350+0000 7f76a1484640 1 -- start start 2024-05-14T01:23:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.350+0000 7f76a1484640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c15f480 0x7f769c06ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.350+0000 7f76a1484640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f769c070ed0 0x7f769c0ca230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.350+0000 7f76a1484640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f769c0cbcd0 con 0x7f769c0ca770 2024-05-14T01:23:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.350+0000 7f76a1484640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f769c06d3a0 con 0x7f769c070ed0 2024-05-14T01:23:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.350+0000 7f76a1484640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f769c0cd1c0 con 0x7f769c15f480 2024-05-14T01:23:33.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.350+0000 7f769affd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c15f480 0x7f769c06ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:33.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.350+0000 7f7693fff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f769c070ed0 0x7f769c0ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:33.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.350+0000 7f769affd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c15f480 0x7f769c06ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:33596/0 (socket says 172.21.15.154:33596) 2024-05-14T01:23:33.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.350+0000 7f769affd640 1 -- 172.21.15.154:0/161742711 learned_addr learned my addr 172.21.15.154:0/161742711 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:33.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.350+0000 7f769affd640 1 -- 172.21.15.154:0/161742711 >> v2:172.21.15.176:3300/0 conn(0x7f769c070ed0 msgr2=0x7f769c0ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:33.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.350+0000 7f769affd640 1 --2- 172.21.15.154:0/161742711 >> v2:172.21.15.176:3300/0 conn(0x7f769c070ed0 0x7f769c0ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:33.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.350+0000 7f769affd640 1 -- 172.21.15.154:0/161742711 >> v1:172.21.15.176:6789/0 conn(0x7f769c0ca770 legacy=0x7f769c15fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:33.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.350+0000 7f769affd640 1 -- 172.21.15.154:0/161742711 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c06d640 con 0x7f769c15f480 2024-05-14T01:23:33.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.354+0000 7f769affd640 1 --2- 172.21.15.154:0/161742711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c15f480 0x7f769c06ce60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7684009870 tx=0x7f768401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdb43cf0114b7ecd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:33.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.354+0000 7f769a7fc640 1 -- 172.21.15.154:0/161742711 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76840b0070 con 0x7f769c15f480 2024-05-14T01:23:33.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.354+0000 7f769a7fc640 1 -- 172.21.15.154:0/161742711 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76840ab600 con 0x7f769c15f480 2024-05-14T01:23:33.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.354+0000 7f769a7fc640 1 -- 172.21.15.154:0/161742711 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76840ab9d0 con 0x7f769c15f480 2024-05-14T01:23:33.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.354+0000 7f76a1484640 1 -- 172.21.15.154:0/161742711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c15f480 msgr2=0x7f769c06ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:33.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.354+0000 7f76a1484640 1 --2- 172.21.15.154:0/161742711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c15f480 0x7f769c06ce60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7684009870 tx=0x7f768401c560 comp rx=0 tx=0).stop 2024-05-14T01:23:33.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.354+0000 7f76a1484640 1 -- 172.21.15.154:0/161742711 shutdown_connections 2024-05-14T01:23:33.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.354+0000 7f76a1484640 1 --2- 172.21.15.154:0/161742711 >> v2:172.21.15.176:3300/0 conn(0x7f769c070ed0 0x7f769c0ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:33.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.354+0000 7f76a1484640 1 --2- 172.21.15.154:0/161742711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c15f480 0x7f769c06ce60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:33.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.354+0000 7f76a1484640 1 -- 172.21.15.154:0/161742711 >> 172.21.15.154:0/161742711 conn(0x7f769c0b1770 msgr2=0x7f769c0b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:33.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.354+0000 7f76a1484640 1 -- 172.21.15.154:0/161742711 shutdown_connections 2024-05-14T01:23:33.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.354+0000 7f76a1484640 1 -- 172.21.15.154:0/161742711 wait complete. 2024-05-14T01:23:33.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f76a1484640 1 Processor -- start 2024-05-14T01:23:33.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f76a1484640 1 -- start start 2024-05-14T01:23:33.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f76a1484640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c070ed0 0x7f769c155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:33.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f76a1484640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f769c0ca770 0x7f769c15a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:33.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f76a1484640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c15f480 0x7f769c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:33.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f76a1484640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f769c0b2a70 con 0x7f769c070ed0 2024-05-14T01:23:33.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f76a1484640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f769c06dee0 con 0x7f769c0ca770 2024-05-14T01:23:33.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f76a1484640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f769c168ec0 con 0x7f769c15f480 2024-05-14T01:23:33.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f769affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c070ed0 0x7f769c155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:33.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f769affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c070ed0 0x7f769c155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59188/0 (socket says 172.21.15.154:59188) 2024-05-14T01:23:33.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f769affd640 1 -- 172.21.15.154:0/3702736863 learned_addr learned my addr 172.21.15.154:0/3702736863 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:33.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f7693fff640 1 --2- 172.21.15.154:0/3702736863 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f769c0ca770 0x7f769c15a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:33.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f769b7fe640 1 --2- 172.21.15.154:0/3702736863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c15f480 0x7f769c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:33.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f769affd640 1 -- 172.21.15.154:0/3702736863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c15f480 msgr2=0x7f769c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:33.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f769affd640 1 --2- 172.21.15.154:0/3702736863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c15f480 0x7f769c15af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:33.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f769affd640 1 -- 172.21.15.154:0/3702736863 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f769c0ca770 msgr2=0x7f769c15a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:33.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f769affd640 1 --2- 172.21.15.154:0/3702736863 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f769c0ca770 0x7f769c15a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:33.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f769affd640 1 -- 172.21.15.154:0/3702736863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c15de90 con 0x7f769c070ed0 2024-05-14T01:23:33.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f7693fff640 1 --2- 172.21.15.154:0/3702736863 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f769c0ca770 0x7f769c15a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:33.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f769affd640 1 --2- 172.21.15.154:0/3702736863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c070ed0 0x7f769c155230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f76840ae040 tx=0x7f768401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:33.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f76937fe640 1 -- 172.21.15.154:0/3702736863 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76840ba020 con 0x7f769c070ed0 2024-05-14T01:23:33.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f76937fe640 1 -- 172.21.15.154:0/3702736863 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76840b6420 con 0x7f769c070ed0 2024-05-14T01:23:33.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f76a1484640 1 -- 172.21.15.154:0/3702736863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f769c15e170 con 0x7f769c070ed0 2024-05-14T01:23:33.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f76937fe640 1 -- 172.21.15.154:0/3702736863 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76840b0040 con 0x7f769c070ed0 2024-05-14T01:23:33.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f76a1484640 1 -- 172.21.15.154:0/3702736863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f769c0c71e0 con 0x7f769c070ed0 2024-05-14T01:23:33.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.358+0000 7f76a1484640 1 -- 172.21.15.154:0/3702736863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f769c075470 con 0x7f769c070ed0 2024-05-14T01:23:33.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.362+0000 7f76937fe640 1 -- 172.21.15.154:0/3702736863 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f76840bd020 con 0x7f769c070ed0 2024-05-14T01:23:33.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.362+0000 7f76937fe640 1 --2- 172.21.15.154:0/3702736863 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f767c0678c0 0x7f767c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:33.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.362+0000 7f76937fe640 1 -- 172.21.15.154:0/3702736863 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f768411fc40 con 0x7f769c070ed0 2024-05-14T01:23:33.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.362+0000 7f7693fff640 1 --2- 172.21.15.154:0/3702736863 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f767c0678c0 0x7f767c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:33.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.362+0000 7f7693fff640 1 --2- 172.21.15.154:0/3702736863 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f767c0678c0 0x7f767c069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f769c0b4a00 tx=0x7f768c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:33.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.366+0000 7f76937fe640 1 -- 172.21.15.154:0/3702736863 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f76840c4030 con 0x7f769c070ed0 2024-05-14T01:23:33.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:33.514+0000 7f76a1484640 1 -- 172.21.15.154:0/3702736863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f769c06e410 con 0x7f769c070ed0 2024-05-14T01:23:33.873 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:23:33.876 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:23:34.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.202+0000 7f76937fe640 1 -- 172.21.15.154:0/3702736863 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f7684016150 con 0x7f769c070ed0 2024-05-14T01:23:34.188 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2024-05-14T01:23:34.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.206+0000 7f76a1484640 1 -- 172.21.15.154:0/3702736863 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f767c0678c0 msgr2=0x7f767c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:34.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.206+0000 7f76a1484640 1 --2- 172.21.15.154:0/3702736863 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f767c0678c0 0x7f767c069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f769c0b4a00 tx=0x7f768c008040 comp rx=0 tx=0).stop 2024-05-14T01:23:34.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.206+0000 7f76a1484640 1 -- 172.21.15.154:0/3702736863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c070ed0 msgr2=0x7f769c155230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:34.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.206+0000 7f76a1484640 1 --2- 172.21.15.154:0/3702736863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c070ed0 0x7f769c155230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f76840ae040 tx=0x7f768401ada0 comp rx=0 tx=0).stop 2024-05-14T01:23:34.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.206+0000 7f76a1484640 1 -- 172.21.15.154:0/3702736863 shutdown_connections 2024-05-14T01:23:34.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.206+0000 7f76a1484640 1 --2- 172.21.15.154:0/3702736863 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f767c0678c0 0x7f767c069d80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:34.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.206+0000 7f76a1484640 1 --2- 172.21.15.154:0/3702736863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f769c15f480 0x7f769c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:34.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.206+0000 7f76a1484640 1 --2- 172.21.15.154:0/3702736863 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f769c0ca770 0x7f769c15a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:34.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.206+0000 7f76a1484640 1 --2- 172.21.15.154:0/3702736863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c070ed0 0x7f769c155230 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:34.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.206+0000 7f76a1484640 1 -- 172.21.15.154:0/3702736863 >> 172.21.15.154:0/3702736863 conn(0x7f769c0b1770 msgr2=0x7f769c0b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:34.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.206+0000 7f76a1484640 1 -- 172.21.15.154:0/3702736863 shutdown_connections 2024-05-14T01:23:34.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.206+0000 7f76a1484640 1 -- 172.21.15.154:0/3702736863 wait complete. 2024-05-14T01:23:34.225 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-14T01:23:34.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.354+0000 7fec8ed22640 1 Processor -- start 2024-05-14T01:23:34.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.354+0000 7fec8ed22640 1 -- start start 2024-05-14T01:23:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.354+0000 7fec8ed22640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec880cf610 0x7fec8815fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.354+0000 7fec8ed22640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec8815ff80 0x7fec8806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.354+0000 7fec8ed22640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec88071840 con 0x7fec881458d0 2024-05-14T01:23:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.354+0000 7fec8ed22640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fec88071b20 con 0x7fec880cf610 2024-05-14T01:23:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.354+0000 7fec8ed22640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fec88071e00 con 0x7fec8815ff80 2024-05-14T01:23:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.354+0000 7fec8cabe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fec881458d0 0x7fec88071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50146/0 (socket says 172.21.15.154:50146) 2024-05-14T01:23:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.354+0000 7fec8cabe640 1 -- 172.21.15.154:0/2590457439 learned_addr learned my addr 172.21.15.154:0/2590457439 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.354+0000 7fec87fff640 1 --2- 172.21.15.154:0/2590457439 >> v2:172.21.15.154:3300/0 conn(0x7fec880cf610 0x7fec8815fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.354+0000 7fec8d2bf640 1 --2- 172.21.15.154:0/2590457439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec8815ff80 0x7fec8806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.354+0000 7fec877fe640 1 -- 172.21.15.154:0/2590457439 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1136146499 0 0) 0x7fec88071840 con 0x7fec881458d0 2024-05-14T01:23:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.354+0000 7fec877fe640 1 -- 172.21.15.154:0/2590457439 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec70003530 con 0x7fec881458d0 2024-05-14T01:23:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.354+0000 7fec87fff640 1 -- 172.21.15.154:0/2590457439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec8815ff80 msgr2=0x7fec8806ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.354+0000 7fec87fff640 1 --2- 172.21.15.154:0/2590457439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec8815ff80 0x7fec8806ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:34.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.354+0000 7fec87fff640 1 -- 172.21.15.154:0/2590457439 >> v1:172.21.15.154:6789/0 conn(0x7fec881458d0 legacy=0x7fec88071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:34.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.354+0000 7fec87fff640 1 -- 172.21.15.154:0/2590457439 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec880720e0 con 0x7fec880cf610 2024-05-14T01:23:34.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.358+0000 7fec87fff640 1 --2- 172.21.15.154:0/2590457439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec880cf610 0x7fec8815fa40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0097c0 tx=0x7fec7c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f8599ef9a8073d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:34.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.358+0000 7fec877fe640 1 -- 172.21.15.154:0/2590457439 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c0b0070 con 0x7fec880cf610 2024-05-14T01:23:34.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.358+0000 7fec877fe640 1 -- 172.21.15.154:0/2590457439 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec7c0ab600 con 0x7fec880cf610 2024-05-14T01:23:34.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.358+0000 7fec877fe640 1 -- 172.21.15.154:0/2590457439 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c0ab9d0 con 0x7fec880cf610 2024-05-14T01:23:34.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.358+0000 7fec8ed22640 1 -- 172.21.15.154:0/2590457439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec880cf610 msgr2=0x7fec8815fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:34.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.358+0000 7fec8ed22640 1 --2- 172.21.15.154:0/2590457439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec880cf610 0x7fec8815fa40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0097c0 tx=0x7fec7c01c4a0 comp rx=0 tx=0).stop 2024-05-14T01:23:34.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.358+0000 7fec8ed22640 1 -- 172.21.15.154:0/2590457439 shutdown_connections 2024-05-14T01:23:34.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.358+0000 7fec8ed22640 1 --2- 172.21.15.154:0/2590457439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec8815ff80 0x7fec8806ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:34.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.358+0000 7fec8ed22640 1 --2- 172.21.15.154:0/2590457439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec880cf610 0x7fec8815fa40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:34.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.358+0000 7fec8ed22640 1 -- 172.21.15.154:0/2590457439 >> 172.21.15.154:0/2590457439 conn(0x7fec880b1770 msgr2=0x7fec880b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:34.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.358+0000 7fec8ed22640 1 -- 172.21.15.154:0/2590457439 shutdown_connections 2024-05-14T01:23:34.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.358+0000 7fec8ed22640 1 -- 172.21.15.154:0/2590457439 wait complete. 2024-05-14T01:23:34.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.358+0000 7fec8ed22640 1 Processor -- start 2024-05-14T01:23:34.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.358+0000 7fec8ed22640 1 -- start start 2024-05-14T01:23:34.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8ed22640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec880cf610 0x7fec880aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:34.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8ed22640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec881458d0 0x7fec881f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:34.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8ed22640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec8815ff80 0x7fec88159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:34.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8ed22640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec88168de0 con 0x7fec880cf610 2024-05-14T01:23:34.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8ed22640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fec8806dda0 con 0x7fec881458d0 2024-05-14T01:23:34.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8ed22640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fec88168f60 con 0x7fec8815ff80 2024-05-14T01:23:34.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8cabe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec880cf610 0x7fec880aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:34.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8cabe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec880cf610 0x7fec880aee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59204/0 (socket says 172.21.15.154:59204) 2024-05-14T01:23:34.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8cabe640 1 -- 172.21.15.154:0/3256566809 learned_addr learned my addr 172.21.15.154:0/3256566809 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:34.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8d2bf640 1 --2- 172.21.15.154:0/3256566809 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec8815ff80 0x7fec88159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:34.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec87fff640 1 --2- 172.21.15.154:0/3256566809 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec881458d0 0x7fec881f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:34.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8cabe640 1 -- 172.21.15.154:0/3256566809 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec8815ff80 msgr2=0x7fec88159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:34.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8cabe640 1 --2- 172.21.15.154:0/3256566809 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec8815ff80 0x7fec88159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:34.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8cabe640 1 -- 172.21.15.154:0/3256566809 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec881458d0 msgr2=0x7fec881f6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:34.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8cabe640 1 --2- 172.21.15.154:0/3256566809 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec881458d0 0x7fec881f6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:34.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8cabe640 1 -- 172.21.15.154:0/3256566809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec880af370 con 0x7fec880cf610 2024-05-14T01:23:34.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8cabe640 1 --2- 172.21.15.154:0/3256566809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec880cf610 0x7fec880aee30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fec7800c450 tx=0x7fec7800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:34.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec857fa640 1 -- 172.21.15.154:0/3256566809 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec78017070 con 0x7fec880cf610 2024-05-14T01:23:34.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec857fa640 1 -- 172.21.15.154:0/3256566809 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec78005cf0 con 0x7fec880cf610 2024-05-14T01:23:34.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec857fa640 1 -- 172.21.15.154:0/3256566809 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec78007290 con 0x7fec880cf610 2024-05-14T01:23:34.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8ed22640 1 -- 172.21.15.154:0/3256566809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec8812fe40 con 0x7fec880cf610 2024-05-14T01:23:34.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8ed22640 1 -- 172.21.15.154:0/3256566809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec88130400 con 0x7fec880cf610 2024-05-14T01:23:34.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec8ed22640 1 -- 172.21.15.154:0/3256566809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec88075470 con 0x7fec880cf610 2024-05-14T01:23:34.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec857fa640 1 -- 172.21.15.154:0/3256566809 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fec7801a070 con 0x7fec880cf610 2024-05-14T01:23:34.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec857fa640 1 --2- 172.21.15.154:0/3256566809 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fec740678c0 0x7fec74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:34.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec87fff640 1 --2- 172.21.15.154:0/3256566809 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fec740678c0 0x7fec74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:34.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.362+0000 7fec857fa640 1 -- 172.21.15.154:0/3256566809 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7fec78085030 con 0x7fec880cf610 2024-05-14T01:23:34.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.366+0000 7fec87fff640 1 --2- 172.21.15.154:0/3256566809 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fec740678c0 0x7fec74069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0ad000 tx=0x7fec7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:34.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.370+0000 7fec857fa640 1 -- 172.21.15.154:0/3256566809 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fec78055bd0 con 0x7fec880cf610 2024-05-14T01:23:34.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:34.562+0000 7fec8ed22640 1 -- 172.21.15.154:0/3256566809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fec88067d00 con 0x7fec880cf610 2024-05-14T01:23:35.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.266+0000 7fec857fa640 1 -- 172.21.15.154:0/3256566809 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fec780554d0 con 0x7fec880cf610 2024-05-14T01:23:35.255 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 2 and data pool 3 2024-05-14T01:23:35.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.270+0000 7fec8ed22640 1 -- 172.21.15.154:0/3256566809 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fec740678c0 msgr2=0x7fec74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:35.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.270+0000 7fec8ed22640 1 --2- 172.21.15.154:0/3256566809 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fec740678c0 0x7fec74069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0ad000 tx=0x7fec7c008040 comp rx=0 tx=0).stop 2024-05-14T01:23:35.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.270+0000 7fec8ed22640 1 -- 172.21.15.154:0/3256566809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec880cf610 msgr2=0x7fec880aee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:35.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.270+0000 7fec8ed22640 1 --2- 172.21.15.154:0/3256566809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec880cf610 0x7fec880aee30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fec7800c450 tx=0x7fec7800c910 comp rx=0 tx=0).stop 2024-05-14T01:23:35.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.270+0000 7fec8ed22640 1 -- 172.21.15.154:0/3256566809 shutdown_connections 2024-05-14T01:23:35.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.270+0000 7fec8ed22640 1 --2- 172.21.15.154:0/3256566809 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fec740678c0 0x7fec74069d80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.270+0000 7fec8ed22640 1 --2- 172.21.15.154:0/3256566809 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec8815ff80 0x7fec88159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.270+0000 7fec8ed22640 1 --2- 172.21.15.154:0/3256566809 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec881458d0 0x7fec881f6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.270+0000 7fec8ed22640 1 --2- 172.21.15.154:0/3256566809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec880cf610 0x7fec880aee30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.270+0000 7fec8ed22640 1 -- 172.21.15.154:0/3256566809 >> 172.21.15.154:0/3256566809 conn(0x7fec880b1770 msgr2=0x7fec8815e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:35.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.270+0000 7fec8ed22640 1 -- 172.21.15.154:0/3256566809 shutdown_connections 2024-05-14T01:23:35.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.270+0000 7fec8ed22640 1 -- 172.21.15.154:0/3256566809 wait complete. 2024-05-14T01:23:35.290 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:23:35.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e5dbd5640 1 Processor -- start 2024-05-14T01:23:35.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e5dbd5640 1 -- start start 2024-05-14T01:23:35.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e5dbd5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e581513c0 0x7f7e580cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:35.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e5dbd5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e5815ee60 con 0x7f7e5806d8d0 2024-05-14T01:23:35.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e5dbd5640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e580b2ec0 con 0x7f7e5806d470 2024-05-14T01:23:35.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e5dbd5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7e580cf9d0 con 0x7f7e581513c0 2024-05-14T01:23:35.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e57fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7e5806d8d0 0x7f7e5815e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50148/0 (socket says 172.21.15.154:50148) 2024-05-14T01:23:35.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e57fff640 1 -- 172.21.15.154:0/3235362258 learned_addr learned my addr 172.21.15.154:0/3235362258 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:35.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e577fe640 1 --2- 172.21.15.154:0/3235362258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e581513c0 0x7f7e580cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:35.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e567fc640 1 -- 172.21.15.154:0/3235362258 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2906410658 0 0) 0x7f7e5815ee60 con 0x7f7e5806d8d0 2024-05-14T01:23:35.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e567fc640 1 -- 172.21.15.154:0/3235362258 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e40003530 con 0x7f7e5806d8d0 2024-05-14T01:23:35.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e567fc640 1 -- 172.21.15.154:0/3235362258 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 523588034 0 0) 0x7f7e40003530 con 0x7f7e5806d8d0 2024-05-14T01:23:35.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e567fc640 1 -- 172.21.15.154:0/3235362258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e581513c0 msgr2=0x7f7e580cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:35.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e567fc640 1 --2- 172.21.15.154:0/3235362258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e581513c0 0x7f7e580cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e567fc640 1 -- 172.21.15.154:0/3235362258 >> v1:172.21.15.176:6789/0 conn(0x7f7e5806d470 legacy=0x7f7e5815e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:35.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e567fc640 1 -- 172.21.15.154:0/3235362258 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e580b31a0 con 0x7f7e5806d8d0 2024-05-14T01:23:35.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e567fc640 1 -- 172.21.15.154:0/3235362258 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f7e50001a00 con 0x7f7e5806d8d0 2024-05-14T01:23:35.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e567fc640 1 -- 172.21.15.154:0/3235362258 >> v1:172.21.15.154:6789/0 conn(0x7f7e5806d8d0 legacy=0x7f7e5815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:35.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e567fc640 1 --2- 172.21.15.154:0/3235362258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e400039f0 0x7f7e40003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:35.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e567fc640 1 --2- 172.21.15.154:0/3235362258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e40004810 0x7f7e40004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:35.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e567fc640 1 --2- 172.21.15.154:0/3235362258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e581513c0 0x7f7e400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:35.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e567fc640 1 -- 172.21.15.154:0/3235362258 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4000ba80 con 0x7f7e40004810 2024-05-14T01:23:35.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e567fc640 1 -- 172.21.15.154:0/3235362258 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4000bc00 con 0x7f7e400039f0 2024-05-14T01:23:35.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e567fc640 1 -- 172.21.15.154:0/3235362258 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7e4000be00 con 0x7f7e581513c0 2024-05-14T01:23:35.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e56ffd640 1 --2- 172.21.15.154:0/3235362258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e40004810 0x7f7e40004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:35.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e577fe640 1 --2- 172.21.15.154:0/3235362258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e400039f0 0x7f7e40003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:35.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e57fff640 1 --2- 172.21.15.154:0/3235362258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e581513c0 0x7f7e400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:35.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e56ffd640 1 -- 172.21.15.154:0/3235362258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e581513c0 msgr2=0x7f7e400051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:35.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e56ffd640 1 --2- 172.21.15.154:0/3235362258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e581513c0 0x7f7e400051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e56ffd640 1 -- 172.21.15.154:0/3235362258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e400039f0 msgr2=0x7f7e40003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:35.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e56ffd640 1 --2- 172.21.15.154:0/3235362258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e400039f0 0x7f7e40003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e56ffd640 1 -- 172.21.15.154:0/3235362258 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e40003530 con 0x7f7e40004810 2024-05-14T01:23:35.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.422+0000 7f7e577fe640 1 --2- 172.21.15.154:0/3235362258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e400039f0 0x7f7e40003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:23:35.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e56ffd640 1 --2- 172.21.15.154:0/3235362258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e40004810 0x7f7e40004c90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c001750 tx=0x7f7e4c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19eb5803ec11d965 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:35.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e567fc640 1 -- 172.21.15.154:0/3235362258 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c0013a0 con 0x7f7e40004810 2024-05-14T01:23:35.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e567fc640 1 -- 172.21.15.154:0/3235362258 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e4c0052f0 con 0x7f7e40004810 2024-05-14T01:23:35.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e567fc640 1 -- 172.21.15.154:0/3235362258 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c003840 con 0x7f7e40004810 2024-05-14T01:23:35.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e5dbd5640 1 -- 172.21.15.154:0/3235362258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e40004810 msgr2=0x7f7e40004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:35.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e5dbd5640 1 --2- 172.21.15.154:0/3235362258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e40004810 0x7f7e40004c90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c001750 tx=0x7f7e4c01c3c0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e57fff640 1 -- 172.21.15.154:0/3235362258 reap_dead start 2024-05-14T01:23:35.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e5dbd5640 1 -- 172.21.15.154:0/3235362258 shutdown_connections 2024-05-14T01:23:35.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e5dbd5640 1 -- 172.21.15.154:0/3235362258 >> 172.21.15.154:0/3235362258 conn(0x7f7e580b1850 msgr2=0x7f7e580b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:35.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e5dbd5640 1 -- 172.21.15.154:0/3235362258 shutdown_connections 2024-05-14T01:23:35.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e5dbd5640 1 -- 172.21.15.154:0/3235362258 wait complete. 2024-05-14T01:23:35.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e5dbd5640 1 Processor -- start 2024-05-14T01:23:35.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e5dbd5640 1 -- start start 2024-05-14T01:23:35.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e5dbd5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e40004810 0x7f7e580cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:35.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e5dbd5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e580cd960 0x7f7e581585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:35.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e5dbd5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e58158b20 0x7f7e58142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:35.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e5dbd5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e580b3760 con 0x7f7e58158b20 2024-05-14T01:23:35.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e5dbd5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7e580b3ad0 con 0x7f7e40004810 2024-05-14T01:23:35.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.426+0000 7f7e5dbd5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7e5815cb70 con 0x7f7e580cd960 2024-05-14T01:23:35.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e57fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e58158b20 0x7f7e58142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:35.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e57fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e58158b20 0x7f7e58142180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59222/0 (socket says 172.21.15.154:59222) 2024-05-14T01:23:35.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e57fff640 1 -- 172.21.15.154:0/2643014052 learned_addr learned my addr 172.21.15.154:0/2643014052 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:35.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e577fe640 1 --2- 172.21.15.154:0/2643014052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e40004810 0x7f7e580cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:35.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e56ffd640 1 --2- 172.21.15.154:0/2643014052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e580cd960 0x7f7e581585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:35.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e57fff640 1 -- 172.21.15.154:0/2643014052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e580cd960 msgr2=0x7f7e581585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:35.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e57fff640 1 --2- 172.21.15.154:0/2643014052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e580cd960 0x7f7e581585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e57fff640 1 -- 172.21.15.154:0/2643014052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e40004810 msgr2=0x7f7e580cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:35.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e57fff640 1 --2- 172.21.15.154:0/2643014052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e40004810 0x7f7e580cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e57fff640 1 -- 172.21.15.154:0/2643014052 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e58159130 con 0x7f7e58158b20 2024-05-14T01:23:35.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e57fff640 1 --2- 172.21.15.154:0/2643014052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e58158b20 0x7f7e58142180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7e5806c250 tx=0x7f7e5000ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:35.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e3ffff640 1 -- 172.21.15.154:0/2643014052 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e50010070 con 0x7f7e58158b20 2024-05-14T01:23:35.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e3ffff640 1 -- 172.21.15.154:0/2643014052 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e500137c0 con 0x7f7e58158b20 2024-05-14T01:23:35.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e5dbd5640 1 -- 172.21.15.154:0/2643014052 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e58159410 con 0x7f7e58158b20 2024-05-14T01:23:35.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e3ffff640 1 -- 172.21.15.154:0/2643014052 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e50013b90 con 0x7f7e58158b20 2024-05-14T01:23:35.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e5dbd5640 1 -- 172.21.15.154:0/2643014052 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e581599d0 con 0x7f7e58158b20 2024-05-14T01:23:35.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e5dbd5640 1 -- 172.21.15.154:0/2643014052 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e58075470 con 0x7f7e58158b20 2024-05-14T01:23:35.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e3ffff640 1 -- 172.21.15.154:0/2643014052 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7e5001f020 con 0x7f7e58158b20 2024-05-14T01:23:35.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e3ffff640 1 --2- 172.21.15.154:0/2643014052 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7e440678f0 0x7f7e44069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:35.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e3ffff640 1 -- 172.21.15.154:0/2643014052 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7e5008ab20 con 0x7f7e58158b20 2024-05-14T01:23:35.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e577fe640 1 --2- 172.21.15.154:0/2643014052 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7e440678f0 0x7f7e44069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:35.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.430+0000 7f7e577fe640 1 --2- 172.21.15.154:0/2643014052 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7e440678f0 0x7f7e44069db0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009b60 tx=0x7f7e48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:35.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.434+0000 7f7e3ffff640 1 -- 172.21.15.154:0/2643014052 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f7e5005b0d0 con 0x7f7e58158b20 2024-05-14T01:23:35.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.598+0000 7f7e5dbd5640 1 -- 172.21.15.154:0/2643014052 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e5806e3d0 con 0x7f7e58158b20 2024-05-14T01:23:35.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.606+0000 7f7e3ffff640 1 -- 172.21.15.154:0/2643014052 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16666 (secure 0 0 0) 0x7f7e5005f3d0 con 0x7f7e58158b20 2024-05-14T01:23:35.589 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:35.589 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:34.569906+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:23:35.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.606+0000 7f7e5dbd5640 1 -- 172.21.15.154:0/2643014052 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7e440678f0 msgr2=0x7f7e44069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:35.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.606+0000 7f7e5dbd5640 1 --2- 172.21.15.154:0/2643014052 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7e440678f0 0x7f7e44069db0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009b60 tx=0x7f7e48008040 comp rx=0 tx=0).stop 2024-05-14T01:23:35.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.606+0000 7f7e5dbd5640 1 -- 172.21.15.154:0/2643014052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e58158b20 msgr2=0x7f7e58142180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:35.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.606+0000 7f7e5dbd5640 1 --2- 172.21.15.154:0/2643014052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e58158b20 0x7f7e58142180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7e5806c250 tx=0x7f7e5000ac80 comp rx=0 tx=0).stop 2024-05-14T01:23:35.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.606+0000 7f7e5dbd5640 1 -- 172.21.15.154:0/2643014052 shutdown_connections 2024-05-14T01:23:35.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.606+0000 7f7e5dbd5640 1 --2- 172.21.15.154:0/2643014052 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7e440678f0 0x7f7e44069db0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.606+0000 7f7e5dbd5640 1 --2- 172.21.15.154:0/2643014052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e58158b20 0x7f7e58142180 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.606+0000 7f7e5dbd5640 1 --2- 172.21.15.154:0/2643014052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e580cd960 0x7f7e581585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.606+0000 7f7e5dbd5640 1 --2- 172.21.15.154:0/2643014052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e40004810 0x7f7e580cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.606+0000 7f7e5dbd5640 1 -- 172.21.15.154:0/2643014052 >> 172.21.15.154:0/2643014052 conn(0x7f7e580b1850 msgr2=0x7f7e580b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:35.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.606+0000 7f7e5dbd5640 1 -- 172.21.15.154:0/2643014052 shutdown_connections 2024-05-14T01:23:35.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.606+0000 7f7e5dbd5640 1 -- 172.21.15.154:0/2643014052 wait complete. 2024-05-14T01:23:35.609 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:23:35.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.742+0000 7fe867d1b640 1 Processor -- start 2024-05-14T01:23:35.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.742+0000 7fe867d1b640 1 -- start start 2024-05-14T01:23:35.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.742+0000 7fe867d1b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe860141d00 0x7fe8600ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:35.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.742+0000 7fe867d1b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe8600ce880 0x7fe86006d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:35.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.742+0000 7fe867d1b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8600cf100 con 0x7fe86013ede0 2024-05-14T01:23:35.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.742+0000 7fe867d1b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe86006cff0 con 0x7fe8600ce880 2024-05-14T01:23:35.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.742+0000 7fe867d1b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe8600cf3e0 con 0x7fe860141d00 2024-05-14T01:23:35.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.742+0000 7fe8662b8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe8600ce880 0x7fe86006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:35.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.742+0000 7fe8662b8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe8600ce880 0x7fe86006d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59228/0 (socket says 172.21.15.154:59228) 2024-05-14T01:23:35.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.742+0000 7fe8662b8640 1 -- 172.21.15.154:0/2904309169 learned_addr learned my addr 172.21.15.154:0/2904309169 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:35.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.742+0000 7fe8652b6640 1 --2- 172.21.15.154:0/2904309169 >> v2:172.21.15.176:3300/0 conn(0x7fe860141d00 0x7fe8600ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:35.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.742+0000 7fe8662b8640 1 -- 172.21.15.154:0/2904309169 >> v2:172.21.15.176:3300/0 conn(0x7fe860141d00 msgr2=0x7fe8600ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:35.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.742+0000 7fe8662b8640 1 --2- 172.21.15.154:0/2904309169 >> v2:172.21.15.176:3300/0 conn(0x7fe860141d00 0x7fe8600ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.742+0000 7fe8662b8640 1 -- 172.21.15.154:0/2904309169 >> v1:172.21.15.176:6789/0 conn(0x7fe86013ede0 legacy=0x7fe8601415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:35.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.742+0000 7fe8662b8640 1 -- 172.21.15.154:0/2904309169 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86006cc80 con 0x7fe8600ce880 2024-05-14T01:23:35.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe8662b8640 1 --2- 172.21.15.154:0/2904309169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8600ce880 0x7fe86006d480 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe858009e50 tx=0x7fe85801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbac3fede484127e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:35.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe864ab5640 1 -- 172.21.15.154:0/2904309169 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8580a5850 con 0x7fe8600ce880 2024-05-14T01:23:35.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe864ab5640 1 -- 172.21.15.154:0/2904309169 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8580a59f0 con 0x7fe8600ce880 2024-05-14T01:23:35.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe864ab5640 1 -- 172.21.15.154:0/2904309169 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8580a5dc0 con 0x7fe8600ce880 2024-05-14T01:23:35.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 -- 172.21.15.154:0/2904309169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8600ce880 msgr2=0x7fe86006d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:35.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 --2- 172.21.15.154:0/2904309169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8600ce880 0x7fe86006d480 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe858009e50 tx=0x7fe85801c9b0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 -- 172.21.15.154:0/2904309169 shutdown_connections 2024-05-14T01:23:35.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 --2- 172.21.15.154:0/2904309169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8600ce880 0x7fe86006d480 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 --2- 172.21.15.154:0/2904309169 >> v2:172.21.15.176:3300/0 conn(0x7fe860141d00 0x7fe8600ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 -- 172.21.15.154:0/2904309169 >> 172.21.15.154:0/2904309169 conn(0x7fe8600b1850 msgr2=0x7fe8600b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:35.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 -- 172.21.15.154:0/2904309169 shutdown_connections 2024-05-14T01:23:35.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 -- 172.21.15.154:0/2904309169 wait complete. 2024-05-14T01:23:35.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 Processor -- start 2024-05-14T01:23:35.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 -- start start 2024-05-14T01:23:35.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8600ce880 0x7fe860139460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:35.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86013ede0 0x7fe860071f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:35.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe860141d00 0x7fe8601663b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:35.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe86006e350 con 0x7fe86013ede0 2024-05-14T01:23:35.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe86006e1d0 con 0x7fe8600ce880 2024-05-14T01:23:35.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe86006e4d0 con 0x7fe860141d00 2024-05-14T01:23:35.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe8652b6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86013ede0 0x7fe860071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:35.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe8652b6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86013ede0 0x7fe860071f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59244/0 (socket says 172.21.15.154:59244) 2024-05-14T01:23:35.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe8652b6640 1 -- 172.21.15.154:0/76535600 learned_addr learned my addr 172.21.15.154:0/76535600 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:35.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe8662b8640 1 --2- 172.21.15.154:0/76535600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe860141d00 0x7fe8601663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:35.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe865ab7640 1 --2- 172.21.15.154:0/76535600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8600ce880 0x7fe860139460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:35.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe8652b6640 1 -- 172.21.15.154:0/76535600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe860141d00 msgr2=0x7fe8601663b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:35.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe8652b6640 1 --2- 172.21.15.154:0/76535600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe860141d00 0x7fe8601663b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe8652b6640 1 -- 172.21.15.154:0/76535600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8600ce880 msgr2=0x7fe860139460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:35.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe8652b6640 1 --2- 172.21.15.154:0/76535600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8600ce880 0x7fe860139460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe8652b6640 1 -- 172.21.15.154:0/76535600 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe860072e70 con 0x7fe86013ede0 2024-05-14T01:23:35.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe865ab7640 1 --2- 172.21.15.154:0/76535600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8600ce880 0x7fe860139460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:35.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe8652b6640 1 --2- 172.21.15.154:0/76535600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86013ede0 0x7fe860071f00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00e870 tx=0x7fe85c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:35.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe8527fc640 1 -- 172.21.15.154:0/76535600 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c017070 con 0x7fe86013ede0 2024-05-14T01:23:35.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe8527fc640 1 -- 172.21.15.154:0/76535600 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe85c00c940 con 0x7fe86013ede0 2024-05-14T01:23:35.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe8527fc640 1 -- 172.21.15.154:0/76535600 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c00ccf0 con 0x7fe86013ede0 2024-05-14T01:23:35.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 -- 172.21.15.154:0/76535600 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe860072b90 con 0x7fe86013ede0 2024-05-14T01:23:35.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 -- 172.21.15.154:0/76535600 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe860071700 con 0x7fe86013ede0 2024-05-14T01:23:35.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe867d1b640 1 -- 172.21.15.154:0/76535600 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe860075470 con 0x7fe86013ede0 2024-05-14T01:23:35.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe8527fc640 1 -- 172.21.15.154:0/76535600 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe85c01a070 con 0x7fe86013ede0 2024-05-14T01:23:35.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe8527fc640 1 --2- 172.21.15.154:0/76535600 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe8440678c0 0x7fe844069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:35.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe8527fc640 1 -- 172.21.15.154:0/76535600 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe85c085af0 con 0x7fe86013ede0 2024-05-14T01:23:35.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe865ab7640 1 --2- 172.21.15.154:0/76535600 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe8440678c0 0x7fe844069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:35.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.750+0000 7fe865ab7640 1 --2- 172.21.15.154:0/76535600 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe8440678c0 0x7fe844069d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe8540016f0 tx=0x7fe854009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:35.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.754+0000 7fe8527fc640 1 -- 172.21.15.154:0/76535600 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fe85c0566c0 con 0x7fe86013ede0 2024-05-14T01:23:35.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.914+0000 7fe867d1b640 1 -- 172.21.15.154:0/76535600 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe86006f180 con 0x7fe86013ede0 2024-05-14T01:23:35.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.918+0000 7fe8527fc640 1 -- 172.21.15.154:0/76535600 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16666 (secure 0 0 0) 0x7fe85c055fc0 con 0x7fe86013ede0 2024-05-14T01:23:35.906 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:35.906 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:34.569906+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:23:35.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.922+0000 7fe867d1b640 1 -- 172.21.15.154:0/76535600 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe8440678c0 msgr2=0x7fe844069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:35.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.922+0000 7fe867d1b640 1 --2- 172.21.15.154:0/76535600 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe8440678c0 0x7fe844069d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe8540016f0 tx=0x7fe854009040 comp rx=0 tx=0).stop 2024-05-14T01:23:35.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.922+0000 7fe867d1b640 1 -- 172.21.15.154:0/76535600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86013ede0 msgr2=0x7fe860071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:35.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.922+0000 7fe867d1b640 1 --2- 172.21.15.154:0/76535600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86013ede0 0x7fe860071f00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00e870 tx=0x7fe85c00ec70 comp rx=0 tx=0).stop 2024-05-14T01:23:35.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.922+0000 7fe867d1b640 1 -- 172.21.15.154:0/76535600 shutdown_connections 2024-05-14T01:23:35.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.922+0000 7fe867d1b640 1 --2- 172.21.15.154:0/76535600 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe8440678c0 0x7fe844069d80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.922+0000 7fe867d1b640 1 --2- 172.21.15.154:0/76535600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe860141d00 0x7fe8601663b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.922+0000 7fe867d1b640 1 --2- 172.21.15.154:0/76535600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86013ede0 0x7fe860071f00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.922+0000 7fe867d1b640 1 --2- 172.21.15.154:0/76535600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8600ce880 0x7fe860139460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:35.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.922+0000 7fe867d1b640 1 -- 172.21.15.154:0/76535600 >> 172.21.15.154:0/76535600 conn(0x7fe8600b1850 msgr2=0x7fe86013fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:35.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.922+0000 7fe867d1b640 1 -- 172.21.15.154:0/76535600 shutdown_connections 2024-05-14T01:23:35.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:35.922+0000 7fe867d1b640 1 -- 172.21.15.154:0/76535600 wait complete. 2024-05-14T01:23:35.926 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-14T01:23:36.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f08535eb640 1 Processor -- start 2024-05-14T01:23:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f08535eb640 1 -- start start 2024-05-14T01:23:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f08535eb640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f084c158920 0x7f084c072c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:36.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f08535eb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f084c071f80 0x7f084c0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:36.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f08535eb640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f084c0723e0 con 0x7f084c161c60 2024-05-14T01:23:36.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f08535eb640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f084c071af0 con 0x7f084c158920 2024-05-14T01:23:36.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f08535eb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f084c0b3bb0 con 0x7f084c071f80 2024-05-14T01:23:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f0850b86640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f084c071f80 0x7f084c0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f0851387640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f084c158920 0x7f084c072c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f0851387640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f084c158920 0x7f084c072c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:49156/0 (socket says 172.21.15.154:49156) 2024-05-14T01:23:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f0851b88640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f084c161c60 0x7f084c0ad880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:51688/0 (socket says 172.21.15.154:51688) 2024-05-14T01:23:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f0851387640 1 -- 172.21.15.154:0/2122596758 learned_addr learned my addr 172.21.15.154:0/2122596758 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f0850b86640 1 -- 172.21.15.154:0/2122596758 >> v2:172.21.15.176:3300/0 conn(0x7f084c158920 msgr2=0x7f084c072c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f0850b86640 1 --2- 172.21.15.154:0/2122596758 >> v2:172.21.15.176:3300/0 conn(0x7f084c158920 0x7f084c072c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f0850b86640 1 -- 172.21.15.154:0/2122596758 >> v1:172.21.15.176:6789/0 conn(0x7f084c161c60 legacy=0x7f084c0ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f0850b86640 1 -- 172.21.15.154:0/2122596758 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084c0711c0 con 0x7f084c071f80 2024-05-14T01:23:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f0851387640 1 --2- 172.21.15.154:0/2122596758 >> v2:172.21.15.176:3300/0 conn(0x7f084c158920 0x7f084c072c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:23:36.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f0850b86640 1 --2- 172.21.15.154:0/2122596758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f084c071f80 0x7f084c0b3480 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f083c0097c0 tx=0x7f083c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20e0dfc413829fae server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:36.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f0843fff640 1 -- 172.21.15.154:0/2122596758 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c0b1070 con 0x7f084c071f80 2024-05-14T01:23:36.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f0843fff640 1 -- 172.21.15.154:0/2122596758 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f083c0ac410 con 0x7f084c071f80 2024-05-14T01:23:36.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f0843fff640 1 -- 172.21.15.154:0/2122596758 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c0ac7e0 con 0x7f084c071f80 2024-05-14T01:23:36.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f08535eb640 1 -- 172.21.15.154:0/2122596758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f084c071f80 msgr2=0x7f084c0b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:36.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f08535eb640 1 --2- 172.21.15.154:0/2122596758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f084c071f80 0x7f084c0b3480 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f083c0097c0 tx=0x7f083c01c4a0 comp rx=0 tx=0).stop 2024-05-14T01:23:36.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f08535eb640 1 -- 172.21.15.154:0/2122596758 shutdown_connections 2024-05-14T01:23:36.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f08535eb640 1 --2- 172.21.15.154:0/2122596758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f084c071f80 0x7f084c0b3480 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:36.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f08535eb640 1 --2- 172.21.15.154:0/2122596758 >> v2:172.21.15.176:3300/0 conn(0x7f084c158920 0x7f084c072c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:36.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.066+0000 7f08535eb640 1 -- 172.21.15.154:0/2122596758 >> 172.21.15.154:0/2122596758 conn(0x7f084c0b1770 msgr2=0x7f084c0b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:36.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f08535eb640 1 -- 172.21.15.154:0/2122596758 shutdown_connections 2024-05-14T01:23:36.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f08535eb640 1 -- 172.21.15.154:0/2122596758 wait complete. 2024-05-14T01:23:36.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f08535eb640 1 Processor -- start 2024-05-14T01:23:36.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f08535eb640 1 -- start start 2024-05-14T01:23:36.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f08535eb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f084c071f80 0x7f084c14eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:36.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f08535eb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f084c161c60 0x7f084c154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:36.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f08535eb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f084c156b30 0x7f084c156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:36.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f08535eb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f084c0ae520 con 0x7f084c156b30 2024-05-14T01:23:36.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f08535eb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f084c0ae3a0 con 0x7f084c161c60 2024-05-14T01:23:36.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f08535eb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f084c16b810 con 0x7f084c071f80 2024-05-14T01:23:36.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f0851b88640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f084c156b30 0x7f084c156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f0851b88640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f084c156b30 0x7f084c156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59260/0 (socket says 172.21.15.154:59260) 2024-05-14T01:23:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f0851b88640 1 -- 172.21.15.154:0/2044204733 learned_addr learned my addr 172.21.15.154:0/2044204733 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f0851387640 1 --2- 172.21.15.154:0/2044204733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f084c071f80 0x7f084c14eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f0850b86640 1 --2- 172.21.15.154:0/2044204733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f084c161c60 0x7f084c154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f0851b88640 1 -- 172.21.15.154:0/2044204733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f084c071f80 msgr2=0x7f084c14eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f0851b88640 1 --2- 172.21.15.154:0/2044204733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f084c071f80 0x7f084c14eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f0851b88640 1 -- 172.21.15.154:0/2044204733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f084c161c60 msgr2=0x7f084c154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f0851b88640 1 --2- 172.21.15.154:0/2044204733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f084c161c60 0x7f084c154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f0851b88640 1 -- 172.21.15.154:0/2044204733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084c0ce4e0 con 0x7f084c156b30 2024-05-14T01:23:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f0851b88640 1 --2- 172.21.15.154:0/2044204733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f084c156b30 0x7f084c156fe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f084400c700 tx=0x7f084400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f0841ffb640 1 -- 172.21.15.154:0/2044204733 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844017070 con 0x7f084c156b30 2024-05-14T01:23:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f0841ffb640 1 -- 172.21.15.154:0/2044204733 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f084400ce10 con 0x7f084c156b30 2024-05-14T01:23:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f08535eb640 1 -- 172.21.15.154:0/2044204733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f084c0ce780 con 0x7f084c156b30 2024-05-14T01:23:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f0841ffb640 1 -- 172.21.15.154:0/2044204733 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084400a840 con 0x7f084c156b30 2024-05-14T01:23:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f08535eb640 1 -- 172.21.15.154:0/2044204733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f084c0ced40 con 0x7f084c156b30 2024-05-14T01:23:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.070+0000 7f08535eb640 1 -- 172.21.15.154:0/2044204733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f084c075470 con 0x7f084c156b30 2024-05-14T01:23:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.074+0000 7f0841ffb640 1 -- 172.21.15.154:0/2044204733 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f084401a070 con 0x7f084c156b30 2024-05-14T01:23:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.074+0000 7f0841ffb640 1 --2- 172.21.15.154:0/2044204733 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f08300678c0 0x7f0830069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.074+0000 7f0851387640 1 --2- 172.21.15.154:0/2044204733 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f08300678c0 0x7f0830069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.074+0000 7f0841ffb640 1 -- 172.21.15.154:0/2044204733 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f08440851d0 con 0x7f084c156b30 2024-05-14T01:23:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.074+0000 7f0851387640 1 --2- 172.21.15.154:0/2044204733 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f08300678c0 0x7f0830069d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0848009630 tx=0x7f0848009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:36.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.078+0000 7f0841ffb640 1 -- 172.21.15.154:0/2044204733 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f0844055620 con 0x7f084c156b30 2024-05-14T01:23:36.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:36.278+0000 7f08535eb640 1 -- 172.21.15.154:0/2044204733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f084c0cf8d0 con 0x7f084c156b30 2024-05-14T01:23:37.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.290+0000 7f0841ffb640 1 -- 172.21.15.154:0/2044204733 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f0844059920 con 0x7f084c156b30 2024-05-14T01:23:37.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.294+0000 7f08535eb640 1 -- 172.21.15.154:0/2044204733 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f08300678c0 msgr2=0x7f0830069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:37.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.294+0000 7f08535eb640 1 --2- 172.21.15.154:0/2044204733 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f08300678c0 0x7f0830069d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0848009630 tx=0x7f0848009240 comp rx=0 tx=0).stop 2024-05-14T01:23:37.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.294+0000 7f08535eb640 1 -- 172.21.15.154:0/2044204733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f084c156b30 msgr2=0x7f084c156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:37.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.294+0000 7f08535eb640 1 --2- 172.21.15.154:0/2044204733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f084c156b30 0x7f084c156fe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f084400c700 tx=0x7f084400cbc0 comp rx=0 tx=0).stop 2024-05-14T01:23:37.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.294+0000 7f08535eb640 1 -- 172.21.15.154:0/2044204733 shutdown_connections 2024-05-14T01:23:37.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.294+0000 7f08535eb640 1 --2- 172.21.15.154:0/2044204733 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f08300678c0 0x7f0830069d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:37.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.294+0000 7f08535eb640 1 --2- 172.21.15.154:0/2044204733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f084c156b30 0x7f084c156fe0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:37.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.294+0000 7f08535eb640 1 --2- 172.21.15.154:0/2044204733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f084c161c60 0x7f084c154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:37.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.294+0000 7f08535eb640 1 --2- 172.21.15.154:0/2044204733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f084c071f80 0x7f084c14eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:37.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.294+0000 7f08535eb640 1 -- 172.21.15.154:0/2044204733 >> 172.21.15.154:0/2044204733 conn(0x7f084c0b1770 msgr2=0x7f084c15f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:37.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.294+0000 7f08535eb640 1 -- 172.21.15.154:0/2044204733 shutdown_connections 2024-05-14T01:23:37.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.294+0000 7f08535eb640 1 -- 172.21.15.154:0/2044204733 wait complete. 2024-05-14T01:23:37.298 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-14T01:23:37.298 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-14T01:23:37.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.438+0000 7f172ba6a640 1 Processor -- start 2024-05-14T01:23:37.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.438+0000 7f172ba6a640 1 -- start start 2024-05-14T01:23:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.438+0000 7f172ba6a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17241458d0 0x7f17240cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.438+0000 7f172ba6a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1724160150 0x7f172406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.438+0000 7f172ba6a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1724071840 con 0x7f1724071060 2024-05-14T01:23:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.438+0000 7f172ba6a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1724071b20 con 0x7f1724160150 2024-05-14T01:23:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.438+0000 7f172ba6a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1724071e00 con 0x7f17241458d0 2024-05-14T01:23:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.438+0000 7f172a007640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1724160150 0x7f172406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.438+0000 7f172a007640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1724160150 0x7f172406ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46108/0 (socket says 172.21.15.154:46108) 2024-05-14T01:23:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.438+0000 7f172a007640 1 -- 172.21.15.154:0/846654963 learned_addr learned my addr 172.21.15.154:0/846654963 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.438+0000 7f1729806640 1 --2- 172.21.15.154:0/846654963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17241458d0 0x7f17240cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.438+0000 7f172a007640 1 -- 172.21.15.154:0/846654963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17241458d0 msgr2=0x7f17240cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.438+0000 7f172a007640 1 --2- 172.21.15.154:0/846654963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17241458d0 0x7f17240cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.438+0000 7f172a007640 1 -- 172.21.15.154:0/846654963 >> v1:172.21.15.176:6789/0 conn(0x7f1724071060 legacy=0x7f172415fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.438+0000 7f172a007640 1 -- 172.21.15.154:0/846654963 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17240720e0 con 0x7f1724160150 2024-05-14T01:23:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.438+0000 7f172a007640 1 --2- 172.21.15.154:0/846654963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1724160150 0x7f172406ce40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f171c009e50 tx=0x7f171c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e642832498595460 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f1728804640 1 -- 172.21.15.154:0/846654963 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c0a5780 con 0x7f1724160150 2024-05-14T01:23:37.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f1728804640 1 -- 172.21.15.154:0/846654963 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171c0a5920 con 0x7f1724160150 2024-05-14T01:23:37.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f1728804640 1 -- 172.21.15.154:0/846654963 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c0a5cf0 con 0x7f1724160150 2024-05-14T01:23:37.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f172ba6a640 1 -- 172.21.15.154:0/846654963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1724160150 msgr2=0x7f172406ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:37.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f172ba6a640 1 --2- 172.21.15.154:0/846654963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1724160150 0x7f172406ce40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f171c009e50 tx=0x7f171c01c9f0 comp rx=0 tx=0).stop 2024-05-14T01:23:37.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f172ba6a640 1 -- 172.21.15.154:0/846654963 shutdown_connections 2024-05-14T01:23:37.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f172ba6a640 1 --2- 172.21.15.154:0/846654963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1724160150 0x7f172406ce40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:37.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f172ba6a640 1 --2- 172.21.15.154:0/846654963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17241458d0 0x7f17240cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:37.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f172ba6a640 1 -- 172.21.15.154:0/846654963 >> 172.21.15.154:0/846654963 conn(0x7f17240b1770 msgr2=0x7f17240b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:37.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f172ba6a640 1 -- 172.21.15.154:0/846654963 shutdown_connections 2024-05-14T01:23:37.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f172ba6a640 1 -- 172.21.15.154:0/846654963 wait complete. 2024-05-14T01:23:37.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f172ba6a640 1 Processor -- start 2024-05-14T01:23:37.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f172ba6a640 1 -- start start 2024-05-14T01:23:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f172ba6a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1724071060 0x7f1724154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f172ba6a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17241458d0 0x7f17241523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f172ba6a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1724160150 0x7f1724152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f172ba6a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f172406dd10 con 0x7f1724071060 2024-05-14T01:23:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f172ba6a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f172406db90 con 0x7f1724160150 2024-05-14T01:23:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f172ba6a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1724168de0 con 0x7f17241458d0 2024-05-14T01:23:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f1729806640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1724071060 0x7f1724154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f1729806640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1724071060 0x7f1724154260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46114/0 (socket says 172.21.15.154:46114) 2024-05-14T01:23:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f1729806640 1 -- 172.21.15.154:0/751691472 learned_addr learned my addr 172.21.15.154:0/751691472 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f1729005640 1 --2- 172.21.15.154:0/751691472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17241458d0 0x7f17241523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f172a007640 1 --2- 172.21.15.154:0/751691472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1724160150 0x7f1724152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f1729806640 1 -- 172.21.15.154:0/751691472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17241458d0 msgr2=0x7f17241523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f1729806640 1 --2- 172.21.15.154:0/751691472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17241458d0 0x7f17241523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f1729806640 1 -- 172.21.15.154:0/751691472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1724160150 msgr2=0x7f1724152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f1729806640 1 --2- 172.21.15.154:0/751691472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1724160150 0x7f1724152930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f1729806640 1 -- 172.21.15.154:0/751691472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1724155730 con 0x7f1724071060 2024-05-14T01:23:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f1729005640 1 --2- 172.21.15.154:0/751691472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17241458d0 0x7f17241523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:37.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.442+0000 7f1729806640 1 --2- 172.21.15.154:0/751691472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1724071060 0x7f1724154260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f172000c7f0 tx=0x7f172000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:37.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.446+0000 7f171a7fc640 1 -- 172.21.15.154:0/751691472 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1720015070 con 0x7f1724071060 2024-05-14T01:23:37.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.446+0000 7f171a7fc640 1 -- 172.21.15.154:0/751691472 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1720004240 con 0x7f1724071060 2024-05-14T01:23:37.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.446+0000 7f172ba6a640 1 -- 172.21.15.154:0/751691472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1724154bb0 con 0x7f1724071060 2024-05-14T01:23:37.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.446+0000 7f171a7fc640 1 -- 172.21.15.154:0/751691472 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1720003620 con 0x7f1724071060 2024-05-14T01:23:37.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.446+0000 7f172ba6a640 1 -- 172.21.15.154:0/751691472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1724155170 con 0x7f1724071060 2024-05-14T01:23:37.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.446+0000 7f172ba6a640 1 -- 172.21.15.154:0/751691472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1724075470 con 0x7f1724071060 2024-05-14T01:23:37.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.446+0000 7f171a7fc640 1 -- 172.21.15.154:0/751691472 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f17200039d0 con 0x7f1724071060 2024-05-14T01:23:37.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.446+0000 7f171a7fc640 1 --2- 172.21.15.154:0/751691472 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f17080678c0 0x7f1708069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:37.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.446+0000 7f171a7fc640 1 -- 172.21.15.154:0/751691472 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1720085c10 con 0x7f1724071060 2024-05-14T01:23:37.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.446+0000 7f1729005640 1 --2- 172.21.15.154:0/751691472 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f17080678c0 0x7f1708069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:37.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.446+0000 7f1729005640 1 --2- 172.21.15.154:0/751691472 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f17080678c0 0x7f1708069d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f172415bbc0 tx=0x7f1714009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:37.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.450+0000 7f171a7fc640 1 -- 172.21.15.154:0/751691472 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f17200567e0 con 0x7f1724071060 2024-05-14T01:23:37.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:37.634+0000 7f172ba6a640 1 -- 172.21.15.154:0/751691472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f1724166bb0 con 0x7f1724071060 2024-05-14T01:23:38.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.294+0000 7f171a7fc640 1 -- 172.21.15.154:0/751691472 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f17200560e0 con 0x7f1724071060 2024-05-14T01:23:38.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.298+0000 7f172ba6a640 1 -- 172.21.15.154:0/751691472 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f17080678c0 msgr2=0x7f1708069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:38.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.298+0000 7f172ba6a640 1 --2- 172.21.15.154:0/751691472 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f17080678c0 0x7f1708069d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f172415bbc0 tx=0x7f1714009040 comp rx=0 tx=0).stop 2024-05-14T01:23:38.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.298+0000 7f172ba6a640 1 -- 172.21.15.154:0/751691472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1724071060 msgr2=0x7f1724154260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:38.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.298+0000 7f172ba6a640 1 --2- 172.21.15.154:0/751691472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1724071060 0x7f1724154260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f172000c7f0 tx=0x7f172000ccb0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.298+0000 7f172ba6a640 1 -- 172.21.15.154:0/751691472 shutdown_connections 2024-05-14T01:23:38.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.298+0000 7f172ba6a640 1 --2- 172.21.15.154:0/751691472 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f17080678c0 0x7f1708069d80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.298+0000 7f172ba6a640 1 --2- 172.21.15.154:0/751691472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1724160150 0x7f1724152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.298+0000 7f172ba6a640 1 --2- 172.21.15.154:0/751691472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17241458d0 0x7f17241523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.298+0000 7f172ba6a640 1 --2- 172.21.15.154:0/751691472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1724071060 0x7f1724154260 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.298+0000 7f172ba6a640 1 -- 172.21.15.154:0/751691472 >> 172.21.15.154:0/751691472 conn(0x7f17240b1770 msgr2=0x7f172406de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:38.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.298+0000 7f172ba6a640 1 -- 172.21.15.154:0/751691472 shutdown_connections 2024-05-14T01:23:38.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.298+0000 7f172ba6a640 1 -- 172.21.15.154:0/751691472 wait complete. 2024-05-14T01:23:38.301 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-14T01:23:38.301 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T01:23:38.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.442+0000 7fd5a4c48640 1 Processor -- start 2024-05-14T01:23:38.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.442+0000 7fd5a4c48640 1 -- start start 2024-05-14T01:23:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.442+0000 7fd5a4c48640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd5a015e100 0x7fd5a00d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.442+0000 7fd5a4c48640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5a00cf520 0x7fd5a00b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.442+0000 7fd5a4c48640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5a00d29f0 con 0x7fd5a015e4e0 2024-05-14T01:23:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.442+0000 7fd5a4c48640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd5a00d2cd0 con 0x7fd5a00cf520 2024-05-14T01:23:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.442+0000 7fd5a4c48640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd5a00d2fb0 con 0x7fd5a015e100 2024-05-14T01:23:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.442+0000 7fd59ed9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5a00cf520 0x7fd5a00b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.442+0000 7fd59dd9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd5a015e4e0 0x7fd5a00cee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57158/0 (socket says 172.21.15.154:57158) 2024-05-14T01:23:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.442+0000 7fd59dd9b640 1 -- 172.21.15.154:0/1807926130 learned_addr learned my addr 172.21.15.154:0/1807926130 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.442+0000 7fd59e59c640 1 --2- 172.21.15.154:0/1807926130 >> v2:172.21.15.176:3300/0 conn(0x7fd5a015e100 0x7fd5a00d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.442+0000 7fd59d59a640 1 -- 172.21.15.154:0/1807926130 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4293353747 0 0) 0x7fd5a00d29f0 con 0x7fd5a015e4e0 2024-05-14T01:23:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.442+0000 7fd59d59a640 1 -- 172.21.15.154:0/1807926130 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd588003530 con 0x7fd5a015e4e0 2024-05-14T01:23:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.442+0000 7fd59ed9d640 1 -- 172.21.15.154:0/1807926130 >> v2:172.21.15.176:3300/0 conn(0x7fd5a015e100 msgr2=0x7fd5a00d22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.442+0000 7fd59ed9d640 1 --2- 172.21.15.154:0/1807926130 >> v2:172.21.15.176:3300/0 conn(0x7fd5a015e100 0x7fd5a00d22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.442+0000 7fd59ed9d640 1 -- 172.21.15.154:0/1807926130 >> v1:172.21.15.154:6789/0 conn(0x7fd5a015e4e0 legacy=0x7fd5a00cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.442+0000 7fd59ed9d640 1 -- 172.21.15.154:0/1807926130 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a00d3290 con 0x7fd5a00cf520 2024-05-14T01:23:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd59ed9d640 1 --2- 172.21.15.154:0/1807926130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5a00cf520 0x7fd5a00b9b20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00ce640 tx=0x7fd59801f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70186282e1a4a1e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd59d59a640 1 -- 172.21.15.154:0/1807926130 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5980b4070 con 0x7fd5a00cf520 2024-05-14T01:23:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd59d59a640 1 -- 172.21.15.154:0/1807926130 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5980af600 con 0x7fd5a00cf520 2024-05-14T01:23:38.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd59d59a640 1 -- 172.21.15.154:0/1807926130 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5980af9b0 con 0x7fd5a00cf520 2024-05-14T01:23:38.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd5a4c48640 1 -- 172.21.15.154:0/1807926130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5a00cf520 msgr2=0x7fd5a00b9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:38.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd5a4c48640 1 --2- 172.21.15.154:0/1807926130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5a00cf520 0x7fd5a00b9b20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00ce640 tx=0x7fd59801f110 comp rx=0 tx=0).stop 2024-05-14T01:23:38.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd5a4c48640 1 -- 172.21.15.154:0/1807926130 shutdown_connections 2024-05-14T01:23:38.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd5a4c48640 1 --2- 172.21.15.154:0/1807926130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5a00cf520 0x7fd5a00b9b20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd5a4c48640 1 --2- 172.21.15.154:0/1807926130 >> v2:172.21.15.176:3300/0 conn(0x7fd5a015e100 0x7fd5a00d22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd5a4c48640 1 -- 172.21.15.154:0/1807926130 >> 172.21.15.154:0/1807926130 conn(0x7fd5a00b5b50 msgr2=0x7fd5a00b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:38.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd5a4c48640 1 -- 172.21.15.154:0/1807926130 shutdown_connections 2024-05-14T01:23:38.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd5a4c48640 1 -- 172.21.15.154:0/1807926130 wait complete. 2024-05-14T01:23:38.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd5a4c48640 1 Processor -- start 2024-05-14T01:23:38.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd5a4c48640 1 -- start start 2024-05-14T01:23:38.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd5a4c48640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5a00cf520 0x7fd5a00cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:38.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd5a4c48640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5a015e100 0x7fd5a01e8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd5a4c48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5a015e4e0 0x7fd5a00c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd5a4c48640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a00d3c10 con 0x7fd5a015e4e0 2024-05-14T01:23:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd5a4c48640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a00d3a90 con 0x7fd5a015e100 2024-05-14T01:23:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd5a4c48640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a0154c40 con 0x7fd5a00cf520 2024-05-14T01:23:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd59ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5a015e4e0 0x7fd5a00c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd59ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5a015e4e0 0x7fd5a00c7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46128/0 (socket says 172.21.15.154:46128) 2024-05-14T01:23:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd59ed9d640 1 -- 172.21.15.154:0/3118702215 learned_addr learned my addr 172.21.15.154:0/3118702215 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd59e59c640 1 --2- 172.21.15.154:0/3118702215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5a00cf520 0x7fd5a00cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd59dd9b640 1 --2- 172.21.15.154:0/3118702215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5a015e100 0x7fd5a01e8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd59ed9d640 1 -- 172.21.15.154:0/3118702215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5a00cf520 msgr2=0x7fd5a00cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd59ed9d640 1 --2- 172.21.15.154:0/3118702215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5a00cf520 0x7fd5a00cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd59ed9d640 1 -- 172.21.15.154:0/3118702215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5a015e100 msgr2=0x7fd5a01e8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd59ed9d640 1 --2- 172.21.15.154:0/3118702215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5a015e100 0x7fd5a01e8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd59ed9d640 1 -- 172.21.15.154:0/3118702215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a01e7a50 con 0x7fd5a015e4e0 2024-05-14T01:23:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.446+0000 7fd59ed9d640 1 --2- 172.21.15.154:0/3118702215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5a015e4e0 0x7fd5a00c7b70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd59801bd20 tx=0x7fd59801beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.450+0000 7fd58effd640 1 -- 172.21.15.154:0/3118702215 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5980b4040 con 0x7fd5a015e4e0 2024-05-14T01:23:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.450+0000 7fd58effd640 1 -- 172.21.15.154:0/3118702215 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5980bf070 con 0x7fd5a015e4e0 2024-05-14T01:23:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.450+0000 7fd5a4c48640 1 -- 172.21.15.154:0/3118702215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a01e7d30 con 0x7fd5a015e4e0 2024-05-14T01:23:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.450+0000 7fd58effd640 1 -- 172.21.15.154:0/3118702215 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5980af9b0 con 0x7fd5a015e4e0 2024-05-14T01:23:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.450+0000 7fd5a4c48640 1 -- 172.21.15.154:0/3118702215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a01e5bb0 con 0x7fd5a015e4e0 2024-05-14T01:23:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.450+0000 7fd5a4c48640 1 -- 172.21.15.154:0/3118702215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5a0075470 con 0x7fd5a015e4e0 2024-05-14T01:23:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.450+0000 7fd58effd640 1 -- 172.21.15.154:0/3118702215 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd5980afb50 con 0x7fd5a015e4e0 2024-05-14T01:23:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.450+0000 7fd58effd640 1 --2- 172.21.15.154:0/3118702215 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd5800678c0 0x7fd580069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.450+0000 7fd58effd640 1 -- 172.21.15.154:0/3118702215 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd598123e00 con 0x7fd5a015e4e0 2024-05-14T01:23:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.450+0000 7fd59e59c640 1 --2- 172.21.15.154:0/3118702215 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd5800678c0 0x7fd580069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:38.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.450+0000 7fd59e59c640 1 --2- 172.21.15.154:0/3118702215 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd5800678c0 0x7fd580069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd59000b9d0 tx=0x7fd590008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.454+0000 7fd58effd640 1 -- 172.21.15.154:0/3118702215 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fd598018c70 con 0x7fd5a015e4e0 2024-05-14T01:23:38.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.638+0000 7fd5a4c48640 1 -- 172.21.15.154:0/3118702215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5a0067db0 con 0x7fd5a015e4e0 2024-05-14T01:23:38.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.638+0000 7fd58effd640 1 -- 172.21.15.154:0/3118702215 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7fd5980c2360 con 0x7fd5a015e4e0 2024-05-14T01:23:38.622 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:38.622 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2575586302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2575586302},{"type":"v1","addr":"172.21.15.154:6836","nonce":2575586302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3108110937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3108110937},{"type":"v1","addr":"172.21.15.154:6837","nonce":3108110937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/77727941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":77727941},{"type":"v1","addr":"172.21.15.176:6833","nonce":77727941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T01:23:34.570674+0000","modified":"2024-05-14T01:23:37.636442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6835/2614790445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2614790445},{"type":"v1","addr":"172.21.15.176:6835","nonce":2614790445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-14T01:23:38.623 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 8 2024-05-14T01:23:38.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.638+0000 7fd5a4c48640 1 -- 172.21.15.154:0/3118702215 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd5800678c0 msgr2=0x7fd580069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:38.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.638+0000 7fd5a4c48640 1 --2- 172.21.15.154:0/3118702215 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd5800678c0 0x7fd580069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd59000b9d0 tx=0x7fd590008040 comp rx=0 tx=0).stop 2024-05-14T01:23:38.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.638+0000 7fd5a4c48640 1 -- 172.21.15.154:0/3118702215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5a015e4e0 msgr2=0x7fd5a00c7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:38.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.638+0000 7fd5a4c48640 1 --2- 172.21.15.154:0/3118702215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5a015e4e0 0x7fd5a00c7b70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd59801bd20 tx=0x7fd59801beb0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.642+0000 7fd5a4c48640 1 -- 172.21.15.154:0/3118702215 shutdown_connections 2024-05-14T01:23:38.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.642+0000 7fd5a4c48640 1 --2- 172.21.15.154:0/3118702215 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd5800678c0 0x7fd580069d80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.642+0000 7fd5a4c48640 1 --2- 172.21.15.154:0/3118702215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5a015e4e0 0x7fd5a00c7b70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.642+0000 7fd5a4c48640 1 --2- 172.21.15.154:0/3118702215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5a015e100 0x7fd5a01e8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.642+0000 7fd5a4c48640 1 --2- 172.21.15.154:0/3118702215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5a00cf520 0x7fd5a00cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.642+0000 7fd5a4c48640 1 -- 172.21.15.154:0/3118702215 >> 172.21.15.154:0/3118702215 conn(0x7fd5a00b5b50 msgr2=0x7fd5a01e4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:38.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.642+0000 7fd5a4c48640 1 -- 172.21.15.154:0/3118702215 shutdown_connections 2024-05-14T01:23:38.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.642+0000 7fd5a4c48640 1 -- 172.21.15.154:0/3118702215 wait complete. 2024-05-14T01:23:38.639 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:23:38.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.778+0000 7fb84e19a640 1 Processor -- start 2024-05-14T01:23:38.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.778+0000 7fb84e19a640 1 -- start start 2024-05-14T01:23:38.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.778+0000 7fb84e19a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84815e1e0 0x7fb8480afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:38.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.778+0000 7fb84e19a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb8480716f0 0x7fb848071b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:38.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.778+0000 7fb84e19a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8480b4ee0 con 0x7fb84815de00 2024-05-14T01:23:38.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.778+0000 7fb84e19a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb8480af790 con 0x7fb8480716f0 2024-05-14T01:23:38.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.778+0000 7fb84e19a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb848072070 con 0x7fb84815e1e0 2024-05-14T01:23:38.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.778+0000 7fb8477fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb84815de00 0x7fb8480b44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57172/0 (socket says 172.21.15.154:57172) 2024-05-14T01:23:38.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.778+0000 7fb8477fe640 1 -- 172.21.15.154:0/332202909 learned_addr learned my addr 172.21.15.154:0/332202909 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:38.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.778+0000 7fb847fff640 1 --2- 172.21.15.154:0/332202909 >> v2:172.21.15.154:3300/0 conn(0x7fb8480716f0 0x7fb848071b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:38.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.778+0000 7fb846ffd640 1 --2- 172.21.15.154:0/332202909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84815e1e0 0x7fb8480afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:38.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.778+0000 7fb8467fc640 1 -- 172.21.15.154:0/332202909 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1437609664 0 0) 0x7fb8480b4ee0 con 0x7fb84815de00 2024-05-14T01:23:38.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.778+0000 7fb8467fc640 1 -- 172.21.15.154:0/332202909 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb830003530 con 0x7fb84815de00 2024-05-14T01:23:38.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.778+0000 7fb847fff640 1 -- 172.21.15.154:0/332202909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84815e1e0 msgr2=0x7fb8480afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:38.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.778+0000 7fb847fff640 1 --2- 172.21.15.154:0/332202909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84815e1e0 0x7fb8480afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.778+0000 7fb847fff640 1 -- 172.21.15.154:0/332202909 >> v1:172.21.15.154:6789/0 conn(0x7fb84815de00 legacy=0x7fb8480b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:38.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.778+0000 7fb847fff640 1 -- 172.21.15.154:0/332202909 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8480af140 con 0x7fb8480716f0 2024-05-14T01:23:38.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb847fff640 1 --2- 172.21.15.154:0/332202909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8480716f0 0x7fb848071b30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb840009d90 tx=0x7fb84001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea54bddf19befda server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:38.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb8467fc640 1 -- 172.21.15.154:0/332202909 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8400b2070 con 0x7fb8480716f0 2024-05-14T01:23:38.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb8467fc640 1 -- 172.21.15.154:0/332202909 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8400a58b0 con 0x7fb8480716f0 2024-05-14T01:23:38.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb8467fc640 1 -- 172.21.15.154:0/332202909 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8400a5c80 con 0x7fb8480716f0 2024-05-14T01:23:38.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb84e19a640 1 -- 172.21.15.154:0/332202909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8480716f0 msgr2=0x7fb848071b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:38.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb84e19a640 1 --2- 172.21.15.154:0/332202909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8480716f0 0x7fb848071b30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb840009d90 tx=0x7fb84001c8e0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb84e19a640 1 -- 172.21.15.154:0/332202909 shutdown_connections 2024-05-14T01:23:38.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb84e19a640 1 --2- 172.21.15.154:0/332202909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8480716f0 0x7fb848071b30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb84e19a640 1 --2- 172.21.15.154:0/332202909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84815e1e0 0x7fb8480afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb84e19a640 1 -- 172.21.15.154:0/332202909 >> 172.21.15.154:0/332202909 conn(0x7fb84806b280 msgr2=0x7fb84806b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:38.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb84e19a640 1 -- 172.21.15.154:0/332202909 shutdown_connections 2024-05-14T01:23:38.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb84e19a640 1 -- 172.21.15.154:0/332202909 wait complete. 2024-05-14T01:23:38.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb84e19a640 1 Processor -- start 2024-05-14T01:23:38.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb84e19a640 1 -- start start 2024-05-14T01:23:38.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb84e19a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8480716f0 0x7fb848158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb84e19a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb84815de00 0x7fb84814d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb84e19a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84815e1e0 0x7fb84814db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb84e19a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb84806dfb0 con 0x7fb84815de00 2024-05-14T01:23:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb84e19a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb84806de30 con 0x7fb8480716f0 2024-05-14T01:23:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb84e19a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb84806e130 con 0x7fb84815e1e0 2024-05-14T01:23:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb846ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb84815de00 0x7fb84814d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb846ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb84815de00 0x7fb84814d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46142/0 (socket says 172.21.15.154:46142) 2024-05-14T01:23:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb846ffd640 1 -- 172.21.15.154:0/4056155728 learned_addr learned my addr 172.21.15.154:0/4056155728 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb8477fe640 1 --2- 172.21.15.154:0/4056155728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8480716f0 0x7fb848158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb847fff640 1 --2- 172.21.15.154:0/4056155728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84815e1e0 0x7fb84814db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb846ffd640 1 -- 172.21.15.154:0/4056155728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84815e1e0 msgr2=0x7fb84814db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb846ffd640 1 --2- 172.21.15.154:0/4056155728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84815e1e0 0x7fb84814db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb846ffd640 1 -- 172.21.15.154:0/4056155728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8480716f0 msgr2=0x7fb848158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:38.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb846ffd640 1 --2- 172.21.15.154:0/4056155728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8480716f0 0x7fb848158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb846ffd640 1 -- 172.21.15.154:0/4056155728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb848157ac0 con 0x7fb84815de00 2024-05-14T01:23:38.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb847fff640 1 --2- 172.21.15.154:0/4056155728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84815e1e0 0x7fb84814db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:38.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb846ffd640 1 --2- 172.21.15.154:0/4056155728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb84815de00 0x7fb84814d5d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00e870 tx=0x7fb83c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:38.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb82ffff640 1 -- 172.21.15.154:0/4056155728 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83c017070 con 0x7fb84815de00 2024-05-14T01:23:38.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.782+0000 7fb82ffff640 1 -- 172.21.15.154:0/4056155728 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb83c00c940 con 0x7fb84815de00 2024-05-14T01:23:38.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.786+0000 7fb84e19a640 1 -- 172.21.15.154:0/4056155728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb848157da0 con 0x7fb84815de00 2024-05-14T01:23:38.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.786+0000 7fb82ffff640 1 -- 172.21.15.154:0/4056155728 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83c00ccf0 con 0x7fb84815de00 2024-05-14T01:23:38.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.786+0000 7fb84e19a640 1 -- 172.21.15.154:0/4056155728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb848158360 con 0x7fb84815de00 2024-05-14T01:23:38.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.786+0000 7fb84e19a640 1 -- 172.21.15.154:0/4056155728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb848075470 con 0x7fb84815de00 2024-05-14T01:23:38.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.786+0000 7fb82ffff640 1 -- 172.21.15.154:0/4056155728 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb83c01a070 con 0x7fb84815de00 2024-05-14T01:23:38.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.786+0000 7fb82ffff640 1 --2- 172.21.15.154:0/4056155728 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb8340678c0 0x7fb834069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:38.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.786+0000 7fb82ffff640 1 -- 172.21.15.154:0/4056155728 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb83c085e80 con 0x7fb84815de00 2024-05-14T01:23:38.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.786+0000 7fb8477fe640 1 --2- 172.21.15.154:0/4056155728 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb8340678c0 0x7fb834069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:38.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.786+0000 7fb8477fe640 1 --2- 172.21.15.154:0/4056155728 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb8340678c0 0x7fb834069d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb838005890 tx=0x7fb838009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:38.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.790+0000 7fb82ffff640 1 -- 172.21.15.154:0/4056155728 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb83c056a50 con 0x7fb84815de00 2024-05-14T01:23:38.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.938+0000 7fb84e19a640 1 -- 172.21.15.154:0/4056155728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb848072390 con 0x7fb84815de00 2024-05-14T01:23:38.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.942+0000 7fb82ffff640 1 -- 172.21.15.154:0/4056155728 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7fb83c056350 con 0x7fb84815de00 2024-05-14T01:23:38.926 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:38.926 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:36.232271+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:23:38.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.942+0000 7fb84e19a640 1 -- 172.21.15.154:0/4056155728 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb8340678c0 msgr2=0x7fb834069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:38.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.942+0000 7fb84e19a640 1 --2- 172.21.15.154:0/4056155728 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb8340678c0 0x7fb834069d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb838005890 tx=0x7fb838009040 comp rx=0 tx=0).stop 2024-05-14T01:23:38.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.942+0000 7fb84e19a640 1 -- 172.21.15.154:0/4056155728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb84815de00 msgr2=0x7fb84814d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:38.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.942+0000 7fb84e19a640 1 --2- 172.21.15.154:0/4056155728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb84815de00 0x7fb84814d5d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00e870 tx=0x7fb83c00ec70 comp rx=0 tx=0).stop 2024-05-14T01:23:38.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.942+0000 7fb84e19a640 1 -- 172.21.15.154:0/4056155728 shutdown_connections 2024-05-14T01:23:38.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.942+0000 7fb84e19a640 1 --2- 172.21.15.154:0/4056155728 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb8340678c0 0x7fb834069d80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.942+0000 7fb84e19a640 1 --2- 172.21.15.154:0/4056155728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb84815e1e0 0x7fb84814db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.942+0000 7fb84e19a640 1 --2- 172.21.15.154:0/4056155728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb84815de00 0x7fb84814d5d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.942+0000 7fb84e19a640 1 --2- 172.21.15.154:0/4056155728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8480716f0 0x7fb848158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:38.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.942+0000 7fb84e19a640 1 -- 172.21.15.154:0/4056155728 >> 172.21.15.154:0/4056155728 conn(0x7fb84806b280 msgr2=0x7fb84815ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:38.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.942+0000 7fb84e19a640 1 -- 172.21.15.154:0/4056155728 shutdown_connections 2024-05-14T01:23:38.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:38.942+0000 7fb84e19a640 1 -- 172.21.15.154:0/4056155728 wait complete. 2024-05-14T01:23:38.943 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-14T01:23:38.943 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T01:23:39.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.074+0000 7febb73aa640 1 Processor -- start 2024-05-14T01:23:39.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.074+0000 7febb73aa640 1 -- start start 2024-05-14T01:23:39.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb73aa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7febb0144760 0x7febb006e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:39.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb73aa640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7febb00b3530 0x7febb015b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:39.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb73aa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb0144b40 con 0x7febb015b910 2024-05-14T01:23:39.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb73aa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7febb00b4650 con 0x7febb0144760 2024-05-14T01:23:39.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb73aa640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7febb00b3a40 con 0x7febb00b3530 2024-05-14T01:23:39.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb5146640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7febb0144760 0x7febb006e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:39.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb5947640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7febb015b910 0x7febb015e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57184/0 (socket says 172.21.15.154:57184) 2024-05-14T01:23:39.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb5947640 1 -- 172.21.15.154:0/1365392929 learned_addr learned my addr 172.21.15.154:0/1365392929 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:39.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb5146640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7febb0144760 0x7febb006e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46150/0 (socket says 172.21.15.154:46150) 2024-05-14T01:23:39.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb4945640 1 --2- 172.21.15.154:0/1365392929 >> v2:172.21.15.176:3300/0 conn(0x7febb00b3530 0x7febb015b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:39.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb5146640 1 -- 172.21.15.154:0/1365392929 >> v2:172.21.15.176:3300/0 conn(0x7febb00b3530 msgr2=0x7febb015b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:39.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb5146640 1 --2- 172.21.15.154:0/1365392929 >> v2:172.21.15.176:3300/0 conn(0x7febb00b3530 0x7febb015b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb5146640 1 -- 172.21.15.154:0/1365392929 >> v1:172.21.15.154:6789/0 conn(0x7febb015b910 legacy=0x7febb015e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:39.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7feba7fff640 1 -- 172.21.15.154:0/1365392929 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3705782107 0 0) 0x7febb0144b40 con 0x7febb015b910 2024-05-14T01:23:39.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb5146640 1 -- 172.21.15.154:0/1365392929 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb00b3d20 con 0x7febb0144760 2024-05-14T01:23:39.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb5146640 1 --2- 172.21.15.154:0/1365392929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febb0144760 0x7febb006e680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7febb0067a80 tx=0x7febac01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8994575cb11979 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:39.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7feba7fff640 1 -- 172.21.15.154:0/1365392929 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febac0ab650 con 0x7febb0144760 2024-05-14T01:23:39.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7feba7fff640 1 -- 172.21.15.154:0/1365392929 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febac0b0070 con 0x7febb0144760 2024-05-14T01:23:39.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7feba7fff640 1 -- 172.21.15.154:0/1365392929 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febac0aba10 con 0x7febb0144760 2024-05-14T01:23:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb73aa640 1 -- 172.21.15.154:0/1365392929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febb0144760 msgr2=0x7febb006e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb73aa640 1 --2- 172.21.15.154:0/1365392929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febb0144760 0x7febb006e680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7febb0067a80 tx=0x7febac01c450 comp rx=0 tx=0).stop 2024-05-14T01:23:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb73aa640 1 -- 172.21.15.154:0/1365392929 shutdown_connections 2024-05-14T01:23:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb73aa640 1 --2- 172.21.15.154:0/1365392929 >> v2:172.21.15.176:3300/0 conn(0x7febb00b3530 0x7febb015b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb73aa640 1 --2- 172.21.15.154:0/1365392929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febb0144760 0x7febb006e680 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb73aa640 1 -- 172.21.15.154:0/1365392929 >> 172.21.15.154:0/1365392929 conn(0x7febb00b1850 msgr2=0x7febb00b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb73aa640 1 -- 172.21.15.154:0/1365392929 shutdown_connections 2024-05-14T01:23:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.078+0000 7febb73aa640 1 -- 172.21.15.154:0/1365392929 wait complete. 2024-05-14T01:23:39.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb73aa640 1 Processor -- start 2024-05-14T01:23:39.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb73aa640 1 -- start start 2024-05-14T01:23:39.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb73aa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febb00b3530 0x7febb0165480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:39.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb73aa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb0144760 0x7febb0071c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:39.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb73aa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febb015b910 0x7febb013c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:39.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb73aa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7febb006ed40 con 0x7febb00b3530 2024-05-14T01:23:39.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb73aa640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7febb006ebc0 con 0x7febb0144760 2024-05-14T01:23:39.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb73aa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7febb0167d20 con 0x7febb015b910 2024-05-14T01:23:39.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb5146640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febb00b3530 0x7febb0165480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:39.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb5146640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febb00b3530 0x7febb0165480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46156/0 (socket says 172.21.15.154:46156) 2024-05-14T01:23:39.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb5146640 1 -- 172.21.15.154:0/3282760515 learned_addr learned my addr 172.21.15.154:0/3282760515 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:39.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb4945640 1 --2- 172.21.15.154:0/3282760515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb0144760 0x7febb0071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb5947640 1 --2- 172.21.15.154:0/3282760515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febb015b910 0x7febb013c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb5146640 1 -- 172.21.15.154:0/3282760515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febb015b910 msgr2=0x7febb013c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb5146640 1 --2- 172.21.15.154:0/3282760515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febb015b910 0x7febb013c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb5146640 1 -- 172.21.15.154:0/3282760515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb0144760 msgr2=0x7febb0071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb5146640 1 --2- 172.21.15.154:0/3282760515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb0144760 0x7febb0071c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb5146640 1 -- 172.21.15.154:0/3282760515 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb0072680 con 0x7febb00b3530 2024-05-14T01:23:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb5146640 1 --2- 172.21.15.154:0/3282760515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febb00b3530 0x7febb0165480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7febac01a080 tx=0x7febac01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7feba5ffb640 1 -- 172.21.15.154:0/3282760515 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febac0bf610 con 0x7febb00b3530 2024-05-14T01:23:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7feba5ffb640 1 -- 172.21.15.154:0/3282760515 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febac0bf7d0 con 0x7febb00b3530 2024-05-14T01:23:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb73aa640 1 -- 172.21.15.154:0/3282760515 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb01fadb0 con 0x7febb00b3530 2024-05-14T01:23:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7feba5ffb640 1 -- 172.21.15.154:0/3282760515 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febac0bfbc0 con 0x7febb00b3530 2024-05-14T01:23:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.082+0000 7febb73aa640 1 -- 172.21.15.154:0/3282760515 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb01fb370 con 0x7febb00b3530 2024-05-14T01:23:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.086+0000 7febb73aa640 1 -- 172.21.15.154:0/3282760515 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb0075470 con 0x7febb00b3530 2024-05-14T01:23:39.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.086+0000 7feba5ffb640 1 -- 172.21.15.154:0/3282760515 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7febac0bd020 con 0x7febb00b3530 2024-05-14T01:23:39.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.086+0000 7feba5ffb640 1 --2- 172.21.15.154:0/3282760515 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7feb940678c0 0x7feb94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:39.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.086+0000 7febb4945640 1 --2- 172.21.15.154:0/3282760515 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7feb940678c0 0x7feb94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:39.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.086+0000 7feba5ffb640 1 -- 172.21.15.154:0/3282760515 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7febac1208f0 con 0x7febb00b3530 2024-05-14T01:23:39.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.086+0000 7febb4945640 1 --2- 172.21.15.154:0/3282760515 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7feb940678c0 0x7feb94069d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7febb006d590 tx=0x7feba0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:39.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.090+0000 7feba5ffb640 1 -- 172.21.15.154:0/3282760515 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7febac016070 con 0x7febb00b3530 2024-05-14T01:23:39.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.234+0000 7febb73aa640 1 -- 172.21.15.154:0/3282760515 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7febb006d250 con 0x7feb940678c0 2024-05-14T01:23:39.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.242+0000 7feba5ffb640 1 -- 172.21.15.154:0/3282760515 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251930 (secure 0 0 0) 0x7febb006d250 con 0x7feb940678c0 2024-05-14T01:23:39.229 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:39.231 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-05-14T01:23:39.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.246+0000 7febb73aa640 1 -- 172.21.15.154:0/3282760515 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7feb940678c0 msgr2=0x7feb94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.246+0000 7febb73aa640 1 --2- 172.21.15.154:0/3282760515 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7feb940678c0 0x7feb94069d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7febb006d590 tx=0x7feba0008040 comp rx=0 tx=0).stop 2024-05-14T01:23:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.246+0000 7febb73aa640 1 -- 172.21.15.154:0/3282760515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febb00b3530 msgr2=0x7febb0165480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.246+0000 7febb73aa640 1 --2- 172.21.15.154:0/3282760515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febb00b3530 0x7febb0165480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7febac01a080 tx=0x7febac01ac90 comp rx=0 tx=0).stop 2024-05-14T01:23:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.246+0000 7febb73aa640 1 -- 172.21.15.154:0/3282760515 shutdown_connections 2024-05-14T01:23:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.246+0000 7febb73aa640 1 --2- 172.21.15.154:0/3282760515 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7feb940678c0 0x7feb94069d80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.246+0000 7febb73aa640 1 --2- 172.21.15.154:0/3282760515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febb015b910 0x7febb013c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.246+0000 7febb73aa640 1 --2- 172.21.15.154:0/3282760515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb0144760 0x7febb0071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.246+0000 7febb73aa640 1 --2- 172.21.15.154:0/3282760515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febb00b3530 0x7febb0165480 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.246+0000 7febb73aa640 1 -- 172.21.15.154:0/3282760515 >> 172.21.15.154:0/3282760515 conn(0x7febb00b1850 msgr2=0x7febb00cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.246+0000 7febb73aa640 1 -- 172.21.15.154:0/3282760515 shutdown_connections 2024-05-14T01:23:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.246+0000 7febb73aa640 1 -- 172.21.15.154:0/3282760515 wait complete. 2024-05-14T01:23:39.245 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-14T01:23:39.103222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223216,"kb_used_data":2884,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751504,"statfs":{"total":773094113280,"available":772865540096,"internally_reserved":0,"allocated":2953216,"data_stored":1771496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.900011"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985821+0000","last_change":"2024-05-14T01:23:35.287575+0000","last_active":"2024-05-14T01:23:36.985821+0000","last_peered":"2024-05-14T01:23:36.985821+0000","last_clean":"2024-05-14T01:23:36.985821+0000","last_became_active":"2024-05-14T01:23:35.287181+0000","last_became_peered":"2024-05-14T01:23:35.287181+0000","last_unstale":"2024-05-14T01:23:36.985821+0000","last_undegraded":"2024-05-14T01:23:36.985821+0000","last_fullsized":"2024-05-14T01:23:36.985821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:27:00.026867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244825+0000","last_change":"2024-05-14T01:23:35.262485+0000","last_active":"2024-05-14T01:23:36.244825+0000","last_peered":"2024-05-14T01:23:36.244825+0000","last_clean":"2024-05-14T01:23:36.244825+0000","last_became_active":"2024-05-14T01:23:35.261381+0000","last_became_peered":"2024-05-14T01:23:35.261381+0000","last_unstale":"2024-05-14T01:23:36.244825+0000","last_undegraded":"2024-05-14T01:23:36.244825+0000","last_fullsized":"2024-05-14T01:23:36.244825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:42:53.264601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087562+0000","last_change":"2024-05-14T01:23:35.269758+0000","last_active":"2024-05-14T01:23:38.087562+0000","last_peered":"2024-05-14T01:23:38.087562+0000","last_clean":"2024-05-14T01:23:38.087562+0000","last_became_active":"2024-05-14T01:23:35.267380+0000","last_became_peered":"2024-05-14T01:23:35.267380+0000","last_unstale":"2024-05-14T01:23:38.087562+0000","last_undegraded":"2024-05-14T01:23:38.087562+0000","last_fullsized":"2024-05-14T01:23:38.087562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:19:26.040802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246660+0000","last_change":"2024-05-14T01:23:35.306674+0000","last_active":"2024-05-14T01:23:36.246660+0000","last_peered":"2024-05-14T01:23:36.246660+0000","last_clean":"2024-05-14T01:23:36.246660+0000","last_became_active":"2024-05-14T01:23:35.301618+0000","last_became_peered":"2024-05-14T01:23:35.301618+0000","last_unstale":"2024-05-14T01:23:36.246660+0000","last_undegraded":"2024-05-14T01:23:36.246660+0000","last_fullsized":"2024-05-14T01:23:36.246660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:41:36.495618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985041+0000","last_change":"2024-05-14T01:23:35.285965+0000","last_active":"2024-05-14T01:23:36.985041+0000","last_peered":"2024-05-14T01:23:36.985041+0000","last_clean":"2024-05-14T01:23:36.985041+0000","last_became_active":"2024-05-14T01:23:35.285545+0000","last_became_peered":"2024-05-14T01:23:35.285545+0000","last_unstale":"2024-05-14T01:23:36.985041+0000","last_undegraded":"2024-05-14T01:23:36.985041+0000","last_fullsized":"2024-05-14T01:23:36.985041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:36.242325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246136+0000","last_change":"2024-05-14T01:23:35.300477+0000","last_active":"2024-05-14T01:23:36.246136+0000","last_peered":"2024-05-14T01:23:36.246136+0000","last_clean":"2024-05-14T01:23:36.246136+0000","last_became_active":"2024-05-14T01:23:35.288129+0000","last_became_peered":"2024-05-14T01:23:35.288129+0000","last_unstale":"2024-05-14T01:23:36.246136+0000","last_undegraded":"2024-05-14T01:23:36.246136+0000","last_fullsized":"2024-05-14T01:23:36.246136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:30:29.890052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984761+0000","last_change":"2024-05-14T01:23:35.286947+0000","last_active":"2024-05-14T01:23:36.984761+0000","last_peered":"2024-05-14T01:23:36.984761+0000","last_clean":"2024-05-14T01:23:36.984761+0000","last_became_active":"2024-05-14T01:23:35.282462+0000","last_became_peered":"2024-05-14T01:23:35.282462+0000","last_unstale":"2024-05-14T01:23:36.984761+0000","last_undegraded":"2024-05-14T01:23:36.984761+0000","last_fullsized":"2024-05-14T01:23:36.984761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:52:26.738482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.282902+0000","last_change":"2024-05-14T01:23:35.281765+0000","last_active":"2024-05-14T01:23:35.282902+0000","last_peered":"2024-05-14T01:23:35.282902+0000","last_clean":"2024-05-14T01:23:35.282902+0000","last_became_active":"2024-05-14T01:23:35.280973+0000","last_became_peered":"2024-05-14T01:23:35.280973+0000","last_unstale":"2024-05-14T01:23:35.282902+0000","last_undegraded":"2024-05-14T01:23:35.282902+0000","last_fullsized":"2024-05-14T01:23:35.282902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:19:26.040802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985998+0000","last_change":"2024-05-14T01:23:35.304119+0000","last_active":"2024-05-14T01:23:36.985998+0000","last_peered":"2024-05-14T01:23:36.985998+0000","last_clean":"2024-05-14T01:23:36.985998+0000","last_became_active":"2024-05-14T01:23:35.303643+0000","last_became_peered":"2024-05-14T01:23:35.303643+0000","last_unstale":"2024-05-14T01:23:36.985998+0000","last_undegraded":"2024-05-14T01:23:36.985998+0000","last_fullsized":"2024-05-14T01:23:36.985998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:48:27.826818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246963+0000","last_change":"2024-05-14T01:23:35.266693+0000","last_active":"2024-05-14T01:23:36.246963+0000","last_peered":"2024-05-14T01:23:36.246963+0000","last_clean":"2024-05-14T01:23:36.246963+0000","last_became_active":"2024-05-14T01:23:35.265931+0000","last_became_peered":"2024-05-14T01:23:35.265931+0000","last_unstale":"2024-05-14T01:23:36.246963+0000","last_undegraded":"2024-05-14T01:23:36.246963+0000","last_fullsized":"2024-05-14T01:23:36.246963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:35:14.703645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246731+0000","last_change":"2024-05-14T01:23:35.296531+0000","last_active":"2024-05-14T01:23:36.246731+0000","last_peered":"2024-05-14T01:23:36.246731+0000","last_clean":"2024-05-14T01:23:36.246731+0000","last_became_active":"2024-05-14T01:23:35.295870+0000","last_became_peered":"2024-05-14T01:23:35.295870+0000","last_unstale":"2024-05-14T01:23:36.246731+0000","last_undegraded":"2024-05-14T01:23:36.246731+0000","last_fullsized":"2024-05-14T01:23:36.246731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:17:24.056984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.675255+0000","last_change":"2024-05-14T01:23:35.259324+0000","last_active":"2024-05-14T01:23:36.675255+0000","last_peered":"2024-05-14T01:23:36.675255+0000","last_clean":"2024-05-14T01:23:36.675255+0000","last_became_active":"2024-05-14T01:23:35.252786+0000","last_became_peered":"2024-05-14T01:23:35.252786+0000","last_unstale":"2024-05-14T01:23:36.675255+0000","last_undegraded":"2024-05-14T01:23:36.675255+0000","last_fullsized":"2024-05-14T01:23:36.675255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:25:50.069629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.274265+0000","last_change":"2024-05-14T01:23:35.259920+0000","last_active":"2024-05-14T01:23:35.274265+0000","last_peered":"2024-05-14T01:23:35.274265+0000","last_clean":"2024-05-14T01:23:35.274265+0000","last_became_active":"2024-05-14T01:23:35.259281+0000","last_became_peered":"2024-05-14T01:23:35.259281+0000","last_unstale":"2024-05-14T01:23:35.274265+0000","last_undegraded":"2024-05-14T01:23:35.274265+0000","last_fullsized":"2024-05-14T01:23:35.274265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:50:27.275145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088060+0000","last_change":"2024-05-14T01:23:35.274981+0000","last_active":"2024-05-14T01:23:38.088060+0000","last_peered":"2024-05-14T01:23:38.088060+0000","last_clean":"2024-05-14T01:23:38.088060+0000","last_became_active":"2024-05-14T01:23:35.274256+0000","last_became_peered":"2024-05-14T01:23:35.274256+0000","last_unstale":"2024-05-14T01:23:38.088060+0000","last_undegraded":"2024-05-14T01:23:38.088060+0000","last_fullsized":"2024-05-14T01:23:38.088060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:27:33.193287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243846+0000","last_change":"2024-05-14T01:23:35.251194+0000","last_active":"2024-05-14T01:23:36.243846+0000","last_peered":"2024-05-14T01:23:36.243846+0000","last_clean":"2024-05-14T01:23:36.243846+0000","last_became_active":"2024-05-14T01:23:35.250384+0000","last_became_peered":"2024-05-14T01:23:35.250384+0000","last_unstale":"2024-05-14T01:23:36.243846+0000","last_undegraded":"2024-05-14T01:23:36.243846+0000","last_fullsized":"2024-05-14T01:23:36.243846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:05:16.096171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245455+0000","last_change":"2024-05-14T01:23:35.277295+0000","last_active":"2024-05-14T01:23:36.245455+0000","last_peered":"2024-05-14T01:23:36.245455+0000","last_clean":"2024-05-14T01:23:36.245455+0000","last_became_active":"2024-05-14T01:23:35.276891+0000","last_became_peered":"2024-05-14T01:23:35.276891+0000","last_unstale":"2024-05-14T01:23:36.245455+0000","last_undegraded":"2024-05-14T01:23:36.245455+0000","last_fullsized":"2024-05-14T01:23:36.245455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:35:14.703645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.248502+0000","last_change":"2024-05-14T01:23:35.305211+0000","last_active":"2024-05-14T01:23:36.248502+0000","last_peered":"2024-05-14T01:23:36.248502+0000","last_clean":"2024-05-14T01:23:36.248502+0000","last_became_active":"2024-05-14T01:23:35.304832+0000","last_became_peered":"2024-05-14T01:23:35.304832+0000","last_unstale":"2024-05-14T01:23:36.248502+0000","last_undegraded":"2024-05-14T01:23:36.248502+0000","last_fullsized":"2024-05-14T01:23:36.248502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:36:36.172326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087165+0000","last_change":"2024-05-14T01:23:35.266048+0000","last_active":"2024-05-14T01:23:38.087165+0000","last_peered":"2024-05-14T01:23:38.087165+0000","last_clean":"2024-05-14T01:23:38.087165+0000","last_became_active":"2024-05-14T01:23:35.265451+0000","last_became_peered":"2024-05-14T01:23:35.265451+0000","last_unstale":"2024-05-14T01:23:38.087165+0000","last_undegraded":"2024-05-14T01:23:38.087165+0000","last_fullsized":"2024-05-14T01:23:38.087165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:25:50.069629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985641+0000","last_change":"2024-05-14T01:23:35.299930+0000","last_active":"2024-05-14T01:23:36.985641+0000","last_peered":"2024-05-14T01:23:36.985641+0000","last_clean":"2024-05-14T01:23:36.985641+0000","last_became_active":"2024-05-14T01:23:35.297563+0000","last_became_peered":"2024-05-14T01:23:35.297563+0000","last_unstale":"2024-05-14T01:23:36.985641+0000","last_undegraded":"2024-05-14T01:23:36.985641+0000","last_fullsized":"2024-05-14T01:23:36.985641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:21:34.753294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245344+0000","last_change":"2024-05-14T01:23:35.253089+0000","last_active":"2024-05-14T01:23:36.245344+0000","last_peered":"2024-05-14T01:23:36.245344+0000","last_clean":"2024-05-14T01:23:36.245344+0000","last_became_active":"2024-05-14T01:23:35.251392+0000","last_became_peered":"2024-05-14T01:23:35.251392+0000","last_unstale":"2024-05-14T01:23:36.245344+0000","last_undegraded":"2024-05-14T01:23:36.245344+0000","last_fullsized":"2024-05-14T01:23:36.245344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:15:22.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088549+0000","last_change":"2024-05-14T01:23:35.288320+0000","last_active":"2024-05-14T01:23:38.088549+0000","last_peered":"2024-05-14T01:23:38.088549+0000","last_clean":"2024-05-14T01:23:38.088549+0000","last_became_active":"2024-05-14T01:23:35.287254+0000","last_became_peered":"2024-05-14T01:23:35.287254+0000","last_unstale":"2024-05-14T01:23:38.088549+0000","last_undegraded":"2024-05-14T01:23:38.088549+0000","last_fullsized":"2024-05-14T01:23:38.088549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:15:22.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246177+0000","last_change":"2024-05-14T01:23:35.300944+0000","last_active":"2024-05-14T01:23:36.246177+0000","last_peered":"2024-05-14T01:23:36.246177+0000","last_clean":"2024-05-14T01:23:36.246177+0000","last_became_active":"2024-05-14T01:23:35.299571+0000","last_became_peered":"2024-05-14T01:23:35.299571+0000","last_unstale":"2024-05-14T01:23:36.246177+0000","last_undegraded":"2024-05-14T01:23:36.246177+0000","last_fullsized":"2024-05-14T01:23:36.246177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:38:23.401263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.280625+0000","last_change":"2024-05-14T01:23:35.269144+0000","last_active":"2024-05-14T01:23:35.280625+0000","last_peered":"2024-05-14T01:23:35.280625+0000","last_clean":"2024-05-14T01:23:35.280625+0000","last_became_active":"2024-05-14T01:23:35.268523+0000","last_became_peered":"2024-05-14T01:23:35.268523+0000","last_unstale":"2024-05-14T01:23:35.280625+0000","last_undegraded":"2024-05-14T01:23:35.280625+0000","last_fullsized":"2024-05-14T01:23:35.280625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:58.295553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245589+0000","last_change":"2024-05-14T01:23:35.294800+0000","last_active":"2024-05-14T01:23:36.245589+0000","last_peered":"2024-05-14T01:23:36.245589+0000","last_clean":"2024-05-14T01:23:36.245589+0000","last_became_active":"2024-05-14T01:23:35.294322+0000","last_became_peered":"2024-05-14T01:23:35.294322+0000","last_unstale":"2024-05-14T01:23:36.245589+0000","last_undegraded":"2024-05-14T01:23:36.245589+0000","last_fullsized":"2024-05-14T01:23:36.245589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:42:53.264601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.281969+0000","last_change":"2024-05-14T01:23:35.274139+0000","last_active":"2024-05-14T01:23:35.281969+0000","last_peered":"2024-05-14T01:23:35.281969+0000","last_clean":"2024-05-14T01:23:35.281969+0000","last_became_active":"2024-05-14T01:23:35.273490+0000","last_became_peered":"2024-05-14T01:23:35.273490+0000","last_unstale":"2024-05-14T01:23:35.281969+0000","last_undegraded":"2024-05-14T01:23:35.281969+0000","last_fullsized":"2024-05-14T01:23:35.281969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:56.796582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247159+0000","last_change":"2024-05-14T01:23:35.252097+0000","last_active":"2024-05-14T01:23:36.247159+0000","last_peered":"2024-05-14T01:23:36.247159+0000","last_clean":"2024-05-14T01:23:36.247159+0000","last_became_active":"2024-05-14T01:23:35.251312+0000","last_became_peered":"2024-05-14T01:23:35.251312+0000","last_unstale":"2024-05-14T01:23:36.247159+0000","last_undegraded":"2024-05-14T01:23:36.247159+0000","last_fullsized":"2024-05-14T01:23:36.247159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:42:53.264601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244046+0000","last_change":"2024-05-14T01:23:35.262232+0000","last_active":"2024-05-14T01:23:36.244046+0000","last_peered":"2024-05-14T01:23:36.244046+0000","last_clean":"2024-05-14T01:23:36.244046+0000","last_became_active":"2024-05-14T01:23:35.261558+0000","last_became_peered":"2024-05-14T01:23:35.261558+0000","last_unstale":"2024-05-14T01:23:36.244046+0000","last_undegraded":"2024-05-14T01:23:36.244046+0000","last_fullsized":"2024-05-14T01:23:36.244046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:35:14.703645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.282029+0000","last_change":"2024-05-14T01:23:35.274631+0000","last_active":"2024-05-14T01:23:35.282029+0000","last_peered":"2024-05-14T01:23:35.282029+0000","last_clean":"2024-05-14T01:23:35.282029+0000","last_became_active":"2024-05-14T01:23:35.273800+0000","last_became_peered":"2024-05-14T01:23:35.273800+0000","last_unstale":"2024-05-14T01:23:35.282029+0000","last_undegraded":"2024-05-14T01:23:35.282029+0000","last_fullsized":"2024-05-14T01:23:35.282029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:28.467794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088951+0000","last_change":"2024-05-14T01:23:35.276519+0000","last_active":"2024-05-14T01:23:38.088951+0000","last_peered":"2024-05-14T01:23:38.088951+0000","last_clean":"2024-05-14T01:23:38.088951+0000","last_became_active":"2024-05-14T01:23:35.275945+0000","last_became_peered":"2024-05-14T01:23:35.275945+0000","last_unstale":"2024-05-14T01:23:38.088951+0000","last_undegraded":"2024-05-14T01:23:38.088951+0000","last_fullsized":"2024-05-14T01:23:38.088951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:19:10.756155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246501+0000","last_change":"2024-05-14T01:23:35.300997+0000","last_active":"2024-05-14T01:23:36.246501+0000","last_peered":"2024-05-14T01:23:36.246501+0000","last_clean":"2024-05-14T01:23:36.246501+0000","last_became_active":"2024-05-14T01:23:35.290048+0000","last_became_peered":"2024-05-14T01:23:35.290048+0000","last_unstale":"2024-05-14T01:23:36.246501+0000","last_undegraded":"2024-05-14T01:23:36.246501+0000","last_fullsized":"2024-05-14T01:23:36.246501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:20:00.610956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.086828+0000","last_change":"2024-05-14T01:23:35.296448+0000","last_active":"2024-05-14T01:23:38.086828+0000","last_peered":"2024-05-14T01:23:38.086828+0000","last_clean":"2024-05-14T01:23:38.086828+0000","last_became_active":"2024-05-14T01:23:35.296164+0000","last_became_peered":"2024-05-14T01:23:35.296164+0000","last_unstale":"2024-05-14T01:23:38.086828+0000","last_undegraded":"2024-05-14T01:23:38.086828+0000","last_fullsized":"2024-05-14T01:23:38.086828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:28.467794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245018+0000","last_change":"2024-05-14T01:23:35.260927+0000","last_active":"2024-05-14T01:23:36.245018+0000","last_peered":"2024-05-14T01:23:36.245018+0000","last_clean":"2024-05-14T01:23:36.245018+0000","last_became_active":"2024-05-14T01:23:35.260122+0000","last_became_peered":"2024-05-14T01:23:35.260122+0000","last_unstale":"2024-05-14T01:23:36.245018+0000","last_undegraded":"2024-05-14T01:23:36.245018+0000","last_fullsized":"2024-05-14T01:23:36.245018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:26:04.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.674795+0000","last_change":"2024-05-14T01:23:35.249002+0000","last_active":"2024-05-14T01:23:36.674795+0000","last_peered":"2024-05-14T01:23:36.674795+0000","last_clean":"2024-05-14T01:23:36.674795+0000","last_became_active":"2024-05-14T01:23:35.248126+0000","last_became_peered":"2024-05-14T01:23:35.248126+0000","last_unstale":"2024-05-14T01:23:36.674795+0000","last_undegraded":"2024-05-14T01:23:36.674795+0000","last_fullsized":"2024-05-14T01:23:36.674795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:58.295553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.303451+0000","last_change":"2024-05-14T01:23:34.250861+0000","last_active":"2024-05-14T01:23:35.303451+0000","last_peered":"2024-05-14T01:23:35.303451+0000","last_clean":"2024-05-14T01:23:35.303451+0000","last_became_active":"2024-05-14T01:23:34.250502+0000","last_became_peered":"2024-05-14T01:23:34.250502+0000","last_unstale":"2024-05-14T01:23:35.303451+0000","last_undegraded":"2024-05-14T01:23:35.303451+0000","last_fullsized":"2024-05-14T01:23:35.303451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:53:43.384791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089367+0000","last_change":"2024-05-14T01:23:35.272454+0000","last_active":"2024-05-14T01:23:38.089367+0000","last_peered":"2024-05-14T01:23:38.089367+0000","last_clean":"2024-05-14T01:23:38.089367+0000","last_became_active":"2024-05-14T01:23:35.271773+0000","last_became_peered":"2024-05-14T01:23:35.271773+0000","last_unstale":"2024-05-14T01:23:38.089367+0000","last_undegraded":"2024-05-14T01:23:38.089367+0000","last_fullsized":"2024-05-14T01:23:38.089367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:42:53.264601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245396+0000","last_change":"2024-05-14T01:23:34.245154+0000","last_active":"2024-05-14T01:23:36.245396+0000","last_peered":"2024-05-14T01:23:36.245396+0000","last_clean":"2024-05-14T01:23:36.245396+0000","last_became_active":"2024-05-14T01:23:34.244225+0000","last_became_peered":"2024-05-14T01:23:34.244225+0000","last_unstale":"2024-05-14T01:23:36.245396+0000","last_undegraded":"2024-05-14T01:23:36.245396+0000","last_fullsized":"2024-05-14T01:23:36.245396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:50:26.266945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.255719+0000","last_change":"2024-05-14T01:23:34.219241+0000","last_active":"2024-05-14T01:23:35.255719+0000","last_peered":"2024-05-14T01:23:35.255719+0000","last_clean":"2024-05-14T01:23:35.255719+0000","last_became_active":"2024-05-14T01:23:34.218932+0000","last_became_peered":"2024-05-14T01:23:34.218932+0000","last_unstale":"2024-05-14T01:23:35.255719+0000","last_undegraded":"2024-05-14T01:23:35.255719+0000","last_fullsized":"2024-05-14T01:23:35.255719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:13:57.047963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.282423+0000","last_change":"2024-05-14T01:23:35.280370+0000","last_active":"2024-05-14T01:23:35.282423+0000","last_peered":"2024-05-14T01:23:35.282423+0000","last_clean":"2024-05-14T01:23:35.282423+0000","last_became_active":"2024-05-14T01:23:35.275913+0000","last_became_peered":"2024-05-14T01:23:35.275913+0000","last_unstale":"2024-05-14T01:23:35.282423+0000","last_undegraded":"2024-05-14T01:23:35.282423+0000","last_fullsized":"2024-05-14T01:23:35.282423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:09:07.570394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245706+0000","last_change":"2024-05-14T01:23:34.251307+0000","last_active":"2024-05-14T01:23:36.245706+0000","last_peered":"2024-05-14T01:23:36.245706+0000","last_clean":"2024-05-14T01:23:36.245706+0000","last_became_active":"2024-05-14T01:23:34.245659+0000","last_became_peered":"2024-05-14T01:23:34.245659+0000","last_unstale":"2024-05-14T01:23:36.245706+0000","last_undegraded":"2024-05-14T01:23:36.245706+0000","last_fullsized":"2024-05-14T01:23:36.245706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:54:09.731166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243716+0000","last_change":"2024-05-14T01:23:35.263892+0000","last_active":"2024-05-14T01:23:36.243716+0000","last_peered":"2024-05-14T01:23:36.243716+0000","last_clean":"2024-05-14T01:23:36.243716+0000","last_became_active":"2024-05-14T01:23:35.262822+0000","last_became_peered":"2024-05-14T01:23:35.262822+0000","last_unstale":"2024-05-14T01:23:36.243716+0000","last_undegraded":"2024-05-14T01:23:36.243716+0000","last_fullsized":"2024-05-14T01:23:36.243716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:19:10.756155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246875+0000","last_change":"2024-05-14T01:23:34.259671+0000","last_active":"2024-05-14T01:23:36.246875+0000","last_peered":"2024-05-14T01:23:36.246875+0000","last_clean":"2024-05-14T01:23:36.246875+0000","last_became_active":"2024-05-14T01:23:34.259001+0000","last_became_peered":"2024-05-14T01:23:34.259001+0000","last_unstale":"2024-05-14T01:23:36.246875+0000","last_undegraded":"2024-05-14T01:23:36.246875+0000","last_fullsized":"2024-05-14T01:23:36.246875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:54:09.731166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.248083+0000","last_change":"2024-05-14T01:23:35.298763+0000","last_active":"2024-05-14T01:23:36.248083+0000","last_peered":"2024-05-14T01:23:36.248083+0000","last_clean":"2024-05-14T01:23:36.248083+0000","last_became_active":"2024-05-14T01:23:35.295383+0000","last_became_peered":"2024-05-14T01:23:35.295383+0000","last_unstale":"2024-05-14T01:23:36.248083+0000","last_undegraded":"2024-05-14T01:23:36.248083+0000","last_fullsized":"2024-05-14T01:23:36.248083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:27:07.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.248017+0000","last_change":"2024-05-14T01:23:34.259392+0000","last_active":"2024-05-14T01:23:36.248017+0000","last_peered":"2024-05-14T01:23:36.248017+0000","last_clean":"2024-05-14T01:23:36.248017+0000","last_became_active":"2024-05-14T01:23:34.258475+0000","last_became_peered":"2024-05-14T01:23:34.258475+0000","last_unstale":"2024-05-14T01:23:36.248017+0000","last_undegraded":"2024-05-14T01:23:36.248017+0000","last_fullsized":"2024-05-14T01:23:36.248017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:50:26.266945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089282+0000","last_change":"2024-05-14T01:23:35.301841+0000","last_active":"2024-05-14T01:23:38.089282+0000","last_peered":"2024-05-14T01:23:38.089282+0000","last_clean":"2024-05-14T01:23:38.089282+0000","last_became_active":"2024-05-14T01:23:35.301260+0000","last_became_peered":"2024-05-14T01:23:35.301260+0000","last_unstale":"2024-05-14T01:23:38.089282+0000","last_undegraded":"2024-05-14T01:23:38.089282+0000","last_fullsized":"2024-05-14T01:23:38.089282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:17:24.056984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244314+0000","last_change":"2024-05-14T01:23:34.241260+0000","last_active":"2024-05-14T01:23:36.244314+0000","last_peered":"2024-05-14T01:23:36.244314+0000","last_clean":"2024-05-14T01:23:36.244314+0000","last_became_active":"2024-05-14T01:23:34.241005+0000","last_became_peered":"2024-05-14T01:23:34.241005+0000","last_unstale":"2024-05-14T01:23:36.244314+0000","last_undegraded":"2024-05-14T01:23:36.244314+0000","last_fullsized":"2024-05-14T01:23:36.244314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:55.788381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.675306+0000","last_change":"2024-05-14T01:23:35.281538+0000","last_active":"2024-05-14T01:23:36.675306+0000","last_peered":"2024-05-14T01:23:36.675306+0000","last_clean":"2024-05-14T01:23:36.675306+0000","last_became_active":"2024-05-14T01:23:35.280728+0000","last_became_peered":"2024-05-14T01:23:35.280728+0000","last_unstale":"2024-05-14T01:23:36.675306+0000","last_undegraded":"2024-05-14T01:23:36.675306+0000","last_fullsized":"2024-05-14T01:23:36.675306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:09:07.570394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246193+0000","last_change":"2024-05-14T01:23:34.229467+0000","last_active":"2024-05-14T01:23:36.246193+0000","last_peered":"2024-05-14T01:23:36.246193+0000","last_clean":"2024-05-14T01:23:36.246193+0000","last_became_active":"2024-05-14T01:23:34.228709+0000","last_became_peered":"2024-05-14T01:23:34.228709+0000","last_unstale":"2024-05-14T01:23:36.246193+0000","last_undegraded":"2024-05-14T01:23:36.246193+0000","last_fullsized":"2024-05-14T01:23:36.246193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:57.287353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985329+0000","last_change":"2024-05-14T01:23:35.297600+0000","last_active":"2024-05-14T01:23:36.985329+0000","last_peered":"2024-05-14T01:23:36.985329+0000","last_clean":"2024-05-14T01:23:36.985329+0000","last_became_active":"2024-05-14T01:23:35.282394+0000","last_became_peered":"2024-05-14T01:23:35.282394+0000","last_unstale":"2024-05-14T01:23:36.985329+0000","last_undegraded":"2024-05-14T01:23:36.985329+0000","last_fullsized":"2024-05-14T01:23:36.985329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:27:07.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089635+0000","last_change":"2024-05-14T01:23:34.233957+0000","last_active":"2024-05-14T01:23:38.089635+0000","last_peered":"2024-05-14T01:23:38.089635+0000","last_clean":"2024-05-14T01:23:38.089635+0000","last_became_active":"2024-05-14T01:23:34.233639+0000","last_became_peered":"2024-05-14T01:23:34.233639+0000","last_unstale":"2024-05-14T01:23:38.089635+0000","last_undegraded":"2024-05-14T01:23:38.089635+0000","last_fullsized":"2024-05-14T01:23:38.089635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:53:43.384791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088454+0000","last_change":"2024-05-14T01:23:35.283594+0000","last_active":"2024-05-14T01:23:38.088454+0000","last_peered":"2024-05-14T01:23:38.088454+0000","last_clean":"2024-05-14T01:23:38.088454+0000","last_became_active":"2024-05-14T01:23:35.283197+0000","last_became_peered":"2024-05-14T01:23:35.283197+0000","last_unstale":"2024-05-14T01:23:38.088454+0000","last_undegraded":"2024-05-14T01:23:38.088454+0000","last_fullsized":"2024-05-14T01:23:38.088454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:26:04.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246382+0000","last_change":"2024-05-14T01:23:34.255912+0000","last_active":"2024-05-14T01:23:36.246382+0000","last_peered":"2024-05-14T01:23:36.246382+0000","last_clean":"2024-05-14T01:23:36.246382+0000","last_became_active":"2024-05-14T01:23:34.253523+0000","last_became_peered":"2024-05-14T01:23:34.253523+0000","last_unstale":"2024-05-14T01:23:36.246382+0000","last_undegraded":"2024-05-14T01:23:36.246382+0000","last_fullsized":"2024-05-14T01:23:36.246382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:55.788381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985315+0000","last_change":"2024-05-14T01:23:35.285975+0000","last_active":"2024-05-14T01:23:36.985315+0000","last_peered":"2024-05-14T01:23:36.985315+0000","last_clean":"2024-05-14T01:23:36.985315+0000","last_became_active":"2024-05-14T01:23:35.285612+0000","last_became_peered":"2024-05-14T01:23:35.285612+0000","last_unstale":"2024-05-14T01:23:36.985315+0000","last_undegraded":"2024-05-14T01:23:36.985315+0000","last_fullsized":"2024-05-14T01:23:36.985315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:51:24.561905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245103+0000","last_change":"2024-05-14T01:23:34.250761+0000","last_active":"2024-05-14T01:23:36.245103+0000","last_peered":"2024-05-14T01:23:36.245103+0000","last_clean":"2024-05-14T01:23:36.245103+0000","last_became_active":"2024-05-14T01:23:34.249867+0000","last_became_peered":"2024-05-14T01:23:34.249867+0000","last_unstale":"2024-05-14T01:23:36.245103+0000","last_undegraded":"2024-05-14T01:23:36.245103+0000","last_fullsized":"2024-05-14T01:23:36.245103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:13:57.047963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245812+0000","last_change":"2024-05-14T01:23:35.261647+0000","last_active":"2024-05-14T01:23:36.245812+0000","last_peered":"2024-05-14T01:23:36.245812+0000","last_clean":"2024-05-14T01:23:36.245812+0000","last_became_active":"2024-05-14T01:23:35.259092+0000","last_became_peered":"2024-05-14T01:23:35.259092+0000","last_unstale":"2024-05-14T01:23:36.245812+0000","last_undegraded":"2024-05-14T01:23:36.245812+0000","last_fullsized":"2024-05-14T01:23:36.245812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:05:16.096171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089803+0000","last_change":"2024-05-14T01:23:34.224371+0000","last_active":"2024-05-14T01:23:38.089803+0000","last_peered":"2024-05-14T01:23:38.089803+0000","last_clean":"2024-05-14T01:23:38.089803+0000","last_became_active":"2024-05-14T01:23:34.224010+0000","last_became_peered":"2024-05-14T01:23:34.224010+0000","last_unstale":"2024-05-14T01:23:38.089803+0000","last_undegraded":"2024-05-14T01:23:38.089803+0000","last_fullsized":"2024-05-14T01:23:38.089803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:13:57.047963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984842+0000","last_change":"2024-05-14T01:23:35.298167+0000","last_active":"2024-05-14T01:23:36.984842+0000","last_peered":"2024-05-14T01:23:36.984842+0000","last_clean":"2024-05-14T01:23:36.984842+0000","last_became_active":"2024-05-14T01:23:35.286157+0000","last_became_peered":"2024-05-14T01:23:35.286157+0000","last_unstale":"2024-05-14T01:23:36.984842+0000","last_undegraded":"2024-05-14T01:23:36.984842+0000","last_fullsized":"2024-05-14T01:23:36.984842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:45:12.494840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.675221+0000","last_change":"2024-05-14T01:23:34.236199+0000","last_active":"2024-05-14T01:23:36.675221+0000","last_peered":"2024-05-14T01:23:36.675221+0000","last_clean":"2024-05-14T01:23:36.675221+0000","last_became_active":"2024-05-14T01:23:34.233012+0000","last_became_peered":"2024-05-14T01:23:34.233012+0000","last_unstale":"2024-05-14T01:23:36.675221+0000","last_undegraded":"2024-05-14T01:23:36.675221+0000","last_fullsized":"2024-05-14T01:23:36.675221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:05:28.581427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985820+0000","last_change":"2024-05-14T01:23:35.297883+0000","last_active":"2024-05-14T01:23:36.985820+0000","last_peered":"2024-05-14T01:23:36.985820+0000","last_clean":"2024-05-14T01:23:36.985820+0000","last_became_active":"2024-05-14T01:23:35.287258+0000","last_became_peered":"2024-05-14T01:23:35.287258+0000","last_unstale":"2024-05-14T01:23:36.985820+0000","last_undegraded":"2024-05-14T01:23:36.985820+0000","last_fullsized":"2024-05-14T01:23:36.985820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:54:11.367649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087438+0000","last_change":"2024-05-14T01:23:34.225011+0000","last_active":"2024-05-14T01:23:38.087438+0000","last_peered":"2024-05-14T01:23:38.087438+0000","last_clean":"2024-05-14T01:23:38.087438+0000","last_became_active":"2024-05-14T01:23:34.224674+0000","last_became_peered":"2024-05-14T01:23:34.224674+0000","last_unstale":"2024-05-14T01:23:38.087438+0000","last_undegraded":"2024-05-14T01:23:38.087438+0000","last_fullsized":"2024-05-14T01:23:38.087438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:50:26.266945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.986041+0000","last_change":"2024-05-14T01:23:35.287056+0000","last_active":"2024-05-14T01:23:36.986041+0000","last_peered":"2024-05-14T01:23:36.986041+0000","last_clean":"2024-05-14T01:23:36.986041+0000","last_became_active":"2024-05-14T01:23:35.286372+0000","last_became_peered":"2024-05-14T01:23:35.286372+0000","last_unstale":"2024-05-14T01:23:36.986041+0000","last_undegraded":"2024-05-14T01:23:36.986041+0000","last_fullsized":"2024-05-14T01:23:36.986041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:24:47.905393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244447+0000","last_change":"2024-05-14T01:23:34.234869+0000","last_active":"2024-05-14T01:23:36.244447+0000","last_peered":"2024-05-14T01:23:36.244447+0000","last_clean":"2024-05-14T01:23:36.244447+0000","last_became_active":"2024-05-14T01:23:34.234582+0000","last_became_peered":"2024-05-14T01:23:34.234582+0000","last_unstale":"2024-05-14T01:23:36.244447+0000","last_undegraded":"2024-05-14T01:23:36.244447+0000","last_fullsized":"2024-05-14T01:23:36.244447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:25:49.061428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247626+0000","last_change":"2024-05-14T01:23:35.294289+0000","last_active":"2024-05-14T01:23:36.247626+0000","last_peered":"2024-05-14T01:23:36.247626+0000","last_clean":"2024-05-14T01:23:36.247626+0000","last_became_active":"2024-05-14T01:23:35.289592+0000","last_became_peered":"2024-05-14T01:23:35.289592+0000","last_unstale":"2024-05-14T01:23:36.247626+0000","last_undegraded":"2024-05-14T01:23:36.247626+0000","last_fullsized":"2024-05-14T01:23:36.247626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:45:12.494840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.086917+0000","last_change":"2024-05-14T01:23:34.253809+0000","last_active":"2024-05-14T01:23:38.086917+0000","last_peered":"2024-05-14T01:23:38.086917+0000","last_clean":"2024-05-14T01:23:38.086917+0000","last_became_active":"2024-05-14T01:23:34.253537+0000","last_became_peered":"2024-05-14T01:23:34.253537+0000","last_unstale":"2024-05-14T01:23:38.086917+0000","last_undegraded":"2024-05-14T01:23:38.086917+0000","last_fullsized":"2024-05-14T01:23:38.086917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:50:36.678245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985359+0000","last_change":"2024-05-14T01:23:35.298846+0000","last_active":"2024-05-14T01:23:36.985359+0000","last_peered":"2024-05-14T01:23:36.985359+0000","last_clean":"2024-05-14T01:23:36.985359+0000","last_became_active":"2024-05-14T01:23:35.298408+0000","last_became_peered":"2024-05-14T01:23:35.298408+0000","last_unstale":"2024-05-14T01:23:36.985359+0000","last_undegraded":"2024-05-14T01:23:36.985359+0000","last_fullsized":"2024-05-14T01:23:36.985359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:36:36.172326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984460+0000","last_change":"2024-05-14T01:23:25.487525+0000","last_active":"2024-05-14T01:23:36.984460+0000","last_peered":"2024-05-14T01:23:36.984460+0000","last_clean":"2024-05-14T01:23:36.984460+0000","last_became_active":"2024-05-14T01:23:25.485622+0000","last_became_peered":"2024-05-14T01:23:25.485622+0000","last_unstale":"2024-05-14T01:23:36.984460+0000","last_undegraded":"2024-05-14T01:23:36.984460+0000","last_fullsized":"2024-05-14T01:23:36.984460+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_clean_scrub_stamp":"2024-05-14T01:23:24.138255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:26:23.884962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246267+0000","last_change":"2024-05-14T01:23:34.250502+0000","last_active":"2024-05-14T01:23:36.246267+0000","last_peered":"2024-05-14T01:23:36.246267+0000","last_clean":"2024-05-14T01:23:36.246267+0000","last_became_active":"2024-05-14T01:23:34.249867+0000","last_became_peered":"2024-05-14T01:23:34.249867+0000","last_unstale":"2024-05-14T01:23:36.246267+0000","last_undegraded":"2024-05-14T01:23:36.246267+0000","last_fullsized":"2024-05-14T01:23:36.246267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:13:57.047963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.306471+0000","last_change":"2024-05-14T01:23:35.302453+0000","last_active":"2024-05-14T01:23:35.306471+0000","last_peered":"2024-05-14T01:23:35.306471+0000","last_clean":"2024-05-14T01:23:35.306471+0000","last_became_active":"2024-05-14T01:23:35.302253+0000","last_became_peered":"2024-05-14T01:23:35.302253+0000","last_unstale":"2024-05-14T01:23:35.306471+0000","last_undegraded":"2024-05-14T01:23:35.306471+0000","last_fullsized":"2024-05-14T01:23:35.306471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:27:33.193287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984361+0000","last_change":"2024-05-14T01:23:34.258164+0000","last_active":"2024-05-14T01:23:36.984361+0000","last_peered":"2024-05-14T01:23:36.984361+0000","last_clean":"2024-05-14T01:23:36.984361+0000","last_became_active":"2024-05-14T01:23:34.257595+0000","last_became_peered":"2024-05-14T01:23:34.257595+0000","last_unstale":"2024-05-14T01:23:36.984361+0000","last_undegraded":"2024-05-14T01:23:36.984361+0000","last_fullsized":"2024-05-14T01:23:36.984361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:27.459594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088117+0000","last_change":"2024-05-14T01:23:35.271974+0000","last_active":"2024-05-14T01:23:38.088117+0000","last_peered":"2024-05-14T01:23:38.088117+0000","last_clean":"2024-05-14T01:23:38.088117+0000","last_became_active":"2024-05-14T01:23:35.269194+0000","last_became_peered":"2024-05-14T01:23:35.269194+0000","last_unstale":"2024-05-14T01:23:38.088117+0000","last_undegraded":"2024-05-14T01:23:38.088117+0000","last_fullsized":"2024-05-14T01:23:38.088117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:55:21.424796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.086730+0000","last_change":"2024-05-14T01:23:34.223715+0000","last_active":"2024-05-14T01:23:38.086730+0000","last_peered":"2024-05-14T01:23:38.086730+0000","last_clean":"2024-05-14T01:23:38.086730+0000","last_became_active":"2024-05-14T01:23:34.223397+0000","last_became_peered":"2024-05-14T01:23:34.223397+0000","last_unstale":"2024-05-14T01:23:38.086730+0000","last_undegraded":"2024-05-14T01:23:38.086730+0000","last_fullsized":"2024-05-14T01:23:38.086730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:54:09.731166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243600+0000","last_change":"2024-05-14T01:23:35.262679+0000","last_active":"2024-05-14T01:23:36.243600+0000","last_peered":"2024-05-14T01:23:36.243600+0000","last_clean":"2024-05-14T01:23:36.243600+0000","last_became_active":"2024-05-14T01:23:35.261920+0000","last_became_peered":"2024-05-14T01:23:35.261920+0000","last_unstale":"2024-05-14T01:23:36.243600+0000","last_undegraded":"2024-05-14T01:23:36.243600+0000","last_fullsized":"2024-05-14T01:23:36.243600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:15:22.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246672+0000","last_change":"2024-05-14T01:23:34.249172+0000","last_active":"2024-05-14T01:23:36.246672+0000","last_peered":"2024-05-14T01:23:36.246672+0000","last_clean":"2024-05-14T01:23:36.246672+0000","last_became_active":"2024-05-14T01:23:34.238802+0000","last_became_peered":"2024-05-14T01:23:34.238802+0000","last_unstale":"2024-05-14T01:23:36.246672+0000","last_undegraded":"2024-05-14T01:23:36.246672+0000","last_fullsized":"2024-05-14T01:23:36.246672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:27.459594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.674803+0000","last_change":"2024-05-14T01:23:35.264275+0000","last_active":"2024-05-14T01:23:36.674803+0000","last_peered":"2024-05-14T01:23:36.674803+0000","last_clean":"2024-05-14T01:23:36.674803+0000","last_became_active":"2024-05-14T01:23:35.262643+0000","last_became_peered":"2024-05-14T01:23:35.262643+0000","last_unstale":"2024-05-14T01:23:36.674803+0000","last_undegraded":"2024-05-14T01:23:36.674803+0000","last_fullsized":"2024-05-14T01:23:36.674803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:56.796582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244185+0000","last_change":"2024-05-14T01:23:34.226163+0000","last_active":"2024-05-14T01:23:36.244185+0000","last_peered":"2024-05-14T01:23:36.244185+0000","last_clean":"2024-05-14T01:23:36.244185+0000","last_became_active":"2024-05-14T01:23:34.225890+0000","last_became_peered":"2024-05-14T01:23:34.225890+0000","last_unstale":"2024-05-14T01:23:36.244185+0000","last_undegraded":"2024-05-14T01:23:36.244185+0000","last_fullsized":"2024-05-14T01:23:36.244185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:57.287353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247976+0000","last_change":"2024-05-14T01:23:35.294211+0000","last_active":"2024-05-14T01:23:36.247976+0000","last_peered":"2024-05-14T01:23:36.247976+0000","last_clean":"2024-05-14T01:23:36.247976+0000","last_became_active":"2024-05-14T01:23:35.289658+0000","last_became_peered":"2024-05-14T01:23:35.289658+0000","last_unstale":"2024-05-14T01:23:36.247976+0000","last_undegraded":"2024-05-14T01:23:36.247976+0000","last_fullsized":"2024-05-14T01:23:36.247976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:51:24.561905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985721+0000","last_change":"2024-05-14T01:23:34.256826+0000","last_active":"2024-05-14T01:23:36.985721+0000","last_peered":"2024-05-14T01:23:36.985721+0000","last_clean":"2024-05-14T01:23:36.985721+0000","last_became_active":"2024-05-14T01:23:34.256022+0000","last_became_peered":"2024-05-14T01:23:34.256022+0000","last_unstale":"2024-05-14T01:23:36.985721+0000","last_undegraded":"2024-05-14T01:23:36.985721+0000","last_fullsized":"2024-05-14T01:23:36.985721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:19:25.032602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243917+0000","last_change":"2024-05-14T01:23:35.260714+0000","last_active":"2024-05-14T01:23:36.243917+0000","last_peered":"2024-05-14T01:23:36.243917+0000","last_clean":"2024-05-14T01:23:36.243917+0000","last_became_active":"2024-05-14T01:23:35.259757+0000","last_became_peered":"2024-05-14T01:23:35.259757+0000","last_unstale":"2024-05-14T01:23:36.243917+0000","last_undegraded":"2024-05-14T01:23:36.243917+0000","last_fullsized":"2024-05-14T01:23:36.243917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:17:24.056984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.286013+0000","last_change":"2024-05-14T01:23:34.235193+0000","last_active":"2024-05-14T01:23:36.286013+0000","last_peered":"2024-05-14T01:23:36.286013+0000","last_clean":"2024-05-14T01:23:36.286013+0000","last_became_active":"2024-05-14T01:23:34.234838+0000","last_became_peered":"2024-05-14T01:23:34.234838+0000","last_unstale":"2024-05-14T01:23:36.286013+0000","last_undegraded":"2024-05-14T01:23:36.286013+0000","last_fullsized":"2024-05-14T01:23:36.286013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:54:09.731166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.307005+0000","last_change":"2024-05-14T01:23:35.304577+0000","last_active":"2024-05-14T01:23:35.307005+0000","last_peered":"2024-05-14T01:23:35.307005+0000","last_clean":"2024-05-14T01:23:35.307005+0000","last_became_active":"2024-05-14T01:23:35.304182+0000","last_became_peered":"2024-05-14T01:23:35.304182+0000","last_unstale":"2024-05-14T01:23:35.307005+0000","last_undegraded":"2024-05-14T01:23:35.307005+0000","last_fullsized":"2024-05-14T01:23:35.307005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:55:21.424796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247154+0000","last_change":"2024-05-14T01:23:34.252262+0000","last_active":"2024-05-14T01:23:36.247154+0000","last_peered":"2024-05-14T01:23:36.247154+0000","last_clean":"2024-05-14T01:23:36.247154+0000","last_became_active":"2024-05-14T01:23:34.251538+0000","last_became_peered":"2024-05-14T01:23:34.251538+0000","last_unstale":"2024-05-14T01:23:36.247154+0000","last_undegraded":"2024-05-14T01:23:36.247154+0000","last_fullsized":"2024-05-14T01:23:36.247154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:55.788381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089306+0000","last_change":"2024-05-14T01:23:35.272849+0000","last_active":"2024-05-14T01:23:38.089306+0000","last_peered":"2024-05-14T01:23:38.089306+0000","last_clean":"2024-05-14T01:23:38.089306+0000","last_became_active":"2024-05-14T01:23:35.272167+0000","last_became_peered":"2024-05-14T01:23:35.272167+0000","last_unstale":"2024-05-14T01:23:38.089306+0000","last_undegraded":"2024-05-14T01:23:38.089306+0000","last_fullsized":"2024-05-14T01:23:38.089306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:35:14.703645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984311+0000","last_change":"2024-05-14T01:23:34.258728+0000","last_active":"2024-05-14T01:23:36.984311+0000","last_peered":"2024-05-14T01:23:36.984311+0000","last_clean":"2024-05-14T01:23:36.984311+0000","last_became_active":"2024-05-14T01:23:34.255812+0000","last_became_peered":"2024-05-14T01:23:34.255812+0000","last_unstale":"2024-05-14T01:23:36.984311+0000","last_undegraded":"2024-05-14T01:23:36.984311+0000","last_fullsized":"2024-05-14T01:23:36.984311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:55.788381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.674842+0000","last_change":"2024-05-14T01:23:35.265948+0000","last_active":"2024-05-14T01:23:36.674842+0000","last_peered":"2024-05-14T01:23:36.674842+0000","last_clean":"2024-05-14T01:23:36.674842+0000","last_became_active":"2024-05-14T01:23:35.261913+0000","last_became_peered":"2024-05-14T01:23:35.261913+0000","last_unstale":"2024-05-14T01:23:36.674842+0000","last_undegraded":"2024-05-14T01:23:36.674842+0000","last_fullsized":"2024-05-14T01:23:36.674842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:28.467794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243989+0000","last_change":"2024-05-14T01:23:34.251067+0000","last_active":"2024-05-14T01:23:36.243989+0000","last_peered":"2024-05-14T01:23:36.243989+0000","last_clean":"2024-05-14T01:23:36.243989+0000","last_became_active":"2024-05-14T01:23:34.250744+0000","last_became_peered":"2024-05-14T01:23:34.250744+0000","last_unstale":"2024-05-14T01:23:36.243989+0000","last_undegraded":"2024-05-14T01:23:36.243989+0000","last_fullsized":"2024-05-14T01:23:36.243989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:27.459594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.282403+0000","last_change":"2024-05-14T01:23:35.276327+0000","last_active":"2024-05-14T01:23:35.282403+0000","last_peered":"2024-05-14T01:23:35.282403+0000","last_clean":"2024-05-14T01:23:35.282403+0000","last_became_active":"2024-05-14T01:23:35.275932+0000","last_became_peered":"2024-05-14T01:23:35.275932+0000","last_unstale":"2024-05-14T01:23:35.282403+0000","last_undegraded":"2024-05-14T01:23:35.282403+0000","last_fullsized":"2024-05-14T01:23:35.282403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:25:50.069629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244161+0000","last_change":"2024-05-14T01:23:34.224180+0000","last_active":"2024-05-14T01:23:36.244161+0000","last_peered":"2024-05-14T01:23:36.244161+0000","last_clean":"2024-05-14T01:23:36.244161+0000","last_became_active":"2024-05-14T01:23:34.223787+0000","last_became_peered":"2024-05-14T01:23:34.223787+0000","last_unstale":"2024-05-14T01:23:36.244161+0000","last_undegraded":"2024-05-14T01:23:36.244161+0000","last_fullsized":"2024-05-14T01:23:36.244161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:50:26.266945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.282381+0000","last_change":"2024-05-14T01:23:35.281157+0000","last_active":"2024-05-14T01:23:35.282381+0000","last_peered":"2024-05-14T01:23:35.282381+0000","last_clean":"2024-05-14T01:23:35.282381+0000","last_became_active":"2024-05-14T01:23:35.280808+0000","last_became_peered":"2024-05-14T01:23:35.280808+0000","last_unstale":"2024-05-14T01:23:35.282381+0000","last_undegraded":"2024-05-14T01:23:35.282381+0000","last_fullsized":"2024-05-14T01:23:35.282381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:55:37.925082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985396+0000","last_change":"2024-05-14T01:23:34.256325+0000","last_active":"2024-05-14T01:23:36.985396+0000","last_peered":"2024-05-14T01:23:36.985396+0000","last_clean":"2024-05-14T01:23:36.985396+0000","last_became_active":"2024-05-14T01:23:34.255642+0000","last_became_peered":"2024-05-14T01:23:34.255642+0000","last_unstale":"2024-05-14T01:23:36.985396+0000","last_undegraded":"2024-05-14T01:23:36.985396+0000","last_fullsized":"2024-05-14T01:23:36.985396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:09:06.562194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245464+0000","last_change":"2024-05-14T01:23:35.254121+0000","last_active":"2024-05-14T01:23:36.245464+0000","last_peered":"2024-05-14T01:23:36.245464+0000","last_clean":"2024-05-14T01:23:36.245464+0000","last_became_active":"2024-05-14T01:23:35.251280+0000","last_became_peered":"2024-05-14T01:23:35.251280+0000","last_unstale":"2024-05-14T01:23:36.245464+0000","last_undegraded":"2024-05-14T01:23:36.245464+0000","last_fullsized":"2024-05-14T01:23:36.245464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:19:10.756155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247888+0000","last_change":"2024-05-14T01:23:35.293893+0000","last_active":"2024-05-14T01:23:36.247888+0000","last_peered":"2024-05-14T01:23:36.247888+0000","last_clean":"2024-05-14T01:23:36.247888+0000","last_became_active":"2024-05-14T01:23:35.289188+0000","last_became_peered":"2024-05-14T01:23:35.289188+0000","last_unstale":"2024-05-14T01:23:36.247888+0000","last_undegraded":"2024-05-14T01:23:36.247888+0000","last_fullsized":"2024-05-14T01:23:36.247888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:36.242325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985145+0000","last_change":"2024-05-14T01:23:34.261385+0000","last_active":"2024-05-14T01:23:36.985145+0000","last_peered":"2024-05-14T01:23:36.985145+0000","last_clean":"2024-05-14T01:23:36.985145+0000","last_became_active":"2024-05-14T01:23:34.260450+0000","last_became_peered":"2024-05-14T01:23:34.260450+0000","last_unstale":"2024-05-14T01:23:36.985145+0000","last_undegraded":"2024-05-14T01:23:36.985145+0000","last_fullsized":"2024-05-14T01:23:36.985145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:25:49.061428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247625+0000","last_change":"2024-05-14T01:23:35.301603+0000","last_active":"2024-05-14T01:23:36.247625+0000","last_peered":"2024-05-14T01:23:36.247625+0000","last_clean":"2024-05-14T01:23:36.247625+0000","last_became_active":"2024-05-14T01:23:35.301338+0000","last_became_peered":"2024-05-14T01:23:35.301338+0000","last_unstale":"2024-05-14T01:23:36.247625+0000","last_undegraded":"2024-05-14T01:23:36.247625+0000","last_fullsized":"2024-05-14T01:23:36.247625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:52:26.738482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985570+0000","last_change":"2024-05-14T01:23:34.260143+0000","last_active":"2024-05-14T01:23:36.985570+0000","last_peered":"2024-05-14T01:23:36.985570+0000","last_clean":"2024-05-14T01:23:36.985570+0000","last_became_active":"2024-05-14T01:23:34.259214+0000","last_became_peered":"2024-05-14T01:23:34.259214+0000","last_unstale":"2024-05-14T01:23:36.985570+0000","last_undegraded":"2024-05-14T01:23:36.985570+0000","last_fullsized":"2024-05-14T01:23:36.985570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:55:36.916881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089027+0000","last_change":"2024-05-14T01:23:35.301480+0000","last_active":"2024-05-14T01:23:38.089027+0000","last_peered":"2024-05-14T01:23:38.089027+0000","last_clean":"2024-05-14T01:23:38.089027+0000","last_became_active":"2024-05-14T01:23:35.301170+0000","last_became_peered":"2024-05-14T01:23:35.301170+0000","last_unstale":"2024-05-14T01:23:38.089027+0000","last_undegraded":"2024-05-14T01:23:38.089027+0000","last_fullsized":"2024-05-14T01:23:38.089027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:05:16.096171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.300982+0000","last_change":"2024-05-14T01:23:34.226086+0000","last_active":"2024-05-14T01:23:35.300982+0000","last_peered":"2024-05-14T01:23:35.300982+0000","last_clean":"2024-05-14T01:23:35.300982+0000","last_became_active":"2024-05-14T01:23:34.225826+0000","last_became_peered":"2024-05-14T01:23:34.225826+0000","last_unstale":"2024-05-14T01:23:35.300982+0000","last_undegraded":"2024-05-14T01:23:35.300982+0000","last_fullsized":"2024-05-14T01:23:35.300982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:50:36.678245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.275212+0000","last_change":"2024-05-14T01:23:35.266231+0000","last_active":"2024-05-14T01:23:35.275212+0000","last_peered":"2024-05-14T01:23:35.275212+0000","last_clean":"2024-05-14T01:23:35.275212+0000","last_became_active":"2024-05-14T01:23:35.265642+0000","last_became_peered":"2024-05-14T01:23:35.265642+0000","last_unstale":"2024-05-14T01:23:35.275212+0000","last_undegraded":"2024-05-14T01:23:35.275212+0000","last_fullsized":"2024-05-14T01:23:35.275212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:54:10.739366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089361+0000","last_change":"2024-05-14T01:23:34.252104+0000","last_active":"2024-05-14T01:23:38.089361+0000","last_peered":"2024-05-14T01:23:38.089361+0000","last_clean":"2024-05-14T01:23:38.089361+0000","last_became_active":"2024-05-14T01:23:34.251819+0000","last_became_peered":"2024-05-14T01:23:34.251819+0000","last_unstale":"2024-05-14T01:23:38.089361+0000","last_undegraded":"2024-05-14T01:23:38.089361+0000","last_fullsized":"2024-05-14T01:23:38.089361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:15:33.123443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":660311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T01:23:39.249 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T01:23:39.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.422+0000 7f08e47ee640 1 Processor -- start 2024-05-14T01:23:39.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.422+0000 7f08e47ee640 1 -- start start 2024-05-14T01:23:39.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.426+0000 7f08e47ee640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f08dc06db80 0x7f08dc0cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:39.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.426+0000 7f08e47ee640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08dc15bb60 0x7f08dc15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:39.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.426+0000 7f08e47ee640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08dc0b2ec0 con 0x7f08dc1513c0 2024-05-14T01:23:39.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.426+0000 7f08e47ee640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f08dc0cf9d0 con 0x7f08dc06db80 2024-05-14T01:23:39.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.426+0000 7f08e47ee640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08dc0b3ad0 con 0x7f08dc15bb60 2024-05-14T01:23:39.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.426+0000 7f08e2d8b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08dc15bb60 0x7f08dc15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:39.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.426+0000 7f08e1d89640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f08dc06db80 0x7f08dc0cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:39.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.426+0000 7f08e1d89640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f08dc06db80 0x7f08dc0cf490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:49858/0 (socket says 172.21.15.154:49858) 2024-05-14T01:23:39.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.426+0000 7f08e2d8b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08dc15bb60 0x7f08dc15bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:58918/0 (socket says 172.21.15.154:58918) 2024-05-14T01:23:39.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.426+0000 7f08e1d89640 1 -- 172.21.15.154:0/1209199808 learned_addr learned my addr 172.21.15.154:0/1209199808 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:39.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.426+0000 7f08e258a640 1 --1- 172.21.15.154:0/1209199808 >> v1:172.21.15.176:6789/0 conn(0x7f08dc1513c0 0x7f08dc06d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:48288/0 (socket says 172.21.15.154:48288) 2024-05-14T01:23:39.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.426+0000 7f08e1d89640 1 -- 172.21.15.154:0/1209199808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08dc15bb60 msgr2=0x7f08dc15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:39.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.426+0000 7f08e1d89640 1 --2- 172.21.15.154:0/1209199808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08dc15bb60 0x7f08dc15bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.426+0000 7f08e1d89640 1 -- 172.21.15.154:0/1209199808 >> v1:172.21.15.176:6789/0 conn(0x7f08dc1513c0 legacy=0x7f08dc06d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:39.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.426+0000 7f08e1d89640 1 -- 172.21.15.154:0/1209199808 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08dc0b31a0 con 0x7f08dc06db80 2024-05-14T01:23:39.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e1d89640 1 --2- 172.21.15.154:0/1209199808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08dc06db80 0x7f08dc0cf490 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009870 tx=0x7f08cc01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38157f81b6771e68 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:39.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e1588640 1 -- 172.21.15.154:0/1209199808 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc0aa610 con 0x7f08dc06db80 2024-05-14T01:23:39.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e1588640 1 -- 172.21.15.154:0/1209199808 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08cc0af070 con 0x7f08dc06db80 2024-05-14T01:23:39.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e1588640 1 -- 172.21.15.154:0/1209199808 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc0aa9d0 con 0x7f08dc06db80 2024-05-14T01:23:39.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e47ee640 1 -- 172.21.15.154:0/1209199808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08dc06db80 msgr2=0x7f08dc0cf490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:39.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e47ee640 1 --2- 172.21.15.154:0/1209199808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08dc06db80 0x7f08dc0cf490 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009870 tx=0x7f08cc01c530 comp rx=0 tx=0).stop 2024-05-14T01:23:39.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e47ee640 1 -- 172.21.15.154:0/1209199808 shutdown_connections 2024-05-14T01:23:39.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e47ee640 1 --2- 172.21.15.154:0/1209199808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08dc15bb60 0x7f08dc15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e47ee640 1 --2- 172.21.15.154:0/1209199808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08dc06db80 0x7f08dc0cf490 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e47ee640 1 -- 172.21.15.154:0/1209199808 >> 172.21.15.154:0/1209199808 conn(0x7f08dc0b1850 msgr2=0x7f08dc0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:39.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e47ee640 1 -- 172.21.15.154:0/1209199808 shutdown_connections 2024-05-14T01:23:39.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e47ee640 1 -- 172.21.15.154:0/1209199808 wait complete. 2024-05-14T01:23:39.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e47ee640 1 Processor -- start 2024-05-14T01:23:39.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e47ee640 1 -- start start 2024-05-14T01:23:39.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e47ee640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08dc06db80 0x7f08dc13e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:39.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e47ee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08dc1513c0 0x7f08dc15e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:39.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e47ee640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08dc15bb60 0x7f08dc15e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:39.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e47ee640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f08dc06e990 con 0x7f08dc1513c0 2024-05-14T01:23:39.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e47ee640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f08dc06e810 con 0x7f08dc06db80 2024-05-14T01:23:39.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.430+0000 7f08e47ee640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08dc0b3f40 con 0x7f08dc15bb60 2024-05-14T01:23:39.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08e1d89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08dc1513c0 0x7f08dc15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:39.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08e1d89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08dc1513c0 0x7f08dc15e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46164/0 (socket says 172.21.15.154:46164) 2024-05-14T01:23:39.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08e1d89640 1 -- 172.21.15.154:0/3793330138 learned_addr learned my addr 172.21.15.154:0/3793330138 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:39.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08e258a640 1 --2- 172.21.15.154:0/3793330138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08dc06db80 0x7f08dc13e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:39.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08e2d8b640 1 --2- 172.21.15.154:0/3793330138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08dc15bb60 0x7f08dc15e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:39.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08e1d89640 1 -- 172.21.15.154:0/3793330138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08dc15bb60 msgr2=0x7f08dc15e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:39.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08e1d89640 1 --2- 172.21.15.154:0/3793330138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08dc15bb60 0x7f08dc15e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08e1d89640 1 -- 172.21.15.154:0/3793330138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08dc06db80 msgr2=0x7f08dc13e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:39.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08e1d89640 1 --2- 172.21.15.154:0/3793330138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08dc06db80 0x7f08dc13e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08e1d89640 1 -- 172.21.15.154:0/3793330138 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08dc071000 con 0x7f08dc1513c0 2024-05-14T01:23:39.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08e258a640 1 --2- 172.21.15.154:0/3793330138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08dc06db80 0x7f08dc13e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:23:39.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08e1d89640 1 --2- 172.21.15.154:0/3793330138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08dc1513c0 0x7f08dc15e040 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0ac040 tx=0x7f08cc01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:39.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08d2ffd640 1 -- 172.21.15.154:0/3793330138 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc0bd5f0 con 0x7f08dc1513c0 2024-05-14T01:23:39.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08d2ffd640 1 -- 172.21.15.154:0/3793330138 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08cc0bd790 con 0x7f08dc1513c0 2024-05-14T01:23:39.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08e47ee640 1 -- 172.21.15.154:0/3793330138 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08dc13e960 con 0x7f08dc1513c0 2024-05-14T01:23:39.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08d2ffd640 1 -- 172.21.15.154:0/3793330138 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc0bdb80 con 0x7f08dc1513c0 2024-05-14T01:23:39.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08e47ee640 1 -- 172.21.15.154:0/3793330138 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08dc071580 con 0x7f08dc1513c0 2024-05-14T01:23:39.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08e47ee640 1 -- 172.21.15.154:0/3793330138 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08dc075470 con 0x7f08dc1513c0 2024-05-14T01:23:39.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08d2ffd640 1 -- 172.21.15.154:0/3793330138 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f08cc0b33f0 con 0x7f08dc1513c0 2024-05-14T01:23:39.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08d2ffd640 1 --2- 172.21.15.154:0/3793330138 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f08c00678c0 0x7f08c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:39.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08d2ffd640 1 -- 172.21.15.154:0/3793330138 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f08cc120930 con 0x7f08dc1513c0 2024-05-14T01:23:39.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08e258a640 1 --2- 172.21.15.154:0/3793330138 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f08c00678c0 0x7f08c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:39.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.434+0000 7f08e258a640 1 --2- 172.21.15.154:0/3793330138 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f08c00678c0 0x7f08c0069d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f08d8000f70 tx=0x7f08d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:39.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.438+0000 7f08d2ffd640 1 -- 172.21.15.154:0/3793330138 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f08cc0c3060 con 0x7f08dc1513c0 2024-05-14T01:23:39.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.590+0000 7f08e47ee640 1 -- 172.21.15.154:0/3793330138 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f08dc06e3d0 con 0x7f08c00678c0 2024-05-14T01:23:39.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.594+0000 7f08d2ffd640 1 -- 172.21.15.154:0/3793330138 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251930 (secure 0 0 0) 0x7f08dc06e3d0 con 0x7f08c00678c0 2024-05-14T01:23:39.582 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:39.584 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-05-14T01:23:39.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.598+0000 7f08e47ee640 1 -- 172.21.15.154:0/3793330138 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f08c00678c0 msgr2=0x7f08c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:39.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.598+0000 7f08e47ee640 1 --2- 172.21.15.154:0/3793330138 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f08c00678c0 0x7f08c0069d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f08d8000f70 tx=0x7f08d8009040 comp rx=0 tx=0).stop 2024-05-14T01:23:39.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.598+0000 7f08e47ee640 1 -- 172.21.15.154:0/3793330138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08dc1513c0 msgr2=0x7f08dc15e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:39.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.598+0000 7f08e47ee640 1 --2- 172.21.15.154:0/3793330138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08dc1513c0 0x7f08dc15e040 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0ac040 tx=0x7f08cc01ad70 comp rx=0 tx=0).stop 2024-05-14T01:23:39.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.598+0000 7f08e47ee640 1 -- 172.21.15.154:0/3793330138 shutdown_connections 2024-05-14T01:23:39.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.598+0000 7f08e47ee640 1 --2- 172.21.15.154:0/3793330138 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f08c00678c0 0x7f08c0069d80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.598+0000 7f08e47ee640 1 --2- 172.21.15.154:0/3793330138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08dc15bb60 0x7f08dc15e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.598+0000 7f08e47ee640 1 --2- 172.21.15.154:0/3793330138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08dc1513c0 0x7f08dc15e040 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.598+0000 7f08e47ee640 1 --2- 172.21.15.154:0/3793330138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08dc06db80 0x7f08dc13e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.598+0000 7f08e47ee640 1 -- 172.21.15.154:0/3793330138 >> 172.21.15.154:0/3793330138 conn(0x7f08dc0b1850 msgr2=0x7f08dc0afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:39.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.598+0000 7f08e47ee640 1 -- 172.21.15.154:0/3793330138 shutdown_connections 2024-05-14T01:23:39.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.598+0000 7f08e47ee640 1 -- 172.21.15.154:0/3793330138 wait complete. 2024-05-14T01:23:39.599 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-14T01:23:39.103222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223216,"kb_used_data":2884,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751504,"statfs":{"total":773094113280,"available":772865540096,"internally_reserved":0,"allocated":2953216,"data_stored":1771496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.900011"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985821+0000","last_change":"2024-05-14T01:23:35.287575+0000","last_active":"2024-05-14T01:23:36.985821+0000","last_peered":"2024-05-14T01:23:36.985821+0000","last_clean":"2024-05-14T01:23:36.985821+0000","last_became_active":"2024-05-14T01:23:35.287181+0000","last_became_peered":"2024-05-14T01:23:35.287181+0000","last_unstale":"2024-05-14T01:23:36.985821+0000","last_undegraded":"2024-05-14T01:23:36.985821+0000","last_fullsized":"2024-05-14T01:23:36.985821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:27:00.026867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244825+0000","last_change":"2024-05-14T01:23:35.262485+0000","last_active":"2024-05-14T01:23:36.244825+0000","last_peered":"2024-05-14T01:23:36.244825+0000","last_clean":"2024-05-14T01:23:36.244825+0000","last_became_active":"2024-05-14T01:23:35.261381+0000","last_became_peered":"2024-05-14T01:23:35.261381+0000","last_unstale":"2024-05-14T01:23:36.244825+0000","last_undegraded":"2024-05-14T01:23:36.244825+0000","last_fullsized":"2024-05-14T01:23:36.244825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:42:53.264601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087562+0000","last_change":"2024-05-14T01:23:35.269758+0000","last_active":"2024-05-14T01:23:38.087562+0000","last_peered":"2024-05-14T01:23:38.087562+0000","last_clean":"2024-05-14T01:23:38.087562+0000","last_became_active":"2024-05-14T01:23:35.267380+0000","last_became_peered":"2024-05-14T01:23:35.267380+0000","last_unstale":"2024-05-14T01:23:38.087562+0000","last_undegraded":"2024-05-14T01:23:38.087562+0000","last_fullsized":"2024-05-14T01:23:38.087562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:19:26.040802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246660+0000","last_change":"2024-05-14T01:23:35.306674+0000","last_active":"2024-05-14T01:23:36.246660+0000","last_peered":"2024-05-14T01:23:36.246660+0000","last_clean":"2024-05-14T01:23:36.246660+0000","last_became_active":"2024-05-14T01:23:35.301618+0000","last_became_peered":"2024-05-14T01:23:35.301618+0000","last_unstale":"2024-05-14T01:23:36.246660+0000","last_undegraded":"2024-05-14T01:23:36.246660+0000","last_fullsized":"2024-05-14T01:23:36.246660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:41:36.495618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985041+0000","last_change":"2024-05-14T01:23:35.285965+0000","last_active":"2024-05-14T01:23:36.985041+0000","last_peered":"2024-05-14T01:23:36.985041+0000","last_clean":"2024-05-14T01:23:36.985041+0000","last_became_active":"2024-05-14T01:23:35.285545+0000","last_became_peered":"2024-05-14T01:23:35.285545+0000","last_unstale":"2024-05-14T01:23:36.985041+0000","last_undegraded":"2024-05-14T01:23:36.985041+0000","last_fullsized":"2024-05-14T01:23:36.985041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:36.242325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246136+0000","last_change":"2024-05-14T01:23:35.300477+0000","last_active":"2024-05-14T01:23:36.246136+0000","last_peered":"2024-05-14T01:23:36.246136+0000","last_clean":"2024-05-14T01:23:36.246136+0000","last_became_active":"2024-05-14T01:23:35.288129+0000","last_became_peered":"2024-05-14T01:23:35.288129+0000","last_unstale":"2024-05-14T01:23:36.246136+0000","last_undegraded":"2024-05-14T01:23:36.246136+0000","last_fullsized":"2024-05-14T01:23:36.246136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:30:29.890052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984761+0000","last_change":"2024-05-14T01:23:35.286947+0000","last_active":"2024-05-14T01:23:36.984761+0000","last_peered":"2024-05-14T01:23:36.984761+0000","last_clean":"2024-05-14T01:23:36.984761+0000","last_became_active":"2024-05-14T01:23:35.282462+0000","last_became_peered":"2024-05-14T01:23:35.282462+0000","last_unstale":"2024-05-14T01:23:36.984761+0000","last_undegraded":"2024-05-14T01:23:36.984761+0000","last_fullsized":"2024-05-14T01:23:36.984761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:52:26.738482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.282902+0000","last_change":"2024-05-14T01:23:35.281765+0000","last_active":"2024-05-14T01:23:35.282902+0000","last_peered":"2024-05-14T01:23:35.282902+0000","last_clean":"2024-05-14T01:23:35.282902+0000","last_became_active":"2024-05-14T01:23:35.280973+0000","last_became_peered":"2024-05-14T01:23:35.280973+0000","last_unstale":"2024-05-14T01:23:35.282902+0000","last_undegraded":"2024-05-14T01:23:35.282902+0000","last_fullsized":"2024-05-14T01:23:35.282902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:19:26.040802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985998+0000","last_change":"2024-05-14T01:23:35.304119+0000","last_active":"2024-05-14T01:23:36.985998+0000","last_peered":"2024-05-14T01:23:36.985998+0000","last_clean":"2024-05-14T01:23:36.985998+0000","last_became_active":"2024-05-14T01:23:35.303643+0000","last_became_peered":"2024-05-14T01:23:35.303643+0000","last_unstale":"2024-05-14T01:23:36.985998+0000","last_undegraded":"2024-05-14T01:23:36.985998+0000","last_fullsized":"2024-05-14T01:23:36.985998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:48:27.826818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246963+0000","last_change":"2024-05-14T01:23:35.266693+0000","last_active":"2024-05-14T01:23:36.246963+0000","last_peered":"2024-05-14T01:23:36.246963+0000","last_clean":"2024-05-14T01:23:36.246963+0000","last_became_active":"2024-05-14T01:23:35.265931+0000","last_became_peered":"2024-05-14T01:23:35.265931+0000","last_unstale":"2024-05-14T01:23:36.246963+0000","last_undegraded":"2024-05-14T01:23:36.246963+0000","last_fullsized":"2024-05-14T01:23:36.246963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:35:14.703645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246731+0000","last_change":"2024-05-14T01:23:35.296531+0000","last_active":"2024-05-14T01:23:36.246731+0000","last_peered":"2024-05-14T01:23:36.246731+0000","last_clean":"2024-05-14T01:23:36.246731+0000","last_became_active":"2024-05-14T01:23:35.295870+0000","last_became_peered":"2024-05-14T01:23:35.295870+0000","last_unstale":"2024-05-14T01:23:36.246731+0000","last_undegraded":"2024-05-14T01:23:36.246731+0000","last_fullsized":"2024-05-14T01:23:36.246731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:17:24.056984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.675255+0000","last_change":"2024-05-14T01:23:35.259324+0000","last_active":"2024-05-14T01:23:36.675255+0000","last_peered":"2024-05-14T01:23:36.675255+0000","last_clean":"2024-05-14T01:23:36.675255+0000","last_became_active":"2024-05-14T01:23:35.252786+0000","last_became_peered":"2024-05-14T01:23:35.252786+0000","last_unstale":"2024-05-14T01:23:36.675255+0000","last_undegraded":"2024-05-14T01:23:36.675255+0000","last_fullsized":"2024-05-14T01:23:36.675255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:25:50.069629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.274265+0000","last_change":"2024-05-14T01:23:35.259920+0000","last_active":"2024-05-14T01:23:35.274265+0000","last_peered":"2024-05-14T01:23:35.274265+0000","last_clean":"2024-05-14T01:23:35.274265+0000","last_became_active":"2024-05-14T01:23:35.259281+0000","last_became_peered":"2024-05-14T01:23:35.259281+0000","last_unstale":"2024-05-14T01:23:35.274265+0000","last_undegraded":"2024-05-14T01:23:35.274265+0000","last_fullsized":"2024-05-14T01:23:35.274265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:50:27.275145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088060+0000","last_change":"2024-05-14T01:23:35.274981+0000","last_active":"2024-05-14T01:23:38.088060+0000","last_peered":"2024-05-14T01:23:38.088060+0000","last_clean":"2024-05-14T01:23:38.088060+0000","last_became_active":"2024-05-14T01:23:35.274256+0000","last_became_peered":"2024-05-14T01:23:35.274256+0000","last_unstale":"2024-05-14T01:23:38.088060+0000","last_undegraded":"2024-05-14T01:23:38.088060+0000","last_fullsized":"2024-05-14T01:23:38.088060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:27:33.193287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243846+0000","last_change":"2024-05-14T01:23:35.251194+0000","last_active":"2024-05-14T01:23:36.243846+0000","last_peered":"2024-05-14T01:23:36.243846+0000","last_clean":"2024-05-14T01:23:36.243846+0000","last_became_active":"2024-05-14T01:23:35.250384+0000","last_became_peered":"2024-05-14T01:23:35.250384+0000","last_unstale":"2024-05-14T01:23:36.243846+0000","last_undegraded":"2024-05-14T01:23:36.243846+0000","last_fullsized":"2024-05-14T01:23:36.243846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:05:16.096171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245455+0000","last_change":"2024-05-14T01:23:35.277295+0000","last_active":"2024-05-14T01:23:36.245455+0000","last_peered":"2024-05-14T01:23:36.245455+0000","last_clean":"2024-05-14T01:23:36.245455+0000","last_became_active":"2024-05-14T01:23:35.276891+0000","last_became_peered":"2024-05-14T01:23:35.276891+0000","last_unstale":"2024-05-14T01:23:36.245455+0000","last_undegraded":"2024-05-14T01:23:36.245455+0000","last_fullsized":"2024-05-14T01:23:36.245455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:35:14.703645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.248502+0000","last_change":"2024-05-14T01:23:35.305211+0000","last_active":"2024-05-14T01:23:36.248502+0000","last_peered":"2024-05-14T01:23:36.248502+0000","last_clean":"2024-05-14T01:23:36.248502+0000","last_became_active":"2024-05-14T01:23:35.304832+0000","last_became_peered":"2024-05-14T01:23:35.304832+0000","last_unstale":"2024-05-14T01:23:36.248502+0000","last_undegraded":"2024-05-14T01:23:36.248502+0000","last_fullsized":"2024-05-14T01:23:36.248502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:36:36.172326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087165+0000","last_change":"2024-05-14T01:23:35.266048+0000","last_active":"2024-05-14T01:23:38.087165+0000","last_peered":"2024-05-14T01:23:38.087165+0000","last_clean":"2024-05-14T01:23:38.087165+0000","last_became_active":"2024-05-14T01:23:35.265451+0000","last_became_peered":"2024-05-14T01:23:35.265451+0000","last_unstale":"2024-05-14T01:23:38.087165+0000","last_undegraded":"2024-05-14T01:23:38.087165+0000","last_fullsized":"2024-05-14T01:23:38.087165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:25:50.069629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985641+0000","last_change":"2024-05-14T01:23:35.299930+0000","last_active":"2024-05-14T01:23:36.985641+0000","last_peered":"2024-05-14T01:23:36.985641+0000","last_clean":"2024-05-14T01:23:36.985641+0000","last_became_active":"2024-05-14T01:23:35.297563+0000","last_became_peered":"2024-05-14T01:23:35.297563+0000","last_unstale":"2024-05-14T01:23:36.985641+0000","last_undegraded":"2024-05-14T01:23:36.985641+0000","last_fullsized":"2024-05-14T01:23:36.985641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:21:34.753294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245344+0000","last_change":"2024-05-14T01:23:35.253089+0000","last_active":"2024-05-14T01:23:36.245344+0000","last_peered":"2024-05-14T01:23:36.245344+0000","last_clean":"2024-05-14T01:23:36.245344+0000","last_became_active":"2024-05-14T01:23:35.251392+0000","last_became_peered":"2024-05-14T01:23:35.251392+0000","last_unstale":"2024-05-14T01:23:36.245344+0000","last_undegraded":"2024-05-14T01:23:36.245344+0000","last_fullsized":"2024-05-14T01:23:36.245344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:15:22.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088549+0000","last_change":"2024-05-14T01:23:35.288320+0000","last_active":"2024-05-14T01:23:38.088549+0000","last_peered":"2024-05-14T01:23:38.088549+0000","last_clean":"2024-05-14T01:23:38.088549+0000","last_became_active":"2024-05-14T01:23:35.287254+0000","last_became_peered":"2024-05-14T01:23:35.287254+0000","last_unstale":"2024-05-14T01:23:38.088549+0000","last_undegraded":"2024-05-14T01:23:38.088549+0000","last_fullsized":"2024-05-14T01:23:38.088549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:15:22.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246177+0000","last_change":"2024-05-14T01:23:35.300944+0000","last_active":"2024-05-14T01:23:36.246177+0000","last_peered":"2024-05-14T01:23:36.246177+0000","last_clean":"2024-05-14T01:23:36.246177+0000","last_became_active":"2024-05-14T01:23:35.299571+0000","last_became_peered":"2024-05-14T01:23:35.299571+0000","last_unstale":"2024-05-14T01:23:36.246177+0000","last_undegraded":"2024-05-14T01:23:36.246177+0000","last_fullsized":"2024-05-14T01:23:36.246177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:38:23.401263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.280625+0000","last_change":"2024-05-14T01:23:35.269144+0000","last_active":"2024-05-14T01:23:35.280625+0000","last_peered":"2024-05-14T01:23:35.280625+0000","last_clean":"2024-05-14T01:23:35.280625+0000","last_became_active":"2024-05-14T01:23:35.268523+0000","last_became_peered":"2024-05-14T01:23:35.268523+0000","last_unstale":"2024-05-14T01:23:35.280625+0000","last_undegraded":"2024-05-14T01:23:35.280625+0000","last_fullsized":"2024-05-14T01:23:35.280625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:58.295553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245589+0000","last_change":"2024-05-14T01:23:35.294800+0000","last_active":"2024-05-14T01:23:36.245589+0000","last_peered":"2024-05-14T01:23:36.245589+0000","last_clean":"2024-05-14T01:23:36.245589+0000","last_became_active":"2024-05-14T01:23:35.294322+0000","last_became_peered":"2024-05-14T01:23:35.294322+0000","last_unstale":"2024-05-14T01:23:36.245589+0000","last_undegraded":"2024-05-14T01:23:36.245589+0000","last_fullsized":"2024-05-14T01:23:36.245589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:42:53.264601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.281969+0000","last_change":"2024-05-14T01:23:35.274139+0000","last_active":"2024-05-14T01:23:35.281969+0000","last_peered":"2024-05-14T01:23:35.281969+0000","last_clean":"2024-05-14T01:23:35.281969+0000","last_became_active":"2024-05-14T01:23:35.273490+0000","last_became_peered":"2024-05-14T01:23:35.273490+0000","last_unstale":"2024-05-14T01:23:35.281969+0000","last_undegraded":"2024-05-14T01:23:35.281969+0000","last_fullsized":"2024-05-14T01:23:35.281969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:56.796582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247159+0000","last_change":"2024-05-14T01:23:35.252097+0000","last_active":"2024-05-14T01:23:36.247159+0000","last_peered":"2024-05-14T01:23:36.247159+0000","last_clean":"2024-05-14T01:23:36.247159+0000","last_became_active":"2024-05-14T01:23:35.251312+0000","last_became_peered":"2024-05-14T01:23:35.251312+0000","last_unstale":"2024-05-14T01:23:36.247159+0000","last_undegraded":"2024-05-14T01:23:36.247159+0000","last_fullsized":"2024-05-14T01:23:36.247159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:42:53.264601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244046+0000","last_change":"2024-05-14T01:23:35.262232+0000","last_active":"2024-05-14T01:23:36.244046+0000","last_peered":"2024-05-14T01:23:36.244046+0000","last_clean":"2024-05-14T01:23:36.244046+0000","last_became_active":"2024-05-14T01:23:35.261558+0000","last_became_peered":"2024-05-14T01:23:35.261558+0000","last_unstale":"2024-05-14T01:23:36.244046+0000","last_undegraded":"2024-05-14T01:23:36.244046+0000","last_fullsized":"2024-05-14T01:23:36.244046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:35:14.703645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.282029+0000","last_change":"2024-05-14T01:23:35.274631+0000","last_active":"2024-05-14T01:23:35.282029+0000","last_peered":"2024-05-14T01:23:35.282029+0000","last_clean":"2024-05-14T01:23:35.282029+0000","last_became_active":"2024-05-14T01:23:35.273800+0000","last_became_peered":"2024-05-14T01:23:35.273800+0000","last_unstale":"2024-05-14T01:23:35.282029+0000","last_undegraded":"2024-05-14T01:23:35.282029+0000","last_fullsized":"2024-05-14T01:23:35.282029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:28.467794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088951+0000","last_change":"2024-05-14T01:23:35.276519+0000","last_active":"2024-05-14T01:23:38.088951+0000","last_peered":"2024-05-14T01:23:38.088951+0000","last_clean":"2024-05-14T01:23:38.088951+0000","last_became_active":"2024-05-14T01:23:35.275945+0000","last_became_peered":"2024-05-14T01:23:35.275945+0000","last_unstale":"2024-05-14T01:23:38.088951+0000","last_undegraded":"2024-05-14T01:23:38.088951+0000","last_fullsized":"2024-05-14T01:23:38.088951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:19:10.756155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246501+0000","last_change":"2024-05-14T01:23:35.300997+0000","last_active":"2024-05-14T01:23:36.246501+0000","last_peered":"2024-05-14T01:23:36.246501+0000","last_clean":"2024-05-14T01:23:36.246501+0000","last_became_active":"2024-05-14T01:23:35.290048+0000","last_became_peered":"2024-05-14T01:23:35.290048+0000","last_unstale":"2024-05-14T01:23:36.246501+0000","last_undegraded":"2024-05-14T01:23:36.246501+0000","last_fullsized":"2024-05-14T01:23:36.246501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:20:00.610956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.086828+0000","last_change":"2024-05-14T01:23:35.296448+0000","last_active":"2024-05-14T01:23:38.086828+0000","last_peered":"2024-05-14T01:23:38.086828+0000","last_clean":"2024-05-14T01:23:38.086828+0000","last_became_active":"2024-05-14T01:23:35.296164+0000","last_became_peered":"2024-05-14T01:23:35.296164+0000","last_unstale":"2024-05-14T01:23:38.086828+0000","last_undegraded":"2024-05-14T01:23:38.086828+0000","last_fullsized":"2024-05-14T01:23:38.086828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:28.467794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245018+0000","last_change":"2024-05-14T01:23:35.260927+0000","last_active":"2024-05-14T01:23:36.245018+0000","last_peered":"2024-05-14T01:23:36.245018+0000","last_clean":"2024-05-14T01:23:36.245018+0000","last_became_active":"2024-05-14T01:23:35.260122+0000","last_became_peered":"2024-05-14T01:23:35.260122+0000","last_unstale":"2024-05-14T01:23:36.245018+0000","last_undegraded":"2024-05-14T01:23:36.245018+0000","last_fullsized":"2024-05-14T01:23:36.245018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:26:04.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.674795+0000","last_change":"2024-05-14T01:23:35.249002+0000","last_active":"2024-05-14T01:23:36.674795+0000","last_peered":"2024-05-14T01:23:36.674795+0000","last_clean":"2024-05-14T01:23:36.674795+0000","last_became_active":"2024-05-14T01:23:35.248126+0000","last_became_peered":"2024-05-14T01:23:35.248126+0000","last_unstale":"2024-05-14T01:23:36.674795+0000","last_undegraded":"2024-05-14T01:23:36.674795+0000","last_fullsized":"2024-05-14T01:23:36.674795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:58.295553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.303451+0000","last_change":"2024-05-14T01:23:34.250861+0000","last_active":"2024-05-14T01:23:35.303451+0000","last_peered":"2024-05-14T01:23:35.303451+0000","last_clean":"2024-05-14T01:23:35.303451+0000","last_became_active":"2024-05-14T01:23:34.250502+0000","last_became_peered":"2024-05-14T01:23:34.250502+0000","last_unstale":"2024-05-14T01:23:35.303451+0000","last_undegraded":"2024-05-14T01:23:35.303451+0000","last_fullsized":"2024-05-14T01:23:35.303451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:53:43.384791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089367+0000","last_change":"2024-05-14T01:23:35.272454+0000","last_active":"2024-05-14T01:23:38.089367+0000","last_peered":"2024-05-14T01:23:38.089367+0000","last_clean":"2024-05-14T01:23:38.089367+0000","last_became_active":"2024-05-14T01:23:35.271773+0000","last_became_peered":"2024-05-14T01:23:35.271773+0000","last_unstale":"2024-05-14T01:23:38.089367+0000","last_undegraded":"2024-05-14T01:23:38.089367+0000","last_fullsized":"2024-05-14T01:23:38.089367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:42:53.264601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245396+0000","last_change":"2024-05-14T01:23:34.245154+0000","last_active":"2024-05-14T01:23:36.245396+0000","last_peered":"2024-05-14T01:23:36.245396+0000","last_clean":"2024-05-14T01:23:36.245396+0000","last_became_active":"2024-05-14T01:23:34.244225+0000","last_became_peered":"2024-05-14T01:23:34.244225+0000","last_unstale":"2024-05-14T01:23:36.245396+0000","last_undegraded":"2024-05-14T01:23:36.245396+0000","last_fullsized":"2024-05-14T01:23:36.245396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:50:26.266945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.255719+0000","last_change":"2024-05-14T01:23:34.219241+0000","last_active":"2024-05-14T01:23:35.255719+0000","last_peered":"2024-05-14T01:23:35.255719+0000","last_clean":"2024-05-14T01:23:35.255719+0000","last_became_active":"2024-05-14T01:23:34.218932+0000","last_became_peered":"2024-05-14T01:23:34.218932+0000","last_unstale":"2024-05-14T01:23:35.255719+0000","last_undegraded":"2024-05-14T01:23:35.255719+0000","last_fullsized":"2024-05-14T01:23:35.255719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:13:57.047963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.282423+0000","last_change":"2024-05-14T01:23:35.280370+0000","last_active":"2024-05-14T01:23:35.282423+0000","last_peered":"2024-05-14T01:23:35.282423+0000","last_clean":"2024-05-14T01:23:35.282423+0000","last_became_active":"2024-05-14T01:23:35.275913+0000","last_became_peered":"2024-05-14T01:23:35.275913+0000","last_unstale":"2024-05-14T01:23:35.282423+0000","last_undegraded":"2024-05-14T01:23:35.282423+0000","last_fullsized":"2024-05-14T01:23:35.282423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:09:07.570394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245706+0000","last_change":"2024-05-14T01:23:34.251307+0000","last_active":"2024-05-14T01:23:36.245706+0000","last_peered":"2024-05-14T01:23:36.245706+0000","last_clean":"2024-05-14T01:23:36.245706+0000","last_became_active":"2024-05-14T01:23:34.245659+0000","last_became_peered":"2024-05-14T01:23:34.245659+0000","last_unstale":"2024-05-14T01:23:36.245706+0000","last_undegraded":"2024-05-14T01:23:36.245706+0000","last_fullsized":"2024-05-14T01:23:36.245706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:54:09.731166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243716+0000","last_change":"2024-05-14T01:23:35.263892+0000","last_active":"2024-05-14T01:23:36.243716+0000","last_peered":"2024-05-14T01:23:36.243716+0000","last_clean":"2024-05-14T01:23:36.243716+0000","last_became_active":"2024-05-14T01:23:35.262822+0000","last_became_peered":"2024-05-14T01:23:35.262822+0000","last_unstale":"2024-05-14T01:23:36.243716+0000","last_undegraded":"2024-05-14T01:23:36.243716+0000","last_fullsized":"2024-05-14T01:23:36.243716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:19:10.756155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246875+0000","last_change":"2024-05-14T01:23:34.259671+0000","last_active":"2024-05-14T01:23:36.246875+0000","last_peered":"2024-05-14T01:23:36.246875+0000","last_clean":"2024-05-14T01:23:36.246875+0000","last_became_active":"2024-05-14T01:23:34.259001+0000","last_became_peered":"2024-05-14T01:23:34.259001+0000","last_unstale":"2024-05-14T01:23:36.246875+0000","last_undegraded":"2024-05-14T01:23:36.246875+0000","last_fullsized":"2024-05-14T01:23:36.246875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:54:09.731166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.248083+0000","last_change":"2024-05-14T01:23:35.298763+0000","last_active":"2024-05-14T01:23:36.248083+0000","last_peered":"2024-05-14T01:23:36.248083+0000","last_clean":"2024-05-14T01:23:36.248083+0000","last_became_active":"2024-05-14T01:23:35.295383+0000","last_became_peered":"2024-05-14T01:23:35.295383+0000","last_unstale":"2024-05-14T01:23:36.248083+0000","last_undegraded":"2024-05-14T01:23:36.248083+0000","last_fullsized":"2024-05-14T01:23:36.248083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:27:07.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.248017+0000","last_change":"2024-05-14T01:23:34.259392+0000","last_active":"2024-05-14T01:23:36.248017+0000","last_peered":"2024-05-14T01:23:36.248017+0000","last_clean":"2024-05-14T01:23:36.248017+0000","last_became_active":"2024-05-14T01:23:34.258475+0000","last_became_peered":"2024-05-14T01:23:34.258475+0000","last_unstale":"2024-05-14T01:23:36.248017+0000","last_undegraded":"2024-05-14T01:23:36.248017+0000","last_fullsized":"2024-05-14T01:23:36.248017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:50:26.266945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089282+0000","last_change":"2024-05-14T01:23:35.301841+0000","last_active":"2024-05-14T01:23:38.089282+0000","last_peered":"2024-05-14T01:23:38.089282+0000","last_clean":"2024-05-14T01:23:38.089282+0000","last_became_active":"2024-05-14T01:23:35.301260+0000","last_became_peered":"2024-05-14T01:23:35.301260+0000","last_unstale":"2024-05-14T01:23:38.089282+0000","last_undegraded":"2024-05-14T01:23:38.089282+0000","last_fullsized":"2024-05-14T01:23:38.089282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:17:24.056984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244314+0000","last_change":"2024-05-14T01:23:34.241260+0000","last_active":"2024-05-14T01:23:36.244314+0000","last_peered":"2024-05-14T01:23:36.244314+0000","last_clean":"2024-05-14T01:23:36.244314+0000","last_became_active":"2024-05-14T01:23:34.241005+0000","last_became_peered":"2024-05-14T01:23:34.241005+0000","last_unstale":"2024-05-14T01:23:36.244314+0000","last_undegraded":"2024-05-14T01:23:36.244314+0000","last_fullsized":"2024-05-14T01:23:36.244314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:55.788381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.675306+0000","last_change":"2024-05-14T01:23:35.281538+0000","last_active":"2024-05-14T01:23:36.675306+0000","last_peered":"2024-05-14T01:23:36.675306+0000","last_clean":"2024-05-14T01:23:36.675306+0000","last_became_active":"2024-05-14T01:23:35.280728+0000","last_became_peered":"2024-05-14T01:23:35.280728+0000","last_unstale":"2024-05-14T01:23:36.675306+0000","last_undegraded":"2024-05-14T01:23:36.675306+0000","last_fullsized":"2024-05-14T01:23:36.675306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:09:07.570394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246193+0000","last_change":"2024-05-14T01:23:34.229467+0000","last_active":"2024-05-14T01:23:36.246193+0000","last_peered":"2024-05-14T01:23:36.246193+0000","last_clean":"2024-05-14T01:23:36.246193+0000","last_became_active":"2024-05-14T01:23:34.228709+0000","last_became_peered":"2024-05-14T01:23:34.228709+0000","last_unstale":"2024-05-14T01:23:36.246193+0000","last_undegraded":"2024-05-14T01:23:36.246193+0000","last_fullsized":"2024-05-14T01:23:36.246193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:57.287353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985329+0000","last_change":"2024-05-14T01:23:35.297600+0000","last_active":"2024-05-14T01:23:36.985329+0000","last_peered":"2024-05-14T01:23:36.985329+0000","last_clean":"2024-05-14T01:23:36.985329+0000","last_became_active":"2024-05-14T01:23:35.282394+0000","last_became_peered":"2024-05-14T01:23:35.282394+0000","last_unstale":"2024-05-14T01:23:36.985329+0000","last_undegraded":"2024-05-14T01:23:36.985329+0000","last_fullsized":"2024-05-14T01:23:36.985329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:27:07.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089635+0000","last_change":"2024-05-14T01:23:34.233957+0000","last_active":"2024-05-14T01:23:38.089635+0000","last_peered":"2024-05-14T01:23:38.089635+0000","last_clean":"2024-05-14T01:23:38.089635+0000","last_became_active":"2024-05-14T01:23:34.233639+0000","last_became_peered":"2024-05-14T01:23:34.233639+0000","last_unstale":"2024-05-14T01:23:38.089635+0000","last_undegraded":"2024-05-14T01:23:38.089635+0000","last_fullsized":"2024-05-14T01:23:38.089635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:53:43.384791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088454+0000","last_change":"2024-05-14T01:23:35.283594+0000","last_active":"2024-05-14T01:23:38.088454+0000","last_peered":"2024-05-14T01:23:38.088454+0000","last_clean":"2024-05-14T01:23:38.088454+0000","last_became_active":"2024-05-14T01:23:35.283197+0000","last_became_peered":"2024-05-14T01:23:35.283197+0000","last_unstale":"2024-05-14T01:23:38.088454+0000","last_undegraded":"2024-05-14T01:23:38.088454+0000","last_fullsized":"2024-05-14T01:23:38.088454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:26:04.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246382+0000","last_change":"2024-05-14T01:23:34.255912+0000","last_active":"2024-05-14T01:23:36.246382+0000","last_peered":"2024-05-14T01:23:36.246382+0000","last_clean":"2024-05-14T01:23:36.246382+0000","last_became_active":"2024-05-14T01:23:34.253523+0000","last_became_peered":"2024-05-14T01:23:34.253523+0000","last_unstale":"2024-05-14T01:23:36.246382+0000","last_undegraded":"2024-05-14T01:23:36.246382+0000","last_fullsized":"2024-05-14T01:23:36.246382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:55.788381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985315+0000","last_change":"2024-05-14T01:23:35.285975+0000","last_active":"2024-05-14T01:23:36.985315+0000","last_peered":"2024-05-14T01:23:36.985315+0000","last_clean":"2024-05-14T01:23:36.985315+0000","last_became_active":"2024-05-14T01:23:35.285612+0000","last_became_peered":"2024-05-14T01:23:35.285612+0000","last_unstale":"2024-05-14T01:23:36.985315+0000","last_undegraded":"2024-05-14T01:23:36.985315+0000","last_fullsized":"2024-05-14T01:23:36.985315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:51:24.561905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245103+0000","last_change":"2024-05-14T01:23:34.250761+0000","last_active":"2024-05-14T01:23:36.245103+0000","last_peered":"2024-05-14T01:23:36.245103+0000","last_clean":"2024-05-14T01:23:36.245103+0000","last_became_active":"2024-05-14T01:23:34.249867+0000","last_became_peered":"2024-05-14T01:23:34.249867+0000","last_unstale":"2024-05-14T01:23:36.245103+0000","last_undegraded":"2024-05-14T01:23:36.245103+0000","last_fullsized":"2024-05-14T01:23:36.245103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:13:57.047963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245812+0000","last_change":"2024-05-14T01:23:35.261647+0000","last_active":"2024-05-14T01:23:36.245812+0000","last_peered":"2024-05-14T01:23:36.245812+0000","last_clean":"2024-05-14T01:23:36.245812+0000","last_became_active":"2024-05-14T01:23:35.259092+0000","last_became_peered":"2024-05-14T01:23:35.259092+0000","last_unstale":"2024-05-14T01:23:36.245812+0000","last_undegraded":"2024-05-14T01:23:36.245812+0000","last_fullsized":"2024-05-14T01:23:36.245812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:05:16.096171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089803+0000","last_change":"2024-05-14T01:23:34.224371+0000","last_active":"2024-05-14T01:23:38.089803+0000","last_peered":"2024-05-14T01:23:38.089803+0000","last_clean":"2024-05-14T01:23:38.089803+0000","last_became_active":"2024-05-14T01:23:34.224010+0000","last_became_peered":"2024-05-14T01:23:34.224010+0000","last_unstale":"2024-05-14T01:23:38.089803+0000","last_undegraded":"2024-05-14T01:23:38.089803+0000","last_fullsized":"2024-05-14T01:23:38.089803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:13:57.047963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984842+0000","last_change":"2024-05-14T01:23:35.298167+0000","last_active":"2024-05-14T01:23:36.984842+0000","last_peered":"2024-05-14T01:23:36.984842+0000","last_clean":"2024-05-14T01:23:36.984842+0000","last_became_active":"2024-05-14T01:23:35.286157+0000","last_became_peered":"2024-05-14T01:23:35.286157+0000","last_unstale":"2024-05-14T01:23:36.984842+0000","last_undegraded":"2024-05-14T01:23:36.984842+0000","last_fullsized":"2024-05-14T01:23:36.984842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:45:12.494840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.675221+0000","last_change":"2024-05-14T01:23:34.236199+0000","last_active":"2024-05-14T01:23:36.675221+0000","last_peered":"2024-05-14T01:23:36.675221+0000","last_clean":"2024-05-14T01:23:36.675221+0000","last_became_active":"2024-05-14T01:23:34.233012+0000","last_became_peered":"2024-05-14T01:23:34.233012+0000","last_unstale":"2024-05-14T01:23:36.675221+0000","last_undegraded":"2024-05-14T01:23:36.675221+0000","last_fullsized":"2024-05-14T01:23:36.675221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:05:28.581427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985820+0000","last_change":"2024-05-14T01:23:35.297883+0000","last_active":"2024-05-14T01:23:36.985820+0000","last_peered":"2024-05-14T01:23:36.985820+0000","last_clean":"2024-05-14T01:23:36.985820+0000","last_became_active":"2024-05-14T01:23:35.287258+0000","last_became_peered":"2024-05-14T01:23:35.287258+0000","last_unstale":"2024-05-14T01:23:36.985820+0000","last_undegraded":"2024-05-14T01:23:36.985820+0000","last_fullsized":"2024-05-14T01:23:36.985820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:54:11.367649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087438+0000","last_change":"2024-05-14T01:23:34.225011+0000","last_active":"2024-05-14T01:23:38.087438+0000","last_peered":"2024-05-14T01:23:38.087438+0000","last_clean":"2024-05-14T01:23:38.087438+0000","last_became_active":"2024-05-14T01:23:34.224674+0000","last_became_peered":"2024-05-14T01:23:34.224674+0000","last_unstale":"2024-05-14T01:23:38.087438+0000","last_undegraded":"2024-05-14T01:23:38.087438+0000","last_fullsized":"2024-05-14T01:23:38.087438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:50:26.266945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.986041+0000","last_change":"2024-05-14T01:23:35.287056+0000","last_active":"2024-05-14T01:23:36.986041+0000","last_peered":"2024-05-14T01:23:36.986041+0000","last_clean":"2024-05-14T01:23:36.986041+0000","last_became_active":"2024-05-14T01:23:35.286372+0000","last_became_peered":"2024-05-14T01:23:35.286372+0000","last_unstale":"2024-05-14T01:23:36.986041+0000","last_undegraded":"2024-05-14T01:23:36.986041+0000","last_fullsized":"2024-05-14T01:23:36.986041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:24:47.905393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244447+0000","last_change":"2024-05-14T01:23:34.234869+0000","last_active":"2024-05-14T01:23:36.244447+0000","last_peered":"2024-05-14T01:23:36.244447+0000","last_clean":"2024-05-14T01:23:36.244447+0000","last_became_active":"2024-05-14T01:23:34.234582+0000","last_became_peered":"2024-05-14T01:23:34.234582+0000","last_unstale":"2024-05-14T01:23:36.244447+0000","last_undegraded":"2024-05-14T01:23:36.244447+0000","last_fullsized":"2024-05-14T01:23:36.244447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:25:49.061428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247626+0000","last_change":"2024-05-14T01:23:35.294289+0000","last_active":"2024-05-14T01:23:36.247626+0000","last_peered":"2024-05-14T01:23:36.247626+0000","last_clean":"2024-05-14T01:23:36.247626+0000","last_became_active":"2024-05-14T01:23:35.289592+0000","last_became_peered":"2024-05-14T01:23:35.289592+0000","last_unstale":"2024-05-14T01:23:36.247626+0000","last_undegraded":"2024-05-14T01:23:36.247626+0000","last_fullsized":"2024-05-14T01:23:36.247626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:45:12.494840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.086917+0000","last_change":"2024-05-14T01:23:34.253809+0000","last_active":"2024-05-14T01:23:38.086917+0000","last_peered":"2024-05-14T01:23:38.086917+0000","last_clean":"2024-05-14T01:23:38.086917+0000","last_became_active":"2024-05-14T01:23:34.253537+0000","last_became_peered":"2024-05-14T01:23:34.253537+0000","last_unstale":"2024-05-14T01:23:38.086917+0000","last_undegraded":"2024-05-14T01:23:38.086917+0000","last_fullsized":"2024-05-14T01:23:38.086917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:50:36.678245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985359+0000","last_change":"2024-05-14T01:23:35.298846+0000","last_active":"2024-05-14T01:23:36.985359+0000","last_peered":"2024-05-14T01:23:36.985359+0000","last_clean":"2024-05-14T01:23:36.985359+0000","last_became_active":"2024-05-14T01:23:35.298408+0000","last_became_peered":"2024-05-14T01:23:35.298408+0000","last_unstale":"2024-05-14T01:23:36.985359+0000","last_undegraded":"2024-05-14T01:23:36.985359+0000","last_fullsized":"2024-05-14T01:23:36.985359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:36:36.172326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984460+0000","last_change":"2024-05-14T01:23:25.487525+0000","last_active":"2024-05-14T01:23:36.984460+0000","last_peered":"2024-05-14T01:23:36.984460+0000","last_clean":"2024-05-14T01:23:36.984460+0000","last_became_active":"2024-05-14T01:23:25.485622+0000","last_became_peered":"2024-05-14T01:23:25.485622+0000","last_unstale":"2024-05-14T01:23:36.984460+0000","last_undegraded":"2024-05-14T01:23:36.984460+0000","last_fullsized":"2024-05-14T01:23:36.984460+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_clean_scrub_stamp":"2024-05-14T01:23:24.138255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:26:23.884962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246267+0000","last_change":"2024-05-14T01:23:34.250502+0000","last_active":"2024-05-14T01:23:36.246267+0000","last_peered":"2024-05-14T01:23:36.246267+0000","last_clean":"2024-05-14T01:23:36.246267+0000","last_became_active":"2024-05-14T01:23:34.249867+0000","last_became_peered":"2024-05-14T01:23:34.249867+0000","last_unstale":"2024-05-14T01:23:36.246267+0000","last_undegraded":"2024-05-14T01:23:36.246267+0000","last_fullsized":"2024-05-14T01:23:36.246267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:13:57.047963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.306471+0000","last_change":"2024-05-14T01:23:35.302453+0000","last_active":"2024-05-14T01:23:35.306471+0000","last_peered":"2024-05-14T01:23:35.306471+0000","last_clean":"2024-05-14T01:23:35.306471+0000","last_became_active":"2024-05-14T01:23:35.302253+0000","last_became_peered":"2024-05-14T01:23:35.302253+0000","last_unstale":"2024-05-14T01:23:35.306471+0000","last_undegraded":"2024-05-14T01:23:35.306471+0000","last_fullsized":"2024-05-14T01:23:35.306471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:27:33.193287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984361+0000","last_change":"2024-05-14T01:23:34.258164+0000","last_active":"2024-05-14T01:23:36.984361+0000","last_peered":"2024-05-14T01:23:36.984361+0000","last_clean":"2024-05-14T01:23:36.984361+0000","last_became_active":"2024-05-14T01:23:34.257595+0000","last_became_peered":"2024-05-14T01:23:34.257595+0000","last_unstale":"2024-05-14T01:23:36.984361+0000","last_undegraded":"2024-05-14T01:23:36.984361+0000","last_fullsized":"2024-05-14T01:23:36.984361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:27.459594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088117+0000","last_change":"2024-05-14T01:23:35.271974+0000","last_active":"2024-05-14T01:23:38.088117+0000","last_peered":"2024-05-14T01:23:38.088117+0000","last_clean":"2024-05-14T01:23:38.088117+0000","last_became_active":"2024-05-14T01:23:35.269194+0000","last_became_peered":"2024-05-14T01:23:35.269194+0000","last_unstale":"2024-05-14T01:23:38.088117+0000","last_undegraded":"2024-05-14T01:23:38.088117+0000","last_fullsized":"2024-05-14T01:23:38.088117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:55:21.424796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.086730+0000","last_change":"2024-05-14T01:23:34.223715+0000","last_active":"2024-05-14T01:23:38.086730+0000","last_peered":"2024-05-14T01:23:38.086730+0000","last_clean":"2024-05-14T01:23:38.086730+0000","last_became_active":"2024-05-14T01:23:34.223397+0000","last_became_peered":"2024-05-14T01:23:34.223397+0000","last_unstale":"2024-05-14T01:23:38.086730+0000","last_undegraded":"2024-05-14T01:23:38.086730+0000","last_fullsized":"2024-05-14T01:23:38.086730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:54:09.731166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243600+0000","last_change":"2024-05-14T01:23:35.262679+0000","last_active":"2024-05-14T01:23:36.243600+0000","last_peered":"2024-05-14T01:23:36.243600+0000","last_clean":"2024-05-14T01:23:36.243600+0000","last_became_active":"2024-05-14T01:23:35.261920+0000","last_became_peered":"2024-05-14T01:23:35.261920+0000","last_unstale":"2024-05-14T01:23:36.243600+0000","last_undegraded":"2024-05-14T01:23:36.243600+0000","last_fullsized":"2024-05-14T01:23:36.243600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:15:22.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246672+0000","last_change":"2024-05-14T01:23:34.249172+0000","last_active":"2024-05-14T01:23:36.246672+0000","last_peered":"2024-05-14T01:23:36.246672+0000","last_clean":"2024-05-14T01:23:36.246672+0000","last_became_active":"2024-05-14T01:23:34.238802+0000","last_became_peered":"2024-05-14T01:23:34.238802+0000","last_unstale":"2024-05-14T01:23:36.246672+0000","last_undegraded":"2024-05-14T01:23:36.246672+0000","last_fullsized":"2024-05-14T01:23:36.246672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:27.459594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.674803+0000","last_change":"2024-05-14T01:23:35.264275+0000","last_active":"2024-05-14T01:23:36.674803+0000","last_peered":"2024-05-14T01:23:36.674803+0000","last_clean":"2024-05-14T01:23:36.674803+0000","last_became_active":"2024-05-14T01:23:35.262643+0000","last_became_peered":"2024-05-14T01:23:35.262643+0000","last_unstale":"2024-05-14T01:23:36.674803+0000","last_undegraded":"2024-05-14T01:23:36.674803+0000","last_fullsized":"2024-05-14T01:23:36.674803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:56.796582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244185+0000","last_change":"2024-05-14T01:23:34.226163+0000","last_active":"2024-05-14T01:23:36.244185+0000","last_peered":"2024-05-14T01:23:36.244185+0000","last_clean":"2024-05-14T01:23:36.244185+0000","last_became_active":"2024-05-14T01:23:34.225890+0000","last_became_peered":"2024-05-14T01:23:34.225890+0000","last_unstale":"2024-05-14T01:23:36.244185+0000","last_undegraded":"2024-05-14T01:23:36.244185+0000","last_fullsized":"2024-05-14T01:23:36.244185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:57.287353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247976+0000","last_change":"2024-05-14T01:23:35.294211+0000","last_active":"2024-05-14T01:23:36.247976+0000","last_peered":"2024-05-14T01:23:36.247976+0000","last_clean":"2024-05-14T01:23:36.247976+0000","last_became_active":"2024-05-14T01:23:35.289658+0000","last_became_peered":"2024-05-14T01:23:35.289658+0000","last_unstale":"2024-05-14T01:23:36.247976+0000","last_undegraded":"2024-05-14T01:23:36.247976+0000","last_fullsized":"2024-05-14T01:23:36.247976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:51:24.561905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985721+0000","last_change":"2024-05-14T01:23:34.256826+0000","last_active":"2024-05-14T01:23:36.985721+0000","last_peered":"2024-05-14T01:23:36.985721+0000","last_clean":"2024-05-14T01:23:36.985721+0000","last_became_active":"2024-05-14T01:23:34.256022+0000","last_became_peered":"2024-05-14T01:23:34.256022+0000","last_unstale":"2024-05-14T01:23:36.985721+0000","last_undegraded":"2024-05-14T01:23:36.985721+0000","last_fullsized":"2024-05-14T01:23:36.985721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:19:25.032602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243917+0000","last_change":"2024-05-14T01:23:35.260714+0000","last_active":"2024-05-14T01:23:36.243917+0000","last_peered":"2024-05-14T01:23:36.243917+0000","last_clean":"2024-05-14T01:23:36.243917+0000","last_became_active":"2024-05-14T01:23:35.259757+0000","last_became_peered":"2024-05-14T01:23:35.259757+0000","last_unstale":"2024-05-14T01:23:36.243917+0000","last_undegraded":"2024-05-14T01:23:36.243917+0000","last_fullsized":"2024-05-14T01:23:36.243917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:17:24.056984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.286013+0000","last_change":"2024-05-14T01:23:34.235193+0000","last_active":"2024-05-14T01:23:36.286013+0000","last_peered":"2024-05-14T01:23:36.286013+0000","last_clean":"2024-05-14T01:23:36.286013+0000","last_became_active":"2024-05-14T01:23:34.234838+0000","last_became_peered":"2024-05-14T01:23:34.234838+0000","last_unstale":"2024-05-14T01:23:36.286013+0000","last_undegraded":"2024-05-14T01:23:36.286013+0000","last_fullsized":"2024-05-14T01:23:36.286013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:54:09.731166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.307005+0000","last_change":"2024-05-14T01:23:35.304577+0000","last_active":"2024-05-14T01:23:35.307005+0000","last_peered":"2024-05-14T01:23:35.307005+0000","last_clean":"2024-05-14T01:23:35.307005+0000","last_became_active":"2024-05-14T01:23:35.304182+0000","last_became_peered":"2024-05-14T01:23:35.304182+0000","last_unstale":"2024-05-14T01:23:35.307005+0000","last_undegraded":"2024-05-14T01:23:35.307005+0000","last_fullsized":"2024-05-14T01:23:35.307005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:55:21.424796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247154+0000","last_change":"2024-05-14T01:23:34.252262+0000","last_active":"2024-05-14T01:23:36.247154+0000","last_peered":"2024-05-14T01:23:36.247154+0000","last_clean":"2024-05-14T01:23:36.247154+0000","last_became_active":"2024-05-14T01:23:34.251538+0000","last_became_peered":"2024-05-14T01:23:34.251538+0000","last_unstale":"2024-05-14T01:23:36.247154+0000","last_undegraded":"2024-05-14T01:23:36.247154+0000","last_fullsized":"2024-05-14T01:23:36.247154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:55.788381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089306+0000","last_change":"2024-05-14T01:23:35.272849+0000","last_active":"2024-05-14T01:23:38.089306+0000","last_peered":"2024-05-14T01:23:38.089306+0000","last_clean":"2024-05-14T01:23:38.089306+0000","last_became_active":"2024-05-14T01:23:35.272167+0000","last_became_peered":"2024-05-14T01:23:35.272167+0000","last_unstale":"2024-05-14T01:23:38.089306+0000","last_undegraded":"2024-05-14T01:23:38.089306+0000","last_fullsized":"2024-05-14T01:23:38.089306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:35:14.703645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984311+0000","last_change":"2024-05-14T01:23:34.258728+0000","last_active":"2024-05-14T01:23:36.984311+0000","last_peered":"2024-05-14T01:23:36.984311+0000","last_clean":"2024-05-14T01:23:36.984311+0000","last_became_active":"2024-05-14T01:23:34.255812+0000","last_became_peered":"2024-05-14T01:23:34.255812+0000","last_unstale":"2024-05-14T01:23:36.984311+0000","last_undegraded":"2024-05-14T01:23:36.984311+0000","last_fullsized":"2024-05-14T01:23:36.984311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:55.788381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.674842+0000","last_change":"2024-05-14T01:23:35.265948+0000","last_active":"2024-05-14T01:23:36.674842+0000","last_peered":"2024-05-14T01:23:36.674842+0000","last_clean":"2024-05-14T01:23:36.674842+0000","last_became_active":"2024-05-14T01:23:35.261913+0000","last_became_peered":"2024-05-14T01:23:35.261913+0000","last_unstale":"2024-05-14T01:23:36.674842+0000","last_undegraded":"2024-05-14T01:23:36.674842+0000","last_fullsized":"2024-05-14T01:23:36.674842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:28.467794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243989+0000","last_change":"2024-05-14T01:23:34.251067+0000","last_active":"2024-05-14T01:23:36.243989+0000","last_peered":"2024-05-14T01:23:36.243989+0000","last_clean":"2024-05-14T01:23:36.243989+0000","last_became_active":"2024-05-14T01:23:34.250744+0000","last_became_peered":"2024-05-14T01:23:34.250744+0000","last_unstale":"2024-05-14T01:23:36.243989+0000","last_undegraded":"2024-05-14T01:23:36.243989+0000","last_fullsized":"2024-05-14T01:23:36.243989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:27.459594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.282403+0000","last_change":"2024-05-14T01:23:35.276327+0000","last_active":"2024-05-14T01:23:35.282403+0000","last_peered":"2024-05-14T01:23:35.282403+0000","last_clean":"2024-05-14T01:23:35.282403+0000","last_became_active":"2024-05-14T01:23:35.275932+0000","last_became_peered":"2024-05-14T01:23:35.275932+0000","last_unstale":"2024-05-14T01:23:35.282403+0000","last_undegraded":"2024-05-14T01:23:35.282403+0000","last_fullsized":"2024-05-14T01:23:35.282403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:25:50.069629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244161+0000","last_change":"2024-05-14T01:23:34.224180+0000","last_active":"2024-05-14T01:23:36.244161+0000","last_peered":"2024-05-14T01:23:36.244161+0000","last_clean":"2024-05-14T01:23:36.244161+0000","last_became_active":"2024-05-14T01:23:34.223787+0000","last_became_peered":"2024-05-14T01:23:34.223787+0000","last_unstale":"2024-05-14T01:23:36.244161+0000","last_undegraded":"2024-05-14T01:23:36.244161+0000","last_fullsized":"2024-05-14T01:23:36.244161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:50:26.266945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.282381+0000","last_change":"2024-05-14T01:23:35.281157+0000","last_active":"2024-05-14T01:23:35.282381+0000","last_peered":"2024-05-14T01:23:35.282381+0000","last_clean":"2024-05-14T01:23:35.282381+0000","last_became_active":"2024-05-14T01:23:35.280808+0000","last_became_peered":"2024-05-14T01:23:35.280808+0000","last_unstale":"2024-05-14T01:23:35.282381+0000","last_undegraded":"2024-05-14T01:23:35.282381+0000","last_fullsized":"2024-05-14T01:23:35.282381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:55:37.925082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985396+0000","last_change":"2024-05-14T01:23:34.256325+0000","last_active":"2024-05-14T01:23:36.985396+0000","last_peered":"2024-05-14T01:23:36.985396+0000","last_clean":"2024-05-14T01:23:36.985396+0000","last_became_active":"2024-05-14T01:23:34.255642+0000","last_became_peered":"2024-05-14T01:23:34.255642+0000","last_unstale":"2024-05-14T01:23:36.985396+0000","last_undegraded":"2024-05-14T01:23:36.985396+0000","last_fullsized":"2024-05-14T01:23:36.985396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:09:06.562194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245464+0000","last_change":"2024-05-14T01:23:35.254121+0000","last_active":"2024-05-14T01:23:36.245464+0000","last_peered":"2024-05-14T01:23:36.245464+0000","last_clean":"2024-05-14T01:23:36.245464+0000","last_became_active":"2024-05-14T01:23:35.251280+0000","last_became_peered":"2024-05-14T01:23:35.251280+0000","last_unstale":"2024-05-14T01:23:36.245464+0000","last_undegraded":"2024-05-14T01:23:36.245464+0000","last_fullsized":"2024-05-14T01:23:36.245464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:19:10.756155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247888+0000","last_change":"2024-05-14T01:23:35.293893+0000","last_active":"2024-05-14T01:23:36.247888+0000","last_peered":"2024-05-14T01:23:36.247888+0000","last_clean":"2024-05-14T01:23:36.247888+0000","last_became_active":"2024-05-14T01:23:35.289188+0000","last_became_peered":"2024-05-14T01:23:35.289188+0000","last_unstale":"2024-05-14T01:23:36.247888+0000","last_undegraded":"2024-05-14T01:23:36.247888+0000","last_fullsized":"2024-05-14T01:23:36.247888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:36.242325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985145+0000","last_change":"2024-05-14T01:23:34.261385+0000","last_active":"2024-05-14T01:23:36.985145+0000","last_peered":"2024-05-14T01:23:36.985145+0000","last_clean":"2024-05-14T01:23:36.985145+0000","last_became_active":"2024-05-14T01:23:34.260450+0000","last_became_peered":"2024-05-14T01:23:34.260450+0000","last_unstale":"2024-05-14T01:23:36.985145+0000","last_undegraded":"2024-05-14T01:23:36.985145+0000","last_fullsized":"2024-05-14T01:23:36.985145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:25:49.061428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247625+0000","last_change":"2024-05-14T01:23:35.301603+0000","last_active":"2024-05-14T01:23:36.247625+0000","last_peered":"2024-05-14T01:23:36.247625+0000","last_clean":"2024-05-14T01:23:36.247625+0000","last_became_active":"2024-05-14T01:23:35.301338+0000","last_became_peered":"2024-05-14T01:23:35.301338+0000","last_unstale":"2024-05-14T01:23:36.247625+0000","last_undegraded":"2024-05-14T01:23:36.247625+0000","last_fullsized":"2024-05-14T01:23:36.247625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:52:26.738482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985570+0000","last_change":"2024-05-14T01:23:34.260143+0000","last_active":"2024-05-14T01:23:36.985570+0000","last_peered":"2024-05-14T01:23:36.985570+0000","last_clean":"2024-05-14T01:23:36.985570+0000","last_became_active":"2024-05-14T01:23:34.259214+0000","last_became_peered":"2024-05-14T01:23:34.259214+0000","last_unstale":"2024-05-14T01:23:36.985570+0000","last_undegraded":"2024-05-14T01:23:36.985570+0000","last_fullsized":"2024-05-14T01:23:36.985570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:55:36.916881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089027+0000","last_change":"2024-05-14T01:23:35.301480+0000","last_active":"2024-05-14T01:23:38.089027+0000","last_peered":"2024-05-14T01:23:38.089027+0000","last_clean":"2024-05-14T01:23:38.089027+0000","last_became_active":"2024-05-14T01:23:35.301170+0000","last_became_peered":"2024-05-14T01:23:35.301170+0000","last_unstale":"2024-05-14T01:23:38.089027+0000","last_undegraded":"2024-05-14T01:23:38.089027+0000","last_fullsized":"2024-05-14T01:23:38.089027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:05:16.096171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.300982+0000","last_change":"2024-05-14T01:23:34.226086+0000","last_active":"2024-05-14T01:23:35.300982+0000","last_peered":"2024-05-14T01:23:35.300982+0000","last_clean":"2024-05-14T01:23:35.300982+0000","last_became_active":"2024-05-14T01:23:34.225826+0000","last_became_peered":"2024-05-14T01:23:34.225826+0000","last_unstale":"2024-05-14T01:23:35.300982+0000","last_undegraded":"2024-05-14T01:23:35.300982+0000","last_fullsized":"2024-05-14T01:23:35.300982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:50:36.678245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-14T01:23:35.275212+0000","last_change":"2024-05-14T01:23:35.266231+0000","last_active":"2024-05-14T01:23:35.275212+0000","last_peered":"2024-05-14T01:23:35.275212+0000","last_clean":"2024-05-14T01:23:35.275212+0000","last_became_active":"2024-05-14T01:23:35.265642+0000","last_became_peered":"2024-05-14T01:23:35.265642+0000","last_unstale":"2024-05-14T01:23:35.275212+0000","last_undegraded":"2024-05-14T01:23:35.275212+0000","last_fullsized":"2024-05-14T01:23:35.275212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:54:10.739366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089361+0000","last_change":"2024-05-14T01:23:34.252104+0000","last_active":"2024-05-14T01:23:38.089361+0000","last_peered":"2024-05-14T01:23:38.089361+0000","last_clean":"2024-05-14T01:23:38.089361+0000","last_became_active":"2024-05-14T01:23:34.251819+0000","last_became_peered":"2024-05-14T01:23:34.251819+0000","last_unstale":"2024-05-14T01:23:38.089361+0000","last_undegraded":"2024-05-14T01:23:38.089361+0000","last_fullsized":"2024-05-14T01:23:38.089361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:15:33.123443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":660311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T01:23:39.603 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-14T01:23:39.603 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-14T01:23:39.603 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-14T01:23:39.603 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-14T01:23:39.604 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-14T01:23:39.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.770+0000 7fe53f4ec640 1 Processor -- start 2024-05-14T01:23:39.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.770+0000 7fe53f4ec640 1 -- start start 2024-05-14T01:23:39.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe53f4ec640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5380cf520 0x7fe5380d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:39.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe53f4ec640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe53815e4e0 0x7fe5380b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:39.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe53f4ec640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5380d29f0 con 0x7fe53815e100 2024-05-14T01:23:39.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe53f4ec640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe5380d2cd0 con 0x7fe5380cf520 2024-05-14T01:23:39.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe53f4ec640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe5380d2fb0 con 0x7fe53815e4e0 2024-05-14T01:23:39.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe53ca87640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5380cf520 0x7fe5380d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:39.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe53ca87640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5380cf520 0x7fe5380d22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46166/0 (socket says 172.21.15.154:46166) 2024-05-14T01:23:39.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe53ca87640 1 -- 172.21.15.154:0/1825931818 learned_addr learned my addr 172.21.15.154:0/1825931818 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:39.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe53da89640 1 --2- 172.21.15.154:0/1825931818 >> v2:172.21.15.176:3300/0 conn(0x7fe53815e4e0 0x7fe5380b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:39.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe53ca87640 1 -- 172.21.15.154:0/1825931818 >> v2:172.21.15.176:3300/0 conn(0x7fe53815e4e0 msgr2=0x7fe5380b9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:39.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe53ca87640 1 --2- 172.21.15.154:0/1825931818 >> v2:172.21.15.176:3300/0 conn(0x7fe53815e4e0 0x7fe5380b9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe53ca87640 1 -- 172.21.15.154:0/1825931818 >> v1:172.21.15.176:6789/0 conn(0x7fe53815e100 legacy=0x7fe5380cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:39.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe53ca87640 1 -- 172.21.15.154:0/1825931818 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5380d3290 con 0x7fe5380cf520 2024-05-14T01:23:39.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe53da89640 1 --2- 172.21.15.154:0/1825931818 >> v2:172.21.15.176:3300/0 conn(0x7fe53815e4e0 0x7fe5380b9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:39.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe53ca87640 1 --2- 172.21.15.154:0/1825931818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5380cf520 0x7fe5380d22f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe538161d60 tx=0x7fe52801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aeecd69dc26f8b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:39.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe52ffff640 1 -- 172.21.15.154:0/1825931818 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5280b5070 con 0x7fe5380cf520 2024-05-14T01:23:39.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe52ffff640 1 -- 172.21.15.154:0/1825931818 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5280a89d0 con 0x7fe5380cf520 2024-05-14T01:23:39.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe52ffff640 1 -- 172.21.15.154:0/1825931818 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5280a8da0 con 0x7fe5380cf520 2024-05-14T01:23:39.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe53f4ec640 1 -- 172.21.15.154:0/1825931818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5380cf520 msgr2=0x7fe5380d22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:39.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.774+0000 7fe53f4ec640 1 --2- 172.21.15.154:0/1825931818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5380cf520 0x7fe5380d22f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe538161d60 tx=0x7fe52801ecd0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53f4ec640 1 -- 172.21.15.154:0/1825931818 shutdown_connections 2024-05-14T01:23:39.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53f4ec640 1 --2- 172.21.15.154:0/1825931818 >> v2:172.21.15.176:3300/0 conn(0x7fe53815e4e0 0x7fe5380b9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53f4ec640 1 --2- 172.21.15.154:0/1825931818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5380cf520 0x7fe5380d22f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53f4ec640 1 -- 172.21.15.154:0/1825931818 >> 172.21.15.154:0/1825931818 conn(0x7fe5380b5b50 msgr2=0x7fe5380b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:39.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53f4ec640 1 -- 172.21.15.154:0/1825931818 shutdown_connections 2024-05-14T01:23:39.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53f4ec640 1 -- 172.21.15.154:0/1825931818 wait complete. 2024-05-14T01:23:39.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53f4ec640 1 Processor -- start 2024-05-14T01:23:39.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53f4ec640 1 -- start start 2024-05-14T01:23:39.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53f4ec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5380cf520 0x7fe538153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:39.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53f4ec640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe53815e100 0x7fe53815e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53f4ec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe53815e4e0 0x7fe53815abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53f4ec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe5380d3c10 con 0x7fe53815e4e0 2024-05-14T01:23:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53f4ec640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe5380d3a90 con 0x7fe53815e100 2024-05-14T01:23:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53f4ec640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe53815fe30 con 0x7fe5380cf520 2024-05-14T01:23:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53da89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe53815e4e0 0x7fe53815abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53da89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe53815e4e0 0x7fe53815abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46180/0 (socket says 172.21.15.154:46180) 2024-05-14T01:23:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53da89640 1 -- 172.21.15.154:0/2340756213 learned_addr learned my addr 172.21.15.154:0/2340756213 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53da89640 1 -- 172.21.15.154:0/2340756213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5380cf520 msgr2=0x7fe538153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53da89640 1 --2- 172.21.15.154:0/2340756213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5380cf520 0x7fe538153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53da89640 1 -- 172.21.15.154:0/2340756213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe53815e100 msgr2=0x7fe53815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53da89640 1 --2- 172.21.15.154:0/2340756213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe53815e100 0x7fe53815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53da89640 1 -- 172.21.15.154:0/2340756213 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53815f220 con 0x7fe53815e4e0 2024-05-14T01:23:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53da89640 1 --2- 172.21.15.154:0/2340756213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe53815e4e0 0x7fe53815abb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe53000cdb0 tx=0x7fe53000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:39.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe52dffb640 1 -- 172.21.15.154:0/2340756213 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe530003ba0 con 0x7fe53815e4e0 2024-05-14T01:23:39.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe52dffb640 1 -- 172.21.15.154:0/2340756213 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe530003d60 con 0x7fe53815e4e0 2024-05-14T01:23:39.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53f4ec640 1 -- 172.21.15.154:0/2340756213 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe53815f500 con 0x7fe53815e4e0 2024-05-14T01:23:39.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe52dffb640 1 -- 172.21.15.154:0/2340756213 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe530004260 con 0x7fe53815e4e0 2024-05-14T01:23:39.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53f4ec640 1 -- 172.21.15.154:0/2340756213 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe53815fac0 con 0x7fe53815e4e0 2024-05-14T01:23:39.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.778+0000 7fe53f4ec640 1 -- 172.21.15.154:0/2340756213 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe538075470 con 0x7fe53815e4e0 2024-05-14T01:23:39.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.782+0000 7fe52dffb640 1 -- 172.21.15.154:0/2340756213 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe530004400 con 0x7fe53815e4e0 2024-05-14T01:23:39.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.782+0000 7fe52dffb640 1 --2- 172.21.15.154:0/2340756213 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe51c0678c0 0x7fe51c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:39.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.782+0000 7fe52dffb640 1 -- 172.21.15.154:0/2340756213 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe530086750 con 0x7fe53815e4e0 2024-05-14T01:23:39.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.782+0000 7fe53d288640 1 --2- 172.21.15.154:0/2340756213 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe51c0678c0 0x7fe51c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:39.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.782+0000 7fe53d288640 1 --2- 172.21.15.154:0/2340756213 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe51c0678c0 0x7fe51c069d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe534003cf0 tx=0x7fe5340079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.786+0000 7fe52dffb640 1 -- 172.21.15.154:0/2340756213 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fe530014030 con 0x7fe53815e4e0 2024-05-14T01:23:39.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.970+0000 7fe53f4ec640 1 -- 172.21.15.154:0/2340756213 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe5380b8dc0 con 0x7fe53815e4e0 2024-05-14T01:23:39.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.974+0000 7fe52dffb640 1 -- 172.21.15.154:0/2340756213 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166894 (secure 0 0 0) 0x7fe530057290 con 0x7fe53815e4e0 2024-05-14T01:23:39.960 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:39.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.978+0000 7fe53f4ec640 1 -- 172.21.15.154:0/2340756213 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe51c0678c0 msgr2=0x7fe51c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:39.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.978+0000 7fe53f4ec640 1 --2- 172.21.15.154:0/2340756213 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe51c0678c0 0x7fe51c069d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe534003cf0 tx=0x7fe5340079c0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.978+0000 7fe53f4ec640 1 -- 172.21.15.154:0/2340756213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe53815e4e0 msgr2=0x7fe53815abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:39.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.978+0000 7fe53f4ec640 1 --2- 172.21.15.154:0/2340756213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe53815e4e0 0x7fe53815abb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe53000cdb0 tx=0x7fe53000a650 comp rx=0 tx=0).stop 2024-05-14T01:23:39.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.978+0000 7fe53f4ec640 1 -- 172.21.15.154:0/2340756213 shutdown_connections 2024-05-14T01:23:39.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.978+0000 7fe53f4ec640 1 --2- 172.21.15.154:0/2340756213 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe51c0678c0 0x7fe51c069d80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.978+0000 7fe53f4ec640 1 --2- 172.21.15.154:0/2340756213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe53815e4e0 0x7fe53815abb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.978+0000 7fe53f4ec640 1 --2- 172.21.15.154:0/2340756213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe53815e100 0x7fe53815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.978+0000 7fe53f4ec640 1 --2- 172.21.15.154:0/2340756213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5380cf520 0x7fe538153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:39.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.978+0000 7fe53f4ec640 1 -- 172.21.15.154:0/2340756213 >> 172.21.15.154:0/2340756213 conn(0x7fe5380b5b50 msgr2=0x7fe5380d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:39.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.978+0000 7fe53f4ec640 1 -- 172.21.15.154:0/2340756213 shutdown_connections 2024-05-14T01:23:39.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:39.978+0000 7fe53f4ec640 1 -- 172.21.15.154:0/2340756213 wait complete. 2024-05-14T01:23:39.977 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2359224792},{"type":"v1","addr":"172.21.15.154:6833","nonce":2359224792}]},"active_addr":"172.21.15.154:6833/2359224792","active_change":"2024-05-14T01:23:15.088207+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":3910825565}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":1090112262}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":2656257928}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":3233012332}]}]} 2024-05-14T01:23:39.980 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-14T01:23:39.980 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-14T01:23:39.981 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:23:40.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.114+0000 7f4eb8c6f640 1 Processor -- start 2024-05-14T01:23:40.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.114+0000 7f4eb8c6f640 1 -- start start 2024-05-14T01:23:40.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4eb8c6f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eb415bf70 0x7f4eb40b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4eb8c6f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4eb40b5070 0x7f4eb4074280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4eb8c6f640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eb406cb70 con 0x7f4eb40747c0 2024-05-14T01:23:40.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4eb8c6f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4eb4074c30 con 0x7f4eb40b5070 2024-05-14T01:23:40.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4eb8c6f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb40b56f0 con 0x7f4eb415bf70 2024-05-14T01:23:40.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4ea9d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4eb40b5070 0x7f4eb4074280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4ea9d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4eb40b5070 0x7f4eb4074280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46186/0 (socket says 172.21.15.154:46186) 2024-05-14T01:23:40.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4ea9d9b640 1 -- 172.21.15.154:0/4140637959 learned_addr learned my addr 172.21.15.154:0/4140637959 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:40.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4eb259c640 1 --2- 172.21.15.154:0/4140637959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eb415bf70 0x7f4eb40b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4ea9d9b640 1 -- 172.21.15.154:0/4140637959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eb415bf70 msgr2=0x7f4eb40b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:40.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4ea9d9b640 1 --2- 172.21.15.154:0/4140637959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eb415bf70 0x7f4eb40b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4ea9d9b640 1 -- 172.21.15.154:0/4140637959 >> v1:172.21.15.176:6789/0 conn(0x7f4eb40747c0 legacy=0x7f4eb4072000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4ea9d9b640 1 -- 172.21.15.154:0/4140637959 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb40b59d0 con 0x7f4eb40b5070 2024-05-14T01:23:40.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4ea9d9b640 1 --2- 172.21.15.154:0/4140637959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb40b5070 0x7f4eb4074280 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009870 tx=0x7f4e9c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3706a00fcbd3305e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4eb1d9b640 1 -- 172.21.15.154:0/4140637959 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0b0070 con 0x7f4eb40b5070 2024-05-14T01:23:40.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4eb1d9b640 1 -- 172.21.15.154:0/4140637959 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e9c0ab600 con 0x7f4eb40b5070 2024-05-14T01:23:40.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4eb1d9b640 1 -- 172.21.15.154:0/4140637959 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0ab9d0 con 0x7f4eb40b5070 2024-05-14T01:23:40.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4eb8c6f640 1 -- 172.21.15.154:0/4140637959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb40b5070 msgr2=0x7f4eb4074280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4eb8c6f640 1 --2- 172.21.15.154:0/4140637959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb40b5070 0x7f4eb4074280 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009870 tx=0x7f4e9c01c560 comp rx=0 tx=0).stop 2024-05-14T01:23:40.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4eb8c6f640 1 -- 172.21.15.154:0/4140637959 shutdown_connections 2024-05-14T01:23:40.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4eb8c6f640 1 --2- 172.21.15.154:0/4140637959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb40b5070 0x7f4eb4074280 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4eb8c6f640 1 --2- 172.21.15.154:0/4140637959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eb415bf70 0x7f4eb40b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4eb8c6f640 1 -- 172.21.15.154:0/4140637959 >> 172.21.15.154:0/4140637959 conn(0x7f4eb40d0d00 msgr2=0x7f4eb40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4eb8c6f640 1 -- 172.21.15.154:0/4140637959 shutdown_connections 2024-05-14T01:23:40.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.118+0000 7f4eb8c6f640 1 -- 172.21.15.154:0/4140637959 wait complete. 2024-05-14T01:23:40.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4eb8c6f640 1 Processor -- start 2024-05-14T01:23:40.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4eb8c6f640 1 -- start start 2024-05-14T01:23:40.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4eb8c6f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eb40747c0 0x7f4eb40cf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4eb8c6f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb40b5070 0x7f4eb41f5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4eb8c6f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eb415bf70 0x7f4eb415f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4eb8c6f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb415fea0 con 0x7f4eb40b5070 2024-05-14T01:23:40.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4eb8c6f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb415fd20 con 0x7f4eb40747c0 2024-05-14T01:23:40.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4eb8c6f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb415c350 con 0x7f4eb415bf70 2024-05-14T01:23:40.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4ea9d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb40b5070 0x7f4eb41f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4ea9d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb40b5070 0x7f4eb41f5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46188/0 (socket says 172.21.15.154:46188) 2024-05-14T01:23:40.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4ea9d9b640 1 -- 172.21.15.154:0/2320911200 learned_addr learned my addr 172.21.15.154:0/2320911200 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:40.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4ea9d9b640 1 -- 172.21.15.154:0/2320911200 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eb415bf70 msgr2=0x7f4eb415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4eb2d9d640 1 --2- 172.21.15.154:0/2320911200 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eb415bf70 0x7f4eb415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4eb259c640 1 --2- 172.21.15.154:0/2320911200 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eb40747c0 0x7f4eb40cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4ea9d9b640 1 --2- 172.21.15.154:0/2320911200 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eb415bf70 0x7f4eb415f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4ea9d9b640 1 -- 172.21.15.154:0/2320911200 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eb40747c0 msgr2=0x7f4eb40cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4ea9d9b640 1 --2- 172.21.15.154:0/2320911200 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eb40747c0 0x7f4eb40cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4ea9d9b640 1 -- 172.21.15.154:0/2320911200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb4154180 con 0x7f4eb40b5070 2024-05-14T01:23:40.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4ea9d9b640 1 --2- 172.21.15.154:0/2320911200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb40b5070 0x7f4eb41f5100 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0ae040 tx=0x7f4e9c019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4eab7fe640 1 -- 172.21.15.154:0/2320911200 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0b0040 con 0x7f4eb40b5070 2024-05-14T01:23:40.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4eab7fe640 1 -- 172.21.15.154:0/2320911200 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e9c0b9070 con 0x7f4eb40b5070 2024-05-14T01:23:40.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4eab7fe640 1 -- 172.21.15.154:0/2320911200 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0b4660 con 0x7f4eb40b5070 2024-05-14T01:23:40.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4eb8c6f640 1 -- 172.21.15.154:0/2320911200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb4154740 con 0x7f4eb40b5070 2024-05-14T01:23:40.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4eb8c6f640 1 -- 172.21.15.154:0/2320911200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb4154d00 con 0x7f4eb40b5070 2024-05-14T01:23:40.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.122+0000 7f4eb8c6f640 1 -- 172.21.15.154:0/2320911200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb4068360 con 0x7f4eb40b5070 2024-05-14T01:23:40.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.126+0000 7f4eab7fe640 1 -- 172.21.15.154:0/2320911200 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4e9c0b4800 con 0x7f4eb40b5070 2024-05-14T01:23:40.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.126+0000 7f4eab7fe640 1 --2- 172.21.15.154:0/2320911200 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4e940678c0 0x7f4e94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.126+0000 7f4eab7fe640 1 -- 172.21.15.154:0/2320911200 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4e9c120420 con 0x7f4eb40b5070 2024-05-14T01:23:40.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.126+0000 7f4eb259c640 1 --2- 172.21.15.154:0/2320911200 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4e940678c0 0x7f4e94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.126+0000 7f4eb259c640 1 --2- 172.21.15.154:0/2320911200 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4e940678c0 0x7f4e94069d80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40096f0 tx=0x7f4ea4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.130+0000 7f4eab7fe640 1 -- 172.21.15.154:0/2320911200 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f4e9c016150 con 0x7f4eb40b5070 2024-05-14T01:23:40.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.290+0000 7f4eb8c6f640 1 -- 172.21.15.154:0/2320911200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4eb406b280 con 0x7f4eb40b5070 2024-05-14T01:23:40.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.290+0000 7f4eab7fe640 1 -- 172.21.15.154:0/2320911200 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f4e9c0f1040 con 0x7f4eb40b5070 2024-05-14T01:23:40.274 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:40.274 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:36.232271+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:23:40.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.290+0000 7f4eb8c6f640 1 -- 172.21.15.154:0/2320911200 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4e940678c0 msgr2=0x7f4e94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.290+0000 7f4eb8c6f640 1 --2- 172.21.15.154:0/2320911200 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4e940678c0 0x7f4e94069d80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40096f0 tx=0x7f4ea4008040 comp rx=0 tx=0).stop 2024-05-14T01:23:40.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.290+0000 7f4eb8c6f640 1 -- 172.21.15.154:0/2320911200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb40b5070 msgr2=0x7f4eb41f5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.290+0000 7f4eb8c6f640 1 --2- 172.21.15.154:0/2320911200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb40b5070 0x7f4eb41f5100 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0ae040 tx=0x7f4e9c019300 comp rx=0 tx=0).stop 2024-05-14T01:23:40.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.290+0000 7f4eb8c6f640 1 -- 172.21.15.154:0/2320911200 shutdown_connections 2024-05-14T01:23:40.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.290+0000 7f4eb8c6f640 1 --2- 172.21.15.154:0/2320911200 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4e940678c0 0x7f4e94069d80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.290+0000 7f4eb8c6f640 1 --2- 172.21.15.154:0/2320911200 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eb415bf70 0x7f4eb415f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.290+0000 7f4eb8c6f640 1 --2- 172.21.15.154:0/2320911200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb40b5070 0x7f4eb41f5100 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.290+0000 7f4eb8c6f640 1 --2- 172.21.15.154:0/2320911200 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eb40747c0 0x7f4eb40cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.290+0000 7f4eb8c6f640 1 -- 172.21.15.154:0/2320911200 >> 172.21.15.154:0/2320911200 conn(0x7f4eb40d0d00 msgr2=0x7f4eb4152f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.290+0000 7f4eb8c6f640 1 -- 172.21.15.154:0/2320911200 shutdown_connections 2024-05-14T01:23:40.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.290+0000 7f4eb8c6f640 1 -- 172.21.15.154:0/2320911200 wait complete. 2024-05-14T01:23:40.293 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-14T01:23:40.293 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:23:40.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.418+0000 7f735a4cc640 1 Processor -- start 2024-05-14T01:23:40.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.418+0000 7f735a4cc640 1 -- start start 2024-05-14T01:23:40.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f735a4cc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7354070e60 0x7f73540b3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f735a4cc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73540b4820 0x7f735406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f735a4cc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7354071240 0x7f73540716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f735a4cc640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f73540b2d60 con 0x7f7354070e60 2024-05-14T01:23:40.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f735a4cc640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f73540ae1b0 con 0x7f7354071240 2024-05-14T01:23:40.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f735a4cc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f73540b3e40 con 0x7f73540b4820 2024-05-14T01:23:40.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f7353fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7354070e60 0x7f73540b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f7353fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7354070e60 0x7f73540b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46202/0 (socket says 172.21.15.154:46202) 2024-05-14T01:23:40.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f7353fff640 1 -- 172.21.15.154:0/1163857644 learned_addr learned my addr 172.21.15.154:0/1163857644 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:40.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f73537fe640 1 --2- 172.21.15.154:0/1163857644 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73540b4820 0x7f735406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f7358a69640 1 --2- 172.21.15.154:0/1163857644 >> v2:172.21.15.176:3300/0 conn(0x7f7354071240 0x7f73540716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f7353fff640 1 -- 172.21.15.154:0/1163857644 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73540b4820 msgr2=0x7f735406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:40.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f7353fff640 1 --2- 172.21.15.154:0/1163857644 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73540b4820 0x7f735406d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f7353fff640 1 -- 172.21.15.154:0/1163857644 >> v2:172.21.15.176:3300/0 conn(0x7f7354071240 msgr2=0x7f73540716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:40.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f7353fff640 1 --2- 172.21.15.154:0/1163857644 >> v2:172.21.15.176:3300/0 conn(0x7f7354071240 0x7f73540716d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f7353fff640 1 -- 172.21.15.154:0/1163857644 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73540b4110 con 0x7f7354070e60 2024-05-14T01:23:40.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f7353fff640 1 --2- 172.21.15.154:0/1163857644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7354070e60 0x7f73540b3900 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f73540b2be0 tx=0x7f734401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3e3c20cec45c3d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f7352ffd640 1 -- 172.21.15.154:0/1163857644 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73440b5070 con 0x7f7354070e60 2024-05-14T01:23:40.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f7352ffd640 1 -- 172.21.15.154:0/1163857644 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73440a89d0 con 0x7f7354070e60 2024-05-14T01:23:40.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f7352ffd640 1 -- 172.21.15.154:0/1163857644 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73440a8da0 con 0x7f7354070e60 2024-05-14T01:23:40.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f735a4cc640 1 -- 172.21.15.154:0/1163857644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7354070e60 msgr2=0x7f73540b3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f735a4cc640 1 --2- 172.21.15.154:0/1163857644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7354070e60 0x7f73540b3900 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f73540b2be0 tx=0x7f734401ed10 comp rx=0 tx=0).stop 2024-05-14T01:23:40.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.422+0000 7f735a4cc640 1 -- 172.21.15.154:0/1163857644 shutdown_connections 2024-05-14T01:23:40.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f735a4cc640 1 --2- 172.21.15.154:0/1163857644 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73540b4820 0x7f735406d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f735a4cc640 1 --2- 172.21.15.154:0/1163857644 >> v2:172.21.15.176:3300/0 conn(0x7f7354071240 0x7f73540716d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f735a4cc640 1 --2- 172.21.15.154:0/1163857644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7354070e60 0x7f73540b3900 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f735a4cc640 1 -- 172.21.15.154:0/1163857644 >> 172.21.15.154:0/1163857644 conn(0x7f73540b1850 msgr2=0x7f73540b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f735a4cc640 1 -- 172.21.15.154:0/1163857644 shutdown_connections 2024-05-14T01:23:40.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f735a4cc640 1 -- 172.21.15.154:0/1163857644 wait complete. 2024-05-14T01:23:40.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f735a4cc640 1 Processor -- start 2024-05-14T01:23:40.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f735a4cc640 1 -- start start 2024-05-14T01:23:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f735a4cc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7354070e60 0x7f7354147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f735a4cc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7354071240 0x7f7354148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f735a4cc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73540b4820 0x7f735415cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f735a4cc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f73540ade40 con 0x7f7354071240 2024-05-14T01:23:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f735a4cc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f73540adb60 con 0x7f7354070e60 2024-05-14T01:23:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f735a4cc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f735406d6b0 con 0x7f73540b4820 2024-05-14T01:23:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f73537fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7354071240 0x7f7354148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f73537fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7354071240 0x7f7354148410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46210/0 (socket says 172.21.15.154:46210) 2024-05-14T01:23:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f73537fe640 1 -- 172.21.15.154:0/1133268059 learned_addr learned my addr 172.21.15.154:0/1133268059 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f7353fff640 1 --2- 172.21.15.154:0/1133268059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7354070e60 0x7f7354147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f7358a69640 1 --2- 172.21.15.154:0/1133268059 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73540b4820 0x7f735415cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f73537fe640 1 -- 172.21.15.154:0/1133268059 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73540b4820 msgr2=0x7f735415cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f73537fe640 1 --2- 172.21.15.154:0/1133268059 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73540b4820 0x7f735415cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f73537fe640 1 -- 172.21.15.154:0/1133268059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7354070e60 msgr2=0x7f7354147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f73537fe640 1 --2- 172.21.15.154:0/1133268059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7354070e60 0x7f7354147dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f73537fe640 1 -- 172.21.15.154:0/1133268059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73540cd250 con 0x7f7354071240 2024-05-14T01:23:40.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f7353fff640 1 --2- 172.21.15.154:0/1133268059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7354070e60 0x7f7354147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:40.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f73537fe640 1 --2- 172.21.15.154:0/1133268059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7354071240 0x7f7354148410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f734800d5f0 tx=0x7f734800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f7350ff9640 1 -- 172.21.15.154:0/1133268059 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73480125f0 con 0x7f7354071240 2024-05-14T01:23:40.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f7350ff9640 1 -- 172.21.15.154:0/1133268059 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7348019070 con 0x7f7354071240 2024-05-14T01:23:40.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f735a4cc640 1 -- 172.21.15.154:0/1133268059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73540cd530 con 0x7f7354071240 2024-05-14T01:23:40.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f7350ff9640 1 -- 172.21.15.154:0/1133268059 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73480129b0 con 0x7f7354071240 2024-05-14T01:23:40.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f735a4cc640 1 -- 172.21.15.154:0/1133268059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73540cdaf0 con 0x7f7354071240 2024-05-14T01:23:40.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.426+0000 7f735a4cc640 1 -- 172.21.15.154:0/1133268059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7354075470 con 0x7f7354071240 2024-05-14T01:23:40.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.430+0000 7f7350ff9640 1 -- 172.21.15.154:0/1133268059 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7348012b50 con 0x7f7354071240 2024-05-14T01:23:40.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.430+0000 7f7350ff9640 1 --2- 172.21.15.154:0/1133268059 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f73400678c0 0x7f7340069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.430+0000 7f7350ff9640 1 -- 172.21.15.154:0/1133268059 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7348086ad0 con 0x7f7354071240 2024-05-14T01:23:40.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.430+0000 7f7353fff640 1 --2- 172.21.15.154:0/1133268059 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f73400678c0 0x7f7340069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.430+0000 7f7353fff640 1 --2- 172.21.15.154:0/1133268059 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f73400678c0 0x7f7340069d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f73440b2000 tx=0x7f7344008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.434+0000 7f7350ff9640 1 -- 172.21.15.154:0/1133268059 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f7348057680 con 0x7f7354071240 2024-05-14T01:23:40.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.594+0000 7f735a4cc640 1 -- 172.21.15.154:0/1133268059 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7354161080 con 0x7f7354071240 2024-05-14T01:23:40.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.594+0000 7f7350ff9640 1 -- 172.21.15.154:0/1133268059 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f7348056f80 con 0x7f7354071240 2024-05-14T01:23:40.580 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:40.580 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:36.232271+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:23:40.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.598+0000 7f735a4cc640 1 -- 172.21.15.154:0/1133268059 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f73400678c0 msgr2=0x7f7340069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.598+0000 7f735a4cc640 1 --2- 172.21.15.154:0/1133268059 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f73400678c0 0x7f7340069d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f73440b2000 tx=0x7f7344008040 comp rx=0 tx=0).stop 2024-05-14T01:23:40.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.598+0000 7f735a4cc640 1 -- 172.21.15.154:0/1133268059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7354071240 msgr2=0x7f7354148410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.598+0000 7f735a4cc640 1 --2- 172.21.15.154:0/1133268059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7354071240 0x7f7354148410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f734800d5f0 tx=0x7f734800dab0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.598+0000 7f735a4cc640 1 -- 172.21.15.154:0/1133268059 shutdown_connections 2024-05-14T01:23:40.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.598+0000 7f735a4cc640 1 --2- 172.21.15.154:0/1133268059 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f73400678c0 0x7f7340069d80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.598+0000 7f735a4cc640 1 --2- 172.21.15.154:0/1133268059 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73540b4820 0x7f735415cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.598+0000 7f735a4cc640 1 --2- 172.21.15.154:0/1133268059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7354071240 0x7f7354148410 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.598+0000 7f735a4cc640 1 --2- 172.21.15.154:0/1133268059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7354070e60 0x7f7354147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.598+0000 7f735a4cc640 1 -- 172.21.15.154:0/1133268059 >> 172.21.15.154:0/1133268059 conn(0x7f73540b1850 msgr2=0x7f73540cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.598+0000 7f735a4cc640 1 -- 172.21.15.154:0/1133268059 shutdown_connections 2024-05-14T01:23:40.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.598+0000 7f735a4cc640 1 -- 172.21.15.154:0/1133268059 wait complete. 2024-05-14T01:23:40.599 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-14T01:23:40.600 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-14T01:23:40.600 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-14T01:23:40.601 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-14T01:23:40.601 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-14T01:23:40.601 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-14T01:23:40.602 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-14T01:23:40.602 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-14T01:23:40.622 INFO:tasks.ceph.mds.b.smithi176.stderr:2024-05-14T01:23:40.639+0000 7f9be0e25640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-14T01:23:40.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.762+0000 7efd32fa2640 1 Processor -- start 2024-05-14T01:23:40.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.762+0000 7efd32fa2640 1 -- start start 2024-05-14T01:23:40.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.766+0000 7efd32fa2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c15ae10 0x7efd2c15b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.766+0000 7efd32fa2640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efd2c06ded0 0x7efd2c06e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.766+0000 7efd32fa2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd2c13dee0 con 0x7efd2c13ce00 2024-05-14T01:23:40.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.766+0000 7efd32fa2640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7efd2c06ce30 con 0x7efd2c06ded0 2024-05-14T01:23:40.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.766+0000 7efd32fa2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efd2c06d110 con 0x7efd2c15ae10 2024-05-14T01:23:40.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.766+0000 7efd30d3e640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7efd2c13ce00 0x7efd2c13d670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57198/0 (socket says 172.21.15.154:57198) 2024-05-14T01:23:40.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.766+0000 7efd30d3e640 1 -- 172.21.15.154:0/673182053 learned_addr learned my addr 172.21.15.154:0/673182053 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:40.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.766+0000 7efd3153f640 1 --2- 172.21.15.154:0/673182053 >> v2:172.21.15.176:3300/0 conn(0x7efd2c06ded0 0x7efd2c06e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.766+0000 7efd2b7fe640 1 -- 172.21.15.154:0/673182053 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2179785103 0 0) 0x7efd2c13dee0 con 0x7efd2c13ce00 2024-05-14T01:23:40.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.766+0000 7efd2bfff640 1 --2- 172.21.15.154:0/673182053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c15ae10 0x7efd2c15b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.766+0000 7efd2b7fe640 1 -- 172.21.15.154:0/673182053 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd14003530 con 0x7efd2c13ce00 2024-05-14T01:23:40.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.766+0000 7efd3153f640 1 -- 172.21.15.154:0/673182053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c15ae10 msgr2=0x7efd2c15b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:40.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.766+0000 7efd3153f640 1 --2- 172.21.15.154:0/673182053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c15ae10 0x7efd2c15b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.766+0000 7efd3153f640 1 -- 172.21.15.154:0/673182053 >> v1:172.21.15.154:6789/0 conn(0x7efd2c13ce00 legacy=0x7efd2c13d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.766+0000 7efd3153f640 1 -- 172.21.15.154:0/673182053 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c06d3f0 con 0x7efd2c06ded0 2024-05-14T01:23:40.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.770+0000 7efd3153f640 1 --2- 172.21.15.154:0/673182053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd2c06ded0 0x7efd2c06e360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0097c0 tx=0x7efd1c01e6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f85260c36f57d3dd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.770+0000 7efd2b7fe640 1 -- 172.21.15.154:0/673182053 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0ae070 con 0x7efd2c06ded0 2024-05-14T01:23:40.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.770+0000 7efd2b7fe640 1 -- 172.21.15.154:0/673182053 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c0a8660 con 0x7efd2c06ded0 2024-05-14T01:23:40.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.770+0000 7efd2b7fe640 1 -- 172.21.15.154:0/673182053 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0a8a10 con 0x7efd2c06ded0 2024-05-14T01:23:40.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.770+0000 7efd32fa2640 1 -- 172.21.15.154:0/673182053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd2c06ded0 msgr2=0x7efd2c06e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.770+0000 7efd32fa2640 1 --2- 172.21.15.154:0/673182053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd2c06ded0 0x7efd2c06e360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0097c0 tx=0x7efd1c01e6d0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.770+0000 7efd32fa2640 1 -- 172.21.15.154:0/673182053 shutdown_connections 2024-05-14T01:23:40.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.770+0000 7efd32fa2640 1 --2- 172.21.15.154:0/673182053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd2c06ded0 0x7efd2c06e360 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.770+0000 7efd32fa2640 1 --2- 172.21.15.154:0/673182053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c15ae10 0x7efd2c15b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.770+0000 7efd32fa2640 1 -- 172.21.15.154:0/673182053 >> 172.21.15.154:0/673182053 conn(0x7efd2c0b1670 msgr2=0x7efd2c0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.770+0000 7efd32fa2640 1 -- 172.21.15.154:0/673182053 shutdown_connections 2024-05-14T01:23:40.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.770+0000 7efd32fa2640 1 -- 172.21.15.154:0/673182053 wait complete. 2024-05-14T01:23:40.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd32fa2640 1 Processor -- start 2024-05-14T01:23:40.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd32fa2640 1 -- start start 2024-05-14T01:23:40.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd32fa2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd2c06ded0 0x7efd2c13c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd32fa2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd2c13ce00 0x7efd2c138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd32fa2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c15ae10 0x7efd2c150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd32fa2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c15e9a0 con 0x7efd2c13ce00 2024-05-14T01:23:40.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd32fa2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c13d3f0 con 0x7efd2c06ded0 2024-05-14T01:23:40.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd32fa2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efd2c15eb20 con 0x7efd2c15ae10 2024-05-14T01:23:40.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd2bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd2c13ce00 0x7efd2c138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd2bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd2c13ce00 0x7efd2c138ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46226/0 (socket says 172.21.15.154:46226) 2024-05-14T01:23:40.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd2bfff640 1 -- 172.21.15.154:0/2641640574 learned_addr learned my addr 172.21.15.154:0/2641640574 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:40.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd30d3e640 1 --2- 172.21.15.154:0/2641640574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd2c06ded0 0x7efd2c13c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd3153f640 1 --2- 172.21.15.154:0/2641640574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c15ae10 0x7efd2c150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd2bfff640 1 -- 172.21.15.154:0/2641640574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c15ae10 msgr2=0x7efd2c150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd2bfff640 1 --2- 172.21.15.154:0/2641640574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c15ae10 0x7efd2c150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd2bfff640 1 -- 172.21.15.154:0/2641640574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd2c06ded0 msgr2=0x7efd2c13c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd2bfff640 1 --2- 172.21.15.154:0/2641640574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd2c06ded0 0x7efd2c13c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd2bfff640 1 -- 172.21.15.154:0/2641640574 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c137a10 con 0x7efd2c13ce00 2024-05-14T01:23:40.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd3153f640 1 --2- 172.21.15.154:0/2641640574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c15ae10 0x7efd2c150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:23:40.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.774+0000 7efd2bfff640 1 --2- 172.21.15.154:0/2641640574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd2c13ce00 0x7efd2c138ab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efd2000e930 tx=0x7efd2000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.782+0000 7efd297fa640 1 -- 172.21.15.154:0/2641640574 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd20017070 con 0x7efd2c13ce00 2024-05-14T01:23:40.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.782+0000 7efd297fa640 1 -- 172.21.15.154:0/2641640574 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd2000ca00 con 0x7efd2c13ce00 2024-05-14T01:23:40.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.782+0000 7efd32fa2640 1 -- 172.21.15.154:0/2641640574 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2c137cf0 con 0x7efd2c13ce00 2024-05-14T01:23:40.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.782+0000 7efd297fa640 1 -- 172.21.15.154:0/2641640574 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2000cdb0 con 0x7efd2c13ce00 2024-05-14T01:23:40.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.782+0000 7efd297fa640 1 -- 172.21.15.154:0/2641640574 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efd2001a070 con 0x7efd2c13ce00 2024-05-14T01:23:40.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.782+0000 7efd32fa2640 1 -- 172.21.15.154:0/2641640574 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd2c1382b0 con 0x7efd2c13ce00 2024-05-14T01:23:40.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.782+0000 7efd297fa640 1 --2- 172.21.15.154:0/2641640574 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7efd18067910 0x7efd18069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.782+0000 7efd297fa640 1 -- 172.21.15.154:0/2641640574 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efd2008a060 con 0x7efd2c13ce00 2024-05-14T01:23:40.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.782+0000 7efd30d3e640 1 --2- 172.21.15.154:0/2641640574 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7efd18067910 0x7efd18069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.786+0000 7efd32fa2640 1 --2- 172.21.15.154:0/2641640574 >> [v2:172.21.15.176:6824/4163648494,v1:172.21.15.176:6825/4163648494] conn(0x7efd2c1384b0 0x7efd2c133f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.786+0000 7efd32fa2640 1 -- 172.21.15.154:0/2641640574 --> [v2:172.21.15.176:6824/4163648494,v1:172.21.15.176:6825/4163648494] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd2c069310 con 0x7efd2c1384b0 2024-05-14T01:23:40.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.786+0000 7efd30d3e640 1 --2- 172.21.15.154:0/2641640574 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7efd18067910 0x7efd18069dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efd240012f0 tx=0x7efd24006110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.786+0000 7efd3153f640 1 --2- 172.21.15.154:0/2641640574 >> [v2:172.21.15.176:6824/4163648494,v1:172.21.15.176:6825/4163648494] conn(0x7efd2c1384b0 0x7efd2c133f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.786+0000 7efd3153f640 1 --2- 172.21.15.154:0/2641640574 >> [v2:172.21.15.176:6824/4163648494,v1:172.21.15.176:6825/4163648494] conn(0x7efd2c1384b0 0x7efd2c133f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.786+0000 7efd297fa640 1 -- 172.21.15.154:0/2641640574 <== osd.5 v2:172.21.15.176:6824/4163648494 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd2c069310 con 0x7efd2c1384b0 2024-05-14T01:23:40.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.794+0000 7fe7ba3b0640 1 Processor -- start 2024-05-14T01:23:40.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.794+0000 7fe7ba3b0640 1 -- start start 2024-05-14T01:23:40.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.794+0000 7fe7ba3b0640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe7ac037510 0x7fe7ac0380e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.794+0000 7fe7ba3b0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe7ac054950 0x7fe7ac049d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.794+0000 7fe7ba3b0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7ac007bd0 con 0x7fe7ac054db0 2024-05-14T01:23:40.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.794+0000 7fe7ba3b0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe7ac0e7c60 con 0x7fe7ac054950 2024-05-14T01:23:40.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.794+0000 7fe7ba3b0640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe7ac0522f0 con 0x7fe7ac037510 2024-05-14T01:23:40.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.794+0000 7fe7b93ae640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe7ac037510 0x7fe7ac0380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.794+0000 7fe7b93ae640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe7ac037510 0x7fe7ac0380e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:49940/0 (socket says 172.21.15.154:49940) 2024-05-14T01:23:40.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.794+0000 7fe7b93ae640 1 -- 172.21.15.154:0/3321196490 learned_addr learned my addr 172.21.15.154:0/3321196490 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:40.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.794+0000 7fe7b93ae640 1 -- 172.21.15.154:0/3321196490 >> v2:172.21.15.154:3300/0 conn(0x7fe7ac054950 msgr2=0x7fe7ac049d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:40.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.794+0000 7fe7b93ae640 1 --2- 172.21.15.154:0/3321196490 >> v2:172.21.15.154:3300/0 conn(0x7fe7ac054950 0x7fe7ac049d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.794+0000 7fe7b93ae640 1 -- 172.21.15.154:0/3321196490 >> v1:172.21.15.154:6789/0 conn(0x7fe7ac054db0 legacy=0x7fe7ac052780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:40.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.794+0000 7fe7b93ae640 1 -- 172.21.15.154:0/3321196490 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac008430 con 0x7fe7ac037510 2024-05-14T01:23:40.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7f1ddb0b8640 1 Processor -- start 2024-05-14T01:23:40.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7f1ddb0b8640 1 -- start start 2024-05-14T01:23:40.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7fe7b93ae640 1 --2- 172.21.15.154:0/3321196490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7ac037510 0x7fe7ac0380e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac010ff0 tx=0x7fe7a401c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17522d424aea764c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7fe7abfff640 1 -- 172.21.15.154:0/3321196490 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40ab5f0 con 0x7fe7ac037510 2024-05-14T01:23:40.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7fe7abfff640 1 -- 172.21.15.154:0/3321196490 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a40b0070 con 0x7fe7ac037510 2024-05-14T01:23:40.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7fe7abfff640 1 -- 172.21.15.154:0/3321196490 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40ab9b0 con 0x7fe7ac037510 2024-05-14T01:23:40.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7f1ddb0b8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dcc036910 0x7f1dcc04fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7f1ddb0b8640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1dcc03a0b0 0x7f1dcc03a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7f1ddb0b8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dcc03aea0 con 0x7f1dcc0e3ba0 2024-05-14T01:23:40.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7f1ddb0b8640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1dcc036cf0 con 0x7f1dcc03a0b0 2024-05-14T01:23:40.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7f1ddb0b8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1dcc04ff90 con 0x7f1dcc036910 2024-05-14T01:23:40.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7f1dd98b5640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1dcc0e3ba0 0x7f1dcc0512f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57230/0 (socket says 172.21.15.154:57230) 2024-05-14T01:23:40.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7f1dd98b5640 1 -- 172.21.15.154:0/1066464595 learned_addr learned my addr 172.21.15.154:0/1066464595 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:40.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7f1dda0b6640 1 --2- 172.21.15.154:0/1066464595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dcc036910 0x7f1dcc04fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7fe7ba3b0640 1 -- 172.21.15.154:0/3321196490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7ac037510 msgr2=0x7fe7ac0380e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7fe7ba3b0640 1 --2- 172.21.15.154:0/3321196490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7ac037510 0x7fe7ac0380e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac010ff0 tx=0x7fe7a401c500 comp rx=0 tx=0).stop 2024-05-14T01:23:40.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7fe7ba3b0640 1 -- 172.21.15.154:0/3321196490 shutdown_connections 2024-05-14T01:23:40.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7fe7ba3b0640 1 --2- 172.21.15.154:0/3321196490 >> v2:172.21.15.154:3300/0 conn(0x7fe7ac054950 0x7fe7ac049d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7fe7ba3b0640 1 --2- 172.21.15.154:0/3321196490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7ac037510 0x7fe7ac0380e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7fe7ba3b0640 1 -- 172.21.15.154:0/3321196490 >> 172.21.15.154:0/3321196490 conn(0x7fe7ac020050 msgr2=0x7fe7ac056d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7f1dd90b4640 1 -- 172.21.15.154:0/1066464595 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3773347447 0 0) 0x7f1dcc03aea0 con 0x7f1dcc0e3ba0 2024-05-14T01:23:40.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7fe7ba3b0640 1 -- 172.21.15.154:0/3321196490 shutdown_connections 2024-05-14T01:23:40.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7fe7ba3b0640 1 -- 172.21.15.154:0/3321196490 wait complete. 2024-05-14T01:23:40.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7f1dda8b7640 1 --2- 172.21.15.154:0/1066464595 >> v2:172.21.15.176:3300/0 conn(0x7f1dcc03a0b0 0x7f1dcc03a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7f1dd90b4640 1 -- 172.21.15.154:0/1066464595 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dc0003530 con 0x7f1dcc0e3ba0 2024-05-14T01:23:40.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7f1dda0b6640 1 -- 172.21.15.154:0/1066464595 >> v2:172.21.15.176:3300/0 conn(0x7f1dcc03a0b0 msgr2=0x7f1dcc03a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:40.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7f1dda0b6640 1 --2- 172.21.15.154:0/1066464595 >> v2:172.21.15.176:3300/0 conn(0x7f1dcc03a0b0 0x7f1dcc03a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7f1dda0b6640 1 -- 172.21.15.154:0/1066464595 >> v1:172.21.15.154:6789/0 conn(0x7f1dcc0e3ba0 legacy=0x7f1dcc0512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7f1dd90b4640 1 -- 172.21.15.154:0/1066464595 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 107791104 0 0) 0x7f1dc0003530 con 0x7f1dcc0e3ba0 2024-05-14T01:23:40.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.798+0000 7f1dda0b6640 1 -- 172.21.15.154:0/1066464595 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dcc050250 con 0x7f1dcc036910 2024-05-14T01:23:40.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7ba3b0640 1 Processor -- start 2024-05-14T01:23:40.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7ba3b0640 1 -- start start 2024-05-14T01:23:40.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7ba3b0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7ac037510 0x7fe7ac0dfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7ba3b0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7ac054950 0x7fe7ac0e6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7ba3b0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7ac054db0 0x7fe7ac0e6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7ba3b0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac038620 con 0x7fe7ac054950 2024-05-14T01:23:40.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7f1dda0b6640 1 --2- 172.21.15.154:0/1066464595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dcc036910 0x7f1dcc04fa50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1dd406a150 tx=0x7f1dd409c180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=552e146a33c5c442 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7ba3b0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac04a6a0 con 0x7fe7ac037510 2024-05-14T01:23:40.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7b8bad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7ac054950 0x7fe7ac0e6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7b93ae640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7ac037510 0x7fe7ac0dfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7ba3b0640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ac057620 con 0x7fe7ac054db0 2024-05-14T01:23:40.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7b8bad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7ac054950 0x7fe7ac0e6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46246/0 (socket says 172.21.15.154:46246) 2024-05-14T01:23:40.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7b8bad640 1 -- 172.21.15.154:0/1908650266 learned_addr learned my addr 172.21.15.154:0/1908650266 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:40.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7b9baf640 1 --2- 172.21.15.154:0/1908650266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7ac054db0 0x7fe7ac0e6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7b8bad640 1 -- 172.21.15.154:0/1908650266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7ac054db0 msgr2=0x7fe7ac0e6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7b8bad640 1 --2- 172.21.15.154:0/1908650266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7ac054db0 0x7fe7ac0e6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7b8bad640 1 -- 172.21.15.154:0/1908650266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7ac037510 msgr2=0x7fe7ac0dfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7b8bad640 1 --2- 172.21.15.154:0/1908650266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7ac037510 0x7fe7ac0dfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7b8bad640 1 -- 172.21.15.154:0/1908650266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac034430 con 0x7fe7ac054950 2024-05-14T01:23:40.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7f1dd90b4640 1 -- 172.21.15.154:0/1066464595 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4131070 con 0x7f1dcc036910 2024-05-14T01:23:40.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7f1dd90b4640 1 -- 172.21.15.154:0/1066464595 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dd41249d0 con 0x7f1dcc036910 2024-05-14T01:23:40.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7f1dd90b4640 1 -- 172.21.15.154:0/1066464595 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0001680 con 0x7f1dcc036910 2024-05-14T01:23:40.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7f7005bed640 1 Processor -- start 2024-05-14T01:23:40.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7f7005bed640 1 -- start start 2024-05-14T01:23:40.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.802+0000 7fe7b8bad640 1 --2- 172.21.15.154:0/1908650266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7ac054950 0x7fe7ac0e6240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000b710 tx=0x7fe7b000bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7fe7a9ffb640 1 -- 172.21.15.154:0/1908650266 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0019070 con 0x7fe7ac054950 2024-05-14T01:23:40.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1ddb0b8640 1 -- 172.21.15.154:0/1066464595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dcc036910 msgr2=0x7f1dcc04fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1ddb0b8640 1 --2- 172.21.15.154:0/1066464595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dcc036910 0x7f1dcc04fa50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1dd406a150 tx=0x7f1dd409c180 comp rx=0 tx=0).stop 2024-05-14T01:23:40.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7fe7a9ffb640 1 -- 172.21.15.154:0/1908650266 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b000c720 con 0x7fe7ac054950 2024-05-14T01:23:40.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7fe7a9ffb640 1 -- 172.21.15.154:0/1908650266 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b000cb10 con 0x7fe7ac054950 2024-05-14T01:23:40.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7fe7ba3b0640 1 -- 172.21.15.154:0/1908650266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ac034710 con 0x7fe7ac054950 2024-05-14T01:23:40.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1ddb0b8640 1 -- 172.21.15.154:0/1066464595 shutdown_connections 2024-05-14T01:23:40.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1ddb0b8640 1 --2- 172.21.15.154:0/1066464595 >> v2:172.21.15.176:3300/0 conn(0x7f1dcc03a0b0 0x7f1dcc03a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1ddb0b8640 1 --2- 172.21.15.154:0/1066464595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dcc036910 0x7f1dcc04fa50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1ddb0b8640 1 -- 172.21.15.154:0/1066464595 >> 172.21.15.154:0/1066464595 conn(0x7f1dcc01e6d0 msgr2=0x7f1dcc055400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7fe7ba3b0640 1 -- 172.21.15.154:0/1908650266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ac034cd0 con 0x7fe7ac054950 2024-05-14T01:23:40.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1ddb0b8640 1 -- 172.21.15.154:0/1066464595 shutdown_connections 2024-05-14T01:23:40.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1ddb0b8640 1 -- 172.21.15.154:0/1066464595 wait complete. 2024-05-14T01:23:40.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f7005bed640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70000b4680 0x7f700006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f7005bed640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7000070140 0x7f700006fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f7005bed640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70000b4f20 con 0x7f700015abc0 2024-05-14T01:23:40.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f7005bed640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f700006e8c0 con 0x7f7000070140 2024-05-14T01:23:40.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f7005bed640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f70000b4c40 con 0x7f70000b4680 2024-05-14T01:23:40.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f6ffeffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70000b4680 0x7f700006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f6ffeffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70000b4680 0x7f700006f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:59034/0 (socket says 172.21.15.154:59034) 2024-05-14T01:23:40.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f6ffeffd640 1 -- 172.21.15.154:0/3280033445 learned_addr learned my addr 172.21.15.154:0/3280033445 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:40.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f700498b640 1 --2- 172.21.15.154:0/3280033445 >> v2:172.21.15.154:3300/0 conn(0x7f7000070140 0x7f700006fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7fe7ba3b0640 1 -- 172.21.15.154:0/1908650266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe7ac0350b0 con 0x7fe7ac054950 2024-05-14T01:23:40.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1ddb0b8640 1 Processor -- start 2024-05-14T01:23:40.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1ddb0b8640 1 -- start start 2024-05-14T01:23:40.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1ddb0b8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dcc036910 0x7f1dcc0d69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1ddb0b8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dcc03a0b0 0x7f1dcc0d9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1ddb0b8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dcc0e3ba0 0x7f1dcc00b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1ddb0b8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc006a40 con 0x7f1dcc03a0b0 2024-05-14T01:23:40.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1ddb0b8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc050dd0 con 0x7f1dcc036910 2024-05-14T01:23:40.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1ddb0b8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1dcc006bc0 con 0x7f1dcc0e3ba0 2024-05-14T01:23:40.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f700498b640 1 -- 172.21.15.154:0/3280033445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70000b4680 msgr2=0x7f700006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:40.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f700498b640 1 --2- 172.21.15.154:0/3280033445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70000b4680 0x7f700006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f700498b640 1 -- 172.21.15.154:0/3280033445 >> v1:172.21.15.154:6789/0 conn(0x7f700015abc0 legacy=0x7f70000add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f700498b640 1 -- 172.21.15.154:0/3280033445 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700006eaf0 con 0x7f7000070140 2024-05-14T01:23:40.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1dd98b5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dcc03a0b0 0x7f1dcc0d9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1dd98b5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dcc03a0b0 0x7f1dcc0d9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46264/0 (socket says 172.21.15.154:46264) 2024-05-14T01:23:40.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1dd98b5640 1 -- 172.21.15.154:0/818059610 learned_addr learned my addr 172.21.15.154:0/818059610 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:40.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1dda0b6640 1 --2- 172.21.15.154:0/818059610 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dcc036910 0x7f1dcc0d69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.806+0000 7f1dda8b7640 1 --2- 172.21.15.154:0/818059610 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dcc0e3ba0 0x7f1dcc00b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f1dd98b5640 1 -- 172.21.15.154:0/818059610 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dcc0e3ba0 msgr2=0x7f1dcc00b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f1dd98b5640 1 --2- 172.21.15.154:0/818059610 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1dcc0e3ba0 0x7f1dcc00b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f1dd98b5640 1 -- 172.21.15.154:0/818059610 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dcc036910 msgr2=0x7f1dcc0d69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f1dd98b5640 1 --2- 172.21.15.154:0/818059610 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dcc036910 0x7f1dcc0d69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f74a951e640 1 Processor -- start 2024-05-14T01:23:40.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f700498b640 1 --2- 172.21.15.154:0/3280033445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7000070140 0x7f700006fb10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009d90 tx=0x7f6ff801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bc3a482e3e59a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f1dd98b5640 1 -- 172.21.15.154:0/818059610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dcc04e620 con 0x7f1dcc03a0b0 2024-05-14T01:23:40.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f1dda0b6640 1 --2- 172.21.15.154:0/818059610 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dcc036910 0x7f1dcc0d69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:23:40.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f1dd98b5640 1 --2- 172.21.15.154:0/818059610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dcc03a0b0 0x7f1dcc0d9320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00011f0 tx=0x7f1dd000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f1dcaffd640 1 -- 172.21.15.154:0/818059610 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0005ae0 con 0x7f1dcc03a0b0 2024-05-14T01:23:40.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f1dcaffd640 1 -- 172.21.15.154:0/818059610 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dd0005c80 con 0x7f1dcc03a0b0 2024-05-14T01:23:40.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f1dcaffd640 1 -- 172.21.15.154:0/818059610 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd00072b0 con 0x7f1dcc03a0b0 2024-05-14T01:23:40.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f1ddb0b8640 1 -- 172.21.15.154:0/818059610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dcc0e1230 con 0x7f1dcc03a0b0 2024-05-14T01:23:40.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f1ddb0b8640 1 -- 172.21.15.154:0/818059610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dcc0d9860 con 0x7f1dcc03a0b0 2024-05-14T01:23:40.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f6ffe7fc640 1 -- 172.21.15.154:0/3280033445 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff80b2070 con 0x7f7000070140 2024-05-14T01:23:40.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f6ffe7fc640 1 -- 172.21.15.154:0/3280033445 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff80a5910 con 0x7f7000070140 2024-05-14T01:23:40.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f6ffe7fc640 1 -- 172.21.15.154:0/3280033445 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff80a5ce0 con 0x7f7000070140 2024-05-14T01:23:40.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f7005bed640 1 -- 172.21.15.154:0/3280033445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7000070140 msgr2=0x7f700006fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f7005bed640 1 --2- 172.21.15.154:0/3280033445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7000070140 0x7f700006fb10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009d90 tx=0x7f6ff801c960 comp rx=0 tx=0).stop 2024-05-14T01:23:40.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f7005bed640 1 -- 172.21.15.154:0/3280033445 shutdown_connections 2024-05-14T01:23:40.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f7005bed640 1 --2- 172.21.15.154:0/3280033445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7000070140 0x7f700006fb10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f7005bed640 1 --2- 172.21.15.154:0/3280033445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70000b4680 0x7f700006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f7005bed640 1 -- 172.21.15.154:0/3280033445 >> 172.21.15.154:0/3280033445 conn(0x7f7000071fc0 msgr2=0x7f70000723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f7005bed640 1 -- 172.21.15.154:0/3280033445 shutdown_connections 2024-05-14T01:23:40.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f7005bed640 1 -- 172.21.15.154:0/3280033445 wait complete. 2024-05-14T01:23:40.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f74a951e640 1 -- start start 2024-05-14T01:23:40.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f74a951e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f749c0e7700 0x7f749c007280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f74a951e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f749c047d70 0x7f749c037ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f74a951e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f749c0543d0 con 0x7f749c0381e0 2024-05-14T01:23:40.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f74a951e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f749c006df0 con 0x7f749c047d70 2024-05-14T01:23:40.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f74a951e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f749c0546b0 con 0x7f749c0e7700 2024-05-14T01:23:40.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f74a2ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f749c0e7700 0x7f749c007280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f74a2ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f749c0e7700 0x7f749c007280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:59062/0 (socket says 172.21.15.154:59062) 2024-05-14T01:23:40.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f74a2ffd640 1 -- 172.21.15.154:0/1734987653 learned_addr learned my addr 172.21.15.154:0/1734987653 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:40.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7fe7a9ffb640 1 -- 172.21.15.154:0/1908650266 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe7b001c070 con 0x7fe7ac054950 2024-05-14T01:23:40.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7fe7a9ffb640 1 --2- 172.21.15.154:0/1908650266 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe7980678c0 0x7fe798069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f7005bed640 1 Processor -- start 2024-05-14T01:23:40.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f7005bed640 1 -- start start 2024-05-14T01:23:40.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7fe7a9ffb640 1 -- 172.21.15.154:0/1908650266 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe7b0053d60 con 0x7fe7ac054950 2024-05-14T01:23:40.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7fe7b93ae640 1 --2- 172.21.15.154:0/1908650266 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe7980678c0 0x7fe798069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7fe7a9ffb640 1 --2- 172.21.15.154:0/1908650266 >> [v2:172.21.15.154:6808/682645045,v1:172.21.15.154:6809/682645045] conn(0x7fe798070670 0x7fe798072b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7fe7a9ffb640 1 -- 172.21.15.154:0/1908650266 --> [v2:172.21.15.154:6808/682645045,v1:172.21.15.154:6809/682645045] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7980731e0 con 0x7fe798070670 2024-05-14T01:23:40.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7fe7a9ffb640 1 -- 172.21.15.154:0/1908650266 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe7b00526f0 con 0x7fe7ac054950 2024-05-14T01:23:40.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f1ddb0b8640 1 -- 172.21.15.154:0/818059610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1dbc001040 con 0x7f1dcc03a0b0 2024-05-14T01:23:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f7005bed640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7000070140 0x7f7000145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f7005bed640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70000b4680 0x7f70001f8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f7005bed640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f700015abc0 0x7f70001f88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f7005bed640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f700015afa0 con 0x7f700015abc0 2024-05-14T01:23:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f7005bed640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f70000ae460 con 0x7f70000b4680 2024-05-14T01:23:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f7005bed640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7000167940 con 0x7f7000070140 2024-05-14T01:23:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f700498b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f700015abc0 0x7f70001f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f700498b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f700015abc0 0x7f70001f88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46276/0 (socket says 172.21.15.154:46276) 2024-05-14T01:23:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f700498b640 1 -- 172.21.15.154:0/3191327924 learned_addr learned my addr 172.21.15.154:0/3191327924 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:40.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f74a2ffd640 1 -- 172.21.15.154:0/1734987653 >> v2:172.21.15.176:3300/0 conn(0x7f749c047d70 msgr2=0x7f749c037ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:40.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f74a2ffd640 1 --2- 172.21.15.154:0/1734987653 >> v2:172.21.15.176:3300/0 conn(0x7f749c047d70 0x7f749c037ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f74a2ffd640 1 -- 172.21.15.154:0/1734987653 >> v1:172.21.15.154:6789/0 conn(0x7f749c0381e0 legacy=0x7f749c0526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:40.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7f74a2ffd640 1 -- 172.21.15.154:0/1734987653 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f749c006a80 con 0x7f749c0e7700 2024-05-14T01:23:40.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f6fff7fe640 1 --2- 172.21.15.154:0/3191327924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7000070140 0x7f7000145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f6ffeffd640 1 --2- 172.21.15.154:0/3191327924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70000b4680 0x7f70001f8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f700498b640 1 -- 172.21.15.154:0/3191327924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7000070140 msgr2=0x7f7000145620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.810+0000 7fe7b93ae640 1 --2- 172.21.15.154:0/1908650266 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe7980678c0 0x7fe798069d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40af000 tx=0x7fe7a40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7fe7b9baf640 1 --2- 172.21.15.154:0/1908650266 >> [v2:172.21.15.154:6808/682645045,v1:172.21.15.154:6809/682645045] conn(0x7fe798070670 0x7fe798072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f700498b640 1 --2- 172.21.15.154:0/3191327924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7000070140 0x7f7000145620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f700498b640 1 -- 172.21.15.154:0/3191327924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70000b4680 msgr2=0x7f70001f8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f700498b640 1 --2- 172.21.15.154:0/3191327924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70000b4680 0x7f70001f8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f700498b640 1 -- 172.21.15.154:0/3191327924 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7000156de0 con 0x7f700015abc0 2024-05-14T01:23:40.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f700498b640 1 --2- 172.21.15.154:0/3191327924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f700015abc0 0x7f70001f88d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6ff801b010 tx=0x7f6ff8019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7fe7b9baf640 1 --2- 172.21.15.154:0/1908650266 >> [v2:172.21.15.154:6808/682645045,v1:172.21.15.154:6809/682645045] conn(0x7fe798070670 0x7fe798072b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f6febfff640 1 -- 172.21.15.154:0/3191327924 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff80b2050 con 0x7f700015abc0 2024-05-14T01:23:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f6febfff640 1 -- 172.21.15.154:0/3191327924 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff80be070 con 0x7f700015abc0 2024-05-14T01:23:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f6febfff640 1 -- 172.21.15.154:0/3191327924 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff80ada50 con 0x7f700015abc0 2024-05-14T01:23:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f1dcaffd640 1 -- 172.21.15.154:0/818059610 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1dd0007450 con 0x7f1dcc03a0b0 2024-05-14T01:23:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f1dcaffd640 1 --2- 172.21.15.154:0/818059610 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1db80679c0 0x7f1db8069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f1dcaffd640 1 -- 172.21.15.154:0/818059610 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1dd0086360 con 0x7f1dcc03a0b0 2024-05-14T01:23:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f1dda0b6640 1 --2- 172.21.15.154:0/818059610 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1db80679c0 0x7f1db8069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f1dcaffd640 1 --2- 172.21.15.154:0/818059610 >> [v2:172.21.15.154:6824/1610701849,v1:172.21.15.154:6825/1610701849] conn(0x7f1db806fbe0 0x7f1db8072000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f1dcaffd640 1 -- 172.21.15.154:0/818059610 --> [v2:172.21.15.154:6824/1610701849,v1:172.21.15.154:6825/1610701849] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1dd001ce50 con 0x7f1db806fbe0 2024-05-14T01:23:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f1dcaffd640 1 -- 172.21.15.154:0/818059610 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1dd0086750 con 0x7f1dcc03a0b0 2024-05-14T01:23:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f1dda8b7640 1 --2- 172.21.15.154:0/818059610 >> [v2:172.21.15.154:6824/1610701849,v1:172.21.15.154:6825/1610701849] conn(0x7f1db806fbe0 0x7f1db8072000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f1dda0b6640 1 --2- 172.21.15.154:0/818059610 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1db80679c0 0x7f1db8069e80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0553d0 tx=0x7f1dd408d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f7005bed640 1 -- 172.21.15.154:0/3191327924 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f700009dba0 con 0x7f700015abc0 2024-05-14T01:23:40.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f6febfff640 1 -- 172.21.15.154:0/3191327924 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6ff80adbf0 con 0x7f700015abc0 2024-05-14T01:23:40.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f4d3536e640 1 Processor -- start 2024-05-14T01:23:40.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f4d3536e640 1 -- start start 2024-05-14T01:23:40.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f4d3536e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d3006c9a0 0x7f4d30162e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f4d3536e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d30163440 con 0x7f4d30159450 2024-05-14T01:23:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f4d3536e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d30163720 con 0x7f4d301629f0 2024-05-14T01:23:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f4d3536e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4d30166160 con 0x7f4d3006c9a0 2024-05-14T01:23:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f4d2f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d3006c9a0 0x7f4d30162e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f4d2f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d3006c9a0 0x7f4d30162e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46288/0 (socket says 172.21.15.154:46288) 2024-05-14T01:23:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f4d2f7fe640 1 -- 172.21.15.154:0/4243518780 learned_addr learned my addr 172.21.15.154:0/4243518780 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f74a2ffd640 1 --2- 172.21.15.154:0/1734987653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f749c0e7700 0x7f749c007280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7494009870 tx=0x7f749401ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80d29ba102887ad server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f1dda8b7640 1 --2- 172.21.15.154:0/818059610 >> [v2:172.21.15.154:6824/1610701849,v1:172.21.15.154:6825/1610701849] conn(0x7f1db806fbe0 0x7f1db8072000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7fe7a9ffb640 1 -- 172.21.15.154:0/1908650266 <== osd.3 v2:172.21.15.154:6808/682645045 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe7980731e0 con 0x7fe798070670 2024-05-14T01:23:40.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.814+0000 7f7005bed640 1 -- 172.21.15.154:0/3191327924 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f700009e160 con 0x7f700015abc0 2024-05-14T01:23:40.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f7005bed640 1 -- 172.21.15.154:0/3191327924 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7000068360 con 0x7f700015abc0 2024-05-14T01:23:40.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f6febfff640 1 --2- 172.21.15.154:0/3191327924 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6fe40678c0 0x7f6fe4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f4d2f7fe640 1 -- 172.21.15.154:0/4243518780 >> v1:172.21.15.176:6789/0 conn(0x7f4d301629f0 legacy=0x7f4d3006c290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T01:23:40.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f4d2f7fe640 1 -- 172.21.15.154:0/4243518780 >> v1:172.21.15.154:6789/0 conn(0x7f4d30159450 legacy=0x7f4d30166960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T01:23:40.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f4d2f7fe640 1 -- 172.21.15.154:0/4243518780 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d30166440 con 0x7f4d3006c9a0 2024-05-14T01:23:40.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f74a1ffb640 1 -- 172.21.15.154:0/1734987653 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74940b5070 con 0x7f749c0e7700 2024-05-14T01:23:40.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f74a1ffb640 1 -- 172.21.15.154:0/1734987653 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74940a89f0 con 0x7f749c0e7700 2024-05-14T01:23:40.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f74a1ffb640 1 -- 172.21.15.154:0/1734987653 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74940a8e00 con 0x7f749c0e7700 2024-05-14T01:23:40.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f74a951e640 1 -- 172.21.15.154:0/1734987653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f749c0e7700 msgr2=0x7f749c007280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f74a951e640 1 --2- 172.21.15.154:0/1734987653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f749c0e7700 0x7f749c007280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7494009870 tx=0x7f749401ed30 comp rx=0 tx=0).stop 2024-05-14T01:23:40.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f6fff7fe640 1 --2- 172.21.15.154:0/3191327924 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6fe40678c0 0x7f6fe4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f1dcaffd640 1 -- 172.21.15.154:0/818059610 <== osd.0 v2:172.21.15.154:6824/1610701849 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1dd001ce50 con 0x7f1db806fbe0 2024-05-14T01:23:40.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f6fff7fe640 1 --2- 172.21.15.154:0/3191327924 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6fe40678c0 0x7f6fe4069d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4001810 tx=0x7f6ff4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f74a951e640 1 -- 172.21.15.154:0/1734987653 shutdown_connections 2024-05-14T01:23:40.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f74a951e640 1 --2- 172.21.15.154:0/1734987653 >> v2:172.21.15.176:3300/0 conn(0x7f749c047d70 0x7f749c037ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f74a951e640 1 --2- 172.21.15.154:0/1734987653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f749c0e7700 0x7f749c007280 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7494009870 tx=0x7f749401ed30 comp rx=0 tx=0).stop 2024-05-14T01:23:40.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f74a951e640 1 -- 172.21.15.154:0/1734987653 >> 172.21.15.154:0/1734987653 conn(0x7f749c054b00 msgr2=0x7f749c054f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.818+0000 7f4d2f7fe640 1 --2- 172.21.15.154:0/4243518780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d3006c9a0 0x7f4d30162e50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009e50 tx=0x7f4d2801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50511b20b854d1e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a951e640 1 -- 172.21.15.154:0/1734987653 shutdown_connections 2024-05-14T01:23:40.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a951e640 1 -- 172.21.15.154:0/1734987653 wait complete. 2024-05-14T01:23:40.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f4d2dffb640 1 -- 172.21.15.154:0/4243518780 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d280a5890 con 0x7f4d3006c9a0 2024-05-14T01:23:40.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f4d2dffb640 1 -- 172.21.15.154:0/4243518780 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d280a5a30 con 0x7f4d3006c9a0 2024-05-14T01:23:40.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f4d2dffb640 1 -- 172.21.15.154:0/4243518780 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d280a5e00 con 0x7f4d3006c9a0 2024-05-14T01:23:40.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f4d3536e640 1 -- 172.21.15.154:0/4243518780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d3006c9a0 msgr2=0x7f4d30162e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f4d3536e640 1 --2- 172.21.15.154:0/4243518780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d3006c9a0 0x7f4d30162e50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009e50 tx=0x7f4d2801c9b0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7efd32fa2640 1 -- 172.21.15.154:0/2641640574 --> [v2:172.21.15.176:6824/4163648494,v1:172.21.15.176:6825/4163648494] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efd2c158770 con 0x7efd2c1384b0 2024-05-14T01:23:40.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f6febfff640 1 -- 172.21.15.154:0/3191327924 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6ff80eed80 con 0x7f700015abc0 2024-05-14T01:23:40.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f6febfff640 1 --2- 172.21.15.154:0/3191327924 >> [v2:172.21.15.154:6810/4138707364,v1:172.21.15.154:6812/4138707364] conn(0x7f6fe406fa60 0x7f6fe4071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f6febfff640 1 -- 172.21.15.154:0/3191327924 --> [v2:172.21.15.154:6810/4138707364,v1:172.21.15.154:6812/4138707364] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6fe4072530 con 0x7f6fe406fa60 2024-05-14T01:23:40.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f6febfff640 1 -- 172.21.15.154:0/3191327924 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6ff8106020 con 0x7f700015abc0 2024-05-14T01:23:40.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f6ffeffd640 1 --2- 172.21.15.154:0/3191327924 >> [v2:172.21.15.154:6810/4138707364,v1:172.21.15.154:6812/4138707364] conn(0x7f6fe406fa60 0x7f6fe4071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f4d3536e640 1 -- 172.21.15.154:0/4243518780 shutdown_connections 2024-05-14T01:23:40.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f4d3536e640 1 --2- 172.21.15.154:0/4243518780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d3006c9a0 0x7f4d30162e50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f4d3536e640 1 -- 172.21.15.154:0/4243518780 >> 172.21.15.154:0/4243518780 conn(0x7f4d30071e20 msgr2=0x7f4d30072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f6ffeffd640 1 --2- 172.21.15.154:0/3191327924 >> [v2:172.21.15.154:6810/4138707364,v1:172.21.15.154:6812/4138707364] conn(0x7f6fe406fa60 0x7f6fe4071e80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a951e640 1 Processor -- start 2024-05-14T01:23:40.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f4d3536e640 1 -- 172.21.15.154:0/4243518780 shutdown_connections 2024-05-14T01:23:40.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7efd297fa640 1 -- 172.21.15.154:0/2641640574 <== osd.5 v2:172.21.15.176:6824/4163648494 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efd2c158770 con 0x7efd2c1384b0 2024-05-14T01:23:40.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a951e640 1 -- start start 2024-05-14T01:23:40.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a951e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f749c0381e0 0x7f749c04cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a951e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f749c047d70 0x7f749c0d6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a951e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f749c038ee0 0x7f749c0d6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a951e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f749c050160 con 0x7f749c038ee0 2024-05-14T01:23:40.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a951e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f749c0e7ae0 con 0x7f749c047d70 2024-05-14T01:23:40.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a951e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f749c038650 con 0x7f749c0381e0 2024-05-14T01:23:40.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f6febfff640 1 -- 172.21.15.154:0/3191327924 <== osd.1 v2:172.21.15.154:6810/4138707364 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6fe4072530 con 0x7f6fe406fa60 2024-05-14T01:23:40.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f749c038ee0 0x7f749c0d6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f749c038ee0 0x7f749c0d6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46304/0 (socket says 172.21.15.154:46304) 2024-05-14T01:23:40.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a37fe640 1 -- 172.21.15.154:0/2706328162 learned_addr learned my addr 172.21.15.154:0/2706328162 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:40.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a27fc640 1 --2- 172.21.15.154:0/2706328162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f749c047d70 0x7f749c0d6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a2ffd640 1 --2- 172.21.15.154:0/2706328162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f749c0381e0 0x7f749c04cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7efd12ffd640 1 -- 172.21.15.154:0/2641640574 >> [v2:172.21.15.176:6824/4163648494,v1:172.21.15.176:6825/4163648494] conn(0x7efd2c1384b0 msgr2=0x7efd2c133f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a37fe640 1 -- 172.21.15.154:0/2706328162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f749c0381e0 msgr2=0x7f749c04cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a37fe640 1 --2- 172.21.15.154:0/2706328162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f749c0381e0 0x7f749c04cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a37fe640 1 -- 172.21.15.154:0/2706328162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f749c047d70 msgr2=0x7f749c0d6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a37fe640 1 --2- 172.21.15.154:0/2706328162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f749c047d70 0x7f749c0d6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f74a37fe640 1 -- 172.21.15.154:0/2706328162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f749c0c9e40 con 0x7f749c038ee0 2024-05-14T01:23:40.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7efd12ffd640 1 --2- 172.21.15.154:0/2641640574 >> [v2:172.21.15.176:6824/4163648494,v1:172.21.15.176:6825/4163648494] conn(0x7efd2c1384b0 0x7efd2c133f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f74a37fe640 1 --2- 172.21.15.154:0/2706328162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f749c038ee0 0x7f749c0d6a80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f74a406b180 tx=0x7f74a40686d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7efd12ffd640 1 -- 172.21.15.154:0/2641640574 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7efd18067910 msgr2=0x7efd18069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7efd12ffd640 1 --2- 172.21.15.154:0/2641640574 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7efd18067910 0x7efd18069dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efd240012f0 tx=0x7efd24006110 comp rx=0 tx=0).stop 2024-05-14T01:23:40.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7efd12ffd640 1 -- 172.21.15.154:0/2641640574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd2c13ce00 msgr2=0x7efd2c138ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7efd12ffd640 1 --2- 172.21.15.154:0/2641640574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd2c13ce00 0x7efd2c138ab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efd2000e930 tx=0x7efd2000edf0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7efd3153f640 1 -- 172.21.15.154:0/2641640574 reap_dead start 2024-05-14T01:23:40.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.822+0000 7f4d3536e640 1 -- 172.21.15.154:0/4243518780 wait complete. 2024-05-14T01:23:40.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f4d3536e640 1 Processor -- start 2024-05-14T01:23:40.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7efd12ffd640 1 -- 172.21.15.154:0/2641640574 shutdown_connections 2024-05-14T01:23:40.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7efd12ffd640 1 -- 172.21.15.154:0/2641640574 >> 172.21.15.154:0/2641640574 conn(0x7efd2c0b1670 msgr2=0x7efd2c13e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f1059c8a640 1 Processor -- start 2024-05-14T01:23:40.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f1059c8a640 1 -- start start 2024-05-14T01:23:40.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7efd12ffd640 1 -- 172.21.15.154:0/2641640574 shutdown_connections 2024-05-14T01:23:40.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7efd12ffd640 1 -- 172.21.15.154:0/2641640574 wait complete. 2024-05-14T01:23:40.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f748b7fe640 1 -- 172.21.15.154:0/2706328162 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4073450 con 0x7f749c038ee0 2024-05-14T01:23:40.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f748b7fe640 1 -- 172.21.15.154:0/2706328162 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a4092070 con 0x7f749c038ee0 2024-05-14T01:23:40.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f748b7fe640 1 -- 172.21.15.154:0/2706328162 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4073850 con 0x7f749c038ee0 2024-05-14T01:23:40.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f4d3536e640 1 -- start start 2024-05-14T01:23:40.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f4d3536e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d3006c9a0 0x7f4d3014e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f4d3536e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d30159450 0x7f4d300b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f4d3536e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d301629f0 0x7f4d300b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f4d3536e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d300b51d0 con 0x7f4d301629f0 2024-05-14T01:23:40.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f4d3536e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4d300b5050 con 0x7f4d30159450 2024-05-14T01:23:40.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f4d3536e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4d30170390 con 0x7f4d3006c9a0 2024-05-14T01:23:40.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f74a951e640 1 -- 172.21.15.154:0/2706328162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f749c04d300 con 0x7f749c038ee0 2024-05-14T01:23:40.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f74a951e640 1 -- 172.21.15.154:0/2706328162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f749c0d7940 con 0x7f749c038ee0 2024-05-14T01:23:40.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f4d2e7fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d30159450 0x7f4d300b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f4d2e7fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d30159450 0x7f4d300b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:50020/0 (socket says 172.21.15.154:50020) 2024-05-14T01:23:40.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f4d2e7fc640 1 -- 172.21.15.154:0/1724392635 learned_addr learned my addr 172.21.15.154:0/1724392635 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:40.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f4d2f7fe640 1 --2- 172.21.15.154:0/1724392635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d301629f0 0x7f4d300b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f4d2effd640 1 --2- 172.21.15.154:0/1724392635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d3006c9a0 0x7f4d3014e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f74a951e640 1 -- 172.21.15.154:0/2706328162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7484001040 con 0x7f749c038ee0 2024-05-14T01:23:40.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f1059c8a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f104c0e7560 0x7f104c0eb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f1059c8a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f104c054450 0x7f104c0eb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f1059c8a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f104c053800 con 0x7f104c0ebb90 2024-05-14T01:23:40.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f1059c8a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f104c037b30 con 0x7f104c054450 2024-05-14T01:23:40.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f1059c8a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f104c005fd0 con 0x7f104c0e7560 2024-05-14T01:23:40.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f4d2e7fc640 1 -- 172.21.15.154:0/1724392635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d3006c9a0 msgr2=0x7f4d3014e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f4d2e7fc640 1 --2- 172.21.15.154:0/1724392635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d3006c9a0 0x7f4d3014e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f4d2e7fc640 1 -- 172.21.15.154:0/1724392635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d301629f0 msgr2=0x7f4d300b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f4d2e7fc640 1 --2- 172.21.15.154:0/1724392635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d301629f0 0x7f4d300b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f4d2e7fc640 1 -- 172.21.15.154:0/1724392635 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3015bec0 con 0x7f4d30159450 2024-05-14T01:23:40.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f10537fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f104c0e7560 0x7f104c0eb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f1052ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f104c054450 0x7f104c0eb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f1052ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f104c054450 0x7f104c0eb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46320/0 (socket says 172.21.15.154:46320) 2024-05-14T01:23:40.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.826+0000 7f1052ffd640 1 -- 172.21.15.154:0/3624797744 learned_addr learned my addr 172.21.15.154:0/3624797744 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:40.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f1052ffd640 1 -- 172.21.15.154:0/3624797744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f104c0e7560 msgr2=0x7f104c0eb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:40.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f1052ffd640 1 --2- 172.21.15.154:0/3624797744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f104c0e7560 0x7f104c0eb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f1052ffd640 1 -- 172.21.15.154:0/3624797744 >> v1:172.21.15.176:6789/0 conn(0x7f104c0ebb90 legacy=0x7f104c04f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:40.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f4d2e7fc640 1 --2- 172.21.15.154:0/1724392635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d30159450 0x7f4d300b18c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000b420 tx=0x7f4d2000b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f1052ffd640 1 -- 172.21.15.154:0/3624797744 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c053ae0 con 0x7f104c054450 2024-05-14T01:23:40.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f4d177fe640 1 -- 172.21.15.154:0/1724392635 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d20011830 con 0x7f4d30159450 2024-05-14T01:23:40.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f4d177fe640 1 -- 172.21.15.154:0/1724392635 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d20016070 con 0x7f4d30159450 2024-05-14T01:23:40.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f4d3536e640 1 -- 172.21.15.154:0/1724392635 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d301604a0 con 0x7f4d30159450 2024-05-14T01:23:40.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f4d3536e640 1 -- 172.21.15.154:0/1724392635 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d30160a60 con 0x7f4d30159450 2024-05-14T01:23:40.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f4d3536e640 1 -- 172.21.15.154:0/1724392635 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4d10001040 con 0x7f4d30159450 2024-05-14T01:23:40.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f1052ffd640 1 --2- 172.21.15.154:0/3624797744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f104c054450 0x7f104c0eb650 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f105406ae20 tx=0x7f1054097f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d11322c13a760f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f4d177fe640 1 -- 172.21.15.154:0/1724392635 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d20011bf0 con 0x7f4d30159450 2024-05-14T01:23:40.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f748b7fe640 1 -- 172.21.15.154:0/2706328162 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f74a40a1430 con 0x7f749c038ee0 2024-05-14T01:23:40.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f748b7fe640 1 --2- 172.21.15.154:0/2706328162 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7490067990 0x7f7490069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f748b7fe640 1 -- 172.21.15.154:0/2706328162 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f74a4101ad0 con 0x7f749c038ee0 2024-05-14T01:23:40.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f748b7fe640 1 --2- 172.21.15.154:0/2706328162 >> [v2:172.21.15.176:6800/2969535252,v1:172.21.15.176:6802/2969535252] conn(0x7f749006fb90 0x7f7490071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f748b7fe640 1 -- 172.21.15.154:0/2706328162 --> [v2:172.21.15.176:6800/2969535252,v1:172.21.15.176:6802/2969535252] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7490072660 con 0x7f749006fb90 2024-05-14T01:23:40.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f74a2ffd640 1 --2- 172.21.15.154:0/2706328162 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7490067990 0x7f7490069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f10527fc640 1 -- 172.21.15.154:0/3624797744 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105412d070 con 0x7f104c054450 2024-05-14T01:23:40.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f10527fc640 1 -- 172.21.15.154:0/3624797744 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1054120b10 con 0x7f104c054450 2024-05-14T01:23:40.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f74a27fc640 1 --2- 172.21.15.154:0/2706328162 >> [v2:172.21.15.176:6800/2969535252,v1:172.21.15.176:6802/2969535252] conn(0x7f749006fb90 0x7f7490071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f10527fc640 1 -- 172.21.15.154:0/3624797744 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1054128440 con 0x7f104c054450 2024-05-14T01:23:40.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f74a2ffd640 1 --2- 172.21.15.154:0/2706328162 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7490067990 0x7f7490069e50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f74940b2000 tx=0x7f7494008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f748b7fe640 1 -- 172.21.15.154:0/2706328162 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f74a40ce240 con 0x7f749c038ee0 2024-05-14T01:23:40.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.830+0000 7f74a27fc640 1 --2- 172.21.15.154:0/2706328162 >> [v2:172.21.15.176:6800/2969535252,v1:172.21.15.176:6802/2969535252] conn(0x7f749006fb90 0x7f7490071fb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1059c8a640 1 -- 172.21.15.154:0/3624797744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f104c054450 msgr2=0x7f104c0eb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1059c8a640 1 --2- 172.21.15.154:0/3624797744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f104c054450 0x7f104c0eb650 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f105406ae20 tx=0x7f1054097f00 comp rx=0 tx=0).stop 2024-05-14T01:23:40.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1059c8a640 1 -- 172.21.15.154:0/3624797744 shutdown_connections 2024-05-14T01:23:40.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1059c8a640 1 --2- 172.21.15.154:0/3624797744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f104c054450 0x7f104c0eb650 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1059c8a640 1 --2- 172.21.15.154:0/3624797744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f104c0e7560 0x7f104c0eb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1059c8a640 1 -- 172.21.15.154:0/3624797744 >> 172.21.15.154:0/3624797744 conn(0x7f104c009fc0 msgr2=0x7f104c00a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1059c8a640 1 -- 172.21.15.154:0/3624797744 shutdown_connections 2024-05-14T01:23:40.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f748b7fe640 1 -- 172.21.15.154:0/2706328162 <== osd.7 v2:172.21.15.176:6800/2969535252 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7490072660 con 0x7f749006fb90 2024-05-14T01:23:40.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1059c8a640 1 -- 172.21.15.154:0/3624797744 wait complete. 2024-05-14T01:23:40.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1059c8a640 1 Processor -- start 2024-05-14T01:23:40.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f4d177fe640 1 -- 172.21.15.154:0/1724392635 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4d2001b460 con 0x7f4d30159450 2024-05-14T01:23:40.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f4d177fe640 1 --2- 172.21.15.154:0/1724392635 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4d1c067910 0x7f4d1c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f4d177fe640 1 -- 172.21.15.154:0/1724392635 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4d200862a0 con 0x7f4d30159450 2024-05-14T01:23:40.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f4d177fe640 1 --2- 172.21.15.154:0/1724392635 >> [v2:172.21.15.154:6800/1507596223,v1:172.21.15.154:6801/1507596223] conn(0x7f4d1c06fb10 0x7f4d1c071f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f4d177fe640 1 -- 172.21.15.154:0/1724392635 --> [v2:172.21.15.154:6800/1507596223,v1:172.21.15.154:6801/1507596223] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4d1c0725e0 con 0x7f4d1c06fb10 2024-05-14T01:23:40.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f4d177fe640 1 -- 172.21.15.154:0/1724392635 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4d20086730 con 0x7f4d30159450 2024-05-14T01:23:40.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f4d2effd640 1 --2- 172.21.15.154:0/1724392635 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4d1c067910 0x7f4d1c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f4d2f7fe640 1 --2- 172.21.15.154:0/1724392635 >> [v2:172.21.15.154:6800/1507596223,v1:172.21.15.154:6801/1507596223] conn(0x7f4d1c06fb10 0x7f4d1c071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1059c8a640 1 -- start start 2024-05-14T01:23:40.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1059c8a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f104c054450 0x7f104c0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1059c8a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f104c0e7560 0x7f104c0e3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1059c8a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f104c0ebb90 0x7f104c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1059c8a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f104c0535a0 con 0x7f104c0ebb90 2024-05-14T01:23:40.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1059c8a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f104c053420 con 0x7f104c054450 2024-05-14T01:23:40.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1059c8a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f104c0f4450 con 0x7f104c0e7560 2024-05-14T01:23:40.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f4d2f7fe640 1 --2- 172.21.15.154:0/1724392635 >> [v2:172.21.15.154:6800/1507596223,v1:172.21.15.154:6801/1507596223] conn(0x7f4d1c06fb10 0x7f4d1c071f30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1053fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f104c0ebb90 0x7f104c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1052ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f104c0e7560 0x7f104c0e3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1052ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f104c0e7560 0x7f104c0e3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:59112/0 (socket says 172.21.15.154:59112) 2024-05-14T01:23:40.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1052ffd640 1 -- 172.21.15.154:0/741436339 learned_addr learned my addr 172.21.15.154:0/741436339 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:40.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f4d2effd640 1 --2- 172.21.15.154:0/1724392635 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4d1c067910 0x7f4d1c069dd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d300af9b0 tx=0x7f4d240090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f10537fe640 1 --2- 172.21.15.154:0/741436339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f104c054450 0x7f104c0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1052ffd640 1 -- 172.21.15.154:0/741436339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f104c054450 msgr2=0x7f104c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.834+0000 7f1052ffd640 1 --2- 172.21.15.154:0/741436339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f104c054450 0x7f104c0d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.838+0000 7f1052ffd640 1 -- 172.21.15.154:0/741436339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f104c0ebb90 msgr2=0x7f104c038dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.838+0000 7f1052ffd640 1 --2- 172.21.15.154:0/741436339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f104c0ebb90 0x7f104c038dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.838+0000 7f1052ffd640 1 -- 172.21.15.154:0/741436339 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c0d2450 con 0x7f104c0e7560 2024-05-14T01:23:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.838+0000 7f4d177fe640 1 -- 172.21.15.154:0/1724392635 <== osd.2 v2:172.21.15.154:6800/1507596223 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4d1c0725e0 con 0x7f4d1c06fb10 2024-05-14T01:23:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.838+0000 7f1052ffd640 1 --2- 172.21.15.154:0/741436339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f104c0e7560 0x7f104c0e3250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1054050910 tx=0x7f1054094d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.838+0000 7f103ffff640 1 -- 172.21.15.154:0/741436339 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105412d040 con 0x7f104c0e7560 2024-05-14T01:23:40.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.838+0000 7f1059c8a640 1 -- 172.21.15.154:0/741436339 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f104c180af0 con 0x7f104c0e7560 2024-05-14T01:23:40.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.838+0000 7f1059c8a640 1 -- 172.21.15.154:0/741436339 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f104c0e1a40 con 0x7f104c0e7560 2024-05-14T01:23:40.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.838+0000 7f103ffff640 1 -- 172.21.15.154:0/741436339 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1054120a20 con 0x7f104c0e7560 2024-05-14T01:23:40.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.838+0000 7f103ffff640 1 -- 172.21.15.154:0/741436339 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1054129df0 con 0x7f104c0e7560 2024-05-14T01:23:40.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.838+0000 7f1059c8a640 1 -- 172.21.15.154:0/741436339 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f104c0e23e0 con 0x7f104c0e7560 2024-05-14T01:23:40.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f1ddb0b8640 1 -- 172.21.15.154:0/818059610 --> [v2:172.21.15.154:6824/1610701849,v1:172.21.15.154:6825/1610701849] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1dbc002de0 con 0x7f1db806fbe0 2024-05-14T01:23:40.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f1dcaffd640 1 -- 172.21.15.154:0/818059610 <== osd.0 v2:172.21.15.154:6824/1610701849 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1dbc002de0 con 0x7f1db806fbe0 2024-05-14T01:23:40.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f1ddb0b8640 1 -- 172.21.15.154:0/818059610 >> [v2:172.21.15.154:6824/1610701849,v1:172.21.15.154:6825/1610701849] conn(0x7f1db806fbe0 msgr2=0x7f1db8072000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f1ddb0b8640 1 --2- 172.21.15.154:0/818059610 >> [v2:172.21.15.154:6824/1610701849,v1:172.21.15.154:6825/1610701849] conn(0x7f1db806fbe0 0x7f1db8072000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.838+0000 7f103ffff640 1 -- 172.21.15.154:0/741436339 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f105413b030 con 0x7f104c0e7560 2024-05-14T01:23:40.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f103ffff640 1 --2- 172.21.15.154:0/741436339 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1044067a20 0x7f1044069ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f103ffff640 1 -- 172.21.15.154:0/741436339 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f105419c030 con 0x7f104c0e7560 2024-05-14T01:23:40.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f103ffff640 1 --2- 172.21.15.154:0/741436339 >> [v2:172.21.15.176:6816/2424559788,v1:172.21.15.176:6817/2424559788] conn(0x7f104406fc40 0x7f1044072060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f103ffff640 1 -- 172.21.15.154:0/741436339 --> [v2:172.21.15.176:6816/2424559788,v1:172.21.15.176:6817/2424559788] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10541292a0 con 0x7f104406fc40 2024-05-14T01:23:40.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f103ffff640 1 -- 172.21.15.154:0/741436339 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f105419c420 con 0x7f104c0e7560 2024-05-14T01:23:40.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f10537fe640 1 --2- 172.21.15.154:0/741436339 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1044067a20 0x7f1044069ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f1ddb0b8640 1 -- 172.21.15.154:0/818059610 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1db80679c0 msgr2=0x7f1db8069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f1ddb0b8640 1 --2- 172.21.15.154:0/818059610 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1db80679c0 0x7f1db8069e80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0553d0 tx=0x7f1dd408d040 comp rx=0 tx=0).stop 2024-05-14T01:23:40.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f1ddb0b8640 1 -- 172.21.15.154:0/818059610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dcc03a0b0 msgr2=0x7f1dcc0d9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f1ddb0b8640 1 --2- 172.21.15.154:0/818059610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dcc03a0b0 0x7f1dcc0d9320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00011f0 tx=0x7f1dd000cbe0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f1dda8b7640 1 -- 172.21.15.154:0/818059610 reap_dead start 2024-05-14T01:23:40.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f1ddb0b8640 1 -- 172.21.15.154:0/818059610 shutdown_connections 2024-05-14T01:23:40.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f1ddb0b8640 1 -- 172.21.15.154:0/818059610 >> 172.21.15.154:0/818059610 conn(0x7f1dcc01e6d0 msgr2=0x7f1dcc04aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f1053fff640 1 --2- 172.21.15.154:0/741436339 >> [v2:172.21.15.176:6816/2424559788,v1:172.21.15.176:6817/2424559788] conn(0x7f104406fc40 0x7f1044072060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f1ddb0b8640 1 -- 172.21.15.154:0/818059610 shutdown_connections 2024-05-14T01:23:40.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f1ddb0b8640 1 -- 172.21.15.154:0/818059610 wait complete. 2024-05-14T01:23:40.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f1053fff640 1 --2- 172.21.15.154:0/741436339 >> [v2:172.21.15.176:6816/2424559788,v1:172.21.15.176:6817/2424559788] conn(0x7f104406fc40 0x7f1044072060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f10537fe640 1 --2- 172.21.15.154:0/741436339 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1044067a20 0x7f1044069ee0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1048007a60 tx=0x7f1048008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.842+0000 7f103ffff640 1 -- 172.21.15.154:0/741436339 <== osd.4 v2:172.21.15.176:6816/2424559788 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10541292a0 con 0x7f104406fc40 2024-05-14T01:23:40.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.846+0000 7fe7ba3b0640 1 -- 172.21.15.154:0/1908650266 --> [v2:172.21.15.154:6808/682645045,v1:172.21.15.154:6809/682645045] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe7ac0057f0 con 0x7fe798070670 2024-05-14T01:23:40.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.846+0000 7fe7a9ffb640 1 -- 172.21.15.154:0/1908650266 <== osd.3 v2:172.21.15.154:6808/682645045 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe7ac0057f0 con 0x7fe798070670 2024-05-14T01:23:40.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.846+0000 7fe7ba3b0640 1 -- 172.21.15.154:0/1908650266 >> [v2:172.21.15.154:6808/682645045,v1:172.21.15.154:6809/682645045] conn(0x7fe798070670 msgr2=0x7fe798072b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.846+0000 7fe7ba3b0640 1 --2- 172.21.15.154:0/1908650266 >> [v2:172.21.15.154:6808/682645045,v1:172.21.15.154:6809/682645045] conn(0x7fe798070670 0x7fe798072b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.846+0000 7ff7455d4640 1 Processor -- start 2024-05-14T01:23:40.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.846+0000 7ff7455d4640 1 -- start start 2024-05-14T01:23:40.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.846+0000 7ff7455d4640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff7400b31f0 0x7ff7401759b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.846+0000 7ff7455d4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff74006d300 con 0x7ff74016b580 2024-05-14T01:23:40.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.846+0000 7ff7455d4640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff74006d5e0 con 0x7ff74006cad0 2024-05-14T01:23:40.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.846+0000 7ff7455d4640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff74006d8c0 con 0x7ff7400b31f0 2024-05-14T01:23:40.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.846+0000 7ff73ffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff74016b580 0x7ff74016b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57266/0 (socket says 172.21.15.154:57266) 2024-05-14T01:23:40.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.846+0000 7ff73ffff640 1 -- 172.21.15.154:0/3173511707 learned_addr learned my addr 172.21.15.154:0/3173511707 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:40.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.846+0000 7ff744dd3640 1 --2- 172.21.15.154:0/3173511707 >> v2:172.21.15.176:3300/0 conn(0x7ff7400b31f0 0x7ff7401759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.846+0000 7ff73effd640 1 -- 172.21.15.154:0/3173511707 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2928080851 0 0) 0x7ff74006d300 con 0x7ff74016b580 2024-05-14T01:23:40.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.846+0000 7ff73effd640 1 -- 172.21.15.154:0/3173511707 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff728007940 con 0x7ff74016b580 2024-05-14T01:23:40.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.846+0000 7ff744dd3640 1 -- 172.21.15.154:0/3173511707 >> v1:172.21.15.176:6789/0 conn(0x7ff74006cad0 legacy=0x7ff7400b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.846+0000 7ff744dd3640 1 -- 172.21.15.154:0/3173511707 >> v1:172.21.15.154:6789/0 conn(0x7ff74016b580 legacy=0x7ff74016b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.846+0000 7ff744dd3640 1 -- 172.21.15.154:0/3173511707 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff740071090 con 0x7ff7400b31f0 2024-05-14T01:23:40.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.850+0000 7f7005bed640 1 -- 172.21.15.154:0/3191327924 --> [v2:172.21.15.154:6810/4138707364,v1:172.21.15.154:6812/4138707364] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7000068a70 con 0x7f6fe406fa60 2024-05-14T01:23:40.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.850+0000 7f6febfff640 1 -- 172.21.15.154:0/3191327924 <== osd.1 v2:172.21.15.154:6810/4138707364 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7000068a70 con 0x7f6fe406fa60 2024-05-14T01:23:40.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.850+0000 7fe7ba3b0640 1 -- 172.21.15.154:0/1908650266 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe7980678c0 msgr2=0x7fe798069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.850+0000 7fe7ba3b0640 1 --2- 172.21.15.154:0/1908650266 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe7980678c0 0x7fe798069d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40af000 tx=0x7fe7a40a7000 comp rx=0 tx=0).stop 2024-05-14T01:23:40.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.850+0000 7fe7ba3b0640 1 -- 172.21.15.154:0/1908650266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7ac054950 msgr2=0x7fe7ac0e6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.850+0000 7fe7ba3b0640 1 --2- 172.21.15.154:0/1908650266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7ac054950 0x7fe7ac0e6240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000b710 tx=0x7fe7b000bb10 comp rx=0 tx=0).stop 2024-05-14T01:23:40.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.850+0000 7fe7b9baf640 1 -- 172.21.15.154:0/1908650266 reap_dead start 2024-05-14T01:23:40.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.850+0000 7ff744dd3640 1 --2- 172.21.15.154:0/3173511707 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7400b31f0 0x7ff7401759b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff738007530 tx=0x7ff73801c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=484e23aae2d82132 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.850+0000 7f7005bed640 1 -- 172.21.15.154:0/3191327924 >> [v2:172.21.15.154:6810/4138707364,v1:172.21.15.154:6812/4138707364] conn(0x7f6fe406fa60 msgr2=0x7f6fe4071e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.850+0000 7f7005bed640 1 --2- 172.21.15.154:0/3191327924 >> [v2:172.21.15.154:6810/4138707364,v1:172.21.15.154:6812/4138707364] conn(0x7f6fe406fa60 0x7f6fe4071e80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.850+0000 7ff73effd640 1 -- 172.21.15.154:0/3173511707 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7380ab070 con 0x7ff7400b31f0 2024-05-14T01:23:40.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.850+0000 7f7005bed640 1 -- 172.21.15.154:0/3191327924 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6fe40678c0 msgr2=0x7f6fe4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.850+0000 7f7005bed640 1 --2- 172.21.15.154:0/3191327924 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6fe40678c0 0x7f6fe4069d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4001810 tx=0x7f6ff4009040 comp rx=0 tx=0).stop 2024-05-14T01:23:40.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.850+0000 7f7005bed640 1 -- 172.21.15.154:0/3191327924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f700015abc0 msgr2=0x7f70001f88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.850+0000 7f7005bed640 1 --2- 172.21.15.154:0/3191327924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f700015abc0 0x7f70001f88d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6ff801b010 tx=0x7f6ff8019700 comp rx=0 tx=0).stop 2024-05-14T01:23:40.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.850+0000 7f700498b640 1 -- 172.21.15.154:0/3191327924 reap_dead start 2024-05-14T01:23:40.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.850+0000 7ff73effd640 1 -- 172.21.15.154:0/3173511707 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7380a56a0 con 0x7ff7400b31f0 2024-05-14T01:23:40.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.850+0000 7ff73effd640 1 -- 172.21.15.154:0/3173511707 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730001680 con 0x7ff7400b31f0 2024-05-14T01:23:40.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.854+0000 7f7005bed640 1 -- 172.21.15.154:0/3191327924 shutdown_connections 2024-05-14T01:23:40.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.854+0000 7f7005bed640 1 -- 172.21.15.154:0/3191327924 >> 172.21.15.154:0/3191327924 conn(0x7f7000071fc0 msgr2=0x7f700015eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.854+0000 7f7005bed640 1 -- 172.21.15.154:0/3191327924 shutdown_connections 2024-05-14T01:23:40.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.854+0000 7f7005bed640 1 -- 172.21.15.154:0/3191327924 wait complete. 2024-05-14T01:23:40.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.854+0000 7ff7455d4640 1 -- 172.21.15.154:0/3173511707 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7400b31f0 msgr2=0x7ff7401759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.854+0000 7ff7455d4640 1 --2- 172.21.15.154:0/3173511707 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7400b31f0 0x7ff7401759b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff738007530 tx=0x7ff73801c800 comp rx=0 tx=0).stop 2024-05-14T01:23:40.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.854+0000 7ff7455d4640 1 -- 172.21.15.154:0/3173511707 shutdown_connections 2024-05-14T01:23:40.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.854+0000 7ff7455d4640 1 --2- 172.21.15.154:0/3173511707 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7400b31f0 0x7ff7401759b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.854+0000 7ff7455d4640 1 -- 172.21.15.154:0/3173511707 >> 172.21.15.154:0/3173511707 conn(0x7ff74006b280 msgr2=0x7ff74006b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.854+0000 7ff7455d4640 1 -- 172.21.15.154:0/3173511707 shutdown_connections 2024-05-14T01:23:40.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.854+0000 7ff7455d4640 1 -- 172.21.15.154:0/3173511707 wait complete. 2024-05-14T01:23:40.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.854+0000 7ff7455d4640 1 Processor -- start 2024-05-14T01:23:40.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.854+0000 7ff7455d4640 1 -- start start 2024-05-14T01:23:40.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.854+0000 7ff7455d4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff74006cad0 0x7ff74015ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7fe7ba3b0640 1 -- 172.21.15.154:0/1908650266 shutdown_connections 2024-05-14T01:23:40.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7fe7ba3b0640 1 -- 172.21.15.154:0/1908650266 >> 172.21.15.154:0/1908650266 conn(0x7fe7ac020050 msgr2=0x7fe7ac00da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7ff7455d4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7400b31f0 0x7ff74016dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7fe7ba3b0640 1 -- 172.21.15.154:0/1908650266 shutdown_connections 2024-05-14T01:23:40.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7fe7ba3b0640 1 -- 172.21.15.154:0/1908650266 wait complete. 2024-05-14T01:23:40.860 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2024-05-14T01:23:40.860 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-14T01:23:40.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7ff7455d4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff74016b580 0x7ff7401593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7ff73ffff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff74006cad0 0x7ff74015ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7ff744dd3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff74016b580 0x7ff7401593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7ff744dd3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff74016b580 0x7ff7401593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46342/0 (socket says 172.21.15.154:46342) 2024-05-14T01:23:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7ff73f7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7400b31f0 0x7ff74016dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7ff73f7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7400b31f0 0x7ff74016dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:50026/0 (socket says 172.21.15.154:50026) 2024-05-14T01:23:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7ff73ffff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff74006cad0 0x7ff74015ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:59126/0 (socket says 172.21.15.154:59126) 2024-05-14T01:23:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7ff744dd3640 1 -- 172.21.15.154:0/2842866670 learned_addr learned my addr 172.21.15.154:0/2842866670 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7ff7455d4640 1 -- 172.21.15.154:0/2842866670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff740178aa0 con 0x7ff74016b580 2024-05-14T01:23:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7ff7455d4640 1 -- 172.21.15.154:0/2842866670 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff740178920 con 0x7ff7400b31f0 2024-05-14T01:23:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7ff7455d4640 1 -- 172.21.15.154:0/2842866670 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff740178c20 con 0x7ff74006cad0 2024-05-14T01:23:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7ff744dd3640 1 -- 172.21.15.154:0/2842866670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff74006cad0 msgr2=0x7ff74015ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7ff744dd3640 1 --2- 172.21.15.154:0/2842866670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff74006cad0 0x7ff74015ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7ff744dd3640 1 -- 172.21.15.154:0/2842866670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7400b31f0 msgr2=0x7ff74016dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7ff744dd3640 1 --2- 172.21.15.154:0/2842866670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7400b31f0 0x7ff74016dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7ff744dd3640 1 -- 172.21.15.154:0/2842866670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74015f660 con 0x7ff74016b580 2024-05-14T01:23:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7ff744dd3640 1 --2- 172.21.15.154:0/2842866670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff74016b580 0x7ff7401593d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff738019410 tx=0x7ff73800b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7f4d3536e640 1 -- 172.21.15.154:0/1724392635 --> [v2:172.21.15.154:6800/1507596223,v1:172.21.15.154:6801/1507596223] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4d10002de0 con 0x7f4d1c06fb10 2024-05-14T01:23:40.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7f4d177fe640 1 -- 172.21.15.154:0/1724392635 <== osd.2 v2:172.21.15.154:6800/1507596223 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4d10002de0 con 0x7f4d1c06fb10 2024-05-14T01:23:40.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7f4d3536e640 1 -- 172.21.15.154:0/1724392635 >> [v2:172.21.15.154:6800/1507596223,v1:172.21.15.154:6801/1507596223] conn(0x7f4d1c06fb10 msgr2=0x7f4d1c071f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.858+0000 7f4d3536e640 1 --2- 172.21.15.154:0/1724392635 >> [v2:172.21.15.154:6800/1507596223,v1:172.21.15.154:6801/1507596223] conn(0x7f4d1c06fb10 0x7f4d1c071f30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.862+0000 7f4d3536e640 1 -- 172.21.15.154:0/1724392635 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4d1c067910 msgr2=0x7f4d1c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.862+0000 7f4d3536e640 1 --2- 172.21.15.154:0/1724392635 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4d1c067910 0x7f4d1c069dd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d300af9b0 tx=0x7f4d240090e0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.862+0000 7f4d3536e640 1 -- 172.21.15.154:0/1724392635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d30159450 msgr2=0x7f4d300b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.862+0000 7f4d3536e640 1 --2- 172.21.15.154:0/1724392635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d30159450 0x7f4d300b18c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000b420 tx=0x7f4d2000b8e0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.862+0000 7f4d2f7fe640 1 -- 172.21.15.154:0/1724392635 reap_dead start 2024-05-14T01:23:40.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.866+0000 7f4d3536e640 1 -- 172.21.15.154:0/1724392635 shutdown_connections 2024-05-14T01:23:40.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.866+0000 7f4d3536e640 1 -- 172.21.15.154:0/1724392635 >> 172.21.15.154:0/1724392635 conn(0x7f4d30071e20 msgr2=0x7f4d30166960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.866+0000 7ff73cff9640 1 -- 172.21.15.154:0/2842866670 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7380ab040 con 0x7ff74016b580 2024-05-14T01:23:40.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.866+0000 7f4d3536e640 1 -- 172.21.15.154:0/1724392635 shutdown_connections 2024-05-14T01:23:40.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.866+0000 7f4d3536e640 1 -- 172.21.15.154:0/1724392635 wait complete. 2024-05-14T01:23:40.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.866+0000 7ff7455d4640 1 -- 172.21.15.154:0/2842866670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74015f940 con 0x7ff74016b580 2024-05-14T01:23:40.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.866+0000 7ff7455d4640 1 -- 172.21.15.154:0/2842866670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff74015ff00 con 0x7ff74016b580 2024-05-14T01:23:40.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.866+0000 7ff73cff9640 1 -- 172.21.15.154:0/2842866670 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7380bf070 con 0x7ff74016b580 2024-05-14T01:23:40.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.866+0000 7ff73cff9640 1 -- 172.21.15.154:0/2842866670 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738004280 con 0x7ff74016b580 2024-05-14T01:23:40.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.866+0000 7ff73cff9640 1 -- 172.21.15.154:0/2842866670 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff7380044e0 con 0x7ff74016b580 2024-05-14T01:23:40.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.866+0000 7ff73cff9640 1 --2- 172.21.15.154:0/2842866670 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff72c0679c0 0x7ff72c069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.866+0000 7ff73cff9640 1 -- 172.21.15.154:0/2842866670 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff738120aa0 con 0x7ff74016b580 2024-05-14T01:23:40.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.866+0000 7ff73ffff640 1 --2- 172.21.15.154:0/2842866670 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff72c0679c0 0x7ff72c069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.866+0000 7ff7455d4640 1 --2- 172.21.15.154:0/2842866670 >> [v2:172.21.15.176:6801/3092848670,v1:172.21.15.176:6803/3092848670] conn(0x7ff720001660 0x7ff720003b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:40.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.866+0000 7ff7455d4640 1 -- 172.21.15.154:0/2842866670 --> [v2:172.21.15.176:6801/3092848670,v1:172.21.15.176:6803/3092848670] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff720006bc0 con 0x7ff720001660 2024-05-14T01:23:40.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.866+0000 7ff73f7fe640 1 --2- 172.21.15.154:0/2842866670 >> [v2:172.21.15.176:6801/3092848670,v1:172.21.15.176:6803/3092848670] conn(0x7ff720001660 0x7ff720003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:40.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.866+0000 7ff73ffff640 1 --2- 172.21.15.154:0/2842866670 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff72c0679c0 0x7ff72c069e80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff730001ec0 tx=0x7ff730001b30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.870+0000 7ff73f7fe640 1 --2- 172.21.15.154:0/2842866670 >> [v2:172.21.15.176:6801/3092848670,v1:172.21.15.176:6803/3092848670] conn(0x7ff720001660 0x7ff720003b20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:40.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.870+0000 7f1059c8a640 1 -- 172.21.15.154:0/741436339 --> [v2:172.21.15.176:6816/2424559788,v1:172.21.15.176:6817/2424559788] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f104c0e23e0 con 0x7f104406fc40 2024-05-14T01:23:40.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.870+0000 7f103ffff640 1 -- 172.21.15.154:0/741436339 <== osd.4 v2:172.21.15.176:6816/2424559788 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f104c0e23e0 con 0x7f104406fc40 2024-05-14T01:23:40.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.870+0000 7ff73cff9640 1 -- 172.21.15.154:0/2842866670 <== osd.6 v2:172.21.15.176:6801/3092848670 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff720006bc0 con 0x7ff720001660 2024-05-14T01:23:40.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.870+0000 7f74a951e640 1 -- 172.21.15.154:0/2706328162 --> [v2:172.21.15.176:6800/2969535252,v1:172.21.15.176:6802/2969535252] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7484002de0 con 0x7f749006fb90 2024-05-14T01:23:40.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.874+0000 7f1059c8a640 1 -- 172.21.15.154:0/741436339 >> [v2:172.21.15.176:6816/2424559788,v1:172.21.15.176:6817/2424559788] conn(0x7f104406fc40 msgr2=0x7f1044072060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.874+0000 7f1059c8a640 1 --2- 172.21.15.154:0/741436339 >> [v2:172.21.15.176:6816/2424559788,v1:172.21.15.176:6817/2424559788] conn(0x7f104406fc40 0x7f1044072060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.874+0000 7f1059c8a640 1 -- 172.21.15.154:0/741436339 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1044067a20 msgr2=0x7f1044069ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.874+0000 7f1059c8a640 1 --2- 172.21.15.154:0/741436339 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1044067a20 0x7f1044069ee0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1048007a60 tx=0x7f1048008040 comp rx=0 tx=0).stop 2024-05-14T01:23:40.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.874+0000 7f1059c8a640 1 -- 172.21.15.154:0/741436339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f104c0e7560 msgr2=0x7f104c0e3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.874+0000 7f1059c8a640 1 --2- 172.21.15.154:0/741436339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f104c0e7560 0x7f104c0e3250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1054050910 tx=0x7f1054094d40 comp rx=0 tx=0).stop 2024-05-14T01:23:40.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.874+0000 7f1053fff640 1 -- 172.21.15.154:0/741436339 reap_dead start 2024-05-14T01:23:40.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.874+0000 7f1059c8a640 1 -- 172.21.15.154:0/741436339 shutdown_connections 2024-05-14T01:23:40.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.874+0000 7f1059c8a640 1 -- 172.21.15.154:0/741436339 >> 172.21.15.154:0/741436339 conn(0x7f104c009fc0 msgr2=0x7f104c04cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.871 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-05-14T01:23:40.871 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-14T01:23:40.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.878+0000 7f748b7fe640 1 -- 172.21.15.154:0/2706328162 <== osd.7 v2:172.21.15.176:6800/2969535252 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7484002de0 con 0x7f749006fb90 2024-05-14T01:23:40.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.878+0000 7f74a951e640 1 -- 172.21.15.154:0/2706328162 >> [v2:172.21.15.176:6800/2969535252,v1:172.21.15.176:6802/2969535252] conn(0x7f749006fb90 msgr2=0x7f7490071fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.878+0000 7f74a951e640 1 --2- 172.21.15.154:0/2706328162 >> [v2:172.21.15.176:6800/2969535252,v1:172.21.15.176:6802/2969535252] conn(0x7f749006fb90 0x7f7490071fb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.878+0000 7f74a951e640 1 -- 172.21.15.154:0/2706328162 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7490067990 msgr2=0x7f7490069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.878+0000 7f74a951e640 1 --2- 172.21.15.154:0/2706328162 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7490067990 0x7f7490069e50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f74940b2000 tx=0x7f7494008040 comp rx=0 tx=0).stop 2024-05-14T01:23:40.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.878+0000 7f74a951e640 1 -- 172.21.15.154:0/2706328162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f749c038ee0 msgr2=0x7f749c0d6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.878+0000 7f74a951e640 1 --2- 172.21.15.154:0/2706328162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f749c038ee0 0x7f749c0d6a80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f74a406b180 tx=0x7f74a40686d0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.878+0000 7f74a37fe640 1 -- 172.21.15.154:0/2706328162 reap_dead start 2024-05-14T01:23:40.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.878+0000 7f74a951e640 1 -- 172.21.15.154:0/2706328162 shutdown_connections 2024-05-14T01:23:40.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.878+0000 7f74a951e640 1 -- 172.21.15.154:0/2706328162 >> 172.21.15.154:0/2706328162 conn(0x7f749c054b00 msgr2=0x7f749c0e55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.878+0000 7f1059c8a640 1 -- 172.21.15.154:0/741436339 shutdown_connections 2024-05-14T01:23:40.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.878+0000 7f1059c8a640 1 -- 172.21.15.154:0/741436339 wait complete. 2024-05-14T01:23:40.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.878+0000 7f74a951e640 1 -- 172.21.15.154:0/2706328162 shutdown_connections 2024-05-14T01:23:40.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.878+0000 7f74a951e640 1 -- 172.21.15.154:0/2706328162 wait complete. 2024-05-14T01:23:40.875 INFO:teuthology.orchestra.run.smithi154.stdout:55834574856 2024-05-14T01:23:40.875 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-14T01:23:40.876 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2024-05-14T01:23:40.876 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-14T01:23:40.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.898+0000 7ff7455d4640 1 -- 172.21.15.154:0/2842866670 --> [v2:172.21.15.176:6801/3092848670,v1:172.21.15.176:6803/3092848670] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff720005c70 con 0x7ff720001660 2024-05-14T01:23:40.883 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-05-14T01:23:40.883 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-14T01:23:40.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.898+0000 7ff73cff9640 1 -- 172.21.15.154:0/2842866670 <== osd.6 v2:172.21.15.176:6801/3092848670 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff720005c70 con 0x7ff720001660 2024-05-14T01:23:40.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.898+0000 7ff7455d4640 1 -- 172.21.15.154:0/2842866670 >> [v2:172.21.15.176:6801/3092848670,v1:172.21.15.176:6803/3092848670] conn(0x7ff720001660 msgr2=0x7ff720003b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.898+0000 7ff7455d4640 1 --2- 172.21.15.154:0/2842866670 >> [v2:172.21.15.176:6801/3092848670,v1:172.21.15.176:6803/3092848670] conn(0x7ff720001660 0x7ff720003b20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:40.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.898+0000 7ff7455d4640 1 -- 172.21.15.154:0/2842866670 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff72c0679c0 msgr2=0x7ff72c069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.898+0000 7ff7455d4640 1 --2- 172.21.15.154:0/2842866670 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff72c0679c0 0x7ff72c069e80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff730001ec0 tx=0x7ff730001b30 comp rx=0 tx=0).stop 2024-05-14T01:23:40.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.898+0000 7ff7455d4640 1 -- 172.21.15.154:0/2842866670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff74016b580 msgr2=0x7ff7401593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:40.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.898+0000 7ff7455d4640 1 --2- 172.21.15.154:0/2842866670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff74016b580 0x7ff7401593d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff738019410 tx=0x7ff73800b420 comp rx=0 tx=0).stop 2024-05-14T01:23:40.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.898+0000 7ff744dd3640 1 -- 172.21.15.154:0/2842866670 reap_dead start 2024-05-14T01:23:40.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.898+0000 7ff7455d4640 1 -- 172.21.15.154:0/2842866670 shutdown_connections 2024-05-14T01:23:40.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.898+0000 7ff7455d4640 1 -- 172.21.15.154:0/2842866670 >> 172.21.15.154:0/2842866670 conn(0x7ff74006b280 msgr2=0x7ff74016a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:40.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.898+0000 7ff7455d4640 1 -- 172.21.15.154:0/2842866670 shutdown_connections 2024-05-14T01:23:40.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:40.898+0000 7ff7455d4640 1 -- 172.21.15.154:0/2842866670 wait complete. 2024-05-14T01:23:40.889 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-05-14T01:23:40.889 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-14T01:23:40.890 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2024-05-14T01:23:40.891 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-14T01:23:40.906 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-05-14T01:23:40.907 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-14T01:23:41.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.038+0000 7fdf2a84c640 1 Processor -- start 2024-05-14T01:23:41.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.038+0000 7fdf2a84c640 1 -- start start 2024-05-14T01:23:41.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.038+0000 7f720b4d8640 1 Processor -- start 2024-05-14T01:23:41.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.038+0000 7fdf2a84c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdf2413ce00 0x7fdf2413d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.038+0000 7fdf2a84c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf2415ae10 0x7fdf2415b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.038+0000 7fdf2a84c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdf2406ded0 0x7fdf2406e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.038+0000 7fdf2a84c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fdf2413dee0 con 0x7fdf2413ce00 2024-05-14T01:23:41.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.038+0000 7fdf2a84c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdf2406ce30 con 0x7fdf2406ded0 2024-05-14T01:23:41.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.038+0000 7fdf2a84c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdf2406d110 con 0x7fdf2415ae10 2024-05-14T01:23:41.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.038+0000 7f720b4d8640 1 -- start start 2024-05-14T01:23:41.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7fdf23fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdf2413ce00 0x7fdf2413d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7fdf28de9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdf2406ded0 0x7fdf2406e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7fdf28de9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdf2406ded0 0x7fdf2406e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:50030/0 (socket says 172.21.15.154:50030) 2024-05-14T01:23:41.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7fdf28de9640 1 -- 172.21.15.154:0/3418092190 learned_addr learned my addr 172.21.15.154:0/3418092190 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:41.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7fdf237fe640 1 --2- 172.21.15.154:0/3418092190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf2415ae10 0x7fdf2415b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7fdf28de9640 1 -- 172.21.15.154:0/3418092190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf2415ae10 msgr2=0x7fdf2415b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:41.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7fdf28de9640 1 --2- 172.21.15.154:0/3418092190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf2415ae10 0x7fdf2415b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7fdf28de9640 1 -- 172.21.15.154:0/3418092190 >> v2:172.21.15.154:3300/0 conn(0x7fdf2413ce00 msgr2=0x7fdf2413d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:41.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7fdf28de9640 1 --2- 172.21.15.154:0/3418092190 >> v2:172.21.15.154:3300/0 conn(0x7fdf2413ce00 0x7fdf2413d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7fdf28de9640 1 -- 172.21.15.154:0/3418092190 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2406d3f0 con 0x7fdf2406ded0 2024-05-14T01:23:41.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7f720b4d8640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f72040b3250 0x7f72040d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7f720b4d8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f72040d05f0 0x7f72040b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7f720b4d8640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72040d09f0 con 0x7f720415bdb0 2024-05-14T01:23:41.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7f720b4d8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f72040af1c0 con 0x7f72040d05f0 2024-05-14T01:23:41.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7f720b4d8640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f72040af4a0 con 0x7f72040b3250 2024-05-14T01:23:41.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7f7209a75640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f72040d05f0 0x7f72040b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7f7209a75640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f72040d05f0 0x7f72040b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46348/0 (socket says 172.21.15.154:46348) 2024-05-14T01:23:41.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7f7209a75640 1 -- 172.21.15.154:0/1876358422 learned_addr learned my addr 172.21.15.154:0/1876358422 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:41.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7f7208a73640 1 --2- 172.21.15.154:0/1876358422 >> v2:172.21.15.176:3300/0 conn(0x7f72040b3250 0x7f72040d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7fdf28de9640 1 --2- 172.21.15.154:0/3418092190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf2406ded0 0x7fdf2406e360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdf2406eac0 tx=0x7fdf1c01ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3a03303866ce2aa server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7fdf22ffd640 1 -- 172.21.15.154:0/3418092190 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c0ad070 con 0x7fdf2406ded0 2024-05-14T01:23:41.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7f7209a75640 1 -- 172.21.15.154:0/1876358422 >> v2:172.21.15.176:3300/0 conn(0x7f72040b3250 msgr2=0x7f72040d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:41.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7f7209a75640 1 --2- 172.21.15.154:0/1876358422 >> v2:172.21.15.176:3300/0 conn(0x7f72040b3250 0x7f72040d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7f7209a75640 1 -- 172.21.15.154:0/1876358422 >> v1:172.21.15.176:6789/0 conn(0x7f720415bdb0 legacy=0x7f72040ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7f7209a75640 1 -- 172.21.15.154:0/1876358422 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72040af780 con 0x7f72040d05f0 2024-05-14T01:23:41.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.042+0000 7f71fbfff640 1 -- 172.21.15.154:0/1876358422 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1160744685 0 0) 0x7f72040d09f0 con 0x7f720415bdb0 2024-05-14T01:23:41.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7fdf22ffd640 1 -- 172.21.15.154:0/3418092190 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf1c0a7df0 con 0x7fdf2406ded0 2024-05-14T01:23:41.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7fdf22ffd640 1 -- 172.21.15.154:0/3418092190 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c0b1620 con 0x7fdf2406ded0 2024-05-14T01:23:41.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7f7209a75640 1 --2- 172.21.15.154:0/1876358422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72040d05f0 0x7f72040b0240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7204072ef0 tx=0x7f7200020900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502ac12d0d3736d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7f71fbfff640 1 -- 172.21.15.154:0/1876358422 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72000b6070 con 0x7f72040d05f0 2024-05-14T01:23:41.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7f71fbfff640 1 -- 172.21.15.154:0/1876358422 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72000a96c0 con 0x7f72040d05f0 2024-05-14T01:23:41.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7f71fbfff640 1 -- 172.21.15.154:0/1876358422 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72000a9a90 con 0x7f72040d05f0 2024-05-14T01:23:41.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7fdf2a84c640 1 -- 172.21.15.154:0/3418092190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf2406ded0 msgr2=0x7fdf2406e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7fdf2a84c640 1 --2- 172.21.15.154:0/3418092190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf2406ded0 0x7fdf2406e360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdf2406eac0 tx=0x7fdf1c01ed40 comp rx=0 tx=0).stop 2024-05-14T01:23:41.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7fdf2a84c640 1 -- 172.21.15.154:0/3418092190 shutdown_connections 2024-05-14T01:23:41.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7fdf2a84c640 1 --2- 172.21.15.154:0/3418092190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf2415ae10 0x7fdf2415b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7fdf2a84c640 1 --2- 172.21.15.154:0/3418092190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf2406ded0 0x7fdf2406e360 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7fdf2a84c640 1 --2- 172.21.15.154:0/3418092190 >> v2:172.21.15.154:3300/0 conn(0x7fdf2413ce00 0x7fdf2413d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7fdf2a84c640 1 -- 172.21.15.154:0/3418092190 >> 172.21.15.154:0/3418092190 conn(0x7fdf240b1670 msgr2=0x7fdf240b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7f720b4d8640 1 -- 172.21.15.154:0/1876358422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72040d05f0 msgr2=0x7f72040b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7f720b4d8640 1 --2- 172.21.15.154:0/1876358422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72040d05f0 0x7f72040b0240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7204072ef0 tx=0x7f7200020900 comp rx=0 tx=0).stop 2024-05-14T01:23:41.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7fdf2a84c640 1 -- 172.21.15.154:0/3418092190 shutdown_connections 2024-05-14T01:23:41.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7fdf2a84c640 1 -- 172.21.15.154:0/3418092190 wait complete. 2024-05-14T01:23:41.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7f720b4d8640 1 -- 172.21.15.154:0/1876358422 shutdown_connections 2024-05-14T01:23:41.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7f720b4d8640 1 --2- 172.21.15.154:0/1876358422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72040d05f0 0x7f72040b0240 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7f720b4d8640 1 --2- 172.21.15.154:0/1876358422 >> v2:172.21.15.176:3300/0 conn(0x7f72040b3250 0x7f72040d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.046+0000 7f720b4d8640 1 -- 172.21.15.154:0/1876358422 >> 172.21.15.154:0/1876358422 conn(0x7f720409aa10 msgr2=0x7f720409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7f720b4d8640 1 -- 172.21.15.154:0/1876358422 shutdown_connections 2024-05-14T01:23:41.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7f720b4d8640 1 -- 172.21.15.154:0/1876358422 wait complete. 2024-05-14T01:23:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf2a84c640 1 Processor -- start 2024-05-14T01:23:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf2a84c640 1 -- start start 2024-05-14T01:23:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf2a84c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf2406ded0 0x7fdf241556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf2a84c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf2413ce00 0x7fdf24153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf2a84c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf2415ae10 0x7fdf24153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf2a84c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2413d360 con 0x7fdf2413ce00 2024-05-14T01:23:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf2a84c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2413d1e0 con 0x7fdf2406ded0 2024-05-14T01:23:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf2a84c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdf2415e9a0 con 0x7fdf2415ae10 2024-05-14T01:23:41.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7f720b4d8640 1 Processor -- start 2024-05-14T01:23:41.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7f720b4d8640 1 -- start start 2024-05-14T01:23:41.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf237fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf2413ce00 0x7fdf24153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf237fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf2413ce00 0x7fdf24153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46362/0 (socket says 172.21.15.154:46362) 2024-05-14T01:23:41.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf237fe640 1 -- 172.21.15.154:0/1062693975 learned_addr learned my addr 172.21.15.154:0/1062693975 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:41.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf28de9640 1 --2- 172.21.15.154:0/1062693975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf2415ae10 0x7fdf24153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf28de9640 1 -- 172.21.15.154:0/1062693975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf2406ded0 msgr2=0x7fdf241556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf28de9640 1 --2- 172.21.15.154:0/1062693975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf2406ded0 0x7fdf241556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf28de9640 1 -- 172.21.15.154:0/1062693975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf2413ce00 msgr2=0x7fdf24153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf28de9640 1 --2- 172.21.15.154:0/1062693975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf2413ce00 0x7fdf24153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf28de9640 1 -- 172.21.15.154:0/1062693975 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf24155cb0 con 0x7fdf2415ae10 2024-05-14T01:23:41.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf237fe640 1 --2- 172.21.15.154:0/1062693975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf2413ce00 0x7fdf24153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:23:41.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf28de9640 1 --2- 172.21.15.154:0/1062693975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf2415ae10 0x7fdf24153a30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdf2415db70 tx=0x7fdf1c01d580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7f720b4d8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72040b3250 0x7f720415cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7f720b4d8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72040d05f0 0x7f7204159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7f720b4d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f720415bdb0 0x7f720415a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7f720b4d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f72040b1110 con 0x7f720415bdb0 2024-05-14T01:23:41.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7f720b4d8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f72040b0f90 con 0x7f72040d05f0 2024-05-14T01:23:41.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7f720b4d8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f72040b1290 con 0x7f72040b3250 2024-05-14T01:23:41.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7f7209a75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f720415bdb0 0x7f720415a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf20ff9640 1 -- 172.21.15.154:0/1062693975 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c0c0070 con 0x7fdf2415ae10 2024-05-14T01:23:41.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf20ff9640 1 -- 172.21.15.154:0/1062693975 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf1c0b1bf0 con 0x7fdf2415ae10 2024-05-14T01:23:41.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf20ff9640 1 -- 172.21.15.154:0/1062693975 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c0ad040 con 0x7fdf2415ae10 2024-05-14T01:23:41.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf2a84c640 1 -- 172.21.15.154:0/1062693975 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf24155f90 con 0x7fdf2415ae10 2024-05-14T01:23:41.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7f7209a75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f720415bdb0 0x7f720415a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46374/0 (socket says 172.21.15.154:46374) 2024-05-14T01:23:41.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7f7209a75640 1 -- 172.21.15.154:0/1544978918 learned_addr learned my addr 172.21.15.154:0/1544978918 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:41.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7f7208a73640 1 --2- 172.21.15.154:0/1544978918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72040d05f0 0x7f7204159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7f7209274640 1 --2- 172.21.15.154:0/1544978918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72040b3250 0x7f720415cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.050+0000 7fdf2a84c640 1 -- 172.21.15.154:0/1062693975 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf24156550 con 0x7fdf2415ae10 2024-05-14T01:23:41.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.054+0000 7f7209a75640 1 -- 172.21.15.154:0/1544978918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72040b3250 msgr2=0x7f720415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.054+0000 7f7209a75640 1 --2- 172.21.15.154:0/1544978918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72040b3250 0x7f720415cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.054+0000 7f7209a75640 1 -- 172.21.15.154:0/1544978918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72040d05f0 msgr2=0x7f7204159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.054+0000 7f7209a75640 1 --2- 172.21.15.154:0/1544978918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72040d05f0 0x7f7204159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.054+0000 7f7209a75640 1 -- 172.21.15.154:0/1544978918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72040b6840 con 0x7f720415bdb0 2024-05-14T01:23:41.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.054+0000 7f7209a75640 1 --2- 172.21.15.154:0/1544978918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f720415bdb0 0x7f720415a530 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f72000b4040 tx=0x7f720001d6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.054+0000 7f71f9ffb640 1 -- 172.21.15.154:0/1544978918 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72000c1070 con 0x7f720415bdb0 2024-05-14T01:23:41.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.054+0000 7f71f9ffb640 1 -- 172.21.15.154:0/1544978918 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72000b1640 con 0x7f720415bdb0 2024-05-14T01:23:41.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.054+0000 7f71f9ffb640 1 -- 172.21.15.154:0/1544978918 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72000b6040 con 0x7f720415bdb0 2024-05-14T01:23:41.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.054+0000 7f720b4d8640 1 -- 172.21.15.154:0/1544978918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72040b6b20 con 0x7f720415bdb0 2024-05-14T01:23:41.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.054+0000 7f720b4d8640 1 -- 172.21.15.154:0/1544978918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72040b70e0 con 0x7f720415bdb0 2024-05-14T01:23:41.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.054+0000 7f720b4d8640 1 -- 172.21.15.154:0/1544978918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7204069310 con 0x7f720415bdb0 2024-05-14T01:23:41.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.054+0000 7f71f9ffb640 1 -- 172.21.15.154:0/1544978918 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f72000b19f0 con 0x7f720415bdb0 2024-05-14T01:23:41.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.054+0000 7fdf20ff9640 1 -- 172.21.15.154:0/1062693975 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdf1c0c3070 con 0x7fdf2415ae10 2024-05-14T01:23:41.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.054+0000 7f71f9ffb640 1 --2- 172.21.15.154:0/1544978918 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f71f00679e0 0x7f71f0069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.058+0000 7fdf20ff9640 1 --2- 172.21.15.154:0/1062693975 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdf10067990 0x7fdf10069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.058+0000 7f71f9ffb640 1 -- 172.21.15.154:0/1544978918 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7200123930 con 0x7f720415bdb0 2024-05-14T01:23:41.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.058+0000 7f7209274640 1 --2- 172.21.15.154:0/1544978918 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f71f00679e0 0x7f71f0069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.058+0000 7fdf20ff9640 1 -- 172.21.15.154:0/1062693975 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdf1c1202f0 con 0x7fdf2415ae10 2024-05-14T01:23:41.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.058+0000 7f7209274640 1 --2- 172.21.15.154:0/1544978918 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f71f00679e0 0x7f71f0069ea0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f72040c5700 tx=0x7f71fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.062+0000 7fdf23fff640 1 --2- 172.21.15.154:0/1062693975 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdf10067990 0x7fdf10069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7f71f9ffb640 1 -- 172.21.15.154:0/1544978918 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f720001a520 con 0x7f720415bdb0 2024-05-14T01:23:41.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7fdf2a84c640 1 -- 172.21.15.154:0/1062693975 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf040052a0 con 0x7fdf2415ae10 2024-05-14T01:23:41.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7fdf23fff640 1 --2- 172.21.15.154:0/1062693975 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdf10067990 0x7fdf10069e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdf14006aa0 tx=0x7fdf14006a30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7fafa2f02640 1 Processor -- start 2024-05-14T01:23:41.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7fafa2f02640 1 -- start start 2024-05-14T01:23:41.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7fafa2f02640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faf9c15ae90 0x7faf9c0aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7fafa2f02640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faf9c0aeff0 0x7faf9c0cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7fafa0c9e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faf9c15ae90 0x7faf9c0aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7fafa0c9e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faf9c15ae90 0x7faf9c0aeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46376/0 (socket says 172.21.15.154:46376) 2024-05-14T01:23:41.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7fafa0c9e640 1 -- 172.21.15.154:0/2736576820 learned_addr learned my addr 172.21.15.154:0/2736576820 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:41.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7fafa149f640 1 --1- 172.21.15.154:0/2736576820 >> v1:172.21.15.154:6789/0 conn(0x7faf9c15b270 0x7faf9c06c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57276/0 (socket says 172.21.15.154:57276) 2024-05-14T01:23:41.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7faf9bfff640 1 --2- 172.21.15.154:0/2736576820 >> v2:172.21.15.176:3300/0 conn(0x7faf9c0aeff0 0x7faf9c0cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7fafa2f02640 1 -- 172.21.15.154:0/2736576820 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf9c0cc420 con 0x7faf9c15b270 2024-05-14T01:23:41.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7fafa2f02640 1 -- 172.21.15.154:0/2736576820 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7faf9c15ebc0 con 0x7faf9c15ae90 2024-05-14T01:23:41.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7fafa2f02640 1 -- 172.21.15.154:0/2736576820 --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7faf9c0cc700 con 0x7faf9c0aeff0 2024-05-14T01:23:41.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7faf9b7fe640 1 -- 172.21.15.154:0/2736576820 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3890011366 0 0) 0x7faf9c0cc420 con 0x7faf9c15b270 2024-05-14T01:23:41.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7faf9b7fe640 1 -- 172.21.15.154:0/2736576820 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf8c003530 con 0x7faf9c15b270 2024-05-14T01:23:41.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7fafa0c9e640 1 -- 172.21.15.154:0/2736576820 >> v2:172.21.15.176:3300/0 conn(0x7faf9c0aeff0 msgr2=0x7faf9c0cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:41.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7fafa0c9e640 1 --2- 172.21.15.154:0/2736576820 >> v2:172.21.15.176:3300/0 conn(0x7faf9c0aeff0 0x7faf9c0cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7fafa0c9e640 1 -- 172.21.15.154:0/2736576820 >> v1:172.21.15.154:6789/0 conn(0x7faf9c15b270 legacy=0x7faf9c06c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.066+0000 7fafa0c9e640 1 -- 172.21.15.154:0/2736576820 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9c0cc9e0 con 0x7faf9c15ae90 2024-05-14T01:23:41.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.070+0000 7fafa0c9e640 1 --2- 172.21.15.154:0/2736576820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf9c15ae90 0x7faf9c0aeab0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faf9c15eb20 tx=0x7faf9001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1933b7123fa1be5a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.070+0000 7faf9b7fe640 1 -- 172.21.15.154:0/2736576820 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf900ab650 con 0x7faf9c15ae90 2024-05-14T01:23:41.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.070+0000 7faf9b7fe640 1 -- 172.21.15.154:0/2736576820 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf900b0070 con 0x7faf9c15ae90 2024-05-14T01:23:41.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.070+0000 7fb1c8f0b640 1 Processor -- start 2024-05-14T01:23:41.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.070+0000 7fb1c8f0b640 1 -- start start 2024-05-14T01:23:41.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.070+0000 7faf9b7fe640 1 -- 172.21.15.154:0/2736576820 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf900ab9f0 con 0x7faf9c15ae90 2024-05-14T01:23:41.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.070+0000 7fafa2f02640 1 -- 172.21.15.154:0/2736576820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf9c15ae90 msgr2=0x7faf9c0aeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.070+0000 7fafa2f02640 1 --2- 172.21.15.154:0/2736576820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf9c15ae90 0x7faf9c0aeab0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faf9c15eb20 tx=0x7faf9001c4f0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.070+0000 7fafa2f02640 1 -- 172.21.15.154:0/2736576820 shutdown_connections 2024-05-14T01:23:41.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.070+0000 7fafa2f02640 1 --2- 172.21.15.154:0/2736576820 >> v2:172.21.15.176:3300/0 conn(0x7faf9c0aeff0 0x7faf9c0cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.070+0000 7fafa2f02640 1 --2- 172.21.15.154:0/2736576820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf9c15ae90 0x7faf9c0aeab0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.070+0000 7fafa2f02640 1 -- 172.21.15.154:0/2736576820 >> 172.21.15.154:0/2736576820 conn(0x7faf9c072050 msgr2=0x7faf9c072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.070+0000 7fafa2f02640 1 -- 172.21.15.154:0/2736576820 shutdown_connections 2024-05-14T01:23:41.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.070+0000 7fafa2f02640 1 -- 172.21.15.154:0/2736576820 wait complete. 2024-05-14T01:23:41.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c8f0b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb1c41445e0 0x7fb1c40b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c8f0b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c40b59b0 0x7fb1c406c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c2d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb1c406c7d0 0x7fb1c415e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57278/0 (socket says 172.21.15.154:57278) 2024-05-14T01:23:41.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c2d9d640 1 -- 172.21.15.154:0/863621604 learned_addr learned my addr 172.21.15.154:0/863621604 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:41.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c1d9b640 1 --2- 172.21.15.154:0/863621604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c40b59b0 0x7fb1c406c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c8f0b640 1 -- 172.21.15.154:0/863621604 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1c406df10 con 0x7fb1c406c7d0 2024-05-14T01:23:41.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c8f0b640 1 -- 172.21.15.154:0/863621604 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb1c406dcc0 con 0x7fb1c41445e0 2024-05-14T01:23:41.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c8f0b640 1 -- 172.21.15.154:0/863621604 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c41449c0 con 0x7fb1c40b59b0 2024-05-14T01:23:41.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa2f02640 1 Processor -- start 2024-05-14T01:23:41.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa2f02640 1 -- start start 2024-05-14T01:23:41.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c159a640 1 -- 172.21.15.154:0/863621604 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151379935 0 0) 0x7fb1c406df10 con 0x7fb1c406c7d0 2024-05-14T01:23:41.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c159a640 1 -- 172.21.15.154:0/863621604 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1ac005740 con 0x7fb1c406c7d0 2024-05-14T01:23:41.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c159a640 1 -- 172.21.15.154:0/863621604 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4037529677 0 0) 0x7fb1ac005740 con 0x7fb1c406c7d0 2024-05-14T01:23:41.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c159a640 1 -- 172.21.15.154:0/863621604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c40b59b0 msgr2=0x7fb1c406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:41.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c159a640 1 --2- 172.21.15.154:0/863621604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c40b59b0 0x7fb1c406c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c159a640 1 -- 172.21.15.154:0/863621604 >> v2:172.21.15.154:3300/0 conn(0x7fb1c41445e0 msgr2=0x7fb1c40b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:41.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c159a640 1 --2- 172.21.15.154:0/863621604 >> v2:172.21.15.154:3300/0 conn(0x7fb1c41445e0 0x7fb1c40b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa2f02640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c0aeff0 0x7faf9c15d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa2f02640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c15ae90 0x7faf9c148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa2f02640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf9c15b270 0x7faf9c0ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa2f02640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c15f860 con 0x7faf9c15b270 2024-05-14T01:23:41.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa2f02640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c06cbb0 con 0x7faf9c15ae90 2024-05-14T01:23:41.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa2f02640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faf9c15f9e0 con 0x7faf9c0aeff0 2024-05-14T01:23:41.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c159a640 1 -- 172.21.15.154:0/863621604 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c406e1f0 con 0x7fb1c406c7d0 2024-05-14T01:23:41.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c159a640 1 -- 172.21.15.154:0/863621604 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fb1bc001a30 con 0x7fb1c406c7d0 2024-05-14T01:23:41.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c159a640 1 -- 172.21.15.154:0/863621604 >> v1:172.21.15.154:6789/0 conn(0x7fb1c406c7d0 legacy=0x7fb1c415e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c159a640 1 --2- 172.21.15.154:0/863621604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c40b59b0 0x7fb1ac005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c159a640 1 --2- 172.21.15.154:0/863621604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1ac006110 0x7fb1ac006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c159a640 1 --2- 172.21.15.154:0/863621604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac006f60 0x7fb1ac0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c159a640 1 -- 172.21.15.154:0/863621604 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c406dcc0 con 0x7fb1ac006f60 2024-05-14T01:23:41.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c159a640 1 -- 172.21.15.154:0/863621604 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c41449c0 con 0x7fb1ac006110 2024-05-14T01:23:41.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c159a640 1 -- 172.21.15.154:0/863621604 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ac007bb0 con 0x7fb1c40b59b0 2024-05-14T01:23:41.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c2d9d640 1 --2- 172.21.15.154:0/863621604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac006f60 0x7fb1ac0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c1d9b640 1 --2- 172.21.15.154:0/863621604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1ac006110 0x7fb1ac006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c259c640 1 --2- 172.21.15.154:0/863621604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c40b59b0 0x7fb1ac005bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa149f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf9c15b270 0x7faf9c0ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c2d9d640 1 -- 172.21.15.154:0/863621604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c40b59b0 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c2d9d640 1 --2- 172.21.15.154:0/863621604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c40b59b0 0x7fb1ac005bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c2d9d640 1 -- 172.21.15.154:0/863621604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1ac006110 msgr2=0x7fb1ac006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c2d9d640 1 --2- 172.21.15.154:0/863621604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1ac006110 0x7fb1ac006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c2d9d640 1 -- 172.21.15.154:0/863621604 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c406e1f0 con 0x7fb1ac006f60 2024-05-14T01:23:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa149f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf9c15b270 0x7faf9c0ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46404/0 (socket says 172.21.15.154:46404) 2024-05-14T01:23:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa149f640 1 -- 172.21.15.154:0/449006494 learned_addr learned my addr 172.21.15.154:0/449006494 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa0c9e640 1 --2- 172.21.15.154:0/449006494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c0aeff0 0x7faf9c15d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c259c640 1 --2- 172.21.15.154:0/863621604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c40b59b0 0x7fb1ac005bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fb1c1d9b640 1 --2- 172.21.15.154:0/863621604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1ac006110 0x7fb1ac006a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:23:41.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7faf9bfff640 1 --2- 172.21.15.154:0/449006494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c15ae90 0x7faf9c148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa149f640 1 -- 172.21.15.154:0/449006494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c0aeff0 msgr2=0x7faf9c15d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa149f640 1 --2- 172.21.15.154:0/449006494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c0aeff0 0x7faf9c15d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa149f640 1 -- 172.21.15.154:0/449006494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c15ae90 msgr2=0x7faf9c148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa149f640 1 --2- 172.21.15.154:0/449006494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c15ae90 0x7faf9c148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa149f640 1 -- 172.21.15.154:0/449006494 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9c15d5e0 con 0x7faf9c15b270 2024-05-14T01:23:41.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa0c9e640 1 --2- 172.21.15.154:0/449006494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c0aeff0 0x7faf9c15d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:41.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7fafa149f640 1 --2- 172.21.15.154:0/449006494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf9c15b270 0x7faf9c0ce600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faf9400c760 tx=0x7faf9400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.074+0000 7faf997fa640 1 -- 172.21.15.154:0/449006494 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94017070 con 0x7faf9c15b270 2024-05-14T01:23:41.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.078+0000 7fb1c2d9d640 1 --2- 172.21.15.154:0/863621604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac006f60 0x7fb1ac0073e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc00a910 tx=0x7fb1bc01fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23aa65f6816f44a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.078+0000 7fb1c159a640 1 -- 172.21.15.154:0/863621604 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc00a4e0 con 0x7fb1ac006f60 2024-05-14T01:23:41.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.078+0000 7fb1c159a640 1 -- 172.21.15.154:0/863621604 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1bc0ad070 con 0x7fb1ac006f60 2024-05-14T01:23:41.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.078+0000 7fb1c159a640 1 -- 172.21.15.154:0/863621604 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc0a99a0 con 0x7fb1ac006f60 2024-05-14T01:23:41.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.078+0000 7fb1c8f0b640 1 -- 172.21.15.154:0/863621604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac006f60 msgr2=0x7fb1ac0073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.078+0000 7fb1c8f0b640 1 --2- 172.21.15.154:0/863621604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac006f60 0x7fb1ac0073e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc00a910 tx=0x7fb1bc01fb60 comp rx=0 tx=0).stop 2024-05-14T01:23:41.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.078+0000 7fb1c2d9d640 1 -- 172.21.15.154:0/863621604 reap_dead start 2024-05-14T01:23:41.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.078+0000 7fb1c8f0b640 1 -- 172.21.15.154:0/863621604 shutdown_connections 2024-05-14T01:23:41.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.078+0000 7fb1c8f0b640 1 -- 172.21.15.154:0/863621604 >> 172.21.15.154:0/863621604 conn(0x7fb1c4071e20 msgr2=0x7fb1c4072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.078+0000 7fb1c8f0b640 1 -- 172.21.15.154:0/863621604 shutdown_connections 2024-05-14T01:23:41.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.078+0000 7fb1c8f0b640 1 -- 172.21.15.154:0/863621604 wait complete. 2024-05-14T01:23:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.078+0000 7fa4ae015640 1 Processor -- start 2024-05-14T01:23:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.078+0000 7fa4ae015640 1 -- start start 2024-05-14T01:23:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.082+0000 7fdf20ff9640 1 -- 172.21.15.154:0/1062693975 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fdf1c018960 con 0x7fdf2415ae10 2024-05-14T01:23:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.082+0000 7fa4ae015640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa4a815ae90 0x7fa4a80aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.082+0000 7fa4ae015640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4a80aeff0 0x7fa4a80cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.082+0000 7fa4a7fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa4a815b270 0x7fa4a806c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57280/0 (socket says 172.21.15.154:57280) 2024-05-14T01:23:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.082+0000 7fa4a7fff640 1 -- 172.21.15.154:0/2057002265 learned_addr learned my addr 172.21.15.154:0/2057002265 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.082+0000 7fa4a6ffd640 1 --2- 172.21.15.154:0/2057002265 >> v2:172.21.15.154:3300/0 conn(0x7fa4a80aeff0 0x7fa4a80cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.082+0000 7fa4ae015640 1 -- 172.21.15.154:0/2057002265 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4a80cc420 con 0x7fa4a815b270 2024-05-14T01:23:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.082+0000 7fa4ae015640 1 -- 172.21.15.154:0/2057002265 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa4a815ebc0 con 0x7fa4a80aeff0 2024-05-14T01:23:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.082+0000 7fa4ae015640 1 -- 172.21.15.154:0/2057002265 --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa4a80cc700 con 0x7fa4a815ae90 2024-05-14T01:23:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.082+0000 7fa4a67fc640 1 -- 172.21.15.154:0/2057002265 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3796414713 0 0) 0x7fa4a80cc420 con 0x7fa4a815b270 2024-05-14T01:23:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.082+0000 7fa4a67fc640 1 -- 172.21.15.154:0/2057002265 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa490003530 con 0x7fa4a815b270 2024-05-14T01:23:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.086+0000 7fafa2f02640 1 -- 172.21.15.154:0/449006494 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf9c06e980 con 0x7faf9c15b270 2024-05-14T01:23:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.086+0000 7fafa2f02640 1 -- 172.21.15.154:0/449006494 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf9c06f1c0 con 0x7faf9c15b270 2024-05-14T01:23:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.086+0000 7faf997fa640 1 -- 172.21.15.154:0/449006494 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf9400a640 con 0x7faf9c15b270 2024-05-14T01:23:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.086+0000 7faf997fa640 1 -- 172.21.15.154:0/449006494 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf9400aa30 con 0x7faf9c15b270 2024-05-14T01:23:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.082+0000 7fa4a6ffd640 1 -- 172.21.15.154:0/2057002265 >> v2:172.21.15.176:3300/0 conn(0x7fa4a815ae90 msgr2=0x7fa4a80aeab0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T01:23:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.082+0000 7fa4a6ffd640 1 --2- 172.21.15.154:0/2057002265 >> v2:172.21.15.176:3300/0 conn(0x7fa4a815ae90 0x7fa4a80aeab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.082+0000 7fa4a6ffd640 1 -- 172.21.15.154:0/2057002265 >> v1:172.21.15.154:6789/0 conn(0x7fa4a815b270 legacy=0x7fa4a806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.082+0000 7fa4a6ffd640 1 -- 172.21.15.154:0/2057002265 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a80cc9e0 con 0x7fa4a80aeff0 2024-05-14T01:23:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.086+0000 7fa4a6ffd640 1 --2- 172.21.15.154:0/2057002265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a80aeff0 0x7fa4a80cb620 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8068090 tx=0x7fa49c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873cfcf3cd140f26 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.086+0000 7fa4a67fc640 1 -- 172.21.15.154:0/2057002265 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0ab5f0 con 0x7fa4a80aeff0 2024-05-14T01:23:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.086+0000 7fa4a67fc640 1 -- 172.21.15.154:0/2057002265 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa49c0b0070 con 0x7fa4a80aeff0 2024-05-14T01:23:41.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.086+0000 7fa4a67fc640 1 -- 172.21.15.154:0/2057002265 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0ab9b0 con 0x7fa4a80aeff0 2024-05-14T01:23:41.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.086+0000 7fafa2f02640 1 -- 172.21.15.154:0/449006494 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf9c068360 con 0x7faf9c15b270 2024-05-14T01:23:41.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.086+0000 7faf997fa640 1 -- 172.21.15.154:0/449006494 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf9401a070 con 0x7faf9c15b270 2024-05-14T01:23:41.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.086+0000 7faf997fa640 1 --2- 172.21.15.154:0/449006494 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7faf80067990 0x7faf80069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.086+0000 7faf997fa640 1 -- 172.21.15.154:0/449006494 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faf94085380 con 0x7faf9c15b270 2024-05-14T01:23:41.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.086+0000 7fafa0c9e640 1 --2- 172.21.15.154:0/449006494 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7faf80067990 0x7faf80069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.086+0000 7fb1c8f0b640 1 Processor -- start 2024-05-14T01:23:41.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.090+0000 7fafa0c9e640 1 --2- 172.21.15.154:0/449006494 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7faf80067990 0x7faf80069e50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faf900af000 tx=0x7faf900a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.086+0000 7fa4ae015640 1 -- 172.21.15.154:0/2057002265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a80aeff0 msgr2=0x7fa4a80cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.086+0000 7fa4ae015640 1 --2- 172.21.15.154:0/2057002265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a80aeff0 0x7fa4a80cb620 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8068090 tx=0x7fa49c01c490 comp rx=0 tx=0).stop 2024-05-14T01:23:41.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1c8f0b640 1 -- start start 2024-05-14T01:23:41.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fa4ae015640 1 -- 172.21.15.154:0/2057002265 shutdown_connections 2024-05-14T01:23:41.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fa4ae015640 1 --2- 172.21.15.154:0/2057002265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a80aeff0 0x7fa4a80cb620 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fa4ae015640 1 --2- 172.21.15.154:0/2057002265 >> v2:172.21.15.176:3300/0 conn(0x7fa4a815ae90 0x7fa4a80aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fa4ae015640 1 -- 172.21.15.154:0/2057002265 >> 172.21.15.154:0/2057002265 conn(0x7fa4a8072050 msgr2=0x7fa4a8072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fa4ae015640 1 -- 172.21.15.154:0/2057002265 shutdown_connections 2024-05-14T01:23:41.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1c8f0b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac006f60 0x7fb1c4141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1c8f0b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c409dff0 0x7fb1c41ef460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1c8f0b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c409e470 0x7fb1c413ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1c8f0b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c40b5e30 con 0x7fb1ac006f60 2024-05-14T01:23:41.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1c8f0b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c406e7b0 con 0x7fb1c409e470 2024-05-14T01:23:41.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1c8f0b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c40b4c10 con 0x7fb1c409dff0 2024-05-14T01:23:41.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1c259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac006f60 0x7fb1c4141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1c259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac006f60 0x7fb1c4141be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46426/0 (socket says 172.21.15.154:46426) 2024-05-14T01:23:41.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1c259c640 1 -- 172.21.15.154:0/3793609076 learned_addr learned my addr 172.21.15.154:0/3793609076 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:41.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1c1d9b640 1 --2- 172.21.15.154:0/3793609076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c409dff0 0x7fb1c41ef460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1c2d9d640 1 --2- 172.21.15.154:0/3793609076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c409e470 0x7fb1c413ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fa4ae015640 1 -- 172.21.15.154:0/2057002265 wait complete. 2024-05-14T01:23:41.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fa4ae015640 1 Processor -- start 2024-05-14T01:23:41.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fa4ae015640 1 -- start start 2024-05-14T01:23:41.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1c259c640 1 -- 172.21.15.154:0/3793609076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c409dff0 msgr2=0x7fb1c41ef460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1c259c640 1 --2- 172.21.15.154:0/3793609076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c409dff0 0x7fb1c41ef460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1c259c640 1 -- 172.21.15.154:0/3793609076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c409e470 msgr2=0x7fb1c413ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1c259c640 1 --2- 172.21.15.154:0/3793609076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c409e470 0x7fb1c413ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1c259c640 1 -- 172.21.15.154:0/3793609076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c415b500 con 0x7fb1ac006f60 2024-05-14T01:23:41.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1c259c640 1 --2- 172.21.15.154:0/3793609076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac006f60 0x7fb1c4141be0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4004710 tx=0x7fb1b400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7faf997fa640 1 -- 172.21.15.154:0/449006494 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7faf9c06e980 con 0x7faf9c15b270 2024-05-14T01:23:41.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1b2ffd640 1 -- 172.21.15.154:0/3793609076 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4015070 con 0x7fb1ac006f60 2024-05-14T01:23:41.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.094+0000 7fb1b2ffd640 1 -- 172.21.15.154:0/3793609076 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b40077a0 con 0x7fb1ac006f60 2024-05-14T01:23:41.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4ae015640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a80aeff0 0x7fa4a8143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4ae015640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4a815ae90 0x7fa4a80b6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4ae015640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4a815b270 0x7fa4a814ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4ae015640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a815f860 con 0x7fa4a80aeff0 2024-05-14T01:23:41.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4ae015640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a806cbf0 con 0x7fa4a815b270 2024-05-14T01:23:41.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4ae015640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a815f9e0 con 0x7fa4a815ae90 2024-05-14T01:23:41.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4a77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a80aeff0 0x7fa4a8143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4a77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a80aeff0 0x7fa4a8143280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46430/0 (socket says 172.21.15.154:46430) 2024-05-14T01:23:41.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4a77fe640 1 -- 172.21.15.154:0/4009691903 learned_addr learned my addr 172.21.15.154:0/4009691903 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:41.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4a6ffd640 1 --2- 172.21.15.154:0/4009691903 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4a815ae90 0x7fa4a80b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4a7fff640 1 --2- 172.21.15.154:0/4009691903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4a815b270 0x7fa4a814ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fb1c8f0b640 1 -- 172.21.15.154:0/3793609076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c415b7e0 con 0x7fb1ac006f60 2024-05-14T01:23:41.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fb1c8f0b640 1 -- 172.21.15.154:0/3793609076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c415bda0 con 0x7fb1ac006f60 2024-05-14T01:23:41.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4a77fe640 1 -- 172.21.15.154:0/4009691903 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4a815ae90 msgr2=0x7fa4a80b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4a77fe640 1 --2- 172.21.15.154:0/4009691903 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4a815ae90 0x7fa4a80b6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4a77fe640 1 -- 172.21.15.154:0/4009691903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4a815b270 msgr2=0x7fa4a814ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4a77fe640 1 --2- 172.21.15.154:0/4009691903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4a815b270 0x7fa4a814ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4a77fe640 1 -- 172.21.15.154:0/4009691903 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a81437c0 con 0x7fa4a80aeff0 2024-05-14T01:23:41.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4a77fe640 1 --2- 172.21.15.154:0/4009691903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a80aeff0 0x7fa4a8143280 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa49800b4a0 tx=0x7fa49800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa48ffff640 1 -- 172.21.15.154:0/4009691903 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa498014070 con 0x7fa4a80aeff0 2024-05-14T01:23:41.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4ae015640 1 -- 172.21.15.154:0/4009691903 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a80b3a60 con 0x7fa4a80aeff0 2024-05-14T01:23:41.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa4ae015640 1 -- 172.21.15.154:0/4009691903 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a80b4020 con 0x7fa4a80aeff0 2024-05-14T01:23:41.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa48ffff640 1 -- 172.21.15.154:0/4009691903 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa498010610 con 0x7fa4a80aeff0 2024-05-14T01:23:41.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fb1b2ffd640 1 -- 172.21.15.154:0/3793609076 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4007b90 con 0x7fb1ac006f60 2024-05-14T01:23:41.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fa48ffff640 1 -- 172.21.15.154:0/4009691903 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa498010a20 con 0x7fa4a80aeff0 2024-05-14T01:23:41.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.098+0000 7fb1b2ffd640 1 -- 172.21.15.154:0/3793609076 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb1b4018070 con 0x7fb1ac006f60 2024-05-14T01:23:41.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.102+0000 7fb1b2ffd640 1 --2- 172.21.15.154:0/3793609076 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb1a40679c0 0x7fb1a4069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.102+0000 7fa48ffff640 1 -- 172.21.15.154:0/4009691903 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa498017070 con 0x7fa4a80aeff0 2024-05-14T01:23:41.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.102+0000 7fb1c1d9b640 1 --2- 172.21.15.154:0/3793609076 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb1a40679c0 0x7fb1a4069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.102+0000 7fb1b2ffd640 1 -- 172.21.15.154:0/3793609076 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb1b4085b10 con 0x7fb1ac006f60 2024-05-14T01:23:41.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.102+0000 7fa48ffff640 1 --2- 172.21.15.154:0/4009691903 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa494067990 0x7fa494069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.102+0000 7fa48ffff640 1 -- 172.21.15.154:0/4009691903 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa498085660 con 0x7fa4a80aeff0 2024-05-14T01:23:41.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.102+0000 7fa4a6ffd640 1 --2- 172.21.15.154:0/4009691903 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa494067990 0x7fa494069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.102+0000 7fb1c1d9b640 1 --2- 172.21.15.154:0/3793609076 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb1a40679c0 0x7fb1a4069e80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40b55b0 tx=0x7fb1b8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.102+0000 7fa4a6ffd640 1 --2- 172.21.15.154:0/4009691903 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa494067990 0x7fa494069e50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0af000 tx=0x7fa49c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.106+0000 7fa4ae015640 1 -- 172.21.15.154:0/4009691903 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4880052a0 con 0x7fa4a80aeff0 2024-05-14T01:23:41.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.106+0000 7fb1c8f0b640 1 -- 172.21.15.154:0/3793609076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c4068360 con 0x7fb1ac006f60 2024-05-14T01:23:41.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.114+0000 7fb1b2ffd640 1 -- 172.21.15.154:0/3793609076 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb1b4055fe0 con 0x7fb1ac006f60 2024-05-14T01:23:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.122+0000 7fa48ffff640 1 -- 172.21.15.154:0/4009691903 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fa498055b30 con 0x7fa4a80aeff0 2024-05-14T01:23:41.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.130+0000 7f1e728b2640 1 Processor -- start 2024-05-14T01:23:41.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.130+0000 7f1e728b2640 1 -- start start 2024-05-14T01:23:41.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.134+0000 7f1e728b2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c168660 0x7f1e6c06cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.134+0000 7f1e728b2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1e6c070d50 0x7f1e6c0711b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.134+0000 7f1e728b2640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e6c16be30 con 0x7f1e6c16b1e0 2024-05-14T01:23:41.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.134+0000 7f1e728b2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1e6c0716f0 con 0x7f1e6c070d50 2024-05-14T01:23:41.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.134+0000 7f1e728b2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1e6c0b3490 con 0x7f1e6c168660 2024-05-14T01:23:41.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.134+0000 7f1e6b7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1e6c070d50 0x7f1e6c0711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.134+0000 7f1e70e4f640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f1e6c16b1e0 0x7f1e6c16b670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:48348/0 (socket says 172.21.15.154:48348) 2024-05-14T01:23:41.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.134+0000 7f1e70e4f640 1 -- 172.21.15.154:0/397017852 learned_addr learned my addr 172.21.15.154:0/397017852 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:41.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.134+0000 7f1e6b7fe640 1 -- 172.21.15.154:0/397017852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c168660 msgr2=0x7f1e6c06cd90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T01:23:41.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.134+0000 7f1e6b7fe640 1 --2- 172.21.15.154:0/397017852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c168660 0x7f1e6c06cd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.134+0000 7f1e6b7fe640 1 -- 172.21.15.154:0/397017852 >> v1:172.21.15.176:6789/0 conn(0x7f1e6c16b1e0 legacy=0x7f1e6c16b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.134+0000 7f1e6b7fe640 1 -- 172.21.15.154:0/397017852 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e6c16c110 con 0x7f1e6c070d50 2024-05-14T01:23:41.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.138+0000 7f1e6b7fe640 1 --2- 172.21.15.154:0/397017852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e6c070d50 0x7f1e6c0711b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c0097c0 tx=0x7f1e5c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7452e3388a3d5765 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.138+0000 7f1e6affd640 1 -- 172.21.15.154:0/397017852 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c0b0070 con 0x7f1e6c070d50 2024-05-14T01:23:41.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.138+0000 7f1e6affd640 1 -- 172.21.15.154:0/397017852 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e5c0ab600 con 0x7f1e6c070d50 2024-05-14T01:23:41.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.142+0000 7f1e728b2640 1 -- 172.21.15.154:0/397017852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e6c070d50 msgr2=0x7f1e6c0711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.142+0000 7f1e728b2640 1 --2- 172.21.15.154:0/397017852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e6c070d50 0x7f1e6c0711b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c0097c0 tx=0x7f1e5c01c3e0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.142+0000 7f1e728b2640 1 -- 172.21.15.154:0/397017852 shutdown_connections 2024-05-14T01:23:41.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.142+0000 7f1e728b2640 1 --2- 172.21.15.154:0/397017852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e6c070d50 0x7f1e6c0711b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.142+0000 7f1e728b2640 1 --2- 172.21.15.154:0/397017852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c168660 0x7f1e6c06cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.142+0000 7f1e728b2640 1 -- 172.21.15.154:0/397017852 >> 172.21.15.154:0/397017852 conn(0x7f1e6c0b1670 msgr2=0x7f1e6c0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.142+0000 7f1e728b2640 1 -- 172.21.15.154:0/397017852 shutdown_connections 2024-05-14T01:23:41.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.142+0000 7f1e728b2640 1 -- 172.21.15.154:0/397017852 wait complete. 2024-05-14T01:23:41.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.142+0000 7f1e728b2640 1 Processor -- start 2024-05-14T01:23:41.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.142+0000 7f1e728b2640 1 -- start start 2024-05-14T01:23:41.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7feee28a9640 1 Processor -- start 2024-05-14T01:23:41.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e728b2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e6c168660 0x7f1e6c08b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e728b2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e6c16b1e0 0x7f1e6c1653d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e728b2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c1707d0 0x7f1e6c158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e728b2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6c168a40 con 0x7f1e6c16b1e0 2024-05-14T01:23:41.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e728b2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6c0b3120 con 0x7f1e6c168660 2024-05-14T01:23:41.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e728b2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1e6c168bc0 con 0x7f1e6c1707d0 2024-05-14T01:23:41.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e70e4f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c1707d0 0x7f1e6c158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e70e4f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c1707d0 0x7f1e6c158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:59214/0 (socket says 172.21.15.154:59214) 2024-05-14T01:23:41.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e70e4f640 1 -- 172.21.15.154:0/953500109 learned_addr learned my addr 172.21.15.154:0/953500109 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:41.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e6b7fe640 1 --2- 172.21.15.154:0/953500109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e6c16b1e0 0x7f1e6c1653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7feee28a9640 1 -- start start 2024-05-14T01:23:41.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7feee28a9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7feedc15ae10 0x7feedc06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7feee28a9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feedc06e410 0x7feedc070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7feee28a9640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feedc13dee0 con 0x7feedc13ce00 2024-05-14T01:23:41.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7feee28a9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7feedc06ce30 con 0x7feedc06e410 2024-05-14T01:23:41.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7feee28a9640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7feedc06d110 con 0x7feedc15ae10 2024-05-14T01:23:41.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7feee0e46640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feedc06e410 0x7feedc070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7feee0e46640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feedc06e410 0x7feedc070f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46444/0 (socket says 172.21.15.154:46444) 2024-05-14T01:23:41.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7feee0e46640 1 -- 172.21.15.154:0/776101991 learned_addr learned my addr 172.21.15.154:0/776101991 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:41.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7feedb7fe640 1 --2- 172.21.15.154:0/776101991 >> v2:172.21.15.176:3300/0 conn(0x7feedc15ae10 0x7feedc06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e70e4f640 1 -- 172.21.15.154:0/953500109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e6c168660 msgr2=0x7f1e6c08b520 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-14T01:23:41.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e70e4f640 1 --2- 172.21.15.154:0/953500109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e6c168660 0x7f1e6c08b520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e70e4f640 1 -- 172.21.15.154:0/953500109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e6c16b1e0 msgr2=0x7f1e6c1653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e70e4f640 1 --2- 172.21.15.154:0/953500109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e6c16b1e0 0x7f1e6c1653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e70e4f640 1 -- 172.21.15.154:0/953500109 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e6c08ba60 con 0x7f1e6c1707d0 2024-05-14T01:23:41.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e6b7fe640 1 --2- 172.21.15.154:0/953500109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e6c16b1e0 0x7f1e6c1653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:23:41.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e70e4f640 1 --2- 172.21.15.154:0/953500109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c1707d0 0x7f1e6c158f10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400e470 tx=0x7f1e6400e930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7feee0e46640 1 -- 172.21.15.154:0/776101991 >> v2:172.21.15.176:3300/0 conn(0x7feedc15ae10 msgr2=0x7feedc06ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:41.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7feee0e46640 1 --2- 172.21.15.154:0/776101991 >> v2:172.21.15.176:3300/0 conn(0x7feedc15ae10 0x7feedc06ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7feee0e46640 1 -- 172.21.15.154:0/776101991 >> v1:172.21.15.176:6789/0 conn(0x7feedc13ce00 legacy=0x7feedc13d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7feee0e46640 1 -- 172.21.15.154:0/776101991 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feedc06d3f0 con 0x7feedc06e410 2024-05-14T01:23:41.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e68ff9640 1 -- 172.21.15.154:0/953500109 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e64009480 con 0x7f1e6c1707d0 2024-05-14T01:23:41.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e68ff9640 1 -- 172.21.15.154:0/953500109 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e64018070 con 0x7f1e6c1707d0 2024-05-14T01:23:41.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e68ff9640 1 -- 172.21.15.154:0/953500109 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e64009840 con 0x7f1e6c1707d0 2024-05-14T01:23:41.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e728b2640 1 -- 172.21.15.154:0/953500109 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e6c165910 con 0x7f1e6c1707d0 2024-05-14T01:23:41.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.146+0000 7f1e728b2640 1 -- 172.21.15.154:0/953500109 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e6c165ec0 con 0x7f1e6c1707d0 2024-05-14T01:23:41.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.150+0000 7feee0e46640 1 --2- 172.21.15.154:0/776101991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feedc06e410 0x7feedc070f60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feedc0739c0 tx=0x7feed4020d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7499c0f6e231ec3f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.150+0000 7f1e68ff9640 1 -- 172.21.15.154:0/953500109 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1e64012070 con 0x7f1e6c1707d0 2024-05-14T01:23:41.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.150+0000 7f1e728b2640 1 -- 172.21.15.154:0/953500109 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e4c0052a0 con 0x7f1e6c1707d0 2024-05-14T01:23:41.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.150+0000 7f1e68ff9640 1 --2- 172.21.15.154:0/953500109 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1e5806bd00 0x7f1e5806e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.150+0000 7f1e68ff9640 1 -- 172.21.15.154:0/953500109 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1e64088770 con 0x7f1e6c1707d0 2024-05-14T01:23:41.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.150+0000 7f1e6bfff640 1 --2- 172.21.15.154:0/953500109 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1e5806bd00 0x7f1e5806e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.150+0000 7f1e6bfff640 1 --2- 172.21.15.154:0/953500109 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1e5806bd00 0x7f1e5806e1c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0b46c0 tx=0x7f1e60006be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.158+0000 7feedaffd640 1 -- 172.21.15.154:0/776101991 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed40af070 con 0x7feedc06e410 2024-05-14T01:23:41.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.158+0000 7feedaffd640 1 -- 172.21.15.154:0/776101991 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed40a9de0 con 0x7feedc06e410 2024-05-14T01:23:41.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.158+0000 7feee28a9640 1 -- 172.21.15.154:0/776101991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feedc06e410 msgr2=0x7feedc070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.158+0000 7feee28a9640 1 --2- 172.21.15.154:0/776101991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feedc06e410 0x7feedc070f60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feedc0739c0 tx=0x7feed4020d70 comp rx=0 tx=0).stop 2024-05-14T01:23:41.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.158+0000 7feee28a9640 1 -- 172.21.15.154:0/776101991 shutdown_connections 2024-05-14T01:23:41.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.158+0000 7feee28a9640 1 --2- 172.21.15.154:0/776101991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feedc06e410 0x7feedc070f60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.158+0000 7feee28a9640 1 --2- 172.21.15.154:0/776101991 >> v2:172.21.15.176:3300/0 conn(0x7feedc15ae10 0x7feedc06ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.158+0000 7feee28a9640 1 -- 172.21.15.154:0/776101991 >> 172.21.15.154:0/776101991 conn(0x7feedc0b1670 msgr2=0x7feedc0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.158+0000 7feee28a9640 1 -- 172.21.15.154:0/776101991 shutdown_connections 2024-05-14T01:23:41.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.158+0000 7feee28a9640 1 -- 172.21.15.154:0/776101991 wait complete. 2024-05-14T01:23:41.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.158+0000 7feee28a9640 1 Processor -- start 2024-05-14T01:23:41.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.158+0000 7feee28a9640 1 -- start start 2024-05-14T01:23:41.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feee28a9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc13ce00 0x7feedc0ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feee28a9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feedc15ae10 0x7feedc14ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feee28a9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feedc153430 0x7feedc1538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feee28a9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feedc13d3f0 con 0x7feedc15ae10 2024-05-14T01:23:41.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feee28a9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feedc15e9a0 con 0x7feedc13ce00 2024-05-14T01:23:41.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feee28a9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7feedc0ce970 con 0x7feedc153430 2024-05-14T01:23:41.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feedbfff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc13ce00 0x7feedc0ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feedbfff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc13ce00 0x7feedc0ce430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:50124/0 (socket says 172.21.15.154:50124) 2024-05-14T01:23:41.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feedbfff640 1 -- 172.21.15.154:0/2502492499 learned_addr learned my addr 172.21.15.154:0/2502492499 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:41.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feee0e46640 1 --2- 172.21.15.154:0/2502492499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feedc153430 0x7feedc1538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feedb7fe640 1 --2- 172.21.15.154:0/2502492499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feedc15ae10 0x7feedc14ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feedbfff640 1 -- 172.21.15.154:0/2502492499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feedc153430 msgr2=0x7feedc1538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feedbfff640 1 --2- 172.21.15.154:0/2502492499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feedc153430 0x7feedc1538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feedbfff640 1 -- 172.21.15.154:0/2502492499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feedc15ae10 msgr2=0x7feedc14ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feedbfff640 1 --2- 172.21.15.154:0/2502492499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feedc15ae10 0x7feedc14ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feedbfff640 1 -- 172.21.15.154:0/2502492499 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feedc159290 con 0x7feedc13ce00 2024-05-14T01:23:41.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feedbfff640 1 --2- 172.21.15.154:0/2502492499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc13ce00 0x7feedc0ce430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7feecc00c750 tx=0x7feecc00cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feed8ff9640 1 -- 172.21.15.154:0/2502492499 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc017070 con 0x7feedc13ce00 2024-05-14T01:23:41.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feee28a9640 1 -- 172.21.15.154:0/2502492499 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feedc159570 con 0x7feedc13ce00 2024-05-14T01:23:41.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7feee28a9640 1 -- 172.21.15.154:0/2502492499 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feedc159b30 con 0x7feedc13ce00 2024-05-14T01:23:41.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.162+0000 7f1e68ff9640 1 -- 172.21.15.154:0/953500109 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1e64010040 con 0x7f1e6c1707d0 2024-05-14T01:23:41.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.166+0000 7feed8ff9640 1 -- 172.21.15.154:0/2502492499 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feecc005280 con 0x7feedc13ce00 2024-05-14T01:23:41.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.166+0000 7feee28a9640 1 -- 172.21.15.154:0/2502492499 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feedc069310 con 0x7feedc13ce00 2024-05-14T01:23:41.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.166+0000 7feed8ff9640 1 -- 172.21.15.154:0/2502492499 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc00a860 con 0x7feedc13ce00 2024-05-14T01:23:41.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.170+0000 7feed8ff9640 1 -- 172.21.15.154:0/2502492499 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feecc01a070 con 0x7feedc13ce00 2024-05-14T01:23:41.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.170+0000 7feed8ff9640 1 --2- 172.21.15.154:0/2502492499 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7feec80678c0 0x7feec8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.170+0000 7feed8ff9640 1 -- 172.21.15.154:0/2502492499 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7feecc085610 con 0x7feedc13ce00 2024-05-14T01:23:41.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.170+0000 7feedb7fe640 1 --2- 172.21.15.154:0/2502492499 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7feec80678c0 0x7feec8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.170+0000 7feedb7fe640 1 --2- 172.21.15.154:0/2502492499 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7feec80678c0 0x7feec8069d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feedc0d0aa0 tx=0x7feed0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.178+0000 7feed8ff9640 1 -- 172.21.15.154:0/2502492499 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7feecc021020 con 0x7feedc13ce00 2024-05-14T01:23:41.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.178+0000 7f2489e90640 1 Processor -- start 2024-05-14T01:23:41.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.178+0000 7f2489e90640 1 -- start start 2024-05-14T01:23:41.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.182+0000 7f2489e90640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f24840cbdb0 0x7f24840cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.182+0000 7f2489e90640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2484166620 con 0x7f2484166120 2024-05-14T01:23:41.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.182+0000 7f2489e90640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2484166900 con 0x7f248406c290 2024-05-14T01:23:41.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.182+0000 7f2489e90640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2484166be0 con 0x7f24840cbdb0 2024-05-14T01:23:41.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.182+0000 7f24837fe640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f248406c290 0x7f248406c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:48366/0 (socket says 172.21.15.154:48366) 2024-05-14T01:23:41.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.182+0000 7f24837fe640 1 -- 172.21.15.154:0/3630366629 learned_addr learned my addr 172.21.15.154:0/3630366629 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:41.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24827fc640 1 -- 172.21.15.154:0/3630366629 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1552679624 0 0) 0x7f2484166900 con 0x7f248406c290 2024-05-14T01:23:41.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24827fc640 1 -- 172.21.15.154:0/3630366629 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f246c003530 con 0x7f248406c290 2024-05-14T01:23:41.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24827fc640 1 -- 172.21.15.154:0/3630366629 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4171474073 0 0) 0x7f246c003530 con 0x7f248406c290 2024-05-14T01:23:41.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24827fc640 1 -- 172.21.15.154:0/3630366629 >> v2:172.21.15.154:3300/0 conn(0x7f24840cbdb0 msgr2=0x7f24840cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:41.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24827fc640 1 --2- 172.21.15.154:0/3630366629 >> v2:172.21.15.154:3300/0 conn(0x7f24840cbdb0 0x7f24840cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24827fc640 1 -- 172.21.15.154:0/3630366629 >> v1:172.21.15.154:6789/0 conn(0x7f2484166120 legacy=0x7f24840cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:41.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24827fc640 1 -- 172.21.15.154:0/3630366629 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2484166ec0 con 0x7f248406c290 2024-05-14T01:23:41.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24827fc640 1 -- 172.21.15.154:0/3630366629 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f2478001680 con 0x7f248406c290 2024-05-14T01:23:41.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24827fc640 1 -- 172.21.15.154:0/3630366629 >> v1:172.21.15.176:6789/0 conn(0x7f248406c290 legacy=0x7f248406c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24827fc640 1 --2- 172.21.15.154:0/3630366629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f246c0039c0 0x7f246c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24827fc640 1 --2- 172.21.15.154:0/3630366629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f246c004810 0x7f246c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24827fc640 1 --2- 172.21.15.154:0/3630366629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f246c005240 0x7f246c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24827fc640 1 -- 172.21.15.154:0/3630366629 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2484166be0 con 0x7f246c004810 2024-05-14T01:23:41.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24827fc640 1 -- 172.21.15.154:0/3630366629 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f246c00c1a0 con 0x7f246c005240 2024-05-14T01:23:41.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24827fc640 1 -- 172.21.15.154:0/3630366629 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f246c00c3a0 con 0x7f246c0039c0 2024-05-14T01:23:41.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f2483fff640 1 --2- 172.21.15.154:0/3630366629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f246c005240 0x7f246c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24837fe640 1 --2- 172.21.15.154:0/3630366629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f246c0039c0 0x7f246c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24837fe640 1 -- 172.21.15.154:0/3630366629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f246c005240 msgr2=0x7f246c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:41.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24837fe640 1 --2- 172.21.15.154:0/3630366629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f246c005240 0x7f246c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24837fe640 1 -- 172.21.15.154:0/3630366629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f246c004810 msgr2=0x7f246c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:41.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24837fe640 1 --2- 172.21.15.154:0/3630366629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f246c004810 0x7f246c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.186+0000 7f24837fe640 1 -- 172.21.15.154:0/3630366629 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2484166ec0 con 0x7f246c0039c0 2024-05-14T01:23:41.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.190+0000 7f2483fff640 1 --2- 172.21.15.154:0/3630366629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f246c005240 0x7f246c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:23:41.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.190+0000 7f2483fff640 1 -- 172.21.15.154:0/3630366629 reap_dead start 2024-05-14T01:23:41.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.190+0000 7f24837fe640 1 --2- 172.21.15.154:0/3630366629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f246c0039c0 0x7f246c003dc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f247800c340 tx=0x7f247801f580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc8dd1a9134b2619 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.190+0000 7f24827fc640 1 -- 172.21.15.154:0/3630366629 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478007e30 con 0x7f246c0039c0 2024-05-14T01:23:41.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.190+0000 7f24827fc640 1 -- 172.21.15.154:0/3630366629 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2478005ae0 con 0x7f246c0039c0 2024-05-14T01:23:41.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.190+0000 7f2489e90640 1 -- 172.21.15.154:0/3630366629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f246c0039c0 msgr2=0x7f246c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.190+0000 7f2489e90640 1 --2- 172.21.15.154:0/3630366629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f246c0039c0 0x7f246c003dc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f247800c340 tx=0x7f247801f580 comp rx=0 tx=0).stop 2024-05-14T01:23:41.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.190+0000 7f2489e90640 1 -- 172.21.15.154:0/3630366629 shutdown_connections 2024-05-14T01:23:41.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.190+0000 7f2489e90640 1 --2- 172.21.15.154:0/3630366629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f246c0039c0 0x7f246c003dc0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.190+0000 7f2489e90640 1 -- 172.21.15.154:0/3630366629 >> 172.21.15.154:0/3630366629 conn(0x7f2484072050 msgr2=0x7f2484072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.190+0000 7f2489e90640 1 -- 172.21.15.154:0/3630366629 shutdown_connections 2024-05-14T01:23:41.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.190+0000 7f2489e90640 1 -- 172.21.15.154:0/3630366629 wait complete. 2024-05-14T01:23:41.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.194+0000 7f2489e90640 1 Processor -- start 2024-05-14T01:23:41.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.194+0000 7f2489e90640 1 -- start start 2024-05-14T01:23:41.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.194+0000 7f2489e90640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24841edd40 0x7f248415fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.194+0000 7f2489e90640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24841ee9f0 0x7f2484160220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.194+0000 7f2489e90640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24841ee4a0 0x7f24841ebf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.194+0000 7f2489e90640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f248406e230 con 0x7f24841ee4a0 2024-05-14T01:23:41.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.194+0000 7f2489e90640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f248406e0b0 con 0x7f24841ee9f0 2024-05-14T01:23:41.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.194+0000 7f2489e90640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f24840d0350 con 0x7f24841edd40 2024-05-14T01:23:41.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.194+0000 7f2483fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24841ee4a0 0x7f24841ebf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.194+0000 7f2483fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24841ee4a0 0x7f24841ebf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46486/0 (socket says 172.21.15.154:46486) 2024-05-14T01:23:41.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.194+0000 7f2483fff640 1 -- 172.21.15.154:0/744745362 learned_addr learned my addr 172.21.15.154:0/744745362 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:41.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.194+0000 7f24837fe640 1 --2- 172.21.15.154:0/744745362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24841edd40 0x7f248415fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.198+0000 7f2483fff640 1 -- 172.21.15.154:0/744745362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24841edd40 msgr2=0x7f248415fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.198+0000 7f2483fff640 1 --2- 172.21.15.154:0/744745362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24841edd40 0x7f248415fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.198+0000 7f2483fff640 1 -- 172.21.15.154:0/744745362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24841ee9f0 msgr2=0x7f2484160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.198+0000 7f2483fff640 1 --2- 172.21.15.154:0/744745362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24841ee9f0 0x7f2484160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.198+0000 7f2483fff640 1 -- 172.21.15.154:0/744745362 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2484204500 con 0x7f24841ee4a0 2024-05-14T01:23:41.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.198+0000 7f2483fff640 1 --2- 172.21.15.154:0/744745362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24841ee4a0 0x7f24841ebf20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2484166550 tx=0x7f247c00fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.206+0000 7f246bfff640 1 -- 172.21.15.154:0/744745362 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c001970 con 0x7f24841ee4a0 2024-05-14T01:23:41.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.206+0000 7f246bfff640 1 -- 172.21.15.154:0/744745362 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f247c018070 con 0x7f24841ee4a0 2024-05-14T01:23:41.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.206+0000 7f246bfff640 1 -- 172.21.15.154:0/744745362 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c003d90 con 0x7f24841ee4a0 2024-05-14T01:23:41.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.206+0000 7f2489e90640 1 -- 172.21.15.154:0/744745362 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24842047e0 con 0x7f24841ee4a0 2024-05-14T01:23:41.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.206+0000 7f2489e90640 1 -- 172.21.15.154:0/744745362 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2484204da0 con 0x7f24841ee4a0 2024-05-14T01:23:41.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.206+0000 7f246bfff640 1 -- 172.21.15.154:0/744745362 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f247c0050d0 con 0x7f24841ee4a0 2024-05-14T01:23:41.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.206+0000 7f246bfff640 1 --2- 172.21.15.154:0/744745362 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2470067910 0x7f2470069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.206+0000 7f24837fe640 1 --2- 172.21.15.154:0/744745362 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2470067910 0x7f2470069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.206+0000 7f246bfff640 1 -- 172.21.15.154:0/744745362 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f247c085100 con 0x7f24841ee4a0 2024-05-14T01:23:41.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.210+0000 7f2469ffb640 1 -- 172.21.15.154:0/744745362 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2484068360 con 0x7f24841ee4a0 2024-05-14T01:23:41.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.210+0000 7f24837fe640 1 --2- 172.21.15.154:0/744745362 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2470067910 0x7f2470069dd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f24780af000 tx=0x7f24780aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.218+0000 7f246bfff640 1 -- 172.21.15.154:0/744745362 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f247c055c30 con 0x7f24841ee4a0 2024-05-14T01:23:41.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.366+0000 7f720b4d8640 1 -- 172.21.15.154:0/1544978918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f72040008e0 con 0x7f720415bdb0 2024-05-14T01:23:41.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.366+0000 7f71f9ffb640 1 -- 172.21.15.154:0/1544978918 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f72000f3e20 con 0x7f720415bdb0 2024-05-14T01:23:41.352 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-05-14T01:23:41.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.370+0000 7f71ef7fe640 1 -- 172.21.15.154:0/1544978918 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f71f00679e0 msgr2=0x7f71f0069ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.370+0000 7f71ef7fe640 1 --2- 172.21.15.154:0/1544978918 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f71f00679e0 0x7f71f0069ea0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f72040c5700 tx=0x7f71fc009040 comp rx=0 tx=0).stop 2024-05-14T01:23:41.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.370+0000 7f71ef7fe640 1 -- 172.21.15.154:0/1544978918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f720415bdb0 msgr2=0x7f720415a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.370+0000 7f71ef7fe640 1 --2- 172.21.15.154:0/1544978918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f720415bdb0 0x7f720415a530 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f72000b4040 tx=0x7f720001d6a0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.370+0000 7f71ef7fe640 1 -- 172.21.15.154:0/1544978918 shutdown_connections 2024-05-14T01:23:41.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.370+0000 7f71ef7fe640 1 --2- 172.21.15.154:0/1544978918 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f71f00679e0 0x7f71f0069ea0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.370+0000 7f71ef7fe640 1 --2- 172.21.15.154:0/1544978918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f720415bdb0 0x7f720415a530 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.370+0000 7f71ef7fe640 1 --2- 172.21.15.154:0/1544978918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72040d05f0 0x7f7204159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.370+0000 7f71ef7fe640 1 --2- 172.21.15.154:0/1544978918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72040b3250 0x7f720415cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.370+0000 7f71ef7fe640 1 -- 172.21.15.154:0/1544978918 >> 172.21.15.154:0/1544978918 conn(0x7f720409aa10 msgr2=0x7f72040ae990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.370+0000 7f71ef7fe640 1 -- 172.21.15.154:0/1544978918 shutdown_connections 2024-05-14T01:23:41.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.370+0000 7f71ef7fe640 1 -- 172.21.15.154:0/1544978918 wait complete. 2024-05-14T01:23:41.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.390+0000 7fdf2a84c640 1 -- 172.21.15.154:0/1062693975 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fdf04005590 con 0x7fdf2415ae10 2024-05-14T01:23:41.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-05-14T01:23:41.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.390+0000 7fdf20ff9640 1 -- 172.21.15.154:0/1062693975 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdf1c0f0910 con 0x7fdf2415ae10 2024-05-14T01:23:41.376 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-05-14T01:23:41.377 DEBUG:teuthology.parallel:result is None 2024-05-14T01:23:41.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.394+0000 7fafa2f02640 1 -- 172.21.15.154:0/449006494 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7faf9c0730f0 con 0x7faf9c15b270 2024-05-14T01:23:41.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.394+0000 7faf997fa640 1 -- 172.21.15.154:0/449006494 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faf94055ea0 con 0x7faf9c15b270 2024-05-14T01:23:41.379 INFO:teuthology.orchestra.run.smithi154.stdout:55834574856 2024-05-14T01:23:41.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.394+0000 7fdf2a84c640 1 -- 172.21.15.154:0/1062693975 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdf10067990 msgr2=0x7fdf10069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.394+0000 7fdf2a84c640 1 --2- 172.21.15.154:0/1062693975 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdf10067990 0x7fdf10069e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdf14006aa0 tx=0x7fdf14006a30 comp rx=0 tx=0).stop 2024-05-14T01:23:41.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.394+0000 7fdf2a84c640 1 -- 172.21.15.154:0/1062693975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf2415ae10 msgr2=0x7fdf24153a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.394+0000 7fdf2a84c640 1 --2- 172.21.15.154:0/1062693975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf2415ae10 0x7fdf24153a30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdf2415db70 tx=0x7fdf1c01d580 comp rx=0 tx=0).stop 2024-05-14T01:23:41.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.394+0000 7fdf2a84c640 1 -- 172.21.15.154:0/1062693975 shutdown_connections 2024-05-14T01:23:41.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.394+0000 7fdf2a84c640 1 --2- 172.21.15.154:0/1062693975 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdf10067990 0x7fdf10069e50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.394+0000 7fdf2a84c640 1 --2- 172.21.15.154:0/1062693975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf2415ae10 0x7fdf24153a30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.394+0000 7fdf2a84c640 1 --2- 172.21.15.154:0/1062693975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf2413ce00 0x7fdf24153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.394+0000 7fdf2a84c640 1 --2- 172.21.15.154:0/1062693975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf2406ded0 0x7fdf241556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.394+0000 7fdf2a84c640 1 -- 172.21.15.154:0/1062693975 >> 172.21.15.154:0/1062693975 conn(0x7fdf240b1670 msgr2=0x7fdf24159a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.398+0000 7fdf2a84c640 1 -- 172.21.15.154:0/1062693975 shutdown_connections 2024-05-14T01:23:41.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.398+0000 7fdf2a84c640 1 -- 172.21.15.154:0/1062693975 wait complete. 2024-05-14T01:23:41.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.398+0000 7fafa2f02640 1 -- 172.21.15.154:0/449006494 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7faf80067990 msgr2=0x7faf80069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.398+0000 7fafa2f02640 1 --2- 172.21.15.154:0/449006494 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7faf80067990 0x7faf80069e50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faf900af000 tx=0x7faf900a7000 comp rx=0 tx=0).stop 2024-05-14T01:23:41.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.398+0000 7fafa2f02640 1 -- 172.21.15.154:0/449006494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf9c15b270 msgr2=0x7faf9c0ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.398+0000 7fafa2f02640 1 --2- 172.21.15.154:0/449006494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf9c15b270 0x7faf9c0ce600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faf9400c760 tx=0x7faf9400cc20 comp rx=0 tx=0).stop 2024-05-14T01:23:41.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.398+0000 7fafa2f02640 1 -- 172.21.15.154:0/449006494 shutdown_connections 2024-05-14T01:23:41.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.398+0000 7fafa2f02640 1 --2- 172.21.15.154:0/449006494 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7faf80067990 0x7faf80069e50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.398+0000 7fafa2f02640 1 --2- 172.21.15.154:0/449006494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf9c15b270 0x7faf9c0ce600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.398+0000 7fafa2f02640 1 --2- 172.21.15.154:0/449006494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c15ae90 0x7faf9c148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.398+0000 7fafa2f02640 1 --2- 172.21.15.154:0/449006494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c0aeff0 0x7faf9c15d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.398+0000 7fafa2f02640 1 -- 172.21.15.154:0/449006494 >> 172.21.15.154:0/449006494 conn(0x7faf9c072050 msgr2=0x7faf9c0af420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.398+0000 7fafa2f02640 1 -- 172.21.15.154:0/449006494 shutdown_connections 2024-05-14T01:23:41.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.398+0000 7fafa2f02640 1 -- 172.21.15.154:0/449006494 wait complete. 2024-05-14T01:23:41.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-05-14T01:23:41.403 DEBUG:teuthology.parallel:result is None 2024-05-14T01:23:41.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.422+0000 7fb1c8f0b640 1 -- 172.21.15.154:0/3793609076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb1c40008e0 con 0x7fb1ac006f60 2024-05-14T01:23:41.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.422+0000 7fb1b2ffd640 1 -- 172.21.15.154:0/3793609076 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb1b405a2e0 con 0x7fb1ac006f60 2024-05-14T01:23:41.407 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2024-05-14T01:23:41.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.426+0000 7fb1c8f0b640 1 -- 172.21.15.154:0/3793609076 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb1a40679c0 msgr2=0x7fb1a4069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.426+0000 7fb1c8f0b640 1 --2- 172.21.15.154:0/3793609076 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb1a40679c0 0x7fb1a4069e80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40b55b0 tx=0x7fb1b8009190 comp rx=0 tx=0).stop 2024-05-14T01:23:41.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.426+0000 7fb1c8f0b640 1 -- 172.21.15.154:0/3793609076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac006f60 msgr2=0x7fb1c4141be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.426+0000 7fb1c8f0b640 1 --2- 172.21.15.154:0/3793609076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac006f60 0x7fb1c4141be0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4004710 tx=0x7fb1b400cb90 comp rx=0 tx=0).stop 2024-05-14T01:23:41.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.426+0000 7fb1c8f0b640 1 -- 172.21.15.154:0/3793609076 shutdown_connections 2024-05-14T01:23:41.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.426+0000 7fb1c8f0b640 1 --2- 172.21.15.154:0/3793609076 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb1a40679c0 0x7fb1a4069e80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.426+0000 7fb1c8f0b640 1 --2- 172.21.15.154:0/3793609076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c409e470 0x7fb1c413ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.426+0000 7fb1c8f0b640 1 --2- 172.21.15.154:0/3793609076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c409dff0 0x7fb1c41ef460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.426+0000 7fb1c8f0b640 1 --2- 172.21.15.154:0/3793609076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac006f60 0x7fb1c4141be0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.426+0000 7fb1c8f0b640 1 -- 172.21.15.154:0/3793609076 >> 172.21.15.154:0/3793609076 conn(0x7fb1c4071e20 msgr2=0x7fb1c40b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.426+0000 7fb1c8f0b640 1 -- 172.21.15.154:0/3793609076 shutdown_connections 2024-05-14T01:23:41.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.426+0000 7fb1c8f0b640 1 -- 172.21.15.154:0/3793609076 wait complete. 2024-05-14T01:23:41.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-05-14T01:23:41.417 DEBUG:teuthology.parallel:result is None 2024-05-14T01:23:41.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.438+0000 7fa4ae015640 1 -- 172.21.15.154:0/4009691903 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa488005590 con 0x7fa4a80aeff0 2024-05-14T01:23:41.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.438+0000 7fa48ffff640 1 -- 172.21.15.154:0/4009691903 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa498059e30 con 0x7fa4a80aeff0 2024-05-14T01:23:41.422 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2024-05-14T01:23:41.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.438+0000 7fa4ae015640 1 -- 172.21.15.154:0/4009691903 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa494067990 msgr2=0x7fa494069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.438+0000 7fa4ae015640 1 --2- 172.21.15.154:0/4009691903 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa494067990 0x7fa494069e50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0af000 tx=0x7fa49c0a7000 comp rx=0 tx=0).stop 2024-05-14T01:23:41.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.438+0000 7fa4ae015640 1 -- 172.21.15.154:0/4009691903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a80aeff0 msgr2=0x7fa4a8143280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.438+0000 7fa4ae015640 1 --2- 172.21.15.154:0/4009691903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a80aeff0 0x7fa4a8143280 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa49800b4a0 tx=0x7fa49800b960 comp rx=0 tx=0).stop 2024-05-14T01:23:41.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.442+0000 7fa4ae015640 1 -- 172.21.15.154:0/4009691903 shutdown_connections 2024-05-14T01:23:41.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.442+0000 7fa4ae015640 1 --2- 172.21.15.154:0/4009691903 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa494067990 0x7fa494069e50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.442+0000 7fa4ae015640 1 --2- 172.21.15.154:0/4009691903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4a815b270 0x7fa4a814ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.442+0000 7fa4ae015640 1 --2- 172.21.15.154:0/4009691903 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4a815ae90 0x7fa4a80b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.442+0000 7fa4ae015640 1 --2- 172.21.15.154:0/4009691903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a80aeff0 0x7fa4a8143280 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.442+0000 7fa4ae015640 1 -- 172.21.15.154:0/4009691903 >> 172.21.15.154:0/4009691903 conn(0x7fa4a8072050 msgr2=0x7fa4a80b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.442+0000 7fa4ae015640 1 -- 172.21.15.154:0/4009691903 shutdown_connections 2024-05-14T01:23:41.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.442+0000 7fa4ae015640 1 -- 172.21.15.154:0/4009691903 wait complete. 2024-05-14T01:23:41.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-05-14T01:23:41.429 DEBUG:teuthology.parallel:result is None 2024-05-14T01:23:41.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-05-14T01:23:41.440 DEBUG:teuthology.parallel:result is None 2024-05-14T01:23:41.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.466+0000 7f1e728b2640 1 -- 172.21.15.154:0/953500109 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f1e4c005860 con 0x7f1e6c1707d0 2024-05-14T01:23:41.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.466+0000 7f1e68ff9640 1 -- 172.21.15.154:0/953500109 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1e64059340 con 0x7f1e6c1707d0 2024-05-14T01:23:41.450 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2024-05-14T01:23:41.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.470+0000 7f1e728b2640 1 -- 172.21.15.154:0/953500109 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1e5806bd00 msgr2=0x7f1e5806e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.470+0000 7f1e728b2640 1 --2- 172.21.15.154:0/953500109 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1e5806bd00 0x7f1e5806e1c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0b46c0 tx=0x7f1e60006be0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.470+0000 7f1e728b2640 1 -- 172.21.15.154:0/953500109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c1707d0 msgr2=0x7f1e6c158f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.470+0000 7f1e728b2640 1 --2- 172.21.15.154:0/953500109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c1707d0 0x7f1e6c158f10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400e470 tx=0x7f1e6400e930 comp rx=0 tx=0).stop 2024-05-14T01:23:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.470+0000 7f1e728b2640 1 -- 172.21.15.154:0/953500109 shutdown_connections 2024-05-14T01:23:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.470+0000 7f1e728b2640 1 --2- 172.21.15.154:0/953500109 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1e5806bd00 0x7f1e5806e1c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.470+0000 7f1e728b2640 1 --2- 172.21.15.154:0/953500109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e6c1707d0 0x7f1e6c158f10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.470+0000 7f1e728b2640 1 --2- 172.21.15.154:0/953500109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e6c16b1e0 0x7f1e6c1653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.470+0000 7f1e728b2640 1 --2- 172.21.15.154:0/953500109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e6c168660 0x7f1e6c08b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.470+0000 7f1e728b2640 1 -- 172.21.15.154:0/953500109 >> 172.21.15.154:0/953500109 conn(0x7f1e6c0b1670 msgr2=0x7f1e6c169530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.470+0000 7f1e728b2640 1 -- 172.21.15.154:0/953500109 shutdown_connections 2024-05-14T01:23:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.470+0000 7f1e728b2640 1 -- 172.21.15.154:0/953500109 wait complete. 2024-05-14T01:23:41.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.474+0000 7feee28a9640 1 -- 172.21.15.154:0/2502492499 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7feedc0b4c50 con 0x7feedc13ce00 2024-05-14T01:23:41.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.474+0000 7feed8ff9640 1 -- 172.21.15.154:0/2502492499 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feecc055ae0 con 0x7feedc13ce00 2024-05-14T01:23:41.457 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-05-14T01:23:41.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.478+0000 7feee28a9640 1 -- 172.21.15.154:0/2502492499 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7feec80678c0 msgr2=0x7feec8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.478+0000 7feee28a9640 1 --2- 172.21.15.154:0/2502492499 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7feec80678c0 0x7feec8069d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feedc0d0aa0 tx=0x7feed0009190 comp rx=0 tx=0).stop 2024-05-14T01:23:41.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.478+0000 7feee28a9640 1 -- 172.21.15.154:0/2502492499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc13ce00 msgr2=0x7feedc0ce430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.478+0000 7feee28a9640 1 --2- 172.21.15.154:0/2502492499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc13ce00 0x7feedc0ce430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7feecc00c750 tx=0x7feecc00cc10 comp rx=0 tx=0).stop 2024-05-14T01:23:41.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.478+0000 7feee28a9640 1 -- 172.21.15.154:0/2502492499 shutdown_connections 2024-05-14T01:23:41.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.478+0000 7feee28a9640 1 --2- 172.21.15.154:0/2502492499 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7feec80678c0 0x7feec8069d80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.478+0000 7feee28a9640 1 --2- 172.21.15.154:0/2502492499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feedc153430 0x7feedc1538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.478+0000 7feee28a9640 1 --2- 172.21.15.154:0/2502492499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feedc15ae10 0x7feedc14ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.478+0000 7feee28a9640 1 --2- 172.21.15.154:0/2502492499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc13ce00 0x7feedc0ce430 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.478+0000 7feee28a9640 1 -- 172.21.15.154:0/2502492499 >> 172.21.15.154:0/2502492499 conn(0x7feedc0b1670 msgr2=0x7feedc071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.478+0000 7feee28a9640 1 -- 172.21.15.154:0/2502492499 shutdown_connections 2024-05-14T01:23:41.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.478+0000 7feee28a9640 1 -- 172.21.15.154:0/2502492499 wait complete. 2024-05-14T01:23:41.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.486+0000 7f2469ffb640 1 -- 172.21.15.154:0/744745362 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f2484070690 con 0x7f24841ee4a0 2024-05-14T01:23:41.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.486+0000 7f246bfff640 1 -- 172.21.15.154:0/744745362 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f247c055530 con 0x7f24841ee4a0 2024-05-14T01:23:41.469 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-05-14T01:23:41.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-05-14T01:23:41.470 DEBUG:teuthology.parallel:result is None 2024-05-14T01:23:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.486+0000 7f2469ffb640 1 -- 172.21.15.154:0/744745362 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2470067910 msgr2=0x7f2470069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.486+0000 7f2469ffb640 1 --2- 172.21.15.154:0/744745362 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2470067910 0x7f2470069dd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f24780af000 tx=0x7f24780aa000 comp rx=0 tx=0).stop 2024-05-14T01:23:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.486+0000 7f2469ffb640 1 -- 172.21.15.154:0/744745362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24841ee4a0 msgr2=0x7f24841ebf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.486+0000 7f2469ffb640 1 --2- 172.21.15.154:0/744745362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24841ee4a0 0x7f24841ebf20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2484166550 tx=0x7f247c00fe90 comp rx=0 tx=0).stop 2024-05-14T01:23:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.486+0000 7f2469ffb640 1 -- 172.21.15.154:0/744745362 shutdown_connections 2024-05-14T01:23:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.486+0000 7f2469ffb640 1 --2- 172.21.15.154:0/744745362 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2470067910 0x7f2470069dd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.486+0000 7f2469ffb640 1 --2- 172.21.15.154:0/744745362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24841ee4a0 0x7f24841ebf20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.486+0000 7f2469ffb640 1 --2- 172.21.15.154:0/744745362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24841ee9f0 0x7f2484160220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.486+0000 7f2469ffb640 1 --2- 172.21.15.154:0/744745362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24841edd40 0x7f248415fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.486+0000 7f2469ffb640 1 -- 172.21.15.154:0/744745362 >> 172.21.15.154:0/744745362 conn(0x7f2484072050 msgr2=0x7f24840b1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.486+0000 7f2469ffb640 1 -- 172.21.15.154:0/744745362 shutdown_connections 2024-05-14T01:23:41.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.486+0000 7f2469ffb640 1 -- 172.21.15.154:0/744745362 wait complete. 2024-05-14T01:23:41.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-05-14T01:23:41.485 DEBUG:teuthology.parallel:result is None 2024-05-14T01:23:41.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-05-14T01:23:41.490 DEBUG:teuthology.parallel:result is None 2024-05-14T01:23:41.491 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-14T01:23:41.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T01:23:41.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.650+0000 7f78b043b640 1 Processor -- start 2024-05-14T01:23:41.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78b043b640 1 -- start start 2024-05-14T01:23:41.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78b043b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a8144760 0x7f78a806e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78b043b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a8144b40 con 0x7f78a815bae0 2024-05-14T01:23:41.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78b043b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a80b3a40 con 0x7f78a80b3530 2024-05-14T01:23:41.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78b043b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f78a80b4650 con 0x7f78a8144760 2024-05-14T01:23:41.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ae9d8640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f78a815bae0 0x7f78a815c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57304/0 (socket says 172.21.15.154:57304) 2024-05-14T01:23:41.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ae9d8640 1 -- 172.21.15.154:0/3533190471 learned_addr learned my addr 172.21.15.154:0/3533190471 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:41.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad1d5640 1 -- 172.21.15.154:0/3533190471 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2493609860 0 0) 0x7f78a8144b40 con 0x7f78a815bae0 2024-05-14T01:23:41.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ae1d7640 1 --2- 172.21.15.154:0/3533190471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a8144760 0x7f78a806e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad1d5640 1 -- 172.21.15.154:0/3533190471 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7894003530 con 0x7f78a815bae0 2024-05-14T01:23:41.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad1d5640 1 -- 172.21.15.154:0/3533190471 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 967115335 0 0) 0x7f7894003530 con 0x7f78a815bae0 2024-05-14T01:23:41.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad1d5640 1 -- 172.21.15.154:0/3533190471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a8144760 msgr2=0x7f78a806e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:41.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad1d5640 1 --2- 172.21.15.154:0/3533190471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a8144760 0x7f78a806e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad1d5640 1 -- 172.21.15.154:0/3533190471 >> v1:172.21.15.176:6789/0 conn(0x7f78a80b3530 legacy=0x7f78a815b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad1d5640 1 -- 172.21.15.154:0/3533190471 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a80b3d20 con 0x7f78a815bae0 2024-05-14T01:23:41.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad1d5640 1 -- 172.21.15.154:0/3533190471 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f78a0001a00 con 0x7f78a815bae0 2024-05-14T01:23:41.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ae1d7640 1 --2- 172.21.15.154:0/3533190471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a8144760 0x7f78a806e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:23:41.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad1d5640 1 -- 172.21.15.154:0/3533190471 >> v1:172.21.15.154:6789/0 conn(0x7f78a815bae0 legacy=0x7f78a815c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad1d5640 1 --2- 172.21.15.154:0/3533190471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78940039f0 0x7f7894003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad1d5640 1 --2- 172.21.15.154:0/3533190471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7894004810 0x7f7894004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad1d5640 1 --2- 172.21.15.154:0/3533190471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a8144760 0x7f78940051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad1d5640 1 -- 172.21.15.154:0/3533190471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78a80b4650 con 0x7f7894004810 2024-05-14T01:23:41.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad1d5640 1 -- 172.21.15.154:0/3533190471 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f789400dce0 con 0x7f78940039f0 2024-05-14T01:23:41.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad1d5640 1 -- 172.21.15.154:0/3533190471 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f789400dee0 con 0x7f78a8144760 2024-05-14T01:23:41.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad9d6640 1 --2- 172.21.15.154:0/3533190471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7894004810 0x7f7894004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ae1d7640 1 --2- 172.21.15.154:0/3533190471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78940039f0 0x7f7894003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ae9d8640 1 --2- 172.21.15.154:0/3533190471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a8144760 0x7f78940051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad9d6640 1 -- 172.21.15.154:0/3533190471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a8144760 msgr2=0x7f78940051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:41.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad9d6640 1 --2- 172.21.15.154:0/3533190471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a8144760 0x7f78940051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad9d6640 1 -- 172.21.15.154:0/3533190471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78940039f0 msgr2=0x7f7894003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:41.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad9d6640 1 --2- 172.21.15.154:0/3533190471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78940039f0 0x7f7894003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.654+0000 7f78ad9d6640 1 -- 172.21.15.154:0/3533190471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7894003530 con 0x7f7894004810 2024-05-14T01:23:41.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78ad9d6640 1 --2- 172.21.15.154:0/3533190471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7894004810 0x7f7894004c90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7898001750 tx=0x7f789801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733ca86e59baf9e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78ad1d5640 1 -- 172.21.15.154:0/3533190471 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78980013a0 con 0x7f7894004810 2024-05-14T01:23:41.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78ad1d5640 1 -- 172.21.15.154:0/3533190471 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78980052f0 con 0x7f7894004810 2024-05-14T01:23:41.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78ad1d5640 1 -- 172.21.15.154:0/3533190471 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898003840 con 0x7f7894004810 2024-05-14T01:23:41.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78b043b640 1 -- 172.21.15.154:0/3533190471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7894004810 msgr2=0x7f7894004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78b043b640 1 --2- 172.21.15.154:0/3533190471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7894004810 0x7f7894004c90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7898001750 tx=0x7f789801c3e0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78ae9d8640 1 -- 172.21.15.154:0/3533190471 reap_dead start 2024-05-14T01:23:41.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78b043b640 1 -- 172.21.15.154:0/3533190471 shutdown_connections 2024-05-14T01:23:41.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78b043b640 1 -- 172.21.15.154:0/3533190471 >> 172.21.15.154:0/3533190471 conn(0x7f78a80b1850 msgr2=0x7f78a80b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78b043b640 1 -- 172.21.15.154:0/3533190471 shutdown_connections 2024-05-14T01:23:41.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78b043b640 1 -- 172.21.15.154:0/3533190471 wait complete. 2024-05-14T01:23:41.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78b043b640 1 Processor -- start 2024-05-14T01:23:41.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78b043b640 1 -- start start 2024-05-14T01:23:41.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78b043b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7894004810 0x7f78a81383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78b043b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a815a770 0x7f78a80ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78b043b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a80ce730 0x7f78a813e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78b043b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78a806e680 con 0x7f78a815a770 2024-05-14T01:23:41.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78b043b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f78a80b42e0 con 0x7f7894004810 2024-05-14T01:23:41.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78b043b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f78a806e800 con 0x7f78a80ce730 2024-05-14T01:23:41.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78ad9d6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a815a770 0x7f78a80ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78ad9d6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a815a770 0x7f78a80ce1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46498/0 (socket says 172.21.15.154:46498) 2024-05-14T01:23:41.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.658+0000 7f78ad9d6640 1 -- 172.21.15.154:0/3661815161 learned_addr learned my addr 172.21.15.154:0/3661815161 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:41.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f78ae9d8640 1 --2- 172.21.15.154:0/3661815161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a80ce730 0x7f78a813e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f78ae1d7640 1 --2- 172.21.15.154:0/3661815161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7894004810 0x7f78a81383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f78ad9d6640 1 -- 172.21.15.154:0/3661815161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a80ce730 msgr2=0x7f78a813e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f78ad9d6640 1 --2- 172.21.15.154:0/3661815161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a80ce730 0x7f78a813e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f78ad9d6640 1 -- 172.21.15.154:0/3661815161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7894004810 msgr2=0x7f78a81383e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f78ad9d6640 1 --2- 172.21.15.154:0/3661815161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7894004810 0x7f78a81383e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f78ad9d6640 1 -- 172.21.15.154:0/3661815161 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a813efc0 con 0x7f78a815a770 2024-05-14T01:23:41.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f78ae9d8640 1 --2- 172.21.15.154:0/3661815161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a80ce730 0x7f78a813e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:41.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f78ae1d7640 1 --2- 172.21.15.154:0/3661815161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7894004810 0x7f78a81383e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:41.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f78ad9d6640 1 --2- 172.21.15.154:0/3661815161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a815a770 0x7f78a80ce1f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f789801c8c0 tx=0x7f7894005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f789effd640 1 -- 172.21.15.154:0/3661815161 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898000ee0 con 0x7f78a815a770 2024-05-14T01:23:41.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f789effd640 1 -- 172.21.15.154:0/3661815161 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78980bb070 con 0x7f78a815a770 2024-05-14T01:23:41.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f78b043b640 1 -- 172.21.15.154:0/3661815161 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a8137900 con 0x7f78a815a770 2024-05-14T01:23:41.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f789effd640 1 -- 172.21.15.154:0/3661815161 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898006a00 con 0x7f78a815a770 2024-05-14T01:23:41.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f78b043b640 1 -- 172.21.15.154:0/3661815161 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a8137ec0 con 0x7f78a815a770 2024-05-14T01:23:41.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f78b043b640 1 -- 172.21.15.154:0/3661815161 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a8067850 con 0x7f78a815a770 2024-05-14T01:23:41.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f789effd640 1 -- 172.21.15.154:0/3661815161 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f78980b4040 con 0x7f78a815a770 2024-05-14T01:23:41.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f789effd640 1 --2- 172.21.15.154:0/3661815161 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f788c067a90 0x7f788c069f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f789effd640 1 -- 172.21.15.154:0/3661815161 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f78981201b0 con 0x7f78a815a770 2024-05-14T01:23:41.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f78ae1d7640 1 --2- 172.21.15.154:0/3661815161 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f788c067a90 0x7f788c069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.662+0000 7f78ae1d7640 1 --2- 172.21.15.154:0/3661815161 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f788c067a90 0x7f788c069f50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f78a400c850 tx=0x7f78a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.666+0000 7f789effd640 1 -- 172.21.15.154:0/3661815161 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f78980160f0 con 0x7f78a815a770 2024-05-14T01:23:41.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.810+0000 7f78b043b640 1 -- 172.21.15.154:0/3661815161 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78a815c220 con 0x7f788c067a90 2024-05-14T01:23:41.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.818+0000 7f789effd640 1 -- 172.21.15.154:0/3661815161 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251860 (secure 0 0 0) 0x7f78a815c220 con 0x7f788c067a90 2024-05-14T01:23:41.804 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:41.805 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-05-14T01:23:41.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.822+0000 7f78b043b640 1 -- 172.21.15.154:0/3661815161 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f788c067a90 msgr2=0x7f788c069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.822+0000 7f78b043b640 1 --2- 172.21.15.154:0/3661815161 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f788c067a90 0x7f788c069f50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f78a400c850 tx=0x7f78a4008040 comp rx=0 tx=0).stop 2024-05-14T01:23:41.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.822+0000 7f78b043b640 1 -- 172.21.15.154:0/3661815161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a815a770 msgr2=0x7f78a80ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.822+0000 7f78b043b640 1 --2- 172.21.15.154:0/3661815161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a815a770 0x7f78a80ce1f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f789801c8c0 tx=0x7f7894005840 comp rx=0 tx=0).stop 2024-05-14T01:23:41.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.822+0000 7f78b043b640 1 -- 172.21.15.154:0/3661815161 shutdown_connections 2024-05-14T01:23:41.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.822+0000 7f78b043b640 1 --2- 172.21.15.154:0/3661815161 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f788c067a90 0x7f788c069f50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.822+0000 7f78b043b640 1 --2- 172.21.15.154:0/3661815161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78a80ce730 0x7f78a813e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.822+0000 7f78b043b640 1 --2- 172.21.15.154:0/3661815161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a815a770 0x7f78a80ce1f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.822+0000 7f78b043b640 1 --2- 172.21.15.154:0/3661815161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7894004810 0x7f78a81383e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.822+0000 7f78b043b640 1 -- 172.21.15.154:0/3661815161 >> 172.21.15.154:0/3661815161 conn(0x7f78a80b1850 msgr2=0x7f78a815e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.822+0000 7f78b043b640 1 -- 172.21.15.154:0/3661815161 shutdown_connections 2024-05-14T01:23:41.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.822+0000 7f78b043b640 1 -- 172.21.15.154:0/3661815161 wait complete. 2024-05-14T01:23:41.820 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-14T01:23:41.103639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223240,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751480,"statfs":{"total":773094113280,"available":772865515520,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.893350"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985821+0000","last_change":"2024-05-14T01:23:35.287575+0000","last_active":"2024-05-14T01:23:36.985821+0000","last_peered":"2024-05-14T01:23:36.985821+0000","last_clean":"2024-05-14T01:23:36.985821+0000","last_became_active":"2024-05-14T01:23:35.287181+0000","last_became_peered":"2024-05-14T01:23:35.287181+0000","last_unstale":"2024-05-14T01:23:36.985821+0000","last_undegraded":"2024-05-14T01:23:36.985821+0000","last_fullsized":"2024-05-14T01:23:36.985821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:27:00.026867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244825+0000","last_change":"2024-05-14T01:23:35.262485+0000","last_active":"2024-05-14T01:23:36.244825+0000","last_peered":"2024-05-14T01:23:36.244825+0000","last_clean":"2024-05-14T01:23:36.244825+0000","last_became_active":"2024-05-14T01:23:35.261381+0000","last_became_peered":"2024-05-14T01:23:35.261381+0000","last_unstale":"2024-05-14T01:23:36.244825+0000","last_undegraded":"2024-05-14T01:23:36.244825+0000","last_fullsized":"2024-05-14T01:23:36.244825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:42:53.264601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087562+0000","last_change":"2024-05-14T01:23:35.269758+0000","last_active":"2024-05-14T01:23:38.087562+0000","last_peered":"2024-05-14T01:23:38.087562+0000","last_clean":"2024-05-14T01:23:38.087562+0000","last_became_active":"2024-05-14T01:23:35.267380+0000","last_became_peered":"2024-05-14T01:23:35.267380+0000","last_unstale":"2024-05-14T01:23:38.087562+0000","last_undegraded":"2024-05-14T01:23:38.087562+0000","last_fullsized":"2024-05-14T01:23:38.087562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:19:26.040802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246660+0000","last_change":"2024-05-14T01:23:35.306674+0000","last_active":"2024-05-14T01:23:36.246660+0000","last_peered":"2024-05-14T01:23:36.246660+0000","last_clean":"2024-05-14T01:23:36.246660+0000","last_became_active":"2024-05-14T01:23:35.301618+0000","last_became_peered":"2024-05-14T01:23:35.301618+0000","last_unstale":"2024-05-14T01:23:36.246660+0000","last_undegraded":"2024-05-14T01:23:36.246660+0000","last_fullsized":"2024-05-14T01:23:36.246660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:41:36.495618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985041+0000","last_change":"2024-05-14T01:23:35.285965+0000","last_active":"2024-05-14T01:23:36.985041+0000","last_peered":"2024-05-14T01:23:36.985041+0000","last_clean":"2024-05-14T01:23:36.985041+0000","last_became_active":"2024-05-14T01:23:35.285545+0000","last_became_peered":"2024-05-14T01:23:35.285545+0000","last_unstale":"2024-05-14T01:23:36.985041+0000","last_undegraded":"2024-05-14T01:23:36.985041+0000","last_fullsized":"2024-05-14T01:23:36.985041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:36.242325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246136+0000","last_change":"2024-05-14T01:23:35.300477+0000","last_active":"2024-05-14T01:23:36.246136+0000","last_peered":"2024-05-14T01:23:36.246136+0000","last_clean":"2024-05-14T01:23:36.246136+0000","last_became_active":"2024-05-14T01:23:35.288129+0000","last_became_peered":"2024-05-14T01:23:35.288129+0000","last_unstale":"2024-05-14T01:23:36.246136+0000","last_undegraded":"2024-05-14T01:23:36.246136+0000","last_fullsized":"2024-05-14T01:23:36.246136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:30:29.890052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984761+0000","last_change":"2024-05-14T01:23:35.286947+0000","last_active":"2024-05-14T01:23:36.984761+0000","last_peered":"2024-05-14T01:23:36.984761+0000","last_clean":"2024-05-14T01:23:36.984761+0000","last_became_active":"2024-05-14T01:23:35.282462+0000","last_became_peered":"2024-05-14T01:23:35.282462+0000","last_unstale":"2024-05-14T01:23:36.984761+0000","last_undegraded":"2024-05-14T01:23:36.984761+0000","last_fullsized":"2024-05-14T01:23:36.984761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:52:26.738482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087397+0000","last_change":"2024-05-14T01:23:35.281765+0000","last_active":"2024-05-14T01:23:38.087397+0000","last_peered":"2024-05-14T01:23:38.087397+0000","last_clean":"2024-05-14T01:23:38.087397+0000","last_became_active":"2024-05-14T01:23:35.280973+0000","last_became_peered":"2024-05-14T01:23:35.280973+0000","last_unstale":"2024-05-14T01:23:38.087397+0000","last_undegraded":"2024-05-14T01:23:38.087397+0000","last_fullsized":"2024-05-14T01:23:38.087397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:15:22.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985998+0000","last_change":"2024-05-14T01:23:35.304119+0000","last_active":"2024-05-14T01:23:36.985998+0000","last_peered":"2024-05-14T01:23:36.985998+0000","last_clean":"2024-05-14T01:23:36.985998+0000","last_became_active":"2024-05-14T01:23:35.303643+0000","last_became_peered":"2024-05-14T01:23:35.303643+0000","last_unstale":"2024-05-14T01:23:36.985998+0000","last_undegraded":"2024-05-14T01:23:36.985998+0000","last_fullsized":"2024-05-14T01:23:36.985998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:48:27.826818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246963+0000","last_change":"2024-05-14T01:23:35.266693+0000","last_active":"2024-05-14T01:23:36.246963+0000","last_peered":"2024-05-14T01:23:36.246963+0000","last_clean":"2024-05-14T01:23:36.246963+0000","last_became_active":"2024-05-14T01:23:35.265931+0000","last_became_peered":"2024-05-14T01:23:35.265931+0000","last_unstale":"2024-05-14T01:23:36.246963+0000","last_undegraded":"2024-05-14T01:23:36.246963+0000","last_fullsized":"2024-05-14T01:23:36.246963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:35:14.703645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246731+0000","last_change":"2024-05-14T01:23:35.296531+0000","last_active":"2024-05-14T01:23:36.246731+0000","last_peered":"2024-05-14T01:23:36.246731+0000","last_clean":"2024-05-14T01:23:36.246731+0000","last_became_active":"2024-05-14T01:23:35.295870+0000","last_became_peered":"2024-05-14T01:23:35.295870+0000","last_unstale":"2024-05-14T01:23:36.246731+0000","last_undegraded":"2024-05-14T01:23:36.246731+0000","last_fullsized":"2024-05-14T01:23:36.246731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:17:24.056984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.675255+0000","last_change":"2024-05-14T01:23:35.259324+0000","last_active":"2024-05-14T01:23:36.675255+0000","last_peered":"2024-05-14T01:23:36.675255+0000","last_clean":"2024-05-14T01:23:36.675255+0000","last_became_active":"2024-05-14T01:23:35.252786+0000","last_became_peered":"2024-05-14T01:23:35.252786+0000","last_unstale":"2024-05-14T01:23:36.675255+0000","last_undegraded":"2024-05-14T01:23:36.675255+0000","last_fullsized":"2024-05-14T01:23:36.675255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:25:50.069629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088690+0000","last_change":"2024-05-14T01:23:35.259920+0000","last_active":"2024-05-14T01:23:38.088690+0000","last_peered":"2024-05-14T01:23:38.088690+0000","last_clean":"2024-05-14T01:23:38.088690+0000","last_became_active":"2024-05-14T01:23:35.259281+0000","last_became_peered":"2024-05-14T01:23:35.259281+0000","last_unstale":"2024-05-14T01:23:38.088690+0000","last_undegraded":"2024-05-14T01:23:38.088690+0000","last_fullsized":"2024-05-14T01:23:38.088690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:30:29.890052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088060+0000","last_change":"2024-05-14T01:23:35.274981+0000","last_active":"2024-05-14T01:23:38.088060+0000","last_peered":"2024-05-14T01:23:38.088060+0000","last_clean":"2024-05-14T01:23:38.088060+0000","last_became_active":"2024-05-14T01:23:35.274256+0000","last_became_peered":"2024-05-14T01:23:35.274256+0000","last_unstale":"2024-05-14T01:23:38.088060+0000","last_undegraded":"2024-05-14T01:23:38.088060+0000","last_fullsized":"2024-05-14T01:23:38.088060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:27:33.193287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243846+0000","last_change":"2024-05-14T01:23:35.251194+0000","last_active":"2024-05-14T01:23:36.243846+0000","last_peered":"2024-05-14T01:23:36.243846+0000","last_clean":"2024-05-14T01:23:36.243846+0000","last_became_active":"2024-05-14T01:23:35.250384+0000","last_became_peered":"2024-05-14T01:23:35.250384+0000","last_unstale":"2024-05-14T01:23:36.243846+0000","last_undegraded":"2024-05-14T01:23:36.243846+0000","last_fullsized":"2024-05-14T01:23:36.243846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:05:16.096171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245455+0000","last_change":"2024-05-14T01:23:35.277295+0000","last_active":"2024-05-14T01:23:36.245455+0000","last_peered":"2024-05-14T01:23:36.245455+0000","last_clean":"2024-05-14T01:23:36.245455+0000","last_became_active":"2024-05-14T01:23:35.276891+0000","last_became_peered":"2024-05-14T01:23:35.276891+0000","last_unstale":"2024-05-14T01:23:36.245455+0000","last_undegraded":"2024-05-14T01:23:36.245455+0000","last_fullsized":"2024-05-14T01:23:36.245455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:35:14.703645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.248502+0000","last_change":"2024-05-14T01:23:35.305211+0000","last_active":"2024-05-14T01:23:36.248502+0000","last_peered":"2024-05-14T01:23:36.248502+0000","last_clean":"2024-05-14T01:23:36.248502+0000","last_became_active":"2024-05-14T01:23:35.304832+0000","last_became_peered":"2024-05-14T01:23:35.304832+0000","last_unstale":"2024-05-14T01:23:36.248502+0000","last_undegraded":"2024-05-14T01:23:36.248502+0000","last_fullsized":"2024-05-14T01:23:36.248502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:36:36.172326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087165+0000","last_change":"2024-05-14T01:23:35.266048+0000","last_active":"2024-05-14T01:23:38.087165+0000","last_peered":"2024-05-14T01:23:38.087165+0000","last_clean":"2024-05-14T01:23:38.087165+0000","last_became_active":"2024-05-14T01:23:35.265451+0000","last_became_peered":"2024-05-14T01:23:35.265451+0000","last_unstale":"2024-05-14T01:23:38.087165+0000","last_undegraded":"2024-05-14T01:23:38.087165+0000","last_fullsized":"2024-05-14T01:23:38.087165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:25:50.069629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985641+0000","last_change":"2024-05-14T01:23:35.299930+0000","last_active":"2024-05-14T01:23:36.985641+0000","last_peered":"2024-05-14T01:23:36.985641+0000","last_clean":"2024-05-14T01:23:36.985641+0000","last_became_active":"2024-05-14T01:23:35.297563+0000","last_became_peered":"2024-05-14T01:23:35.297563+0000","last_unstale":"2024-05-14T01:23:36.985641+0000","last_undegraded":"2024-05-14T01:23:36.985641+0000","last_fullsized":"2024-05-14T01:23:36.985641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:21:34.753294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245344+0000","last_change":"2024-05-14T01:23:35.253089+0000","last_active":"2024-05-14T01:23:36.245344+0000","last_peered":"2024-05-14T01:23:36.245344+0000","last_clean":"2024-05-14T01:23:36.245344+0000","last_became_active":"2024-05-14T01:23:35.251392+0000","last_became_peered":"2024-05-14T01:23:35.251392+0000","last_unstale":"2024-05-14T01:23:36.245344+0000","last_undegraded":"2024-05-14T01:23:36.245344+0000","last_fullsized":"2024-05-14T01:23:36.245344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:15:22.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088549+0000","last_change":"2024-05-14T01:23:35.288320+0000","last_active":"2024-05-14T01:23:38.088549+0000","last_peered":"2024-05-14T01:23:38.088549+0000","last_clean":"2024-05-14T01:23:38.088549+0000","last_became_active":"2024-05-14T01:23:35.287254+0000","last_became_peered":"2024-05-14T01:23:35.287254+0000","last_unstale":"2024-05-14T01:23:38.088549+0000","last_undegraded":"2024-05-14T01:23:38.088549+0000","last_fullsized":"2024-05-14T01:23:38.088549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:15:22.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246177+0000","last_change":"2024-05-14T01:23:35.300944+0000","last_active":"2024-05-14T01:23:36.246177+0000","last_peered":"2024-05-14T01:23:36.246177+0000","last_clean":"2024-05-14T01:23:36.246177+0000","last_became_active":"2024-05-14T01:23:35.299571+0000","last_became_peered":"2024-05-14T01:23:35.299571+0000","last_unstale":"2024-05-14T01:23:36.246177+0000","last_undegraded":"2024-05-14T01:23:36.246177+0000","last_fullsized":"2024-05-14T01:23:36.246177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:38:23.401263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087271+0000","last_change":"2024-05-14T01:23:35.269144+0000","last_active":"2024-05-14T01:23:38.087271+0000","last_peered":"2024-05-14T01:23:38.087271+0000","last_clean":"2024-05-14T01:23:38.087271+0000","last_became_active":"2024-05-14T01:23:35.268523+0000","last_became_peered":"2024-05-14T01:23:35.268523+0000","last_unstale":"2024-05-14T01:23:38.087271+0000","last_undegraded":"2024-05-14T01:23:38.087271+0000","last_fullsized":"2024-05-14T01:23:38.087271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:26:04.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245589+0000","last_change":"2024-05-14T01:23:35.294800+0000","last_active":"2024-05-14T01:23:36.245589+0000","last_peered":"2024-05-14T01:23:36.245589+0000","last_clean":"2024-05-14T01:23:36.245589+0000","last_became_active":"2024-05-14T01:23:35.294322+0000","last_became_peered":"2024-05-14T01:23:35.294322+0000","last_unstale":"2024-05-14T01:23:36.245589+0000","last_undegraded":"2024-05-14T01:23:36.245589+0000","last_fullsized":"2024-05-14T01:23:36.245589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:42:53.264601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087889+0000","last_change":"2024-05-14T01:23:35.274139+0000","last_active":"2024-05-14T01:23:38.087889+0000","last_peered":"2024-05-14T01:23:38.087889+0000","last_clean":"2024-05-14T01:23:38.087889+0000","last_became_active":"2024-05-14T01:23:35.273490+0000","last_became_peered":"2024-05-14T01:23:35.273490+0000","last_unstale":"2024-05-14T01:23:38.087889+0000","last_undegraded":"2024-05-14T01:23:38.087889+0000","last_fullsized":"2024-05-14T01:23:38.087889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:05:16.096171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247159+0000","last_change":"2024-05-14T01:23:35.252097+0000","last_active":"2024-05-14T01:23:36.247159+0000","last_peered":"2024-05-14T01:23:36.247159+0000","last_clean":"2024-05-14T01:23:36.247159+0000","last_became_active":"2024-05-14T01:23:35.251312+0000","last_became_peered":"2024-05-14T01:23:35.251312+0000","last_unstale":"2024-05-14T01:23:36.247159+0000","last_undegraded":"2024-05-14T01:23:36.247159+0000","last_fullsized":"2024-05-14T01:23:36.247159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:42:53.264601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244046+0000","last_change":"2024-05-14T01:23:35.262232+0000","last_active":"2024-05-14T01:23:36.244046+0000","last_peered":"2024-05-14T01:23:36.244046+0000","last_clean":"2024-05-14T01:23:36.244046+0000","last_became_active":"2024-05-14T01:23:35.261558+0000","last_became_peered":"2024-05-14T01:23:35.261558+0000","last_unstale":"2024-05-14T01:23:36.244046+0000","last_undegraded":"2024-05-14T01:23:36.244046+0000","last_fullsized":"2024-05-14T01:23:36.244046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:35:14.703645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089962+0000","last_change":"2024-05-14T01:23:35.274631+0000","last_active":"2024-05-14T01:23:38.089962+0000","last_peered":"2024-05-14T01:23:38.089962+0000","last_clean":"2024-05-14T01:23:38.089962+0000","last_became_active":"2024-05-14T01:23:35.273800+0000","last_became_peered":"2024-05-14T01:23:35.273800+0000","last_unstale":"2024-05-14T01:23:38.089962+0000","last_undegraded":"2024-05-14T01:23:38.089962+0000","last_fullsized":"2024-05-14T01:23:38.089962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:41:36.495618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088951+0000","last_change":"2024-05-14T01:23:35.276519+0000","last_active":"2024-05-14T01:23:38.088951+0000","last_peered":"2024-05-14T01:23:38.088951+0000","last_clean":"2024-05-14T01:23:38.088951+0000","last_became_active":"2024-05-14T01:23:35.275945+0000","last_became_peered":"2024-05-14T01:23:35.275945+0000","last_unstale":"2024-05-14T01:23:38.088951+0000","last_undegraded":"2024-05-14T01:23:38.088951+0000","last_fullsized":"2024-05-14T01:23:38.088951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:19:10.756155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246501+0000","last_change":"2024-05-14T01:23:35.300997+0000","last_active":"2024-05-14T01:23:36.246501+0000","last_peered":"2024-05-14T01:23:36.246501+0000","last_clean":"2024-05-14T01:23:36.246501+0000","last_became_active":"2024-05-14T01:23:35.290048+0000","last_became_peered":"2024-05-14T01:23:35.290048+0000","last_unstale":"2024-05-14T01:23:36.246501+0000","last_undegraded":"2024-05-14T01:23:36.246501+0000","last_fullsized":"2024-05-14T01:23:36.246501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:20:00.610956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.086828+0000","last_change":"2024-05-14T01:23:35.296448+0000","last_active":"2024-05-14T01:23:38.086828+0000","last_peered":"2024-05-14T01:23:38.086828+0000","last_clean":"2024-05-14T01:23:38.086828+0000","last_became_active":"2024-05-14T01:23:35.296164+0000","last_became_peered":"2024-05-14T01:23:35.296164+0000","last_unstale":"2024-05-14T01:23:38.086828+0000","last_undegraded":"2024-05-14T01:23:38.086828+0000","last_fullsized":"2024-05-14T01:23:38.086828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:28.467794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245018+0000","last_change":"2024-05-14T01:23:35.260927+0000","last_active":"2024-05-14T01:23:36.245018+0000","last_peered":"2024-05-14T01:23:36.245018+0000","last_clean":"2024-05-14T01:23:36.245018+0000","last_became_active":"2024-05-14T01:23:35.260122+0000","last_became_peered":"2024-05-14T01:23:35.260122+0000","last_unstale":"2024-05-14T01:23:36.245018+0000","last_undegraded":"2024-05-14T01:23:36.245018+0000","last_fullsized":"2024-05-14T01:23:36.245018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:26:04.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.674795+0000","last_change":"2024-05-14T01:23:35.249002+0000","last_active":"2024-05-14T01:23:36.674795+0000","last_peered":"2024-05-14T01:23:36.674795+0000","last_clean":"2024-05-14T01:23:36.674795+0000","last_became_active":"2024-05-14T01:23:35.248126+0000","last_became_peered":"2024-05-14T01:23:35.248126+0000","last_unstale":"2024-05-14T01:23:36.674795+0000","last_undegraded":"2024-05-14T01:23:36.674795+0000","last_fullsized":"2024-05-14T01:23:36.674795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:58.295553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089403+0000","last_change":"2024-05-14T01:23:34.250861+0000","last_active":"2024-05-14T01:23:38.089403+0000","last_peered":"2024-05-14T01:23:38.089403+0000","last_clean":"2024-05-14T01:23:38.089403+0000","last_became_active":"2024-05-14T01:23:34.250502+0000","last_became_peered":"2024-05-14T01:23:34.250502+0000","last_unstale":"2024-05-14T01:23:38.089403+0000","last_undegraded":"2024-05-14T01:23:38.089403+0000","last_fullsized":"2024-05-14T01:23:38.089403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:53:43.384791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089367+0000","last_change":"2024-05-14T01:23:35.272454+0000","last_active":"2024-05-14T01:23:38.089367+0000","last_peered":"2024-05-14T01:23:38.089367+0000","last_clean":"2024-05-14T01:23:38.089367+0000","last_became_active":"2024-05-14T01:23:35.271773+0000","last_became_peered":"2024-05-14T01:23:35.271773+0000","last_unstale":"2024-05-14T01:23:38.089367+0000","last_undegraded":"2024-05-14T01:23:38.089367+0000","last_fullsized":"2024-05-14T01:23:38.089367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:42:53.264601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245396+0000","last_change":"2024-05-14T01:23:34.245154+0000","last_active":"2024-05-14T01:23:36.245396+0000","last_peered":"2024-05-14T01:23:36.245396+0000","last_clean":"2024-05-14T01:23:36.245396+0000","last_became_active":"2024-05-14T01:23:34.244225+0000","last_became_peered":"2024-05-14T01:23:34.244225+0000","last_unstale":"2024-05-14T01:23:36.245396+0000","last_undegraded":"2024-05-14T01:23:36.245396+0000","last_fullsized":"2024-05-14T01:23:36.245396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:50:26.266945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089413+0000","last_change":"2024-05-14T01:23:34.219241+0000","last_active":"2024-05-14T01:23:38.089413+0000","last_peered":"2024-05-14T01:23:38.089413+0000","last_clean":"2024-05-14T01:23:38.089413+0000","last_became_active":"2024-05-14T01:23:34.218932+0000","last_became_peered":"2024-05-14T01:23:34.218932+0000","last_unstale":"2024-05-14T01:23:38.089413+0000","last_undegraded":"2024-05-14T01:23:38.089413+0000","last_fullsized":"2024-05-14T01:23:38.089413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:13:57.047963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087835+0000","last_change":"2024-05-14T01:23:35.280370+0000","last_active":"2024-05-14T01:23:38.087835+0000","last_peered":"2024-05-14T01:23:38.087835+0000","last_clean":"2024-05-14T01:23:38.087835+0000","last_became_active":"2024-05-14T01:23:35.275913+0000","last_became_peered":"2024-05-14T01:23:35.275913+0000","last_unstale":"2024-05-14T01:23:38.087835+0000","last_undegraded":"2024-05-14T01:23:38.087835+0000","last_fullsized":"2024-05-14T01:23:38.087835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:19:10.756155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245706+0000","last_change":"2024-05-14T01:23:34.251307+0000","last_active":"2024-05-14T01:23:36.245706+0000","last_peered":"2024-05-14T01:23:36.245706+0000","last_clean":"2024-05-14T01:23:36.245706+0000","last_became_active":"2024-05-14T01:23:34.245659+0000","last_became_peered":"2024-05-14T01:23:34.245659+0000","last_unstale":"2024-05-14T01:23:36.245706+0000","last_undegraded":"2024-05-14T01:23:36.245706+0000","last_fullsized":"2024-05-14T01:23:36.245706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:54:09.731166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243716+0000","last_change":"2024-05-14T01:23:35.263892+0000","last_active":"2024-05-14T01:23:36.243716+0000","last_peered":"2024-05-14T01:23:36.243716+0000","last_clean":"2024-05-14T01:23:36.243716+0000","last_became_active":"2024-05-14T01:23:35.262822+0000","last_became_peered":"2024-05-14T01:23:35.262822+0000","last_unstale":"2024-05-14T01:23:36.243716+0000","last_undegraded":"2024-05-14T01:23:36.243716+0000","last_fullsized":"2024-05-14T01:23:36.243716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:19:10.756155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246875+0000","last_change":"2024-05-14T01:23:34.259671+0000","last_active":"2024-05-14T01:23:36.246875+0000","last_peered":"2024-05-14T01:23:36.246875+0000","last_clean":"2024-05-14T01:23:36.246875+0000","last_became_active":"2024-05-14T01:23:34.259001+0000","last_became_peered":"2024-05-14T01:23:34.259001+0000","last_unstale":"2024-05-14T01:23:36.246875+0000","last_undegraded":"2024-05-14T01:23:36.246875+0000","last_fullsized":"2024-05-14T01:23:36.246875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:54:09.731166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.248083+0000","last_change":"2024-05-14T01:23:35.298763+0000","last_active":"2024-05-14T01:23:36.248083+0000","last_peered":"2024-05-14T01:23:36.248083+0000","last_clean":"2024-05-14T01:23:36.248083+0000","last_became_active":"2024-05-14T01:23:35.295383+0000","last_became_peered":"2024-05-14T01:23:35.295383+0000","last_unstale":"2024-05-14T01:23:36.248083+0000","last_undegraded":"2024-05-14T01:23:36.248083+0000","last_fullsized":"2024-05-14T01:23:36.248083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:27:07.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.248017+0000","last_change":"2024-05-14T01:23:34.259392+0000","last_active":"2024-05-14T01:23:36.248017+0000","last_peered":"2024-05-14T01:23:36.248017+0000","last_clean":"2024-05-14T01:23:36.248017+0000","last_became_active":"2024-05-14T01:23:34.258475+0000","last_became_peered":"2024-05-14T01:23:34.258475+0000","last_unstale":"2024-05-14T01:23:36.248017+0000","last_undegraded":"2024-05-14T01:23:36.248017+0000","last_fullsized":"2024-05-14T01:23:36.248017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:50:26.266945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089282+0000","last_change":"2024-05-14T01:23:35.301841+0000","last_active":"2024-05-14T01:23:38.089282+0000","last_peered":"2024-05-14T01:23:38.089282+0000","last_clean":"2024-05-14T01:23:38.089282+0000","last_became_active":"2024-05-14T01:23:35.301260+0000","last_became_peered":"2024-05-14T01:23:35.301260+0000","last_unstale":"2024-05-14T01:23:38.089282+0000","last_undegraded":"2024-05-14T01:23:38.089282+0000","last_fullsized":"2024-05-14T01:23:38.089282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:17:24.056984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244314+0000","last_change":"2024-05-14T01:23:34.241260+0000","last_active":"2024-05-14T01:23:36.244314+0000","last_peered":"2024-05-14T01:23:36.244314+0000","last_clean":"2024-05-14T01:23:36.244314+0000","last_became_active":"2024-05-14T01:23:34.241005+0000","last_became_peered":"2024-05-14T01:23:34.241005+0000","last_unstale":"2024-05-14T01:23:36.244314+0000","last_undegraded":"2024-05-14T01:23:36.244314+0000","last_fullsized":"2024-05-14T01:23:36.244314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:55.788381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.675306+0000","last_change":"2024-05-14T01:23:35.281538+0000","last_active":"2024-05-14T01:23:36.675306+0000","last_peered":"2024-05-14T01:23:36.675306+0000","last_clean":"2024-05-14T01:23:36.675306+0000","last_became_active":"2024-05-14T01:23:35.280728+0000","last_became_peered":"2024-05-14T01:23:35.280728+0000","last_unstale":"2024-05-14T01:23:36.675306+0000","last_undegraded":"2024-05-14T01:23:36.675306+0000","last_fullsized":"2024-05-14T01:23:36.675306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:09:07.570394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246193+0000","last_change":"2024-05-14T01:23:34.229467+0000","last_active":"2024-05-14T01:23:36.246193+0000","last_peered":"2024-05-14T01:23:36.246193+0000","last_clean":"2024-05-14T01:23:36.246193+0000","last_became_active":"2024-05-14T01:23:34.228709+0000","last_became_peered":"2024-05-14T01:23:34.228709+0000","last_unstale":"2024-05-14T01:23:36.246193+0000","last_undegraded":"2024-05-14T01:23:36.246193+0000","last_fullsized":"2024-05-14T01:23:36.246193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:57.287353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985329+0000","last_change":"2024-05-14T01:23:35.297600+0000","last_active":"2024-05-14T01:23:36.985329+0000","last_peered":"2024-05-14T01:23:36.985329+0000","last_clean":"2024-05-14T01:23:36.985329+0000","last_became_active":"2024-05-14T01:23:35.282394+0000","last_became_peered":"2024-05-14T01:23:35.282394+0000","last_unstale":"2024-05-14T01:23:36.985329+0000","last_undegraded":"2024-05-14T01:23:36.985329+0000","last_fullsized":"2024-05-14T01:23:36.985329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:27:07.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089635+0000","last_change":"2024-05-14T01:23:34.233957+0000","last_active":"2024-05-14T01:23:38.089635+0000","last_peered":"2024-05-14T01:23:38.089635+0000","last_clean":"2024-05-14T01:23:38.089635+0000","last_became_active":"2024-05-14T01:23:34.233639+0000","last_became_peered":"2024-05-14T01:23:34.233639+0000","last_unstale":"2024-05-14T01:23:38.089635+0000","last_undegraded":"2024-05-14T01:23:38.089635+0000","last_fullsized":"2024-05-14T01:23:38.089635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:53:43.384791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088454+0000","last_change":"2024-05-14T01:23:35.283594+0000","last_active":"2024-05-14T01:23:38.088454+0000","last_peered":"2024-05-14T01:23:38.088454+0000","last_clean":"2024-05-14T01:23:38.088454+0000","last_became_active":"2024-05-14T01:23:35.283197+0000","last_became_peered":"2024-05-14T01:23:35.283197+0000","last_unstale":"2024-05-14T01:23:38.088454+0000","last_undegraded":"2024-05-14T01:23:38.088454+0000","last_fullsized":"2024-05-14T01:23:38.088454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:26:04.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246382+0000","last_change":"2024-05-14T01:23:34.255912+0000","last_active":"2024-05-14T01:23:36.246382+0000","last_peered":"2024-05-14T01:23:36.246382+0000","last_clean":"2024-05-14T01:23:36.246382+0000","last_became_active":"2024-05-14T01:23:34.253523+0000","last_became_peered":"2024-05-14T01:23:34.253523+0000","last_unstale":"2024-05-14T01:23:36.246382+0000","last_undegraded":"2024-05-14T01:23:36.246382+0000","last_fullsized":"2024-05-14T01:23:36.246382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:55.788381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985315+0000","last_change":"2024-05-14T01:23:35.285975+0000","last_active":"2024-05-14T01:23:36.985315+0000","last_peered":"2024-05-14T01:23:36.985315+0000","last_clean":"2024-05-14T01:23:36.985315+0000","last_became_active":"2024-05-14T01:23:35.285612+0000","last_became_peered":"2024-05-14T01:23:35.285612+0000","last_unstale":"2024-05-14T01:23:36.985315+0000","last_undegraded":"2024-05-14T01:23:36.985315+0000","last_fullsized":"2024-05-14T01:23:36.985315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:51:24.561905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245103+0000","last_change":"2024-05-14T01:23:34.250761+0000","last_active":"2024-05-14T01:23:36.245103+0000","last_peered":"2024-05-14T01:23:36.245103+0000","last_clean":"2024-05-14T01:23:36.245103+0000","last_became_active":"2024-05-14T01:23:34.249867+0000","last_became_peered":"2024-05-14T01:23:34.249867+0000","last_unstale":"2024-05-14T01:23:36.245103+0000","last_undegraded":"2024-05-14T01:23:36.245103+0000","last_fullsized":"2024-05-14T01:23:36.245103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:13:57.047963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245812+0000","last_change":"2024-05-14T01:23:35.261647+0000","last_active":"2024-05-14T01:23:36.245812+0000","last_peered":"2024-05-14T01:23:36.245812+0000","last_clean":"2024-05-14T01:23:36.245812+0000","last_became_active":"2024-05-14T01:23:35.259092+0000","last_became_peered":"2024-05-14T01:23:35.259092+0000","last_unstale":"2024-05-14T01:23:36.245812+0000","last_undegraded":"2024-05-14T01:23:36.245812+0000","last_fullsized":"2024-05-14T01:23:36.245812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:05:16.096171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089803+0000","last_change":"2024-05-14T01:23:34.224371+0000","last_active":"2024-05-14T01:23:38.089803+0000","last_peered":"2024-05-14T01:23:38.089803+0000","last_clean":"2024-05-14T01:23:38.089803+0000","last_became_active":"2024-05-14T01:23:34.224010+0000","last_became_peered":"2024-05-14T01:23:34.224010+0000","last_unstale":"2024-05-14T01:23:38.089803+0000","last_undegraded":"2024-05-14T01:23:38.089803+0000","last_fullsized":"2024-05-14T01:23:38.089803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:13:57.047963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984842+0000","last_change":"2024-05-14T01:23:35.298167+0000","last_active":"2024-05-14T01:23:36.984842+0000","last_peered":"2024-05-14T01:23:36.984842+0000","last_clean":"2024-05-14T01:23:36.984842+0000","last_became_active":"2024-05-14T01:23:35.286157+0000","last_became_peered":"2024-05-14T01:23:35.286157+0000","last_unstale":"2024-05-14T01:23:36.984842+0000","last_undegraded":"2024-05-14T01:23:36.984842+0000","last_fullsized":"2024-05-14T01:23:36.984842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:45:12.494840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.675221+0000","last_change":"2024-05-14T01:23:34.236199+0000","last_active":"2024-05-14T01:23:36.675221+0000","last_peered":"2024-05-14T01:23:36.675221+0000","last_clean":"2024-05-14T01:23:36.675221+0000","last_became_active":"2024-05-14T01:23:34.233012+0000","last_became_peered":"2024-05-14T01:23:34.233012+0000","last_unstale":"2024-05-14T01:23:36.675221+0000","last_undegraded":"2024-05-14T01:23:36.675221+0000","last_fullsized":"2024-05-14T01:23:36.675221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:05:28.581427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985820+0000","last_change":"2024-05-14T01:23:35.297883+0000","last_active":"2024-05-14T01:23:36.985820+0000","last_peered":"2024-05-14T01:23:36.985820+0000","last_clean":"2024-05-14T01:23:36.985820+0000","last_became_active":"2024-05-14T01:23:35.287258+0000","last_became_peered":"2024-05-14T01:23:35.287258+0000","last_unstale":"2024-05-14T01:23:36.985820+0000","last_undegraded":"2024-05-14T01:23:36.985820+0000","last_fullsized":"2024-05-14T01:23:36.985820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:54:11.367649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087438+0000","last_change":"2024-05-14T01:23:34.225011+0000","last_active":"2024-05-14T01:23:38.087438+0000","last_peered":"2024-05-14T01:23:38.087438+0000","last_clean":"2024-05-14T01:23:38.087438+0000","last_became_active":"2024-05-14T01:23:34.224674+0000","last_became_peered":"2024-05-14T01:23:34.224674+0000","last_unstale":"2024-05-14T01:23:38.087438+0000","last_undegraded":"2024-05-14T01:23:38.087438+0000","last_fullsized":"2024-05-14T01:23:38.087438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:50:26.266945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.986041+0000","last_change":"2024-05-14T01:23:35.287056+0000","last_active":"2024-05-14T01:23:36.986041+0000","last_peered":"2024-05-14T01:23:36.986041+0000","last_clean":"2024-05-14T01:23:36.986041+0000","last_became_active":"2024-05-14T01:23:35.286372+0000","last_became_peered":"2024-05-14T01:23:35.286372+0000","last_unstale":"2024-05-14T01:23:36.986041+0000","last_undegraded":"2024-05-14T01:23:36.986041+0000","last_fullsized":"2024-05-14T01:23:36.986041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:24:47.905393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244447+0000","last_change":"2024-05-14T01:23:34.234869+0000","last_active":"2024-05-14T01:23:36.244447+0000","last_peered":"2024-05-14T01:23:36.244447+0000","last_clean":"2024-05-14T01:23:36.244447+0000","last_became_active":"2024-05-14T01:23:34.234582+0000","last_became_peered":"2024-05-14T01:23:34.234582+0000","last_unstale":"2024-05-14T01:23:36.244447+0000","last_undegraded":"2024-05-14T01:23:36.244447+0000","last_fullsized":"2024-05-14T01:23:36.244447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:25:49.061428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247626+0000","last_change":"2024-05-14T01:23:35.294289+0000","last_active":"2024-05-14T01:23:36.247626+0000","last_peered":"2024-05-14T01:23:36.247626+0000","last_clean":"2024-05-14T01:23:36.247626+0000","last_became_active":"2024-05-14T01:23:35.289592+0000","last_became_peered":"2024-05-14T01:23:35.289592+0000","last_unstale":"2024-05-14T01:23:36.247626+0000","last_undegraded":"2024-05-14T01:23:36.247626+0000","last_fullsized":"2024-05-14T01:23:36.247626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:45:12.494840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.086917+0000","last_change":"2024-05-14T01:23:34.253809+0000","last_active":"2024-05-14T01:23:38.086917+0000","last_peered":"2024-05-14T01:23:38.086917+0000","last_clean":"2024-05-14T01:23:38.086917+0000","last_became_active":"2024-05-14T01:23:34.253537+0000","last_became_peered":"2024-05-14T01:23:34.253537+0000","last_unstale":"2024-05-14T01:23:38.086917+0000","last_undegraded":"2024-05-14T01:23:38.086917+0000","last_fullsized":"2024-05-14T01:23:38.086917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:50:36.678245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985359+0000","last_change":"2024-05-14T01:23:35.298846+0000","last_active":"2024-05-14T01:23:36.985359+0000","last_peered":"2024-05-14T01:23:36.985359+0000","last_clean":"2024-05-14T01:23:36.985359+0000","last_became_active":"2024-05-14T01:23:35.298408+0000","last_became_peered":"2024-05-14T01:23:35.298408+0000","last_unstale":"2024-05-14T01:23:36.985359+0000","last_undegraded":"2024-05-14T01:23:36.985359+0000","last_fullsized":"2024-05-14T01:23:36.985359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:36:36.172326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984460+0000","last_change":"2024-05-14T01:23:25.487525+0000","last_active":"2024-05-14T01:23:36.984460+0000","last_peered":"2024-05-14T01:23:36.984460+0000","last_clean":"2024-05-14T01:23:36.984460+0000","last_became_active":"2024-05-14T01:23:25.485622+0000","last_became_peered":"2024-05-14T01:23:25.485622+0000","last_unstale":"2024-05-14T01:23:36.984460+0000","last_undegraded":"2024-05-14T01:23:36.984460+0000","last_fullsized":"2024-05-14T01:23:36.984460+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_clean_scrub_stamp":"2024-05-14T01:23:24.138255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:26:23.884962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246267+0000","last_change":"2024-05-14T01:23:34.250502+0000","last_active":"2024-05-14T01:23:36.246267+0000","last_peered":"2024-05-14T01:23:36.246267+0000","last_clean":"2024-05-14T01:23:36.246267+0000","last_became_active":"2024-05-14T01:23:34.249867+0000","last_became_peered":"2024-05-14T01:23:34.249867+0000","last_unstale":"2024-05-14T01:23:36.246267+0000","last_undegraded":"2024-05-14T01:23:36.246267+0000","last_fullsized":"2024-05-14T01:23:36.246267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:13:57.047963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088772+0000","last_change":"2024-05-14T01:23:35.302453+0000","last_active":"2024-05-14T01:23:38.088772+0000","last_peered":"2024-05-14T01:23:38.088772+0000","last_clean":"2024-05-14T01:23:38.088772+0000","last_became_active":"2024-05-14T01:23:35.302253+0000","last_became_peered":"2024-05-14T01:23:35.302253+0000","last_unstale":"2024-05-14T01:23:38.088772+0000","last_undegraded":"2024-05-14T01:23:38.088772+0000","last_fullsized":"2024-05-14T01:23:38.088772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:38:23.401263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984361+0000","last_change":"2024-05-14T01:23:34.258164+0000","last_active":"2024-05-14T01:23:36.984361+0000","last_peered":"2024-05-14T01:23:36.984361+0000","last_clean":"2024-05-14T01:23:36.984361+0000","last_became_active":"2024-05-14T01:23:34.257595+0000","last_became_peered":"2024-05-14T01:23:34.257595+0000","last_unstale":"2024-05-14T01:23:36.984361+0000","last_undegraded":"2024-05-14T01:23:36.984361+0000","last_fullsized":"2024-05-14T01:23:36.984361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:27.459594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088117+0000","last_change":"2024-05-14T01:23:35.271974+0000","last_active":"2024-05-14T01:23:38.088117+0000","last_peered":"2024-05-14T01:23:38.088117+0000","last_clean":"2024-05-14T01:23:38.088117+0000","last_became_active":"2024-05-14T01:23:35.269194+0000","last_became_peered":"2024-05-14T01:23:35.269194+0000","last_unstale":"2024-05-14T01:23:38.088117+0000","last_undegraded":"2024-05-14T01:23:38.088117+0000","last_fullsized":"2024-05-14T01:23:38.088117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:55:21.424796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.086730+0000","last_change":"2024-05-14T01:23:34.223715+0000","last_active":"2024-05-14T01:23:38.086730+0000","last_peered":"2024-05-14T01:23:38.086730+0000","last_clean":"2024-05-14T01:23:38.086730+0000","last_became_active":"2024-05-14T01:23:34.223397+0000","last_became_peered":"2024-05-14T01:23:34.223397+0000","last_unstale":"2024-05-14T01:23:38.086730+0000","last_undegraded":"2024-05-14T01:23:38.086730+0000","last_fullsized":"2024-05-14T01:23:38.086730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:54:09.731166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243600+0000","last_change":"2024-05-14T01:23:35.262679+0000","last_active":"2024-05-14T01:23:36.243600+0000","last_peered":"2024-05-14T01:23:36.243600+0000","last_clean":"2024-05-14T01:23:36.243600+0000","last_became_active":"2024-05-14T01:23:35.261920+0000","last_became_peered":"2024-05-14T01:23:35.261920+0000","last_unstale":"2024-05-14T01:23:36.243600+0000","last_undegraded":"2024-05-14T01:23:36.243600+0000","last_fullsized":"2024-05-14T01:23:36.243600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:15:22.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246672+0000","last_change":"2024-05-14T01:23:34.249172+0000","last_active":"2024-05-14T01:23:36.246672+0000","last_peered":"2024-05-14T01:23:36.246672+0000","last_clean":"2024-05-14T01:23:36.246672+0000","last_became_active":"2024-05-14T01:23:34.238802+0000","last_became_peered":"2024-05-14T01:23:34.238802+0000","last_unstale":"2024-05-14T01:23:36.246672+0000","last_undegraded":"2024-05-14T01:23:36.246672+0000","last_fullsized":"2024-05-14T01:23:36.246672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:27.459594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.674803+0000","last_change":"2024-05-14T01:23:35.264275+0000","last_active":"2024-05-14T01:23:36.674803+0000","last_peered":"2024-05-14T01:23:36.674803+0000","last_clean":"2024-05-14T01:23:36.674803+0000","last_became_active":"2024-05-14T01:23:35.262643+0000","last_became_peered":"2024-05-14T01:23:35.262643+0000","last_unstale":"2024-05-14T01:23:36.674803+0000","last_undegraded":"2024-05-14T01:23:36.674803+0000","last_fullsized":"2024-05-14T01:23:36.674803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:56.796582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244185+0000","last_change":"2024-05-14T01:23:34.226163+0000","last_active":"2024-05-14T01:23:36.244185+0000","last_peered":"2024-05-14T01:23:36.244185+0000","last_clean":"2024-05-14T01:23:36.244185+0000","last_became_active":"2024-05-14T01:23:34.225890+0000","last_became_peered":"2024-05-14T01:23:34.225890+0000","last_unstale":"2024-05-14T01:23:36.244185+0000","last_undegraded":"2024-05-14T01:23:36.244185+0000","last_fullsized":"2024-05-14T01:23:36.244185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:57.287353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247976+0000","last_change":"2024-05-14T01:23:35.294211+0000","last_active":"2024-05-14T01:23:36.247976+0000","last_peered":"2024-05-14T01:23:36.247976+0000","last_clean":"2024-05-14T01:23:36.247976+0000","last_became_active":"2024-05-14T01:23:35.289658+0000","last_became_peered":"2024-05-14T01:23:35.289658+0000","last_unstale":"2024-05-14T01:23:36.247976+0000","last_undegraded":"2024-05-14T01:23:36.247976+0000","last_fullsized":"2024-05-14T01:23:36.247976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:51:24.561905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985721+0000","last_change":"2024-05-14T01:23:34.256826+0000","last_active":"2024-05-14T01:23:36.985721+0000","last_peered":"2024-05-14T01:23:36.985721+0000","last_clean":"2024-05-14T01:23:36.985721+0000","last_became_active":"2024-05-14T01:23:34.256022+0000","last_became_peered":"2024-05-14T01:23:34.256022+0000","last_unstale":"2024-05-14T01:23:36.985721+0000","last_undegraded":"2024-05-14T01:23:36.985721+0000","last_fullsized":"2024-05-14T01:23:36.985721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:19:25.032602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243917+0000","last_change":"2024-05-14T01:23:35.260714+0000","last_active":"2024-05-14T01:23:36.243917+0000","last_peered":"2024-05-14T01:23:36.243917+0000","last_clean":"2024-05-14T01:23:36.243917+0000","last_became_active":"2024-05-14T01:23:35.259757+0000","last_became_peered":"2024-05-14T01:23:35.259757+0000","last_unstale":"2024-05-14T01:23:36.243917+0000","last_undegraded":"2024-05-14T01:23:36.243917+0000","last_fullsized":"2024-05-14T01:23:36.243917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:17:24.056984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.286013+0000","last_change":"2024-05-14T01:23:34.235193+0000","last_active":"2024-05-14T01:23:36.286013+0000","last_peered":"2024-05-14T01:23:36.286013+0000","last_clean":"2024-05-14T01:23:36.286013+0000","last_became_active":"2024-05-14T01:23:34.234838+0000","last_became_peered":"2024-05-14T01:23:34.234838+0000","last_unstale":"2024-05-14T01:23:36.286013+0000","last_undegraded":"2024-05-14T01:23:36.286013+0000","last_fullsized":"2024-05-14T01:23:36.286013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:54:09.731166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088147+0000","last_change":"2024-05-14T01:23:35.304577+0000","last_active":"2024-05-14T01:23:38.088147+0000","last_peered":"2024-05-14T01:23:38.088147+0000","last_clean":"2024-05-14T01:23:38.088147+0000","last_became_active":"2024-05-14T01:23:35.304182+0000","last_became_peered":"2024-05-14T01:23:35.304182+0000","last_unstale":"2024-05-14T01:23:38.088147+0000","last_undegraded":"2024-05-14T01:23:38.088147+0000","last_fullsized":"2024-05-14T01:23:38.088147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:42:53.264601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247154+0000","last_change":"2024-05-14T01:23:34.252262+0000","last_active":"2024-05-14T01:23:36.247154+0000","last_peered":"2024-05-14T01:23:36.247154+0000","last_clean":"2024-05-14T01:23:36.247154+0000","last_became_active":"2024-05-14T01:23:34.251538+0000","last_became_peered":"2024-05-14T01:23:34.251538+0000","last_unstale":"2024-05-14T01:23:36.247154+0000","last_undegraded":"2024-05-14T01:23:36.247154+0000","last_fullsized":"2024-05-14T01:23:36.247154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:55.788381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089306+0000","last_change":"2024-05-14T01:23:35.272849+0000","last_active":"2024-05-14T01:23:38.089306+0000","last_peered":"2024-05-14T01:23:38.089306+0000","last_clean":"2024-05-14T01:23:38.089306+0000","last_became_active":"2024-05-14T01:23:35.272167+0000","last_became_peered":"2024-05-14T01:23:35.272167+0000","last_unstale":"2024-05-14T01:23:38.089306+0000","last_undegraded":"2024-05-14T01:23:38.089306+0000","last_fullsized":"2024-05-14T01:23:38.089306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:35:14.703645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984311+0000","last_change":"2024-05-14T01:23:34.258728+0000","last_active":"2024-05-14T01:23:36.984311+0000","last_peered":"2024-05-14T01:23:36.984311+0000","last_clean":"2024-05-14T01:23:36.984311+0000","last_became_active":"2024-05-14T01:23:34.255812+0000","last_became_peered":"2024-05-14T01:23:34.255812+0000","last_unstale":"2024-05-14T01:23:36.984311+0000","last_undegraded":"2024-05-14T01:23:36.984311+0000","last_fullsized":"2024-05-14T01:23:36.984311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:55.788381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.674842+0000","last_change":"2024-05-14T01:23:35.265948+0000","last_active":"2024-05-14T01:23:36.674842+0000","last_peered":"2024-05-14T01:23:36.674842+0000","last_clean":"2024-05-14T01:23:36.674842+0000","last_became_active":"2024-05-14T01:23:35.261913+0000","last_became_peered":"2024-05-14T01:23:35.261913+0000","last_unstale":"2024-05-14T01:23:36.674842+0000","last_undegraded":"2024-05-14T01:23:36.674842+0000","last_fullsized":"2024-05-14T01:23:36.674842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:28.467794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243989+0000","last_change":"2024-05-14T01:23:34.251067+0000","last_active":"2024-05-14T01:23:36.243989+0000","last_peered":"2024-05-14T01:23:36.243989+0000","last_clean":"2024-05-14T01:23:36.243989+0000","last_became_active":"2024-05-14T01:23:34.250744+0000","last_became_peered":"2024-05-14T01:23:34.250744+0000","last_unstale":"2024-05-14T01:23:36.243989+0000","last_undegraded":"2024-05-14T01:23:36.243989+0000","last_fullsized":"2024-05-14T01:23:36.243989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:27.459594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088158+0000","last_change":"2024-05-14T01:23:35.276327+0000","last_active":"2024-05-14T01:23:38.088158+0000","last_peered":"2024-05-14T01:23:38.088158+0000","last_clean":"2024-05-14T01:23:38.088158+0000","last_became_active":"2024-05-14T01:23:35.275932+0000","last_became_peered":"2024-05-14T01:23:35.275932+0000","last_unstale":"2024-05-14T01:23:38.088158+0000","last_undegraded":"2024-05-14T01:23:38.088158+0000","last_fullsized":"2024-05-14T01:23:38.088158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:35:14.703645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244161+0000","last_change":"2024-05-14T01:23:34.224180+0000","last_active":"2024-05-14T01:23:36.244161+0000","last_peered":"2024-05-14T01:23:36.244161+0000","last_clean":"2024-05-14T01:23:36.244161+0000","last_became_active":"2024-05-14T01:23:34.223787+0000","last_became_peered":"2024-05-14T01:23:34.223787+0000","last_unstale":"2024-05-14T01:23:36.244161+0000","last_undegraded":"2024-05-14T01:23:36.244161+0000","last_fullsized":"2024-05-14T01:23:36.244161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:50:26.266945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089151+0000","last_change":"2024-05-14T01:23:35.281157+0000","last_active":"2024-05-14T01:23:38.089151+0000","last_peered":"2024-05-14T01:23:38.089151+0000","last_clean":"2024-05-14T01:23:38.089151+0000","last_became_active":"2024-05-14T01:23:35.280808+0000","last_became_peered":"2024-05-14T01:23:35.280808+0000","last_unstale":"2024-05-14T01:23:38.089151+0000","last_undegraded":"2024-05-14T01:23:38.089151+0000","last_fullsized":"2024-05-14T01:23:38.089151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:20:00.610956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985396+0000","last_change":"2024-05-14T01:23:34.256325+0000","last_active":"2024-05-14T01:23:36.985396+0000","last_peered":"2024-05-14T01:23:36.985396+0000","last_clean":"2024-05-14T01:23:36.985396+0000","last_became_active":"2024-05-14T01:23:34.255642+0000","last_became_peered":"2024-05-14T01:23:34.255642+0000","last_unstale":"2024-05-14T01:23:36.985396+0000","last_undegraded":"2024-05-14T01:23:36.985396+0000","last_fullsized":"2024-05-14T01:23:36.985396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:09:06.562194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245464+0000","last_change":"2024-05-14T01:23:35.254121+0000","last_active":"2024-05-14T01:23:36.245464+0000","last_peered":"2024-05-14T01:23:36.245464+0000","last_clean":"2024-05-14T01:23:36.245464+0000","last_became_active":"2024-05-14T01:23:35.251280+0000","last_became_peered":"2024-05-14T01:23:35.251280+0000","last_unstale":"2024-05-14T01:23:36.245464+0000","last_undegraded":"2024-05-14T01:23:36.245464+0000","last_fullsized":"2024-05-14T01:23:36.245464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:19:10.756155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247888+0000","last_change":"2024-05-14T01:23:35.293893+0000","last_active":"2024-05-14T01:23:36.247888+0000","last_peered":"2024-05-14T01:23:36.247888+0000","last_clean":"2024-05-14T01:23:36.247888+0000","last_became_active":"2024-05-14T01:23:35.289188+0000","last_became_peered":"2024-05-14T01:23:35.289188+0000","last_unstale":"2024-05-14T01:23:36.247888+0000","last_undegraded":"2024-05-14T01:23:36.247888+0000","last_fullsized":"2024-05-14T01:23:36.247888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:36.242325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985145+0000","last_change":"2024-05-14T01:23:34.261385+0000","last_active":"2024-05-14T01:23:36.985145+0000","last_peered":"2024-05-14T01:23:36.985145+0000","last_clean":"2024-05-14T01:23:36.985145+0000","last_became_active":"2024-05-14T01:23:34.260450+0000","last_became_peered":"2024-05-14T01:23:34.260450+0000","last_unstale":"2024-05-14T01:23:36.985145+0000","last_undegraded":"2024-05-14T01:23:36.985145+0000","last_fullsized":"2024-05-14T01:23:36.985145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:25:49.061428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247625+0000","last_change":"2024-05-14T01:23:35.301603+0000","last_active":"2024-05-14T01:23:36.247625+0000","last_peered":"2024-05-14T01:23:36.247625+0000","last_clean":"2024-05-14T01:23:36.247625+0000","last_became_active":"2024-05-14T01:23:35.301338+0000","last_became_peered":"2024-05-14T01:23:35.301338+0000","last_unstale":"2024-05-14T01:23:36.247625+0000","last_undegraded":"2024-05-14T01:23:36.247625+0000","last_fullsized":"2024-05-14T01:23:36.247625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:52:26.738482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985570+0000","last_change":"2024-05-14T01:23:34.260143+0000","last_active":"2024-05-14T01:23:36.985570+0000","last_peered":"2024-05-14T01:23:36.985570+0000","last_clean":"2024-05-14T01:23:36.985570+0000","last_became_active":"2024-05-14T01:23:34.259214+0000","last_became_peered":"2024-05-14T01:23:34.259214+0000","last_unstale":"2024-05-14T01:23:36.985570+0000","last_undegraded":"2024-05-14T01:23:36.985570+0000","last_fullsized":"2024-05-14T01:23:36.985570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:55:36.916881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089027+0000","last_change":"2024-05-14T01:23:35.301480+0000","last_active":"2024-05-14T01:23:38.089027+0000","last_peered":"2024-05-14T01:23:38.089027+0000","last_clean":"2024-05-14T01:23:38.089027+0000","last_became_active":"2024-05-14T01:23:35.301170+0000","last_became_peered":"2024-05-14T01:23:35.301170+0000","last_unstale":"2024-05-14T01:23:38.089027+0000","last_undegraded":"2024-05-14T01:23:38.089027+0000","last_fullsized":"2024-05-14T01:23:38.089027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:05:16.096171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088199+0000","last_change":"2024-05-14T01:23:34.226086+0000","last_active":"2024-05-14T01:23:38.088199+0000","last_peered":"2024-05-14T01:23:38.088199+0000","last_clean":"2024-05-14T01:23:38.088199+0000","last_became_active":"2024-05-14T01:23:34.225826+0000","last_became_peered":"2024-05-14T01:23:34.225826+0000","last_unstale":"2024-05-14T01:23:38.088199+0000","last_undegraded":"2024-05-14T01:23:38.088199+0000","last_fullsized":"2024-05-14T01:23:38.088199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:50:36.678245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087918+0000","last_change":"2024-05-14T01:23:35.266231+0000","last_active":"2024-05-14T01:23:38.087918+0000","last_peered":"2024-05-14T01:23:38.087918+0000","last_clean":"2024-05-14T01:23:38.087918+0000","last_became_active":"2024-05-14T01:23:35.265642+0000","last_became_peered":"2024-05-14T01:23:35.265642+0000","last_unstale":"2024-05-14T01:23:38.087918+0000","last_undegraded":"2024-05-14T01:23:38.087918+0000","last_fullsized":"2024-05-14T01:23:38.087918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:17:24.056984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089361+0000","last_change":"2024-05-14T01:23:34.252104+0000","last_active":"2024-05-14T01:23:38.089361+0000","last_peered":"2024-05-14T01:23:38.089361+0000","last_clean":"2024-05-14T01:23:38.089361+0000","last_became_active":"2024-05-14T01:23:34.251819+0000","last_became_peered":"2024-05-14T01:23:34.251819+0000","last_unstale":"2024-05-14T01:23:38.089361+0000","last_undegraded":"2024-05-14T01:23:38.089361+0000","last_fullsized":"2024-05-14T01:23:38.089361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:15:33.123443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T01:23:41.824 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T01:23:41.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.994+0000 7f19c94f9640 1 Processor -- start 2024-05-14T01:23:41.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.994+0000 7f19c94f9640 1 -- start start 2024-05-14T01:23:41.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c94f9640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f19c415c040 0x7f19c40cc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c94f9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c406f850 0x7f19c406fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c94f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f19c406d780 0x7f19c406dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c94f9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f19c40cb460 con 0x7f19c406d780 2024-05-14T01:23:41.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c94f9640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f19c40afd60 con 0x7f19c415c040 2024-05-14T01:23:41.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c94f9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f19c40cb6b0 con 0x7f19c406f850 2024-05-14T01:23:41.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c37fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f19c406d780 0x7f19c406dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c37fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f19c406d780 0x7f19c406dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46506/0 (socket says 172.21.15.154:46506) 2024-05-14T01:23:41.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c37fe640 1 -- 172.21.15.154:0/3328073526 learned_addr learned my addr 172.21.15.154:0/3328073526 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:41.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c2ffd640 1 --2- 172.21.15.154:0/3328073526 >> v2:172.21.15.176:3300/0 conn(0x7f19c415c040 0x7f19c40cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c27fc640 1 --2- 172.21.15.154:0/3328073526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c406f850 0x7f19c406fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c37fe640 1 -- 172.21.15.154:0/3328073526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c406f850 msgr2=0x7f19c406fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:41.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c37fe640 1 --2- 172.21.15.154:0/3328073526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c406f850 0x7f19c406fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c37fe640 1 -- 172.21.15.154:0/3328073526 >> v2:172.21.15.176:3300/0 conn(0x7f19c415c040 msgr2=0x7f19c40cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:41.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c37fe640 1 --2- 172.21.15.154:0/3328073526 >> v2:172.21.15.176:3300/0 conn(0x7f19c415c040 0x7f19c40cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c37fe640 1 -- 172.21.15.154:0/3328073526 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c40cb990 con 0x7f19c406d780 2024-05-14T01:23:41.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c37fe640 1 --2- 172.21.15.154:0/3328073526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c406d780 0x7f19c406dc10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f19c40b3030 tx=0x7f19bc01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16863cf634001b83 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c1ffb640 1 -- 172.21.15.154:0/3328073526 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc0a55e0 con 0x7f19c406d780 2024-05-14T01:23:41.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c1ffb640 1 -- 172.21.15.154:0/3328073526 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19bc0a5780 con 0x7f19c406d780 2024-05-14T01:23:41.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c1ffb640 1 -- 172.21.15.154:0/3328073526 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc0a5b50 con 0x7f19c406d780 2024-05-14T01:23:41.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c94f9640 1 -- 172.21.15.154:0/3328073526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c406d780 msgr2=0x7f19c406dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c94f9640 1 --2- 172.21.15.154:0/3328073526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c406d780 0x7f19c406dc10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f19c40b3030 tx=0x7f19bc01c960 comp rx=0 tx=0).stop 2024-05-14T01:23:41.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c94f9640 1 -- 172.21.15.154:0/3328073526 shutdown_connections 2024-05-14T01:23:41.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c94f9640 1 --2- 172.21.15.154:0/3328073526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c406f850 0x7f19c406fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c94f9640 1 --2- 172.21.15.154:0/3328073526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c406d780 0x7f19c406dc10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c94f9640 1 --2- 172.21.15.154:0/3328073526 >> v2:172.21.15.176:3300/0 conn(0x7f19c415c040 0x7f19c40cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c94f9640 1 -- 172.21.15.154:0/3328073526 >> 172.21.15.154:0/3328073526 conn(0x7f19c40cce80 msgr2=0x7f19c40cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:41.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:41.998+0000 7f19c94f9640 1 -- 172.21.15.154:0/3328073526 shutdown_connections 2024-05-14T01:23:41.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c94f9640 1 -- 172.21.15.154:0/3328073526 wait complete. 2024-05-14T01:23:41.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c94f9640 1 Processor -- start 2024-05-14T01:23:41.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c94f9640 1 -- start start 2024-05-14T01:23:41.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c94f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c406d780 0x7f19c4147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c94f9640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c406f850 0x7f19c415ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c94f9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c415c040 0x7f19c4155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c94f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f19c40b3d60 con 0x7f19c406d780 2024-05-14T01:23:41.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c94f9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f19c40b3be0 con 0x7f19c415c040 2024-05-14T01:23:41.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c94f9640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f19c40b3ee0 con 0x7f19c406f850 2024-05-14T01:23:41.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c406d780 0x7f19c4147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c406d780 0x7f19c4147f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46514/0 (socket says 172.21.15.154:46514) 2024-05-14T01:23:41.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c2ffd640 1 -- 172.21.15.154:0/3415211424 learned_addr learned my addr 172.21.15.154:0/3415211424 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:41.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c27fc640 1 --2- 172.21.15.154:0/3415211424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c406f850 0x7f19c415ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c37fe640 1 --2- 172.21.15.154:0/3415211424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c415c040 0x7f19c4155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c2ffd640 1 -- 172.21.15.154:0/3415211424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c406f850 msgr2=0x7f19c415ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c2ffd640 1 --2- 172.21.15.154:0/3415211424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c406f850 0x7f19c415ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c2ffd640 1 -- 172.21.15.154:0/3415211424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c415c040 msgr2=0x7f19c4155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:41.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c2ffd640 1 --2- 172.21.15.154:0/3415211424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c415c040 0x7f19c4155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:41.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c2ffd640 1 -- 172.21.15.154:0/3415211424 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c415d440 con 0x7f19c406d780 2024-05-14T01:23:41.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c27fc640 1 --2- 172.21.15.154:0/3415211424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c406f850 0x7f19c415ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:41.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c2ffd640 1 --2- 172.21.15.154:0/3415211424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c406d780 0x7f19c4147f20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f19b400d830 tx=0x7f19b400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19ab7fe640 1 -- 172.21.15.154:0/3415211424 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b400b6c0 con 0x7f19c406d780 2024-05-14T01:23:41.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19ab7fe640 1 -- 172.21.15.154:0/3415211424 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b4019070 con 0x7f19c406d780 2024-05-14T01:23:41.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c94f9640 1 -- 172.21.15.154:0/3415211424 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19c415d720 con 0x7f19c406d780 2024-05-14T01:23:41.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19ab7fe640 1 -- 172.21.15.154:0/3415211424 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b400ba60 con 0x7f19c406d780 2024-05-14T01:23:41.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c94f9640 1 -- 172.21.15.154:0/3415211424 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19c415dce0 con 0x7f19c406d780 2024-05-14T01:23:41.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19c94f9640 1 -- 172.21.15.154:0/3415211424 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19c4068360 con 0x7f19c406d780 2024-05-14T01:23:41.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.002+0000 7f19ab7fe640 1 -- 172.21.15.154:0/3415211424 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f19b401e460 con 0x7f19c406d780 2024-05-14T01:23:41.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.006+0000 7f19ab7fe640 1 --2- 172.21.15.154:0/3415211424 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f19b00678c0 0x7f19b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:41.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.006+0000 7f19ab7fe640 1 -- 172.21.15.154:0/3415211424 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f19b4086390 con 0x7f19c406d780 2024-05-14T01:23:41.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.006+0000 7f19c27fc640 1 --2- 172.21.15.154:0/3415211424 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f19b00678c0 0x7f19b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:41.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.006+0000 7f19c27fc640 1 --2- 172.21.15.154:0/3415211424 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f19b00678c0 0x7f19b0069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f19c40b0bf0 tx=0x7f19b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:41.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.010+0000 7f19ab7fe640 1 -- 172.21.15.154:0/3415211424 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f19b4056ed0 con 0x7f19c406d780 2024-05-14T01:23:42.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.154+0000 7f19c94f9640 1 -- 172.21.15.154:0/3415211424 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19c40af4d0 con 0x7f19b00678c0 2024-05-14T01:23:42.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.162+0000 7f19ab7fe640 1 -- 172.21.15.154:0/3415211424 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251860 (secure 0 0 0) 0x7f19c40af4d0 con 0x7f19b00678c0 2024-05-14T01:23:42.147 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:42.149 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-05-14T01:23:42.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.166+0000 7f19c94f9640 1 -- 172.21.15.154:0/3415211424 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f19b00678c0 msgr2=0x7f19b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:42.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.166+0000 7f19c94f9640 1 --2- 172.21.15.154:0/3415211424 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f19b00678c0 0x7f19b0069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f19c40b0bf0 tx=0x7f19b8008040 comp rx=0 tx=0).stop 2024-05-14T01:23:42.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.166+0000 7f19c94f9640 1 -- 172.21.15.154:0/3415211424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c406d780 msgr2=0x7f19c4147f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:42.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.166+0000 7f19c94f9640 1 --2- 172.21.15.154:0/3415211424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c406d780 0x7f19c4147f20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f19b400d830 tx=0x7f19b400dcf0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.166+0000 7f19c94f9640 1 -- 172.21.15.154:0/3415211424 shutdown_connections 2024-05-14T01:23:42.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.166+0000 7f19c94f9640 1 --2- 172.21.15.154:0/3415211424 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f19b00678c0 0x7f19b0069d80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.166+0000 7f19c94f9640 1 --2- 172.21.15.154:0/3415211424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c415c040 0x7f19c4155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.166+0000 7f19c94f9640 1 --2- 172.21.15.154:0/3415211424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c406f850 0x7f19c415ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.166+0000 7f19c94f9640 1 --2- 172.21.15.154:0/3415211424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c406d780 0x7f19c4147f20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.166+0000 7f19c94f9640 1 -- 172.21.15.154:0/3415211424 >> 172.21.15.154:0/3415211424 conn(0x7f19c40cce80 msgr2=0x7f19c4071620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:42.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.166+0000 7f19c94f9640 1 -- 172.21.15.154:0/3415211424 shutdown_connections 2024-05-14T01:23:42.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.166+0000 7f19c94f9640 1 -- 172.21.15.154:0/3415211424 wait complete. 2024-05-14T01:23:42.165 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-14T01:23:41.103639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223240,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751480,"statfs":{"total":773094113280,"available":772865515520,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.893350"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985821+0000","last_change":"2024-05-14T01:23:35.287575+0000","last_active":"2024-05-14T01:23:36.985821+0000","last_peered":"2024-05-14T01:23:36.985821+0000","last_clean":"2024-05-14T01:23:36.985821+0000","last_became_active":"2024-05-14T01:23:35.287181+0000","last_became_peered":"2024-05-14T01:23:35.287181+0000","last_unstale":"2024-05-14T01:23:36.985821+0000","last_undegraded":"2024-05-14T01:23:36.985821+0000","last_fullsized":"2024-05-14T01:23:36.985821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:27:00.026867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244825+0000","last_change":"2024-05-14T01:23:35.262485+0000","last_active":"2024-05-14T01:23:36.244825+0000","last_peered":"2024-05-14T01:23:36.244825+0000","last_clean":"2024-05-14T01:23:36.244825+0000","last_became_active":"2024-05-14T01:23:35.261381+0000","last_became_peered":"2024-05-14T01:23:35.261381+0000","last_unstale":"2024-05-14T01:23:36.244825+0000","last_undegraded":"2024-05-14T01:23:36.244825+0000","last_fullsized":"2024-05-14T01:23:36.244825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:42:53.264601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087562+0000","last_change":"2024-05-14T01:23:35.269758+0000","last_active":"2024-05-14T01:23:38.087562+0000","last_peered":"2024-05-14T01:23:38.087562+0000","last_clean":"2024-05-14T01:23:38.087562+0000","last_became_active":"2024-05-14T01:23:35.267380+0000","last_became_peered":"2024-05-14T01:23:35.267380+0000","last_unstale":"2024-05-14T01:23:38.087562+0000","last_undegraded":"2024-05-14T01:23:38.087562+0000","last_fullsized":"2024-05-14T01:23:38.087562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:19:26.040802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246660+0000","last_change":"2024-05-14T01:23:35.306674+0000","last_active":"2024-05-14T01:23:36.246660+0000","last_peered":"2024-05-14T01:23:36.246660+0000","last_clean":"2024-05-14T01:23:36.246660+0000","last_became_active":"2024-05-14T01:23:35.301618+0000","last_became_peered":"2024-05-14T01:23:35.301618+0000","last_unstale":"2024-05-14T01:23:36.246660+0000","last_undegraded":"2024-05-14T01:23:36.246660+0000","last_fullsized":"2024-05-14T01:23:36.246660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:41:36.495618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985041+0000","last_change":"2024-05-14T01:23:35.285965+0000","last_active":"2024-05-14T01:23:36.985041+0000","last_peered":"2024-05-14T01:23:36.985041+0000","last_clean":"2024-05-14T01:23:36.985041+0000","last_became_active":"2024-05-14T01:23:35.285545+0000","last_became_peered":"2024-05-14T01:23:35.285545+0000","last_unstale":"2024-05-14T01:23:36.985041+0000","last_undegraded":"2024-05-14T01:23:36.985041+0000","last_fullsized":"2024-05-14T01:23:36.985041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:36.242325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246136+0000","last_change":"2024-05-14T01:23:35.300477+0000","last_active":"2024-05-14T01:23:36.246136+0000","last_peered":"2024-05-14T01:23:36.246136+0000","last_clean":"2024-05-14T01:23:36.246136+0000","last_became_active":"2024-05-14T01:23:35.288129+0000","last_became_peered":"2024-05-14T01:23:35.288129+0000","last_unstale":"2024-05-14T01:23:36.246136+0000","last_undegraded":"2024-05-14T01:23:36.246136+0000","last_fullsized":"2024-05-14T01:23:36.246136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:30:29.890052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984761+0000","last_change":"2024-05-14T01:23:35.286947+0000","last_active":"2024-05-14T01:23:36.984761+0000","last_peered":"2024-05-14T01:23:36.984761+0000","last_clean":"2024-05-14T01:23:36.984761+0000","last_became_active":"2024-05-14T01:23:35.282462+0000","last_became_peered":"2024-05-14T01:23:35.282462+0000","last_unstale":"2024-05-14T01:23:36.984761+0000","last_undegraded":"2024-05-14T01:23:36.984761+0000","last_fullsized":"2024-05-14T01:23:36.984761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:52:26.738482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087397+0000","last_change":"2024-05-14T01:23:35.281765+0000","last_active":"2024-05-14T01:23:38.087397+0000","last_peered":"2024-05-14T01:23:38.087397+0000","last_clean":"2024-05-14T01:23:38.087397+0000","last_became_active":"2024-05-14T01:23:35.280973+0000","last_became_peered":"2024-05-14T01:23:35.280973+0000","last_unstale":"2024-05-14T01:23:38.087397+0000","last_undegraded":"2024-05-14T01:23:38.087397+0000","last_fullsized":"2024-05-14T01:23:38.087397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:15:22.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985998+0000","last_change":"2024-05-14T01:23:35.304119+0000","last_active":"2024-05-14T01:23:36.985998+0000","last_peered":"2024-05-14T01:23:36.985998+0000","last_clean":"2024-05-14T01:23:36.985998+0000","last_became_active":"2024-05-14T01:23:35.303643+0000","last_became_peered":"2024-05-14T01:23:35.303643+0000","last_unstale":"2024-05-14T01:23:36.985998+0000","last_undegraded":"2024-05-14T01:23:36.985998+0000","last_fullsized":"2024-05-14T01:23:36.985998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:48:27.826818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246963+0000","last_change":"2024-05-14T01:23:35.266693+0000","last_active":"2024-05-14T01:23:36.246963+0000","last_peered":"2024-05-14T01:23:36.246963+0000","last_clean":"2024-05-14T01:23:36.246963+0000","last_became_active":"2024-05-14T01:23:35.265931+0000","last_became_peered":"2024-05-14T01:23:35.265931+0000","last_unstale":"2024-05-14T01:23:36.246963+0000","last_undegraded":"2024-05-14T01:23:36.246963+0000","last_fullsized":"2024-05-14T01:23:36.246963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:35:14.703645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246731+0000","last_change":"2024-05-14T01:23:35.296531+0000","last_active":"2024-05-14T01:23:36.246731+0000","last_peered":"2024-05-14T01:23:36.246731+0000","last_clean":"2024-05-14T01:23:36.246731+0000","last_became_active":"2024-05-14T01:23:35.295870+0000","last_became_peered":"2024-05-14T01:23:35.295870+0000","last_unstale":"2024-05-14T01:23:36.246731+0000","last_undegraded":"2024-05-14T01:23:36.246731+0000","last_fullsized":"2024-05-14T01:23:36.246731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:17:24.056984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.675255+0000","last_change":"2024-05-14T01:23:35.259324+0000","last_active":"2024-05-14T01:23:36.675255+0000","last_peered":"2024-05-14T01:23:36.675255+0000","last_clean":"2024-05-14T01:23:36.675255+0000","last_became_active":"2024-05-14T01:23:35.252786+0000","last_became_peered":"2024-05-14T01:23:35.252786+0000","last_unstale":"2024-05-14T01:23:36.675255+0000","last_undegraded":"2024-05-14T01:23:36.675255+0000","last_fullsized":"2024-05-14T01:23:36.675255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:25:50.069629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088690+0000","last_change":"2024-05-14T01:23:35.259920+0000","last_active":"2024-05-14T01:23:38.088690+0000","last_peered":"2024-05-14T01:23:38.088690+0000","last_clean":"2024-05-14T01:23:38.088690+0000","last_became_active":"2024-05-14T01:23:35.259281+0000","last_became_peered":"2024-05-14T01:23:35.259281+0000","last_unstale":"2024-05-14T01:23:38.088690+0000","last_undegraded":"2024-05-14T01:23:38.088690+0000","last_fullsized":"2024-05-14T01:23:38.088690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:30:29.890052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088060+0000","last_change":"2024-05-14T01:23:35.274981+0000","last_active":"2024-05-14T01:23:38.088060+0000","last_peered":"2024-05-14T01:23:38.088060+0000","last_clean":"2024-05-14T01:23:38.088060+0000","last_became_active":"2024-05-14T01:23:35.274256+0000","last_became_peered":"2024-05-14T01:23:35.274256+0000","last_unstale":"2024-05-14T01:23:38.088060+0000","last_undegraded":"2024-05-14T01:23:38.088060+0000","last_fullsized":"2024-05-14T01:23:38.088060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:27:33.193287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243846+0000","last_change":"2024-05-14T01:23:35.251194+0000","last_active":"2024-05-14T01:23:36.243846+0000","last_peered":"2024-05-14T01:23:36.243846+0000","last_clean":"2024-05-14T01:23:36.243846+0000","last_became_active":"2024-05-14T01:23:35.250384+0000","last_became_peered":"2024-05-14T01:23:35.250384+0000","last_unstale":"2024-05-14T01:23:36.243846+0000","last_undegraded":"2024-05-14T01:23:36.243846+0000","last_fullsized":"2024-05-14T01:23:36.243846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:05:16.096171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245455+0000","last_change":"2024-05-14T01:23:35.277295+0000","last_active":"2024-05-14T01:23:36.245455+0000","last_peered":"2024-05-14T01:23:36.245455+0000","last_clean":"2024-05-14T01:23:36.245455+0000","last_became_active":"2024-05-14T01:23:35.276891+0000","last_became_peered":"2024-05-14T01:23:35.276891+0000","last_unstale":"2024-05-14T01:23:36.245455+0000","last_undegraded":"2024-05-14T01:23:36.245455+0000","last_fullsized":"2024-05-14T01:23:36.245455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:35:14.703645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.248502+0000","last_change":"2024-05-14T01:23:35.305211+0000","last_active":"2024-05-14T01:23:36.248502+0000","last_peered":"2024-05-14T01:23:36.248502+0000","last_clean":"2024-05-14T01:23:36.248502+0000","last_became_active":"2024-05-14T01:23:35.304832+0000","last_became_peered":"2024-05-14T01:23:35.304832+0000","last_unstale":"2024-05-14T01:23:36.248502+0000","last_undegraded":"2024-05-14T01:23:36.248502+0000","last_fullsized":"2024-05-14T01:23:36.248502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:36:36.172326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087165+0000","last_change":"2024-05-14T01:23:35.266048+0000","last_active":"2024-05-14T01:23:38.087165+0000","last_peered":"2024-05-14T01:23:38.087165+0000","last_clean":"2024-05-14T01:23:38.087165+0000","last_became_active":"2024-05-14T01:23:35.265451+0000","last_became_peered":"2024-05-14T01:23:35.265451+0000","last_unstale":"2024-05-14T01:23:38.087165+0000","last_undegraded":"2024-05-14T01:23:38.087165+0000","last_fullsized":"2024-05-14T01:23:38.087165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:25:50.069629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985641+0000","last_change":"2024-05-14T01:23:35.299930+0000","last_active":"2024-05-14T01:23:36.985641+0000","last_peered":"2024-05-14T01:23:36.985641+0000","last_clean":"2024-05-14T01:23:36.985641+0000","last_became_active":"2024-05-14T01:23:35.297563+0000","last_became_peered":"2024-05-14T01:23:35.297563+0000","last_unstale":"2024-05-14T01:23:36.985641+0000","last_undegraded":"2024-05-14T01:23:36.985641+0000","last_fullsized":"2024-05-14T01:23:36.985641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:21:34.753294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245344+0000","last_change":"2024-05-14T01:23:35.253089+0000","last_active":"2024-05-14T01:23:36.245344+0000","last_peered":"2024-05-14T01:23:36.245344+0000","last_clean":"2024-05-14T01:23:36.245344+0000","last_became_active":"2024-05-14T01:23:35.251392+0000","last_became_peered":"2024-05-14T01:23:35.251392+0000","last_unstale":"2024-05-14T01:23:36.245344+0000","last_undegraded":"2024-05-14T01:23:36.245344+0000","last_fullsized":"2024-05-14T01:23:36.245344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:15:22.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088549+0000","last_change":"2024-05-14T01:23:35.288320+0000","last_active":"2024-05-14T01:23:38.088549+0000","last_peered":"2024-05-14T01:23:38.088549+0000","last_clean":"2024-05-14T01:23:38.088549+0000","last_became_active":"2024-05-14T01:23:35.287254+0000","last_became_peered":"2024-05-14T01:23:35.287254+0000","last_unstale":"2024-05-14T01:23:38.088549+0000","last_undegraded":"2024-05-14T01:23:38.088549+0000","last_fullsized":"2024-05-14T01:23:38.088549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:15:22.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246177+0000","last_change":"2024-05-14T01:23:35.300944+0000","last_active":"2024-05-14T01:23:36.246177+0000","last_peered":"2024-05-14T01:23:36.246177+0000","last_clean":"2024-05-14T01:23:36.246177+0000","last_became_active":"2024-05-14T01:23:35.299571+0000","last_became_peered":"2024-05-14T01:23:35.299571+0000","last_unstale":"2024-05-14T01:23:36.246177+0000","last_undegraded":"2024-05-14T01:23:36.246177+0000","last_fullsized":"2024-05-14T01:23:36.246177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:38:23.401263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087271+0000","last_change":"2024-05-14T01:23:35.269144+0000","last_active":"2024-05-14T01:23:38.087271+0000","last_peered":"2024-05-14T01:23:38.087271+0000","last_clean":"2024-05-14T01:23:38.087271+0000","last_became_active":"2024-05-14T01:23:35.268523+0000","last_became_peered":"2024-05-14T01:23:35.268523+0000","last_unstale":"2024-05-14T01:23:38.087271+0000","last_undegraded":"2024-05-14T01:23:38.087271+0000","last_fullsized":"2024-05-14T01:23:38.087271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:26:04.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245589+0000","last_change":"2024-05-14T01:23:35.294800+0000","last_active":"2024-05-14T01:23:36.245589+0000","last_peered":"2024-05-14T01:23:36.245589+0000","last_clean":"2024-05-14T01:23:36.245589+0000","last_became_active":"2024-05-14T01:23:35.294322+0000","last_became_peered":"2024-05-14T01:23:35.294322+0000","last_unstale":"2024-05-14T01:23:36.245589+0000","last_undegraded":"2024-05-14T01:23:36.245589+0000","last_fullsized":"2024-05-14T01:23:36.245589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:42:53.264601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087889+0000","last_change":"2024-05-14T01:23:35.274139+0000","last_active":"2024-05-14T01:23:38.087889+0000","last_peered":"2024-05-14T01:23:38.087889+0000","last_clean":"2024-05-14T01:23:38.087889+0000","last_became_active":"2024-05-14T01:23:35.273490+0000","last_became_peered":"2024-05-14T01:23:35.273490+0000","last_unstale":"2024-05-14T01:23:38.087889+0000","last_undegraded":"2024-05-14T01:23:38.087889+0000","last_fullsized":"2024-05-14T01:23:38.087889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:05:16.096171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247159+0000","last_change":"2024-05-14T01:23:35.252097+0000","last_active":"2024-05-14T01:23:36.247159+0000","last_peered":"2024-05-14T01:23:36.247159+0000","last_clean":"2024-05-14T01:23:36.247159+0000","last_became_active":"2024-05-14T01:23:35.251312+0000","last_became_peered":"2024-05-14T01:23:35.251312+0000","last_unstale":"2024-05-14T01:23:36.247159+0000","last_undegraded":"2024-05-14T01:23:36.247159+0000","last_fullsized":"2024-05-14T01:23:36.247159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:42:53.264601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244046+0000","last_change":"2024-05-14T01:23:35.262232+0000","last_active":"2024-05-14T01:23:36.244046+0000","last_peered":"2024-05-14T01:23:36.244046+0000","last_clean":"2024-05-14T01:23:36.244046+0000","last_became_active":"2024-05-14T01:23:35.261558+0000","last_became_peered":"2024-05-14T01:23:35.261558+0000","last_unstale":"2024-05-14T01:23:36.244046+0000","last_undegraded":"2024-05-14T01:23:36.244046+0000","last_fullsized":"2024-05-14T01:23:36.244046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:35:14.703645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089962+0000","last_change":"2024-05-14T01:23:35.274631+0000","last_active":"2024-05-14T01:23:38.089962+0000","last_peered":"2024-05-14T01:23:38.089962+0000","last_clean":"2024-05-14T01:23:38.089962+0000","last_became_active":"2024-05-14T01:23:35.273800+0000","last_became_peered":"2024-05-14T01:23:35.273800+0000","last_unstale":"2024-05-14T01:23:38.089962+0000","last_undegraded":"2024-05-14T01:23:38.089962+0000","last_fullsized":"2024-05-14T01:23:38.089962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:41:36.495618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088951+0000","last_change":"2024-05-14T01:23:35.276519+0000","last_active":"2024-05-14T01:23:38.088951+0000","last_peered":"2024-05-14T01:23:38.088951+0000","last_clean":"2024-05-14T01:23:38.088951+0000","last_became_active":"2024-05-14T01:23:35.275945+0000","last_became_peered":"2024-05-14T01:23:35.275945+0000","last_unstale":"2024-05-14T01:23:38.088951+0000","last_undegraded":"2024-05-14T01:23:38.088951+0000","last_fullsized":"2024-05-14T01:23:38.088951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:19:10.756155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246501+0000","last_change":"2024-05-14T01:23:35.300997+0000","last_active":"2024-05-14T01:23:36.246501+0000","last_peered":"2024-05-14T01:23:36.246501+0000","last_clean":"2024-05-14T01:23:36.246501+0000","last_became_active":"2024-05-14T01:23:35.290048+0000","last_became_peered":"2024-05-14T01:23:35.290048+0000","last_unstale":"2024-05-14T01:23:36.246501+0000","last_undegraded":"2024-05-14T01:23:36.246501+0000","last_fullsized":"2024-05-14T01:23:36.246501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:20:00.610956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.086828+0000","last_change":"2024-05-14T01:23:35.296448+0000","last_active":"2024-05-14T01:23:38.086828+0000","last_peered":"2024-05-14T01:23:38.086828+0000","last_clean":"2024-05-14T01:23:38.086828+0000","last_became_active":"2024-05-14T01:23:35.296164+0000","last_became_peered":"2024-05-14T01:23:35.296164+0000","last_unstale":"2024-05-14T01:23:38.086828+0000","last_undegraded":"2024-05-14T01:23:38.086828+0000","last_fullsized":"2024-05-14T01:23:38.086828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:28.467794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245018+0000","last_change":"2024-05-14T01:23:35.260927+0000","last_active":"2024-05-14T01:23:36.245018+0000","last_peered":"2024-05-14T01:23:36.245018+0000","last_clean":"2024-05-14T01:23:36.245018+0000","last_became_active":"2024-05-14T01:23:35.260122+0000","last_became_peered":"2024-05-14T01:23:35.260122+0000","last_unstale":"2024-05-14T01:23:36.245018+0000","last_undegraded":"2024-05-14T01:23:36.245018+0000","last_fullsized":"2024-05-14T01:23:36.245018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:26:04.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.674795+0000","last_change":"2024-05-14T01:23:35.249002+0000","last_active":"2024-05-14T01:23:36.674795+0000","last_peered":"2024-05-14T01:23:36.674795+0000","last_clean":"2024-05-14T01:23:36.674795+0000","last_became_active":"2024-05-14T01:23:35.248126+0000","last_became_peered":"2024-05-14T01:23:35.248126+0000","last_unstale":"2024-05-14T01:23:36.674795+0000","last_undegraded":"2024-05-14T01:23:36.674795+0000","last_fullsized":"2024-05-14T01:23:36.674795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:58.295553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089403+0000","last_change":"2024-05-14T01:23:34.250861+0000","last_active":"2024-05-14T01:23:38.089403+0000","last_peered":"2024-05-14T01:23:38.089403+0000","last_clean":"2024-05-14T01:23:38.089403+0000","last_became_active":"2024-05-14T01:23:34.250502+0000","last_became_peered":"2024-05-14T01:23:34.250502+0000","last_unstale":"2024-05-14T01:23:38.089403+0000","last_undegraded":"2024-05-14T01:23:38.089403+0000","last_fullsized":"2024-05-14T01:23:38.089403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:53:43.384791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089367+0000","last_change":"2024-05-14T01:23:35.272454+0000","last_active":"2024-05-14T01:23:38.089367+0000","last_peered":"2024-05-14T01:23:38.089367+0000","last_clean":"2024-05-14T01:23:38.089367+0000","last_became_active":"2024-05-14T01:23:35.271773+0000","last_became_peered":"2024-05-14T01:23:35.271773+0000","last_unstale":"2024-05-14T01:23:38.089367+0000","last_undegraded":"2024-05-14T01:23:38.089367+0000","last_fullsized":"2024-05-14T01:23:38.089367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:42:53.264601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245396+0000","last_change":"2024-05-14T01:23:34.245154+0000","last_active":"2024-05-14T01:23:36.245396+0000","last_peered":"2024-05-14T01:23:36.245396+0000","last_clean":"2024-05-14T01:23:36.245396+0000","last_became_active":"2024-05-14T01:23:34.244225+0000","last_became_peered":"2024-05-14T01:23:34.244225+0000","last_unstale":"2024-05-14T01:23:36.245396+0000","last_undegraded":"2024-05-14T01:23:36.245396+0000","last_fullsized":"2024-05-14T01:23:36.245396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:50:26.266945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089413+0000","last_change":"2024-05-14T01:23:34.219241+0000","last_active":"2024-05-14T01:23:38.089413+0000","last_peered":"2024-05-14T01:23:38.089413+0000","last_clean":"2024-05-14T01:23:38.089413+0000","last_became_active":"2024-05-14T01:23:34.218932+0000","last_became_peered":"2024-05-14T01:23:34.218932+0000","last_unstale":"2024-05-14T01:23:38.089413+0000","last_undegraded":"2024-05-14T01:23:38.089413+0000","last_fullsized":"2024-05-14T01:23:38.089413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:13:57.047963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087835+0000","last_change":"2024-05-14T01:23:35.280370+0000","last_active":"2024-05-14T01:23:38.087835+0000","last_peered":"2024-05-14T01:23:38.087835+0000","last_clean":"2024-05-14T01:23:38.087835+0000","last_became_active":"2024-05-14T01:23:35.275913+0000","last_became_peered":"2024-05-14T01:23:35.275913+0000","last_unstale":"2024-05-14T01:23:38.087835+0000","last_undegraded":"2024-05-14T01:23:38.087835+0000","last_fullsized":"2024-05-14T01:23:38.087835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:19:10.756155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245706+0000","last_change":"2024-05-14T01:23:34.251307+0000","last_active":"2024-05-14T01:23:36.245706+0000","last_peered":"2024-05-14T01:23:36.245706+0000","last_clean":"2024-05-14T01:23:36.245706+0000","last_became_active":"2024-05-14T01:23:34.245659+0000","last_became_peered":"2024-05-14T01:23:34.245659+0000","last_unstale":"2024-05-14T01:23:36.245706+0000","last_undegraded":"2024-05-14T01:23:36.245706+0000","last_fullsized":"2024-05-14T01:23:36.245706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:54:09.731166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243716+0000","last_change":"2024-05-14T01:23:35.263892+0000","last_active":"2024-05-14T01:23:36.243716+0000","last_peered":"2024-05-14T01:23:36.243716+0000","last_clean":"2024-05-14T01:23:36.243716+0000","last_became_active":"2024-05-14T01:23:35.262822+0000","last_became_peered":"2024-05-14T01:23:35.262822+0000","last_unstale":"2024-05-14T01:23:36.243716+0000","last_undegraded":"2024-05-14T01:23:36.243716+0000","last_fullsized":"2024-05-14T01:23:36.243716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:19:10.756155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246875+0000","last_change":"2024-05-14T01:23:34.259671+0000","last_active":"2024-05-14T01:23:36.246875+0000","last_peered":"2024-05-14T01:23:36.246875+0000","last_clean":"2024-05-14T01:23:36.246875+0000","last_became_active":"2024-05-14T01:23:34.259001+0000","last_became_peered":"2024-05-14T01:23:34.259001+0000","last_unstale":"2024-05-14T01:23:36.246875+0000","last_undegraded":"2024-05-14T01:23:36.246875+0000","last_fullsized":"2024-05-14T01:23:36.246875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:54:09.731166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.248083+0000","last_change":"2024-05-14T01:23:35.298763+0000","last_active":"2024-05-14T01:23:36.248083+0000","last_peered":"2024-05-14T01:23:36.248083+0000","last_clean":"2024-05-14T01:23:36.248083+0000","last_became_active":"2024-05-14T01:23:35.295383+0000","last_became_peered":"2024-05-14T01:23:35.295383+0000","last_unstale":"2024-05-14T01:23:36.248083+0000","last_undegraded":"2024-05-14T01:23:36.248083+0000","last_fullsized":"2024-05-14T01:23:36.248083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:27:07.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.248017+0000","last_change":"2024-05-14T01:23:34.259392+0000","last_active":"2024-05-14T01:23:36.248017+0000","last_peered":"2024-05-14T01:23:36.248017+0000","last_clean":"2024-05-14T01:23:36.248017+0000","last_became_active":"2024-05-14T01:23:34.258475+0000","last_became_peered":"2024-05-14T01:23:34.258475+0000","last_unstale":"2024-05-14T01:23:36.248017+0000","last_undegraded":"2024-05-14T01:23:36.248017+0000","last_fullsized":"2024-05-14T01:23:36.248017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:50:26.266945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089282+0000","last_change":"2024-05-14T01:23:35.301841+0000","last_active":"2024-05-14T01:23:38.089282+0000","last_peered":"2024-05-14T01:23:38.089282+0000","last_clean":"2024-05-14T01:23:38.089282+0000","last_became_active":"2024-05-14T01:23:35.301260+0000","last_became_peered":"2024-05-14T01:23:35.301260+0000","last_unstale":"2024-05-14T01:23:38.089282+0000","last_undegraded":"2024-05-14T01:23:38.089282+0000","last_fullsized":"2024-05-14T01:23:38.089282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:17:24.056984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244314+0000","last_change":"2024-05-14T01:23:34.241260+0000","last_active":"2024-05-14T01:23:36.244314+0000","last_peered":"2024-05-14T01:23:36.244314+0000","last_clean":"2024-05-14T01:23:36.244314+0000","last_became_active":"2024-05-14T01:23:34.241005+0000","last_became_peered":"2024-05-14T01:23:34.241005+0000","last_unstale":"2024-05-14T01:23:36.244314+0000","last_undegraded":"2024-05-14T01:23:36.244314+0000","last_fullsized":"2024-05-14T01:23:36.244314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:55.788381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.675306+0000","last_change":"2024-05-14T01:23:35.281538+0000","last_active":"2024-05-14T01:23:36.675306+0000","last_peered":"2024-05-14T01:23:36.675306+0000","last_clean":"2024-05-14T01:23:36.675306+0000","last_became_active":"2024-05-14T01:23:35.280728+0000","last_became_peered":"2024-05-14T01:23:35.280728+0000","last_unstale":"2024-05-14T01:23:36.675306+0000","last_undegraded":"2024-05-14T01:23:36.675306+0000","last_fullsized":"2024-05-14T01:23:36.675306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:09:07.570394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246193+0000","last_change":"2024-05-14T01:23:34.229467+0000","last_active":"2024-05-14T01:23:36.246193+0000","last_peered":"2024-05-14T01:23:36.246193+0000","last_clean":"2024-05-14T01:23:36.246193+0000","last_became_active":"2024-05-14T01:23:34.228709+0000","last_became_peered":"2024-05-14T01:23:34.228709+0000","last_unstale":"2024-05-14T01:23:36.246193+0000","last_undegraded":"2024-05-14T01:23:36.246193+0000","last_fullsized":"2024-05-14T01:23:36.246193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:57.287353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985329+0000","last_change":"2024-05-14T01:23:35.297600+0000","last_active":"2024-05-14T01:23:36.985329+0000","last_peered":"2024-05-14T01:23:36.985329+0000","last_clean":"2024-05-14T01:23:36.985329+0000","last_became_active":"2024-05-14T01:23:35.282394+0000","last_became_peered":"2024-05-14T01:23:35.282394+0000","last_unstale":"2024-05-14T01:23:36.985329+0000","last_undegraded":"2024-05-14T01:23:36.985329+0000","last_fullsized":"2024-05-14T01:23:36.985329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:27:07.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089635+0000","last_change":"2024-05-14T01:23:34.233957+0000","last_active":"2024-05-14T01:23:38.089635+0000","last_peered":"2024-05-14T01:23:38.089635+0000","last_clean":"2024-05-14T01:23:38.089635+0000","last_became_active":"2024-05-14T01:23:34.233639+0000","last_became_peered":"2024-05-14T01:23:34.233639+0000","last_unstale":"2024-05-14T01:23:38.089635+0000","last_undegraded":"2024-05-14T01:23:38.089635+0000","last_fullsized":"2024-05-14T01:23:38.089635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:53:43.384791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088454+0000","last_change":"2024-05-14T01:23:35.283594+0000","last_active":"2024-05-14T01:23:38.088454+0000","last_peered":"2024-05-14T01:23:38.088454+0000","last_clean":"2024-05-14T01:23:38.088454+0000","last_became_active":"2024-05-14T01:23:35.283197+0000","last_became_peered":"2024-05-14T01:23:35.283197+0000","last_unstale":"2024-05-14T01:23:38.088454+0000","last_undegraded":"2024-05-14T01:23:38.088454+0000","last_fullsized":"2024-05-14T01:23:38.088454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:26:04.128742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246382+0000","last_change":"2024-05-14T01:23:34.255912+0000","last_active":"2024-05-14T01:23:36.246382+0000","last_peered":"2024-05-14T01:23:36.246382+0000","last_clean":"2024-05-14T01:23:36.246382+0000","last_became_active":"2024-05-14T01:23:34.253523+0000","last_became_peered":"2024-05-14T01:23:34.253523+0000","last_unstale":"2024-05-14T01:23:36.246382+0000","last_undegraded":"2024-05-14T01:23:36.246382+0000","last_fullsized":"2024-05-14T01:23:36.246382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:55.788381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985315+0000","last_change":"2024-05-14T01:23:35.285975+0000","last_active":"2024-05-14T01:23:36.985315+0000","last_peered":"2024-05-14T01:23:36.985315+0000","last_clean":"2024-05-14T01:23:36.985315+0000","last_became_active":"2024-05-14T01:23:35.285612+0000","last_became_peered":"2024-05-14T01:23:35.285612+0000","last_unstale":"2024-05-14T01:23:36.985315+0000","last_undegraded":"2024-05-14T01:23:36.985315+0000","last_fullsized":"2024-05-14T01:23:36.985315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:51:24.561905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245103+0000","last_change":"2024-05-14T01:23:34.250761+0000","last_active":"2024-05-14T01:23:36.245103+0000","last_peered":"2024-05-14T01:23:36.245103+0000","last_clean":"2024-05-14T01:23:36.245103+0000","last_became_active":"2024-05-14T01:23:34.249867+0000","last_became_peered":"2024-05-14T01:23:34.249867+0000","last_unstale":"2024-05-14T01:23:36.245103+0000","last_undegraded":"2024-05-14T01:23:36.245103+0000","last_fullsized":"2024-05-14T01:23:36.245103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:13:57.047963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245812+0000","last_change":"2024-05-14T01:23:35.261647+0000","last_active":"2024-05-14T01:23:36.245812+0000","last_peered":"2024-05-14T01:23:36.245812+0000","last_clean":"2024-05-14T01:23:36.245812+0000","last_became_active":"2024-05-14T01:23:35.259092+0000","last_became_peered":"2024-05-14T01:23:35.259092+0000","last_unstale":"2024-05-14T01:23:36.245812+0000","last_undegraded":"2024-05-14T01:23:36.245812+0000","last_fullsized":"2024-05-14T01:23:36.245812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:05:16.096171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089803+0000","last_change":"2024-05-14T01:23:34.224371+0000","last_active":"2024-05-14T01:23:38.089803+0000","last_peered":"2024-05-14T01:23:38.089803+0000","last_clean":"2024-05-14T01:23:38.089803+0000","last_became_active":"2024-05-14T01:23:34.224010+0000","last_became_peered":"2024-05-14T01:23:34.224010+0000","last_unstale":"2024-05-14T01:23:38.089803+0000","last_undegraded":"2024-05-14T01:23:38.089803+0000","last_fullsized":"2024-05-14T01:23:38.089803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:13:57.047963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984842+0000","last_change":"2024-05-14T01:23:35.298167+0000","last_active":"2024-05-14T01:23:36.984842+0000","last_peered":"2024-05-14T01:23:36.984842+0000","last_clean":"2024-05-14T01:23:36.984842+0000","last_became_active":"2024-05-14T01:23:35.286157+0000","last_became_peered":"2024-05-14T01:23:35.286157+0000","last_unstale":"2024-05-14T01:23:36.984842+0000","last_undegraded":"2024-05-14T01:23:36.984842+0000","last_fullsized":"2024-05-14T01:23:36.984842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:45:12.494840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.675221+0000","last_change":"2024-05-14T01:23:34.236199+0000","last_active":"2024-05-14T01:23:36.675221+0000","last_peered":"2024-05-14T01:23:36.675221+0000","last_clean":"2024-05-14T01:23:36.675221+0000","last_became_active":"2024-05-14T01:23:34.233012+0000","last_became_peered":"2024-05-14T01:23:34.233012+0000","last_unstale":"2024-05-14T01:23:36.675221+0000","last_undegraded":"2024-05-14T01:23:36.675221+0000","last_fullsized":"2024-05-14T01:23:36.675221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:05:28.581427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985820+0000","last_change":"2024-05-14T01:23:35.297883+0000","last_active":"2024-05-14T01:23:36.985820+0000","last_peered":"2024-05-14T01:23:36.985820+0000","last_clean":"2024-05-14T01:23:36.985820+0000","last_became_active":"2024-05-14T01:23:35.287258+0000","last_became_peered":"2024-05-14T01:23:35.287258+0000","last_unstale":"2024-05-14T01:23:36.985820+0000","last_undegraded":"2024-05-14T01:23:36.985820+0000","last_fullsized":"2024-05-14T01:23:36.985820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:54:11.367649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087438+0000","last_change":"2024-05-14T01:23:34.225011+0000","last_active":"2024-05-14T01:23:38.087438+0000","last_peered":"2024-05-14T01:23:38.087438+0000","last_clean":"2024-05-14T01:23:38.087438+0000","last_became_active":"2024-05-14T01:23:34.224674+0000","last_became_peered":"2024-05-14T01:23:34.224674+0000","last_unstale":"2024-05-14T01:23:38.087438+0000","last_undegraded":"2024-05-14T01:23:38.087438+0000","last_fullsized":"2024-05-14T01:23:38.087438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:50:26.266945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.986041+0000","last_change":"2024-05-14T01:23:35.287056+0000","last_active":"2024-05-14T01:23:36.986041+0000","last_peered":"2024-05-14T01:23:36.986041+0000","last_clean":"2024-05-14T01:23:36.986041+0000","last_became_active":"2024-05-14T01:23:35.286372+0000","last_became_peered":"2024-05-14T01:23:35.286372+0000","last_unstale":"2024-05-14T01:23:36.986041+0000","last_undegraded":"2024-05-14T01:23:36.986041+0000","last_fullsized":"2024-05-14T01:23:36.986041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:24:47.905393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244447+0000","last_change":"2024-05-14T01:23:34.234869+0000","last_active":"2024-05-14T01:23:36.244447+0000","last_peered":"2024-05-14T01:23:36.244447+0000","last_clean":"2024-05-14T01:23:36.244447+0000","last_became_active":"2024-05-14T01:23:34.234582+0000","last_became_peered":"2024-05-14T01:23:34.234582+0000","last_unstale":"2024-05-14T01:23:36.244447+0000","last_undegraded":"2024-05-14T01:23:36.244447+0000","last_fullsized":"2024-05-14T01:23:36.244447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:25:49.061428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247626+0000","last_change":"2024-05-14T01:23:35.294289+0000","last_active":"2024-05-14T01:23:36.247626+0000","last_peered":"2024-05-14T01:23:36.247626+0000","last_clean":"2024-05-14T01:23:36.247626+0000","last_became_active":"2024-05-14T01:23:35.289592+0000","last_became_peered":"2024-05-14T01:23:35.289592+0000","last_unstale":"2024-05-14T01:23:36.247626+0000","last_undegraded":"2024-05-14T01:23:36.247626+0000","last_fullsized":"2024-05-14T01:23:36.247626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:45:12.494840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.086917+0000","last_change":"2024-05-14T01:23:34.253809+0000","last_active":"2024-05-14T01:23:38.086917+0000","last_peered":"2024-05-14T01:23:38.086917+0000","last_clean":"2024-05-14T01:23:38.086917+0000","last_became_active":"2024-05-14T01:23:34.253537+0000","last_became_peered":"2024-05-14T01:23:34.253537+0000","last_unstale":"2024-05-14T01:23:38.086917+0000","last_undegraded":"2024-05-14T01:23:38.086917+0000","last_fullsized":"2024-05-14T01:23:38.086917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:50:36.678245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985359+0000","last_change":"2024-05-14T01:23:35.298846+0000","last_active":"2024-05-14T01:23:36.985359+0000","last_peered":"2024-05-14T01:23:36.985359+0000","last_clean":"2024-05-14T01:23:36.985359+0000","last_became_active":"2024-05-14T01:23:35.298408+0000","last_became_peered":"2024-05-14T01:23:35.298408+0000","last_unstale":"2024-05-14T01:23:36.985359+0000","last_undegraded":"2024-05-14T01:23:36.985359+0000","last_fullsized":"2024-05-14T01:23:36.985359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:36:36.172326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984460+0000","last_change":"2024-05-14T01:23:25.487525+0000","last_active":"2024-05-14T01:23:36.984460+0000","last_peered":"2024-05-14T01:23:36.984460+0000","last_clean":"2024-05-14T01:23:36.984460+0000","last_became_active":"2024-05-14T01:23:25.485622+0000","last_became_peered":"2024-05-14T01:23:25.485622+0000","last_unstale":"2024-05-14T01:23:36.984460+0000","last_undegraded":"2024-05-14T01:23:36.984460+0000","last_fullsized":"2024-05-14T01:23:36.984460+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_clean_scrub_stamp":"2024-05-14T01:23:24.138255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:26:23.884962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246267+0000","last_change":"2024-05-14T01:23:34.250502+0000","last_active":"2024-05-14T01:23:36.246267+0000","last_peered":"2024-05-14T01:23:36.246267+0000","last_clean":"2024-05-14T01:23:36.246267+0000","last_became_active":"2024-05-14T01:23:34.249867+0000","last_became_peered":"2024-05-14T01:23:34.249867+0000","last_unstale":"2024-05-14T01:23:36.246267+0000","last_undegraded":"2024-05-14T01:23:36.246267+0000","last_fullsized":"2024-05-14T01:23:36.246267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:13:57.047963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088772+0000","last_change":"2024-05-14T01:23:35.302453+0000","last_active":"2024-05-14T01:23:38.088772+0000","last_peered":"2024-05-14T01:23:38.088772+0000","last_clean":"2024-05-14T01:23:38.088772+0000","last_became_active":"2024-05-14T01:23:35.302253+0000","last_became_peered":"2024-05-14T01:23:35.302253+0000","last_unstale":"2024-05-14T01:23:38.088772+0000","last_undegraded":"2024-05-14T01:23:38.088772+0000","last_fullsized":"2024-05-14T01:23:38.088772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:38:23.401263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984361+0000","last_change":"2024-05-14T01:23:34.258164+0000","last_active":"2024-05-14T01:23:36.984361+0000","last_peered":"2024-05-14T01:23:36.984361+0000","last_clean":"2024-05-14T01:23:36.984361+0000","last_became_active":"2024-05-14T01:23:34.257595+0000","last_became_peered":"2024-05-14T01:23:34.257595+0000","last_unstale":"2024-05-14T01:23:36.984361+0000","last_undegraded":"2024-05-14T01:23:36.984361+0000","last_fullsized":"2024-05-14T01:23:36.984361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:27.459594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088117+0000","last_change":"2024-05-14T01:23:35.271974+0000","last_active":"2024-05-14T01:23:38.088117+0000","last_peered":"2024-05-14T01:23:38.088117+0000","last_clean":"2024-05-14T01:23:38.088117+0000","last_became_active":"2024-05-14T01:23:35.269194+0000","last_became_peered":"2024-05-14T01:23:35.269194+0000","last_unstale":"2024-05-14T01:23:38.088117+0000","last_undegraded":"2024-05-14T01:23:38.088117+0000","last_fullsized":"2024-05-14T01:23:38.088117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:55:21.424796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.086730+0000","last_change":"2024-05-14T01:23:34.223715+0000","last_active":"2024-05-14T01:23:38.086730+0000","last_peered":"2024-05-14T01:23:38.086730+0000","last_clean":"2024-05-14T01:23:38.086730+0000","last_became_active":"2024-05-14T01:23:34.223397+0000","last_became_peered":"2024-05-14T01:23:34.223397+0000","last_unstale":"2024-05-14T01:23:38.086730+0000","last_undegraded":"2024-05-14T01:23:38.086730+0000","last_fullsized":"2024-05-14T01:23:38.086730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:54:09.731166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243600+0000","last_change":"2024-05-14T01:23:35.262679+0000","last_active":"2024-05-14T01:23:36.243600+0000","last_peered":"2024-05-14T01:23:36.243600+0000","last_clean":"2024-05-14T01:23:36.243600+0000","last_became_active":"2024-05-14T01:23:35.261920+0000","last_became_peered":"2024-05-14T01:23:35.261920+0000","last_unstale":"2024-05-14T01:23:36.243600+0000","last_undegraded":"2024-05-14T01:23:36.243600+0000","last_fullsized":"2024-05-14T01:23:36.243600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:15:22.443392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.246672+0000","last_change":"2024-05-14T01:23:34.249172+0000","last_active":"2024-05-14T01:23:36.246672+0000","last_peered":"2024-05-14T01:23:36.246672+0000","last_clean":"2024-05-14T01:23:36.246672+0000","last_became_active":"2024-05-14T01:23:34.238802+0000","last_became_peered":"2024-05-14T01:23:34.238802+0000","last_unstale":"2024-05-14T01:23:36.246672+0000","last_undegraded":"2024-05-14T01:23:36.246672+0000","last_fullsized":"2024-05-14T01:23:36.246672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:27.459594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.674803+0000","last_change":"2024-05-14T01:23:35.264275+0000","last_active":"2024-05-14T01:23:36.674803+0000","last_peered":"2024-05-14T01:23:36.674803+0000","last_clean":"2024-05-14T01:23:36.674803+0000","last_became_active":"2024-05-14T01:23:35.262643+0000","last_became_peered":"2024-05-14T01:23:35.262643+0000","last_unstale":"2024-05-14T01:23:36.674803+0000","last_undegraded":"2024-05-14T01:23:36.674803+0000","last_fullsized":"2024-05-14T01:23:36.674803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:56.796582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244185+0000","last_change":"2024-05-14T01:23:34.226163+0000","last_active":"2024-05-14T01:23:36.244185+0000","last_peered":"2024-05-14T01:23:36.244185+0000","last_clean":"2024-05-14T01:23:36.244185+0000","last_became_active":"2024-05-14T01:23:34.225890+0000","last_became_peered":"2024-05-14T01:23:34.225890+0000","last_unstale":"2024-05-14T01:23:36.244185+0000","last_undegraded":"2024-05-14T01:23:36.244185+0000","last_fullsized":"2024-05-14T01:23:36.244185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:57.287353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247976+0000","last_change":"2024-05-14T01:23:35.294211+0000","last_active":"2024-05-14T01:23:36.247976+0000","last_peered":"2024-05-14T01:23:36.247976+0000","last_clean":"2024-05-14T01:23:36.247976+0000","last_became_active":"2024-05-14T01:23:35.289658+0000","last_became_peered":"2024-05-14T01:23:35.289658+0000","last_unstale":"2024-05-14T01:23:36.247976+0000","last_undegraded":"2024-05-14T01:23:36.247976+0000","last_fullsized":"2024-05-14T01:23:36.247976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:51:24.561905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985721+0000","last_change":"2024-05-14T01:23:34.256826+0000","last_active":"2024-05-14T01:23:36.985721+0000","last_peered":"2024-05-14T01:23:36.985721+0000","last_clean":"2024-05-14T01:23:36.985721+0000","last_became_active":"2024-05-14T01:23:34.256022+0000","last_became_peered":"2024-05-14T01:23:34.256022+0000","last_unstale":"2024-05-14T01:23:36.985721+0000","last_undegraded":"2024-05-14T01:23:36.985721+0000","last_fullsized":"2024-05-14T01:23:36.985721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:19:25.032602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243917+0000","last_change":"2024-05-14T01:23:35.260714+0000","last_active":"2024-05-14T01:23:36.243917+0000","last_peered":"2024-05-14T01:23:36.243917+0000","last_clean":"2024-05-14T01:23:36.243917+0000","last_became_active":"2024-05-14T01:23:35.259757+0000","last_became_peered":"2024-05-14T01:23:35.259757+0000","last_unstale":"2024-05-14T01:23:36.243917+0000","last_undegraded":"2024-05-14T01:23:36.243917+0000","last_fullsized":"2024-05-14T01:23:36.243917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:17:24.056984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.286013+0000","last_change":"2024-05-14T01:23:34.235193+0000","last_active":"2024-05-14T01:23:36.286013+0000","last_peered":"2024-05-14T01:23:36.286013+0000","last_clean":"2024-05-14T01:23:36.286013+0000","last_became_active":"2024-05-14T01:23:34.234838+0000","last_became_peered":"2024-05-14T01:23:34.234838+0000","last_unstale":"2024-05-14T01:23:36.286013+0000","last_undegraded":"2024-05-14T01:23:36.286013+0000","last_fullsized":"2024-05-14T01:23:36.286013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:54:09.731166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088147+0000","last_change":"2024-05-14T01:23:35.304577+0000","last_active":"2024-05-14T01:23:38.088147+0000","last_peered":"2024-05-14T01:23:38.088147+0000","last_clean":"2024-05-14T01:23:38.088147+0000","last_became_active":"2024-05-14T01:23:35.304182+0000","last_became_peered":"2024-05-14T01:23:35.304182+0000","last_unstale":"2024-05-14T01:23:38.088147+0000","last_undegraded":"2024-05-14T01:23:38.088147+0000","last_fullsized":"2024-05-14T01:23:38.088147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:42:53.264601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247154+0000","last_change":"2024-05-14T01:23:34.252262+0000","last_active":"2024-05-14T01:23:36.247154+0000","last_peered":"2024-05-14T01:23:36.247154+0000","last_clean":"2024-05-14T01:23:36.247154+0000","last_became_active":"2024-05-14T01:23:34.251538+0000","last_became_peered":"2024-05-14T01:23:34.251538+0000","last_unstale":"2024-05-14T01:23:36.247154+0000","last_undegraded":"2024-05-14T01:23:36.247154+0000","last_fullsized":"2024-05-14T01:23:36.247154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:55.788381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089306+0000","last_change":"2024-05-14T01:23:35.272849+0000","last_active":"2024-05-14T01:23:38.089306+0000","last_peered":"2024-05-14T01:23:38.089306+0000","last_clean":"2024-05-14T01:23:38.089306+0000","last_became_active":"2024-05-14T01:23:35.272167+0000","last_became_peered":"2024-05-14T01:23:35.272167+0000","last_unstale":"2024-05-14T01:23:38.089306+0000","last_undegraded":"2024-05-14T01:23:38.089306+0000","last_fullsized":"2024-05-14T01:23:38.089306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:35:14.703645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.984311+0000","last_change":"2024-05-14T01:23:34.258728+0000","last_active":"2024-05-14T01:23:36.984311+0000","last_peered":"2024-05-14T01:23:36.984311+0000","last_clean":"2024-05-14T01:23:36.984311+0000","last_became_active":"2024-05-14T01:23:34.255812+0000","last_became_peered":"2024-05-14T01:23:34.255812+0000","last_unstale":"2024-05-14T01:23:36.984311+0000","last_undegraded":"2024-05-14T01:23:36.984311+0000","last_fullsized":"2024-05-14T01:23:36.984311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:02:55.788381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.674842+0000","last_change":"2024-05-14T01:23:35.265948+0000","last_active":"2024-05-14T01:23:36.674842+0000","last_peered":"2024-05-14T01:23:36.674842+0000","last_clean":"2024-05-14T01:23:36.674842+0000","last_became_active":"2024-05-14T01:23:35.261913+0000","last_became_peered":"2024-05-14T01:23:35.261913+0000","last_unstale":"2024-05-14T01:23:36.674842+0000","last_undegraded":"2024-05-14T01:23:36.674842+0000","last_fullsized":"2024-05-14T01:23:36.674842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:28.467794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.243989+0000","last_change":"2024-05-14T01:23:34.251067+0000","last_active":"2024-05-14T01:23:36.243989+0000","last_peered":"2024-05-14T01:23:36.243989+0000","last_clean":"2024-05-14T01:23:36.243989+0000","last_became_active":"2024-05-14T01:23:34.250744+0000","last_became_peered":"2024-05-14T01:23:34.250744+0000","last_unstale":"2024-05-14T01:23:36.243989+0000","last_undegraded":"2024-05-14T01:23:36.243989+0000","last_fullsized":"2024-05-14T01:23:36.243989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:29:27.459594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088158+0000","last_change":"2024-05-14T01:23:35.276327+0000","last_active":"2024-05-14T01:23:38.088158+0000","last_peered":"2024-05-14T01:23:38.088158+0000","last_clean":"2024-05-14T01:23:38.088158+0000","last_became_active":"2024-05-14T01:23:35.275932+0000","last_became_peered":"2024-05-14T01:23:35.275932+0000","last_unstale":"2024-05-14T01:23:38.088158+0000","last_undegraded":"2024-05-14T01:23:38.088158+0000","last_fullsized":"2024-05-14T01:23:38.088158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:35:14.703645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.244161+0000","last_change":"2024-05-14T01:23:34.224180+0000","last_active":"2024-05-14T01:23:36.244161+0000","last_peered":"2024-05-14T01:23:36.244161+0000","last_clean":"2024-05-14T01:23:36.244161+0000","last_became_active":"2024-05-14T01:23:34.223787+0000","last_became_peered":"2024-05-14T01:23:34.223787+0000","last_unstale":"2024-05-14T01:23:36.244161+0000","last_undegraded":"2024-05-14T01:23:36.244161+0000","last_fullsized":"2024-05-14T01:23:36.244161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:50:26.266945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089151+0000","last_change":"2024-05-14T01:23:35.281157+0000","last_active":"2024-05-14T01:23:38.089151+0000","last_peered":"2024-05-14T01:23:38.089151+0000","last_clean":"2024-05-14T01:23:38.089151+0000","last_became_active":"2024-05-14T01:23:35.280808+0000","last_became_peered":"2024-05-14T01:23:35.280808+0000","last_unstale":"2024-05-14T01:23:38.089151+0000","last_undegraded":"2024-05-14T01:23:38.089151+0000","last_fullsized":"2024-05-14T01:23:38.089151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:20:00.610956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985396+0000","last_change":"2024-05-14T01:23:34.256325+0000","last_active":"2024-05-14T01:23:36.985396+0000","last_peered":"2024-05-14T01:23:36.985396+0000","last_clean":"2024-05-14T01:23:36.985396+0000","last_became_active":"2024-05-14T01:23:34.255642+0000","last_became_peered":"2024-05-14T01:23:34.255642+0000","last_unstale":"2024-05-14T01:23:36.985396+0000","last_undegraded":"2024-05-14T01:23:36.985396+0000","last_fullsized":"2024-05-14T01:23:36.985396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:09:06.562194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.245464+0000","last_change":"2024-05-14T01:23:35.254121+0000","last_active":"2024-05-14T01:23:36.245464+0000","last_peered":"2024-05-14T01:23:36.245464+0000","last_clean":"2024-05-14T01:23:36.245464+0000","last_became_active":"2024-05-14T01:23:35.251280+0000","last_became_peered":"2024-05-14T01:23:35.251280+0000","last_unstale":"2024-05-14T01:23:36.245464+0000","last_undegraded":"2024-05-14T01:23:36.245464+0000","last_fullsized":"2024-05-14T01:23:36.245464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:19:10.756155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247888+0000","last_change":"2024-05-14T01:23:35.293893+0000","last_active":"2024-05-14T01:23:36.247888+0000","last_peered":"2024-05-14T01:23:36.247888+0000","last_clean":"2024-05-14T01:23:36.247888+0000","last_became_active":"2024-05-14T01:23:35.289188+0000","last_became_peered":"2024-05-14T01:23:35.289188+0000","last_unstale":"2024-05-14T01:23:36.247888+0000","last_undegraded":"2024-05-14T01:23:36.247888+0000","last_fullsized":"2024-05-14T01:23:36.247888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:44:36.242325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985145+0000","last_change":"2024-05-14T01:23:34.261385+0000","last_active":"2024-05-14T01:23:36.985145+0000","last_peered":"2024-05-14T01:23:36.985145+0000","last_clean":"2024-05-14T01:23:36.985145+0000","last_became_active":"2024-05-14T01:23:34.260450+0000","last_became_peered":"2024-05-14T01:23:34.260450+0000","last_unstale":"2024-05-14T01:23:36.985145+0000","last_undegraded":"2024-05-14T01:23:36.985145+0000","last_fullsized":"2024-05-14T01:23:36.985145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:25:49.061428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.247625+0000","last_change":"2024-05-14T01:23:35.301603+0000","last_active":"2024-05-14T01:23:36.247625+0000","last_peered":"2024-05-14T01:23:36.247625+0000","last_clean":"2024-05-14T01:23:36.247625+0000","last_became_active":"2024-05-14T01:23:35.301338+0000","last_became_peered":"2024-05-14T01:23:35.301338+0000","last_unstale":"2024-05-14T01:23:36.247625+0000","last_undegraded":"2024-05-14T01:23:36.247625+0000","last_fullsized":"2024-05-14T01:23:36.247625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:52:26.738482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:36.985570+0000","last_change":"2024-05-14T01:23:34.260143+0000","last_active":"2024-05-14T01:23:36.985570+0000","last_peered":"2024-05-14T01:23:36.985570+0000","last_clean":"2024-05-14T01:23:36.985570+0000","last_became_active":"2024-05-14T01:23:34.259214+0000","last_became_peered":"2024-05-14T01:23:34.259214+0000","last_unstale":"2024-05-14T01:23:36.985570+0000","last_undegraded":"2024-05-14T01:23:36.985570+0000","last_fullsized":"2024-05-14T01:23:36.985570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:55:36.916881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089027+0000","last_change":"2024-05-14T01:23:35.301480+0000","last_active":"2024-05-14T01:23:38.089027+0000","last_peered":"2024-05-14T01:23:38.089027+0000","last_clean":"2024-05-14T01:23:38.089027+0000","last_became_active":"2024-05-14T01:23:35.301170+0000","last_became_peered":"2024-05-14T01:23:35.301170+0000","last_unstale":"2024-05-14T01:23:38.089027+0000","last_undegraded":"2024-05-14T01:23:38.089027+0000","last_fullsized":"2024-05-14T01:23:38.089027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:05:16.096171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.088199+0000","last_change":"2024-05-14T01:23:34.226086+0000","last_active":"2024-05-14T01:23:38.088199+0000","last_peered":"2024-05-14T01:23:38.088199+0000","last_clean":"2024-05-14T01:23:38.088199+0000","last_became_active":"2024-05-14T01:23:34.225826+0000","last_became_peered":"2024-05-14T01:23:34.225826+0000","last_unstale":"2024-05-14T01:23:38.088199+0000","last_undegraded":"2024-05-14T01:23:38.088199+0000","last_fullsized":"2024-05-14T01:23:38.088199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:50:36.678245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.087918+0000","last_change":"2024-05-14T01:23:35.266231+0000","last_active":"2024-05-14T01:23:38.087918+0000","last_peered":"2024-05-14T01:23:38.087918+0000","last_clean":"2024-05-14T01:23:38.087918+0000","last_became_active":"2024-05-14T01:23:35.265642+0000","last_became_peered":"2024-05-14T01:23:35.265642+0000","last_unstale":"2024-05-14T01:23:38.087918+0000","last_undegraded":"2024-05-14T01:23:38.087918+0000","last_fullsized":"2024-05-14T01:23:38.087918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:34.201622+0000","last_clean_scrub_stamp":"2024-05-14T01:23:34.201622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:17:24.056984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-14T01:23:38.089361+0000","last_change":"2024-05-14T01:23:34.252104+0000","last_active":"2024-05-14T01:23:38.089361+0000","last_peered":"2024-05-14T01:23:38.089361+0000","last_clean":"2024-05-14T01:23:38.089361+0000","last_became_active":"2024-05-14T01:23:34.251819+0000","last_became_peered":"2024-05-14T01:23:34.251819+0000","last_unstale":"2024-05-14T01:23:38.089361+0000","last_undegraded":"2024-05-14T01:23:38.089361+0000","last_fullsized":"2024-05-14T01:23:38.089361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:33.193422+0000","last_clean_scrub_stamp":"2024-05-14T01:23:33.193422+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:15:33.123443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T01:23:42.169 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-14T01:23:42.169 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-14T01:23:42.169 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-14T01:23:42.169 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-14T01:23:42.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1c92c640 1 Processor -- start 2024-05-14T01:23:42.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1c92c640 1 -- start start 2024-05-14T01:23:42.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1c92c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9a181459c0 0x7f9a1806c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1c92c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1806e490 0x7f9a180af380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1c92c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a180ae2e0 con 0x7f9a1806c7d0 2024-05-14T01:23:42.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1c92c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9a180ae5c0 con 0x7f9a181459c0 2024-05-14T01:23:42.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1c92c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9a180ae8a0 con 0x7f9a1806e490 2024-05-14T01:23:42.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a15d9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9a1806c7d0 0x7f9a1806dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57316/0 (socket says 172.21.15.154:57316) 2024-05-14T01:23:42.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a15d9b640 1 -- 172.21.15.154:0/3731450035 learned_addr learned my addr 172.21.15.154:0/3731450035 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:42.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a16d9d640 1 --2- 172.21.15.154:0/3731450035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1806e490 0x7f9a180af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1659c640 1 --2- 172.21.15.154:0/3731450035 >> v2:172.21.15.176:3300/0 conn(0x7f9a181459c0 0x7f9a1806c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1559a640 1 -- 172.21.15.154:0/3731450035 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2883636563 0 0) 0x7f9a180ae2e0 con 0x7f9a1806c7d0 2024-05-14T01:23:42.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1559a640 1 -- 172.21.15.154:0/3731450035 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a00003530 con 0x7f9a1806c7d0 2024-05-14T01:23:42.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1559a640 1 -- 172.21.15.154:0/3731450035 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2510187918 0 0) 0x7f9a00003530 con 0x7f9a1806c7d0 2024-05-14T01:23:42.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1559a640 1 -- 172.21.15.154:0/3731450035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1806e490 msgr2=0x7f9a180af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:42.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1559a640 1 --2- 172.21.15.154:0/3731450035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1806e490 0x7f9a180af380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1559a640 1 -- 172.21.15.154:0/3731450035 >> v2:172.21.15.176:3300/0 conn(0x7f9a181459c0 msgr2=0x7f9a1806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:42.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1559a640 1 --2- 172.21.15.154:0/3731450035 >> v2:172.21.15.176:3300/0 conn(0x7f9a181459c0 0x7f9a1806c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1559a640 1 -- 172.21.15.154:0/3731450035 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a180aeb80 con 0x7f9a1806c7d0 2024-05-14T01:23:42.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1559a640 1 -- 172.21.15.154:0/3731450035 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f9a0c001680 con 0x7f9a1806c7d0 2024-05-14T01:23:42.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1559a640 1 -- 172.21.15.154:0/3731450035 >> v1:172.21.15.154:6789/0 conn(0x7f9a1806c7d0 legacy=0x7f9a1806dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:42.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1559a640 1 --2- 172.21.15.154:0/3731450035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a000039c0 0x7f9a00003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1559a640 1 --2- 172.21.15.154:0/3731450035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a00004810 0x7f9a00004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1559a640 1 --2- 172.21.15.154:0/3731450035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1806e490 0x7f9a000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1559a640 1 -- 172.21.15.154:0/3731450035 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9a180ae5c0 con 0x7f9a00004810 2024-05-14T01:23:42.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1559a640 1 -- 172.21.15.154:0/3731450035 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9a180ae8a0 con 0x7f9a000039c0 2024-05-14T01:23:42.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1559a640 1 -- 172.21.15.154:0/3731450035 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9a0000b9d0 con 0x7f9a1806e490 2024-05-14T01:23:42.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a15d9b640 1 --2- 172.21.15.154:0/3731450035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a00004810 0x7f9a00004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a16d9d640 1 --2- 172.21.15.154:0/3731450035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1806e490 0x7f9a000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a15d9b640 1 -- 172.21.15.154:0/3731450035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1806e490 msgr2=0x7f9a000051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:42.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a1659c640 1 --2- 172.21.15.154:0/3731450035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a000039c0 0x7f9a00003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a15d9b640 1 --2- 172.21.15.154:0/3731450035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1806e490 0x7f9a000051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a15d9b640 1 -- 172.21.15.154:0/3731450035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a000039c0 msgr2=0x7f9a00003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:42.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a15d9b640 1 --2- 172.21.15.154:0/3731450035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a000039c0 0x7f9a00003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a15d9b640 1 -- 172.21.15.154:0/3731450035 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a00003530 con 0x7f9a00004810 2024-05-14T01:23:42.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.338+0000 7f9a16d9d640 1 --2- 172.21.15.154:0/3731450035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1806e490 0x7f9a000051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:42.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.342+0000 7f9a15d9b640 1 --2- 172.21.15.154:0/3731450035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a00004810 0x7f9a00004c90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00c240 tx=0x7f9a0c01f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf10dd443c437d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:42.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.342+0000 7f9a1559a640 1 -- 172.21.15.154:0/3731450035 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c007d40 con 0x7f9a00004810 2024-05-14T01:23:42.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.342+0000 7f9a1559a640 1 -- 172.21.15.154:0/3731450035 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0c005b00 con 0x7f9a00004810 2024-05-14T01:23:42.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.342+0000 7f9a1559a640 1 -- 172.21.15.154:0/3731450035 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c007070 con 0x7f9a00004810 2024-05-14T01:23:42.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.342+0000 7f9a1c92c640 1 -- 172.21.15.154:0/3731450035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a00004810 msgr2=0x7f9a00004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:42.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.342+0000 7f9a1c92c640 1 --2- 172.21.15.154:0/3731450035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a00004810 0x7f9a00004c90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00c240 tx=0x7f9a0c01f410 comp rx=0 tx=0).stop 2024-05-14T01:23:42.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.342+0000 7f9a16d9d640 1 -- 172.21.15.154:0/3731450035 reap_dead start 2024-05-14T01:23:42.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.342+0000 7f9a1c92c640 1 -- 172.21.15.154:0/3731450035 shutdown_connections 2024-05-14T01:23:42.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.342+0000 7f9a1c92c640 1 -- 172.21.15.154:0/3731450035 >> 172.21.15.154:0/3731450035 conn(0x7f9a18072000 msgr2=0x7f9a18072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:42.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.342+0000 7f9a1c92c640 1 -- 172.21.15.154:0/3731450035 shutdown_connections 2024-05-14T01:23:42.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.342+0000 7f9a1c92c640 1 -- 172.21.15.154:0/3731450035 wait complete. 2024-05-14T01:23:42.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.342+0000 7f9a1c92c640 1 Processor -- start 2024-05-14T01:23:42.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.342+0000 7f9a1c92c640 1 -- start start 2024-05-14T01:23:42.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a1c92c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1815b420 0x7f9a1815c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a1c92c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a1815b800 0x7f9a181f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a1c92c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a1815db10 0x7f9a180b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a1c92c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9a180af500 con 0x7f9a1815b800 2024-05-14T01:23:42.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a1c92c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9a180af380 con 0x7f9a1815db10 2024-05-14T01:23:42.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a1c92c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9a180af680 con 0x7f9a1815b420 2024-05-14T01:23:42.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a15d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a1815b800 0x7f9a181f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a15d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a1815b800 0x7f9a181f2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46526/0 (socket says 172.21.15.154:46526) 2024-05-14T01:23:42.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a15d9b640 1 -- 172.21.15.154:0/1468936905 learned_addr learned my addr 172.21.15.154:0/1468936905 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:42.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a16d9d640 1 --2- 172.21.15.154:0/1468936905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a1815db10 0x7f9a180b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a1659c640 1 --2- 172.21.15.154:0/1468936905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1815b420 0x7f9a1815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a15d9b640 1 -- 172.21.15.154:0/1468936905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1815b420 msgr2=0x7f9a1815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:42.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a15d9b640 1 --2- 172.21.15.154:0/1468936905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1815b420 0x7f9a1815c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a15d9b640 1 -- 172.21.15.154:0/1468936905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a1815db10 msgr2=0x7f9a180b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:42.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a15d9b640 1 --2- 172.21.15.154:0/1468936905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a1815db10 0x7f9a180b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a15d9b640 1 -- 172.21.15.154:0/1468936905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1815cba0 con 0x7f9a1815b800 2024-05-14T01:23:42.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a16d9d640 1 --2- 172.21.15.154:0/1468936905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a1815db10 0x7f9a180b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:42.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a15d9b640 1 --2- 172.21.15.154:0/1468936905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a1815b800 0x7f9a181f2bb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c025f80 tx=0x7f9a00005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:42.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a06ffd640 1 -- 172.21.15.154:0/1468936905 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c001c80 con 0x7f9a1815b800 2024-05-14T01:23:42.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a06ffd640 1 -- 172.21.15.154:0/1468936905 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0c0048b0 con 0x7f9a1815b800 2024-05-14T01:23:42.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a06ffd640 1 -- 172.21.15.154:0/1468936905 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c004c80 con 0x7f9a1815b800 2024-05-14T01:23:42.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a1c92c640 1 -- 172.21.15.154:0/1468936905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1815ce80 con 0x7f9a1815b800 2024-05-14T01:23:42.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a1c92c640 1 -- 172.21.15.154:0/1468936905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a181f30f0 con 0x7f9a1815b800 2024-05-14T01:23:42.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a1c92c640 1 -- 172.21.15.154:0/1468936905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a18068360 con 0x7f9a1815b800 2024-05-14T01:23:42.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a06ffd640 1 -- 172.21.15.154:0/1468936905 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9a0c007110 con 0x7f9a1815b800 2024-05-14T01:23:42.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a06ffd640 1 --2- 172.21.15.154:0/1468936905 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99f80678f0 0x7f99f8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a06ffd640 1 -- 172.21.15.154:0/1468936905 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9a0c123050 con 0x7f9a1815b800 2024-05-14T01:23:42.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a1659c640 1 --2- 172.21.15.154:0/1468936905 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99f80678f0 0x7f99f8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.346+0000 7f9a1659c640 1 --2- 172.21.15.154:0/1468936905 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99f80678f0 0x7f99f8069db0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9a080099b0 tx=0x7f9a08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:42.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.350+0000 7f9a06ffd640 1 -- 172.21.15.154:0/1468936905 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f9a0c019120 con 0x7f9a1815b800 2024-05-14T01:23:42.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.534+0000 7f9a1c92c640 1 -- 172.21.15.154:0/1468936905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9a180cd260 con 0x7f9a1815b800 2024-05-14T01:23:42.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.534+0000 7f9a06ffd640 1 -- 172.21.15.154:0/1468936905 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9a0c004e20 con 0x7f9a1815b800 2024-05-14T01:23:42.519 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:42.519 INFO:teuthology.orchestra.run.smithi154.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-14T01:23:42.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.538+0000 7f9a1c92c640 1 -- 172.21.15.154:0/1468936905 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99f80678f0 msgr2=0x7f99f8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:42.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.538+0000 7f9a1c92c640 1 --2- 172.21.15.154:0/1468936905 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99f80678f0 0x7f99f8069db0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9a080099b0 tx=0x7f9a08008040 comp rx=0 tx=0).stop 2024-05-14T01:23:42.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.538+0000 7f9a1c92c640 1 -- 172.21.15.154:0/1468936905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a1815b800 msgr2=0x7f9a181f2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:42.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.538+0000 7f9a1c92c640 1 --2- 172.21.15.154:0/1468936905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a1815b800 0x7f9a181f2bb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c025f80 tx=0x7f9a00005840 comp rx=0 tx=0).stop 2024-05-14T01:23:42.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.538+0000 7f9a1c92c640 1 -- 172.21.15.154:0/1468936905 shutdown_connections 2024-05-14T01:23:42.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.538+0000 7f9a1c92c640 1 --2- 172.21.15.154:0/1468936905 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99f80678f0 0x7f99f8069db0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.538+0000 7f9a1c92c640 1 --2- 172.21.15.154:0/1468936905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a1815db10 0x7f9a180b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.538+0000 7f9a1c92c640 1 --2- 172.21.15.154:0/1468936905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a1815b800 0x7f9a181f2bb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.538+0000 7f9a1c92c640 1 --2- 172.21.15.154:0/1468936905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a1815b420 0x7f9a1815c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.538+0000 7f9a1c92c640 1 -- 172.21.15.154:0/1468936905 >> 172.21.15.154:0/1468936905 conn(0x7f9a18072000 msgr2=0x7f9a180b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:42.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.538+0000 7f9a1c92c640 1 -- 172.21.15.154:0/1468936905 shutdown_connections 2024-05-14T01:23:42.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.538+0000 7f9a1c92c640 1 -- 172.21.15.154:0/1468936905 wait complete. 2024-05-14T01:23:42.536 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-14T01:23:42.537 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:23:42.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.662+0000 7f554da5b640 1 Processor -- start 2024-05-14T01:23:42.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.662+0000 7f554da5b640 1 -- start start 2024-05-14T01:23:42.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.662+0000 7f554da5b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f554806e490 0x7f55480cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.662+0000 7f554da5b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55480cf100 con 0x7f5548141d00 2024-05-14T01:23:42.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.662+0000 7f554da5b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55480cf3e0 con 0x7f554813ede0 2024-05-14T01:23:42.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.662+0000 7f554da5b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f554806cff0 con 0x7f554806e490 2024-05-14T01:23:42.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.662+0000 7f553e7fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5548141d00 0x7f55480ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57318/0 (socket says 172.21.15.154:57318) 2024-05-14T01:23:42.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.662+0000 7f553e7fc640 1 -- 172.21.15.154:0/3892986098 learned_addr learned my addr 172.21.15.154:0/3892986098 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:42.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.662+0000 7f55477fe640 1 --2- 172.21.15.154:0/3892986098 >> v2:172.21.15.154:3300/0 conn(0x7f554806e490 0x7f55480cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.662+0000 7f55467fc640 1 -- 172.21.15.154:0/3892986098 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1710831001 0 0) 0x7f55480cf100 con 0x7f5548141d00 2024-05-14T01:23:42.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.662+0000 7f55467fc640 1 -- 172.21.15.154:0/3892986098 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5534003530 con 0x7f5548141d00 2024-05-14T01:23:42.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.662+0000 7f55477fe640 1 -- 172.21.15.154:0/3892986098 >> v1:172.21.15.176:6789/0 conn(0x7f554813ede0 legacy=0x7f55481415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:42.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.662+0000 7f55477fe640 1 -- 172.21.15.154:0/3892986098 >> v1:172.21.15.154:6789/0 conn(0x7f5548141d00 legacy=0x7f55480ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:42.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.662+0000 7f55477fe640 1 -- 172.21.15.154:0/3892986098 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554806cc80 con 0x7f554806e490 2024-05-14T01:23:42.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.662+0000 7f55477fe640 1 --2- 172.21.15.154:0/3892986098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f554806e490 0x7f55480cea50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5540009dc0 tx=0x7f554001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22383e202c0cfba6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:42.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.662+0000 7f55467fc640 1 -- 172.21.15.154:0/3892986098 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55400b2070 con 0x7f554806e490 2024-05-14T01:23:42.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.662+0000 7f55467fc640 1 -- 172.21.15.154:0/3892986098 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55400a59a0 con 0x7f554806e490 2024-05-14T01:23:42.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.662+0000 7f55467fc640 1 -- 172.21.15.154:0/3892986098 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55400a5d70 con 0x7f554806e490 2024-05-14T01:23:42.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f554da5b640 1 -- 172.21.15.154:0/3892986098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f554806e490 msgr2=0x7f55480cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:42.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f554da5b640 1 --2- 172.21.15.154:0/3892986098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f554806e490 0x7f55480cea50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5540009dc0 tx=0x7f554001c910 comp rx=0 tx=0).stop 2024-05-14T01:23:42.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f554da5b640 1 -- 172.21.15.154:0/3892986098 shutdown_connections 2024-05-14T01:23:42.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f554da5b640 1 --2- 172.21.15.154:0/3892986098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f554806e490 0x7f55480cea50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f554da5b640 1 -- 172.21.15.154:0/3892986098 >> 172.21.15.154:0/3892986098 conn(0x7f55480b1850 msgr2=0x7f55480b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:42.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f554da5b640 1 -- 172.21.15.154:0/3892986098 shutdown_connections 2024-05-14T01:23:42.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f554da5b640 1 -- 172.21.15.154:0/3892986098 wait complete. 2024-05-14T01:23:42.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f554da5b640 1 Processor -- start 2024-05-14T01:23:42.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f554da5b640 1 -- start start 2024-05-14T01:23:42.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f554da5b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f554806e490 0x7f5548154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f554da5b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f554813ede0 0x7f55480b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f554da5b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5548141d00 0x7f554813c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f554da5b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5548169940 con 0x7f5548141d00 2024-05-14T01:23:42.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f554da5b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f55481697c0 con 0x7f554806e490 2024-05-14T01:23:42.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f554da5b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5548169ac0 con 0x7f554813ede0 2024-05-14T01:23:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f55477fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5548141d00 0x7f554813c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f55477fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5548141d00 0x7f554813c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46536/0 (socket says 172.21.15.154:46536) 2024-05-14T01:23:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f55477fe640 1 -- 172.21.15.154:0/1547393854 learned_addr learned my addr 172.21.15.154:0/1547393854 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f553e7fc640 1 --2- 172.21.15.154:0/1547393854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f554813ede0 0x7f55480b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f5546ffd640 1 --2- 172.21.15.154:0/1547393854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f554806e490 0x7f5548154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f55477fe640 1 -- 172.21.15.154:0/1547393854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f554813ede0 msgr2=0x7f55480b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f55477fe640 1 --2- 172.21.15.154:0/1547393854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f554813ede0 0x7f55480b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f55477fe640 1 -- 172.21.15.154:0/1547393854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f554806e490 msgr2=0x7f5548154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f55477fe640 1 --2- 172.21.15.154:0/1547393854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f554806e490 0x7f5548154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f55477fe640 1 -- 172.21.15.154:0/1547393854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5548154950 con 0x7f5548141d00 2024-05-14T01:23:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f5546ffd640 1 --2- 172.21.15.154:0/1547393854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f554806e490 0x7f5548154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f55477fe640 1 --2- 172.21.15.154:0/1547393854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5548141d00 0x7f554813c990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f554001a540 tx=0x7f55400196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f5544ff9640 1 -- 172.21.15.154:0/1547393854 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55400b2050 con 0x7f5548141d00 2024-05-14T01:23:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f5544ff9640 1 -- 172.21.15.154:0/1547393854 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55400be070 con 0x7f5548141d00 2024-05-14T01:23:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f554da5b640 1 -- 172.21.15.154:0/1547393854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5548154c30 con 0x7f5548141d00 2024-05-14T01:23:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f5544ff9640 1 -- 172.21.15.154:0/1547393854 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55400ada90 con 0x7f5548141d00 2024-05-14T01:23:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.666+0000 7f554da5b640 1 -- 172.21.15.154:0/1547393854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f554813fd40 con 0x7f5548141d00 2024-05-14T01:23:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.670+0000 7f554da5b640 1 -- 172.21.15.154:0/1547393854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5548075470 con 0x7f5548141d00 2024-05-14T01:23:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.670+0000 7f5544ff9640 1 -- 172.21.15.154:0/1547393854 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f55400adc30 con 0x7f5548141d00 2024-05-14T01:23:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.670+0000 7f5544ff9640 1 --2- 172.21.15.154:0/1547393854 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f55280678c0 0x7f5528069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.670+0000 7f5544ff9640 1 -- 172.21.15.154:0/1547393854 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5540120e30 con 0x7f5548141d00 2024-05-14T01:23:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.670+0000 7f5546ffd640 1 --2- 172.21.15.154:0/1547393854 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f55280678c0 0x7f5528069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.670+0000 7f5546ffd640 1 --2- 172.21.15.154:0/1547393854 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f55280678c0 0x7f5528069d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5548152100 tx=0x7f5538009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:42.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.674+0000 7f5544ff9640 1 -- 172.21.15.154:0/1547393854 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f5540016500 con 0x7f5548141d00 2024-05-14T01:23:42.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.822+0000 7f554da5b640 1 -- 172.21.15.154:0/1547393854 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f554806f180 con 0x7f5548141d00 2024-05-14T01:23:42.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.826+0000 7f5544ff9640 1 -- 172.21.15.154:0/1547393854 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f55400f1a90 con 0x7f5548141d00 2024-05-14T01:23:42.809 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:42.809 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:36.232271+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:23:42.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.826+0000 7f554da5b640 1 -- 172.21.15.154:0/1547393854 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f55280678c0 msgr2=0x7f5528069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:42.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.826+0000 7f554da5b640 1 --2- 172.21.15.154:0/1547393854 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f55280678c0 0x7f5528069d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5548152100 tx=0x7f5538009040 comp rx=0 tx=0).stop 2024-05-14T01:23:42.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.826+0000 7f554da5b640 1 -- 172.21.15.154:0/1547393854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5548141d00 msgr2=0x7f554813c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:42.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.826+0000 7f554da5b640 1 --2- 172.21.15.154:0/1547393854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5548141d00 0x7f554813c990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f554001a540 tx=0x7f55400196b0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.826+0000 7f554da5b640 1 -- 172.21.15.154:0/1547393854 shutdown_connections 2024-05-14T01:23:42.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.826+0000 7f554da5b640 1 --2- 172.21.15.154:0/1547393854 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f55280678c0 0x7f5528069d80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.826+0000 7f554da5b640 1 --2- 172.21.15.154:0/1547393854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5548141d00 0x7f554813c990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.826+0000 7f554da5b640 1 --2- 172.21.15.154:0/1547393854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f554813ede0 0x7f55480b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.826+0000 7f554da5b640 1 --2- 172.21.15.154:0/1547393854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f554806e490 0x7f5548154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.826+0000 7f554da5b640 1 -- 172.21.15.154:0/1547393854 >> 172.21.15.154:0/1547393854 conn(0x7f55480b1850 msgr2=0x7f55480aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:42.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.826+0000 7f554da5b640 1 -- 172.21.15.154:0/1547393854 shutdown_connections 2024-05-14T01:23:42.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.826+0000 7f554da5b640 1 -- 172.21.15.154:0/1547393854 wait complete. 2024-05-14T01:23:42.827 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T01:23:33.083538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T01:23:33.556058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:23:42.827 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:23:42.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.954+0000 7f083ecbd640 1 Processor -- start 2024-05-14T01:23:42.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.954+0000 7f083ecbd640 1 -- start start 2024-05-14T01:23:42.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.954+0000 7f083ecbd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08380cf610 0x7f083815fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.954+0000 7f083ecbd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f083815ff80 0x7f083806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.954+0000 7f083ecbd640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0838071840 con 0x7f08381458d0 2024-05-14T01:23:42.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.954+0000 7f083ecbd640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f0838071b20 con 0x7f083815ff80 2024-05-14T01:23:42.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.954+0000 7f083ecbd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0838071e00 con 0x7f08380cf610 2024-05-14T01:23:42.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.954+0000 7f0837fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08380cf610 0x7f083815fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.954+0000 7f0837fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08380cf610 0x7f083815fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:59346/0 (socket says 172.21.15.154:59346) 2024-05-14T01:23:42.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.954+0000 7f083d25a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f083815ff80 0x7f083806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.954+0000 7f0837fff640 1 -- 172.21.15.154:0/2676581972 learned_addr learned my addr 172.21.15.154:0/2676581972 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:42.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.954+0000 7f0837fff640 1 -- 172.21.15.154:0/2676581972 >> v2:172.21.15.176:3300/0 conn(0x7f083815ff80 msgr2=0x7f083806ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:42.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.954+0000 7f0837fff640 1 --2- 172.21.15.154:0/2676581972 >> v2:172.21.15.176:3300/0 conn(0x7f083815ff80 0x7f083806ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.954+0000 7f0837fff640 1 -- 172.21.15.154:0/2676581972 >> v1:172.21.15.176:6789/0 conn(0x7f08381458d0 legacy=0x7f0838071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:42.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.954+0000 7f0837fff640 1 -- 172.21.15.154:0/2676581972 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08380720e0 con 0x7f08380cf610 2024-05-14T01:23:42.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f0837fff640 1 --2- 172.21.15.154:0/2676581972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08380cf610 0x7f083815fa40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0820009870 tx=0x7f082001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fc8ac55e0333bb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:42.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f08377fe640 1 -- 172.21.15.154:0/2676581972 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08200b2070 con 0x7f08380cf610 2024-05-14T01:23:42.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f08377fe640 1 -- 172.21.15.154:0/2676581972 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08200a9070 con 0x7f08380cf610 2024-05-14T01:23:42.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f08377fe640 1 -- 172.21.15.154:0/2676581972 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08200ad880 con 0x7f08380cf610 2024-05-14T01:23:42.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083ecbd640 1 -- 172.21.15.154:0/2676581972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08380cf610 msgr2=0x7f083815fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:42.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083ecbd640 1 --2- 172.21.15.154:0/2676581972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08380cf610 0x7f083815fa40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0820009870 tx=0x7f082001c560 comp rx=0 tx=0).stop 2024-05-14T01:23:42.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083ecbd640 1 -- 172.21.15.154:0/2676581972 shutdown_connections 2024-05-14T01:23:42.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083ecbd640 1 --2- 172.21.15.154:0/2676581972 >> v2:172.21.15.176:3300/0 conn(0x7f083815ff80 0x7f083806ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083ecbd640 1 --2- 172.21.15.154:0/2676581972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08380cf610 0x7f083815fa40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083ecbd640 1 -- 172.21.15.154:0/2676581972 >> 172.21.15.154:0/2676581972 conn(0x7f08380b1770 msgr2=0x7f08380b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:42.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083ecbd640 1 -- 172.21.15.154:0/2676581972 shutdown_connections 2024-05-14T01:23:42.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083ecbd640 1 -- 172.21.15.154:0/2676581972 wait complete. 2024-05-14T01:23:42.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083ecbd640 1 Processor -- start 2024-05-14T01:23:42.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083ecbd640 1 -- start start 2024-05-14T01:23:42.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083ecbd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08380cf610 0x7f08381417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083ecbd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08381458d0 0x7f0838157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083ecbd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f083815ff80 0x7f0838144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083ecbd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0838168de0 con 0x7f08381458d0 2024-05-14T01:23:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083ecbd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f083806dde0 con 0x7f083815ff80 2024-05-14T01:23:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083ecbd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0838168f60 con 0x7f08380cf610 2024-05-14T01:23:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f0837fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08381458d0 0x7f0838157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f0837fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08381458d0 0x7f0838157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46540/0 (socket says 172.21.15.154:46540) 2024-05-14T01:23:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f0837fff640 1 -- 172.21.15.154:0/2148337430 learned_addr learned my addr 172.21.15.154:0/2148337430 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083ca59640 1 --2- 172.21.15.154:0/2148337430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08380cf610 0x7f08381417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083d25a640 1 --2- 172.21.15.154:0/2148337430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f083815ff80 0x7f0838144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f0837fff640 1 -- 172.21.15.154:0/2148337430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08380cf610 msgr2=0x7f08381417a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f0837fff640 1 --2- 172.21.15.154:0/2148337430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08380cf610 0x7f08381417a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f0837fff640 1 -- 172.21.15.154:0/2148337430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f083815ff80 msgr2=0x7f0838144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f0837fff640 1 --2- 172.21.15.154:0/2148337430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f083815ff80 0x7f0838144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f0837fff640 1 -- 172.21.15.154:0/2148337430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0838141580 con 0x7f08381458d0 2024-05-14T01:23:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.958+0000 7f083d25a640 1 --2- 172.21.15.154:0/2148337430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f083815ff80 0x7f0838144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.962+0000 7f0837fff640 1 --2- 172.21.15.154:0/2148337430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08381458d0 0x7f0838157080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f08200b0040 tx=0x7f0820019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.962+0000 7f08357fa640 1 -- 172.21.15.154:0/2148337430 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08200b2040 con 0x7f08381458d0 2024-05-14T01:23:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.962+0000 7f08357fa640 1 -- 172.21.15.154:0/2148337430 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08200bb070 con 0x7f08381458d0 2024-05-14T01:23:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.962+0000 7f083ecbd640 1 -- 172.21.15.154:0/2148337430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0838157710 con 0x7f08381458d0 2024-05-14T01:23:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.962+0000 7f08357fa640 1 -- 172.21.15.154:0/2148337430 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08200b6440 con 0x7f08381458d0 2024-05-14T01:23:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.962+0000 7f083ecbd640 1 -- 172.21.15.154:0/2148337430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0838157cd0 con 0x7f08381458d0 2024-05-14T01:23:42.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.962+0000 7f083ecbd640 1 -- 172.21.15.154:0/2148337430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0838157f10 con 0x7f08381458d0 2024-05-14T01:23:42.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.962+0000 7f08357fa640 1 -- 172.21.15.154:0/2148337430 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f08200ab070 con 0x7f08381458d0 2024-05-14T01:23:42.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.962+0000 7f08357fa640 1 --2- 172.21.15.154:0/2148337430 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f08180678c0 0x7f0818069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:42.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.962+0000 7f08357fa640 1 -- 172.21.15.154:0/2148337430 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f082011f530 con 0x7f08381458d0 2024-05-14T01:23:42.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.962+0000 7f083ca59640 1 --2- 172.21.15.154:0/2148337430 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f08180678c0 0x7f0818069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:42.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.962+0000 7f083ca59640 1 --2- 172.21.15.154:0/2148337430 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f08180678c0 0x7f0818069d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0828001cb0 tx=0x7f0828009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:42.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:42.966+0000 7f08357fa640 1 -- 172.21.15.154:0/2148337430 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f0838141580 con 0x7f08381458d0 2024-05-14T01:23:43.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.114+0000 7f083ecbd640 1 -- 172.21.15.154:0/2148337430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0838075470 con 0x7f08381458d0 2024-05-14T01:23:43.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.114+0000 7f08357fa640 1 -- 172.21.15.154:0/2148337430 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f0820016150 con 0x7f08381458d0 2024-05-14T01:23:43.100 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:23:43.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.118+0000 7f083ecbd640 1 -- 172.21.15.154:0/2148337430 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f08180678c0 msgr2=0x7f0818069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.118+0000 7f083ecbd640 1 --2- 172.21.15.154:0/2148337430 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f08180678c0 0x7f0818069d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0828001cb0 tx=0x7f0828009040 comp rx=0 tx=0).stop 2024-05-14T01:23:43.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.118+0000 7f083ecbd640 1 -- 172.21.15.154:0/2148337430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08381458d0 msgr2=0x7f0838157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.118+0000 7f083ecbd640 1 --2- 172.21.15.154:0/2148337430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08381458d0 0x7f0838157080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f08200b0040 tx=0x7f0820019300 comp rx=0 tx=0).stop 2024-05-14T01:23:43.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.118+0000 7f083ecbd640 1 -- 172.21.15.154:0/2148337430 shutdown_connections 2024-05-14T01:23:43.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.118+0000 7f083ecbd640 1 --2- 172.21.15.154:0/2148337430 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f08180678c0 0x7f0818069d80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.118+0000 7f083ecbd640 1 --2- 172.21.15.154:0/2148337430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f083815ff80 0x7f0838144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.118+0000 7f083ecbd640 1 --2- 172.21.15.154:0/2148337430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08381458d0 0x7f0838157080 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.118+0000 7f083ecbd640 1 --2- 172.21.15.154:0/2148337430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08380cf610 0x7f08381417a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.118+0000 7f083ecbd640 1 -- 172.21.15.154:0/2148337430 >> 172.21.15.154:0/2148337430 conn(0x7f08380b1770 msgr2=0x7f08380af5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:43.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.118+0000 7f083ecbd640 1 -- 172.21.15.154:0/2148337430 shutdown_connections 2024-05-14T01:23:43.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.118+0000 7f083ecbd640 1 -- 172.21.15.154:0/2148337430 wait complete. 2024-05-14T01:23:43.118 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T01:23:43.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.258+0000 7f1b26e8e640 1 Processor -- start 2024-05-14T01:23:43.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.258+0000 7f1b26e8e640 1 -- start start 2024-05-14T01:23:43.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.258+0000 7f1b26e8e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b20072c40 0x7f1b20071f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:43.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.258+0000 7f1b26e8e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b200b3bb0 con 0x7f1b20158920 2024-05-14T01:23:43.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.258+0000 7f1b26e8e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b200711c0 con 0x7f1b20162370 2024-05-14T01:23:43.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.258+0000 7f1b26e8e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1b20071af0 con 0x7f1b20072c40 2024-05-14T01:23:43.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.258+0000 7f1b2542b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b20072c40 0x7f1b20071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:43.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.258+0000 7f1b24c2a640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1b20158920 0x7f1b20161c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57322/0 (socket says 172.21.15.154:57322) 2024-05-14T01:23:43.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.258+0000 7f1b24c2a640 1 -- 172.21.15.154:0/408002412 learned_addr learned my addr 172.21.15.154:0/408002412 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:43.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.258+0000 7f1b2542b640 1 -- 172.21.15.154:0/408002412 >> v1:172.21.15.176:6789/0 conn(0x7f1b20162370 legacy=0x7f1b200ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.258+0000 7f1b2542b640 1 -- 172.21.15.154:0/408002412 >> v1:172.21.15.154:6789/0 conn(0x7f1b20158920 legacy=0x7f1b20161c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.258+0000 7f1b2542b640 1 -- 172.21.15.154:0/408002412 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b200714a0 con 0x7f1b20072c40 2024-05-14T01:23:43.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.258+0000 7f1b1f7fe640 1 -- 172.21.15.154:0/408002412 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1496165306 0 0) 0x7f1b200b3bb0 con 0x7f1b20158920 2024-05-14T01:23:43.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b2542b640 1 --2- 172.21.15.154:0/408002412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b20072c40 0x7f1b20071f80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009d90 tx=0x7f1b1801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fb8e5ee2927a01 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:43.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b1f7fe640 1 -- 172.21.15.154:0/408002412 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b180b2070 con 0x7f1b20072c40 2024-05-14T01:23:43.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b1f7fe640 1 -- 172.21.15.154:0/408002412 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b180a5900 con 0x7f1b20072c40 2024-05-14T01:23:43.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b1f7fe640 1 -- 172.21.15.154:0/408002412 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b180a5cd0 con 0x7f1b20072c40 2024-05-14T01:23:43.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b26e8e640 1 -- 172.21.15.154:0/408002412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b20072c40 msgr2=0x7f1b20071f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b26e8e640 1 --2- 172.21.15.154:0/408002412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b20072c40 0x7f1b20071f80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009d90 tx=0x7f1b1801c970 comp rx=0 tx=0).stop 2024-05-14T01:23:43.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b26e8e640 1 -- 172.21.15.154:0/408002412 shutdown_connections 2024-05-14T01:23:43.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b26e8e640 1 --2- 172.21.15.154:0/408002412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b20072c40 0x7f1b20071f80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b26e8e640 1 -- 172.21.15.154:0/408002412 >> 172.21.15.154:0/408002412 conn(0x7f1b200b1770 msgr2=0x7f1b200b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:43.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b26e8e640 1 -- 172.21.15.154:0/408002412 shutdown_connections 2024-05-14T01:23:43.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b26e8e640 1 -- 172.21.15.154:0/408002412 wait complete. 2024-05-14T01:23:43.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b26e8e640 1 Processor -- start 2024-05-14T01:23:43.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b26e8e640 1 -- start start 2024-05-14T01:23:43.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b26e8e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b20072c40 0x7f1b20146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:43.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b26e8e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b20162370 0x7f1b2006e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:43.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b26e8e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2006ec80 0x7f1b200b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:43.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b26e8e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b200ae520 con 0x7f1b2006ec80 2024-05-14T01:23:43.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b26e8e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1b200ae3a0 con 0x7f1b20162370 2024-05-14T01:23:43.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b26e8e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1b2016c820 con 0x7f1b20072c40 2024-05-14T01:23:43.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b2542b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2006ec80 0x7f1b200b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:43.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b2542b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2006ec80 0x7f1b200b0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46560/0 (socket says 172.21.15.154:46560) 2024-05-14T01:23:43.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.262+0000 7f1b2542b640 1 -- 172.21.15.154:0/328009892 learned_addr learned my addr 172.21.15.154:0/328009892 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:43.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.266+0000 7f1b1ffff640 1 --2- 172.21.15.154:0/328009892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b20162370 0x7f1b2006e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:43.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.266+0000 7f1b2542b640 1 -- 172.21.15.154:0/328009892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b20072c40 msgr2=0x7f1b20146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.266+0000 7f1b2542b640 1 --2- 172.21.15.154:0/328009892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b20072c40 0x7f1b20146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.266+0000 7f1b2542b640 1 -- 172.21.15.154:0/328009892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b20162370 msgr2=0x7f1b2006e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.266+0000 7f1b2542b640 1 --2- 172.21.15.154:0/328009892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b20162370 0x7f1b2006e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.266+0000 7f1b2542b640 1 -- 172.21.15.154:0/328009892 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b200cc730 con 0x7f1b2006ec80 2024-05-14T01:23:43.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.266+0000 7f1b2542b640 1 --2- 172.21.15.154:0/328009892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2006ec80 0x7f1b200b0990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009d90 tx=0x7f1b18019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:43.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.266+0000 7f1b1d7fa640 1 -- 172.21.15.154:0/328009892 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b180b2040 con 0x7f1b2006ec80 2024-05-14T01:23:43.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.266+0000 7f1b1d7fa640 1 -- 172.21.15.154:0/328009892 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b180bf070 con 0x7f1b2006ec80 2024-05-14T01:23:43.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.266+0000 7f1b26e8e640 1 -- 172.21.15.154:0/328009892 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b200cca10 con 0x7f1b2006ec80 2024-05-14T01:23:43.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.266+0000 7f1b1d7fa640 1 -- 172.21.15.154:0/328009892 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b180ad900 con 0x7f1b2006ec80 2024-05-14T01:23:43.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.266+0000 7f1b26e8e640 1 -- 172.21.15.154:0/328009892 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b200ccfd0 con 0x7f1b2006ec80 2024-05-14T01:23:43.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.266+0000 7f1b26e8e640 1 -- 172.21.15.154:0/328009892 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b20075470 con 0x7f1b2006ec80 2024-05-14T01:23:43.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.266+0000 7f1b1d7fa640 1 -- 172.21.15.154:0/328009892 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b180adaa0 con 0x7f1b2006ec80 2024-05-14T01:23:43.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.266+0000 7f1b1d7fa640 1 --2- 172.21.15.154:0/328009892 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1b0c0678f0 0x7f1b0c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:43.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.266+0000 7f1b24c2a640 1 --2- 172.21.15.154:0/328009892 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1b0c0678f0 0x7f1b0c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:43.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.266+0000 7f1b1d7fa640 1 -- 172.21.15.154:0/328009892 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1b18120f50 con 0x7f1b2006ec80 2024-05-14T01:23:43.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.266+0000 7f1b24c2a640 1 --2- 172.21.15.154:0/328009892 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1b0c0678f0 0x7f1b0c069db0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b10000c10 tx=0x7f1b10007910 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:43.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.270+0000 7f1b1d7fa640 1 -- 172.21.15.154:0/328009892 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1b18016560 con 0x7f1b2006ec80 2024-05-14T01:23:43.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.434+0000 7f1b26e8e640 1 -- 172.21.15.154:0/328009892 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1b2006f130 con 0x7f1b2006ec80 2024-05-14T01:23:43.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.434+0000 7f1b1d7fa640 1 -- 172.21.15.154:0/328009892 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f1b180f1b20 con 0x7f1b2006ec80 2024-05-14T01:23:43.420 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-05-14T01:23:43.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.438+0000 7f1b26e8e640 1 -- 172.21.15.154:0/328009892 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1b0c0678f0 msgr2=0x7f1b0c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.438+0000 7f1b26e8e640 1 --2- 172.21.15.154:0/328009892 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1b0c0678f0 0x7f1b0c069db0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b10000c10 tx=0x7f1b10007910 comp rx=0 tx=0).stop 2024-05-14T01:23:43.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.438+0000 7f1b26e8e640 1 -- 172.21.15.154:0/328009892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2006ec80 msgr2=0x7f1b200b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.438+0000 7f1b26e8e640 1 --2- 172.21.15.154:0/328009892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2006ec80 0x7f1b200b0990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009d90 tx=0x7f1b18019710 comp rx=0 tx=0).stop 2024-05-14T01:23:43.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.438+0000 7f1b26e8e640 1 -- 172.21.15.154:0/328009892 shutdown_connections 2024-05-14T01:23:43.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.438+0000 7f1b26e8e640 1 --2- 172.21.15.154:0/328009892 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1b0c0678f0 0x7f1b0c069db0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.438+0000 7f1b26e8e640 1 --2- 172.21.15.154:0/328009892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2006ec80 0x7f1b200b0990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.438+0000 7f1b26e8e640 1 --2- 172.21.15.154:0/328009892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b20162370 0x7f1b2006e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.438+0000 7f1b26e8e640 1 --2- 172.21.15.154:0/328009892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b20072c40 0x7f1b20146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.438+0000 7f1b26e8e640 1 -- 172.21.15.154:0/328009892 >> 172.21.15.154:0/328009892 conn(0x7f1b200b1770 msgr2=0x7f1b200cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:43.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.438+0000 7f1b26e8e640 1 -- 172.21.15.154:0/328009892 shutdown_connections 2024-05-14T01:23:43.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.438+0000 7f1b26e8e640 1 -- 172.21.15.154:0/328009892 wait complete. 2024-05-14T01:23:43.438 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T01:23:43.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.574+0000 7fb519a78640 1 Processor -- start 2024-05-14T01:23:43.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.574+0000 7fb519a78640 1 -- start start 2024-05-14T01:23:43.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.574+0000 7fb519a78640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb51415a670 0x7fb514071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:43.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.574+0000 7fb519a78640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb51406dde0 0x7fb514164160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:43.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.574+0000 7fb519a78640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb514071ea0 con 0x7fb514071060 2024-05-14T01:23:43.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.574+0000 7fb519a78640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb5140b32d0 con 0x7fb51406dde0 2024-05-14T01:23:43.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.574+0000 7fb519a78640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb5140b2c80 con 0x7fb51415a670 2024-05-14T01:23:43.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.574+0000 7fb5137fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb51415a670 0x7fb514071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:43.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.574+0000 7fb513fff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb51406dde0 0x7fb514164160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:43.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.574+0000 7fb5137fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb51415a670 0x7fb514071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:59382/0 (socket says 172.21.15.154:59382) 2024-05-14T01:23:43.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.574+0000 7fb5137fe640 1 -- 172.21.15.154:0/797699048 learned_addr learned my addr 172.21.15.154:0/797699048 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:43.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.574+0000 7fb5137fe640 1 -- 172.21.15.154:0/797699048 >> v2:172.21.15.176:3300/0 conn(0x7fb51406dde0 msgr2=0x7fb514164160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:43.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.574+0000 7fb5137fe640 1 --2- 172.21.15.154:0/797699048 >> v2:172.21.15.176:3300/0 conn(0x7fb51406dde0 0x7fb514164160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.574+0000 7fb5137fe640 1 -- 172.21.15.154:0/797699048 >> v1:172.21.15.176:6789/0 conn(0x7fb514071060 legacy=0x7fb51406d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.574+0000 7fb5137fe640 1 -- 172.21.15.154:0/797699048 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5140b2f60 con 0x7fb51415a670 2024-05-14T01:23:43.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.574+0000 7fb513fff640 1 --2- 172.21.15.154:0/797699048 >> v2:172.21.15.176:3300/0 conn(0x7fb51406dde0 0x7fb514164160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:23:43.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.578+0000 7fb5137fe640 1 --2- 172.21.15.154:0/797699048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb51415a670 0x7fb514071850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb50400d150 tx=0x7fb50401ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d47a1582e44fab4e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:43.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.578+0000 7fb5127fc640 1 -- 172.21.15.154:0/797699048 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5040ad070 con 0x7fb51415a670 2024-05-14T01:23:43.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.578+0000 7fb5127fc640 1 -- 172.21.15.154:0/797699048 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5040a7a80 con 0x7fb51415a670 2024-05-14T01:23:43.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.578+0000 7fb5127fc640 1 -- 172.21.15.154:0/797699048 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5040a7e50 con 0x7fb51415a670 2024-05-14T01:23:43.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.578+0000 7fb519a78640 1 -- 172.21.15.154:0/797699048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb51415a670 msgr2=0x7fb514071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.578+0000 7fb519a78640 1 --2- 172.21.15.154:0/797699048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb51415a670 0x7fb514071850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb50400d150 tx=0x7fb50401ec30 comp rx=0 tx=0).stop 2024-05-14T01:23:43.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.578+0000 7fb519a78640 1 -- 172.21.15.154:0/797699048 shutdown_connections 2024-05-14T01:23:43.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.578+0000 7fb519a78640 1 --2- 172.21.15.154:0/797699048 >> v2:172.21.15.176:3300/0 conn(0x7fb51406dde0 0x7fb514164160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.578+0000 7fb519a78640 1 --2- 172.21.15.154:0/797699048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb51415a670 0x7fb514071850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.578+0000 7fb519a78640 1 -- 172.21.15.154:0/797699048 >> 172.21.15.154:0/797699048 conn(0x7fb5140b1770 msgr2=0x7fb5140b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:43.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.578+0000 7fb519a78640 1 -- 172.21.15.154:0/797699048 shutdown_connections 2024-05-14T01:23:43.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.578+0000 7fb519a78640 1 -- 172.21.15.154:0/797699048 wait complete. 2024-05-14T01:23:43.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.578+0000 7fb519a78640 1 Processor -- start 2024-05-14T01:23:43.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.578+0000 7fb519a78640 1 -- start start 2024-05-14T01:23:43.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb519a78640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb51406dde0 0x7fb51414e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:43.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb519a78640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb514071060 0x7fb514156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb519a78640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb51415a670 0x7fb5140c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb519a78640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb514166a40 con 0x7fb51415a670 2024-05-14T01:23:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb519a78640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb5141668c0 con 0x7fb514071060 2024-05-14T01:23:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb519a78640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb514166bc0 con 0x7fb51406dde0 2024-05-14T01:23:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb513fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb51415a670 0x7fb5140c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb513fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb51415a670 0x7fb5140c9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46566/0 (socket says 172.21.15.154:46566) 2024-05-14T01:23:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb513fff640 1 -- 172.21.15.154:0/3532781002 learned_addr learned my addr 172.21.15.154:0/3532781002 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb5137fe640 1 --2- 172.21.15.154:0/3532781002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb51406dde0 0x7fb51414e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb512ffd640 1 --2- 172.21.15.154:0/3532781002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb514071060 0x7fb514156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb513fff640 1 -- 172.21.15.154:0/3532781002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb51406dde0 msgr2=0x7fb51414e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb513fff640 1 --2- 172.21.15.154:0/3532781002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb51406dde0 0x7fb51414e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb513fff640 1 -- 172.21.15.154:0/3532781002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb514071060 msgr2=0x7fb514156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb513fff640 1 --2- 172.21.15.154:0/3532781002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb514071060 0x7fb514156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb513fff640 1 -- 172.21.15.154:0/3532781002 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb514156ac0 con 0x7fb51415a670 2024-05-14T01:23:43.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb513fff640 1 --2- 172.21.15.154:0/3532781002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb51415a670 0x7fb5140c9a30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00e910 tx=0x7fb50c00edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:43.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb50bfff640 1 -- 172.21.15.154:0/3532781002 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50c017070 con 0x7fb51415a670 2024-05-14T01:23:43.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb50bfff640 1 -- 172.21.15.154:0/3532781002 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb50c00ca00 con 0x7fb51415a670 2024-05-14T01:23:43.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb50bfff640 1 -- 172.21.15.154:0/3532781002 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50c00cdf0 con 0x7fb51415a670 2024-05-14T01:23:43.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb519a78640 1 -- 172.21.15.154:0/3532781002 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb51414eab0 con 0x7fb51415a670 2024-05-14T01:23:43.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb519a78640 1 -- 172.21.15.154:0/3532781002 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb51414f070 con 0x7fb51415a670 2024-05-14T01:23:43.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb519a78640 1 -- 172.21.15.154:0/3532781002 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb514075470 con 0x7fb51415a670 2024-05-14T01:23:43.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb50bfff640 1 -- 172.21.15.154:0/3532781002 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb50c01a070 con 0x7fb51415a670 2024-05-14T01:23:43.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb50bfff640 1 --2- 172.21.15.154:0/3532781002 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb4f40678c0 0x7fb4f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:43.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb50bfff640 1 -- 172.21.15.154:0/3532781002 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb50c085be0 con 0x7fb51415a670 2024-05-14T01:23:43.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb5137fe640 1 --2- 172.21.15.154:0/3532781002 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb4f40678c0 0x7fb4f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:43.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.582+0000 7fb5137fe640 1 --2- 172.21.15.154:0/3532781002 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb4f40678c0 0x7fb4f4069d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb5040b2000 tx=0x7fb5040a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:43.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.586+0000 7fb50bfff640 1 -- 172.21.15.154:0/3532781002 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb50c056680 con 0x7fb51415a670 2024-05-14T01:23:43.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.750+0000 7fb519a78640 1 -- 172.21.15.154:0/3532781002 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb5140cf7c0 con 0x7fb51415a670 2024-05-14T01:23:43.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.750+0000 7fb50bfff640 1 -- 172.21.15.154:0/3532781002 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fb50c055f80 con 0x7fb51415a670 2024-05-14T01:23:43.734 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-05-14T01:23:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.750+0000 7fb519a78640 1 -- 172.21.15.154:0/3532781002 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb4f40678c0 msgr2=0x7fb4f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.750+0000 7fb519a78640 1 --2- 172.21.15.154:0/3532781002 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb4f40678c0 0x7fb4f4069d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb5040b2000 tx=0x7fb5040a9070 comp rx=0 tx=0).stop 2024-05-14T01:23:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.750+0000 7fb519a78640 1 -- 172.21.15.154:0/3532781002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb51415a670 msgr2=0x7fb5140c9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.750+0000 7fb519a78640 1 --2- 172.21.15.154:0/3532781002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb51415a670 0x7fb5140c9a30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00e910 tx=0x7fb50c00edd0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.754+0000 7fb519a78640 1 -- 172.21.15.154:0/3532781002 shutdown_connections 2024-05-14T01:23:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.754+0000 7fb519a78640 1 --2- 172.21.15.154:0/3532781002 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb4f40678c0 0x7fb4f4069d80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.754+0000 7fb519a78640 1 --2- 172.21.15.154:0/3532781002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb51415a670 0x7fb5140c9a30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.754+0000 7fb519a78640 1 --2- 172.21.15.154:0/3532781002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb514071060 0x7fb514156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.754+0000 7fb519a78640 1 --2- 172.21.15.154:0/3532781002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb51406dde0 0x7fb51414e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.754+0000 7fb519a78640 1 -- 172.21.15.154:0/3532781002 >> 172.21.15.154:0/3532781002 conn(0x7fb5140b1770 msgr2=0x7fb514156e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.754+0000 7fb519a78640 1 -- 172.21.15.154:0/3532781002 shutdown_connections 2024-05-14T01:23:43.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.754+0000 7fb519a78640 1 -- 172.21.15.154:0/3532781002 wait complete. 2024-05-14T01:23:43.754 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T01:23:43.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.890+0000 7fe478750640 1 Processor -- start 2024-05-14T01:23:43.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.890+0000 7fe478750640 1 -- start start 2024-05-14T01:23:43.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.894+0000 7fe478750640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe470145680 0x7fe47006df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:43.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.894+0000 7fe478750640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe47006e440 0x7fe47006c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:43.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.894+0000 7fe478750640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4700ae370 con 0x7fe47006c7d0 2024-05-14T01:23:43.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.894+0000 7fe478750640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe47006cc40 con 0x7fe47006e440 2024-05-14T01:23:43.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.894+0000 7fe478750640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe4700ae650 con 0x7fe470145680 2024-05-14T01:23:43.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.894+0000 7fe4764ec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe470145680 0x7fe47006df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:43.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.894+0000 7fe475ceb640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe47006e440 0x7fe47006c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:43.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.894+0000 7fe4764ec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe470145680 0x7fe47006df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:59402/0 (socket says 172.21.15.154:59402) 2024-05-14T01:23:43.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.894+0000 7fe476ced640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fe47006c7d0 0x7fe470074280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:48412/0 (socket says 172.21.15.154:48412) 2024-05-14T01:23:43.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.894+0000 7fe4764ec640 1 -- 172.21.15.154:0/3318453218 learned_addr learned my addr 172.21.15.154:0/3318453218 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:43.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.894+0000 7fe4764ec640 1 -- 172.21.15.154:0/3318453218 >> v2:172.21.15.176:3300/0 conn(0x7fe47006e440 msgr2=0x7fe47006c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:43.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.894+0000 7fe4764ec640 1 --2- 172.21.15.154:0/3318453218 >> v2:172.21.15.176:3300/0 conn(0x7fe47006e440 0x7fe47006c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.894+0000 7fe4764ec640 1 -- 172.21.15.154:0/3318453218 >> v1:172.21.15.176:6789/0 conn(0x7fe47006c7d0 legacy=0x7fe470074280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.894+0000 7fe4754ea640 1 -- 172.21.15.154:0/3318453218 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 902705233 0 0) 0x7fe4700ae370 con 0x7fe47006c7d0 2024-05-14T01:23:43.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.894+0000 7fe4764ec640 1 -- 172.21.15.154:0/3318453218 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4700ae930 con 0x7fe470145680 2024-05-14T01:23:43.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.894+0000 7fe475ceb640 1 --2- 172.21.15.154:0/3318453218 >> v2:172.21.15.176:3300/0 conn(0x7fe47006e440 0x7fe47006c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:23:43.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe4764ec640 1 --2- 172.21.15.154:0/3318453218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe470145680 0x7fe47006df00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe460009e50 tx=0x7fe46001ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7595e8af3368d217 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:43.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe4754ea640 1 -- 172.21.15.154:0/3318453218 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4600a5700 con 0x7fe470145680 2024-05-14T01:23:43.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe4754ea640 1 -- 172.21.15.154:0/3318453218 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4600a58a0 con 0x7fe470145680 2024-05-14T01:23:43.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe4754ea640 1 -- 172.21.15.154:0/3318453218 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4600a5c70 con 0x7fe470145680 2024-05-14T01:23:43.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe478750640 1 -- 172.21.15.154:0/3318453218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe470145680 msgr2=0x7fe47006df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe478750640 1 --2- 172.21.15.154:0/3318453218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe470145680 0x7fe47006df00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe460009e50 tx=0x7fe46001ca30 comp rx=0 tx=0).stop 2024-05-14T01:23:43.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe478750640 1 -- 172.21.15.154:0/3318453218 shutdown_connections 2024-05-14T01:23:43.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe478750640 1 --2- 172.21.15.154:0/3318453218 >> v2:172.21.15.176:3300/0 conn(0x7fe47006e440 0x7fe47006c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe478750640 1 --2- 172.21.15.154:0/3318453218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe470145680 0x7fe47006df00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe478750640 1 -- 172.21.15.154:0/3318453218 >> 172.21.15.154:0/3318453218 conn(0x7fe470071fc0 msgr2=0x7fe4700723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:43.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe478750640 1 -- 172.21.15.154:0/3318453218 shutdown_connections 2024-05-14T01:23:43.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe478750640 1 -- 172.21.15.154:0/3318453218 wait complete. 2024-05-14T01:23:43.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe478750640 1 Processor -- start 2024-05-14T01:23:43.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe478750640 1 -- start start 2024-05-14T01:23:43.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe478750640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe47006c7d0 0x7fe47013ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:43.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe478750640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe47006e440 0x7fe47009aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:43.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe478750640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe470145680 0x7fe47013b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:43.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe478750640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe470145be0 con 0x7fe47006e440 2024-05-14T01:23:43.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe478750640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe470145a60 con 0x7fe47006c7d0 2024-05-14T01:23:43.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe478750640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe4700b0420 con 0x7fe470145680 2024-05-14T01:23:43.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe475ceb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe47006e440 0x7fe47009aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:43.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe475ceb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe47006e440 0x7fe47009aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46574/0 (socket says 172.21.15.154:46574) 2024-05-14T01:23:43.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe475ceb640 1 -- 172.21.15.154:0/4195353161 learned_addr learned my addr 172.21.15.154:0/4195353161 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:43.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.898+0000 7fe476ced640 1 --2- 172.21.15.154:0/4195353161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe470145680 0x7fe47013b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:43.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe4764ec640 1 --2- 172.21.15.154:0/4195353161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe47006c7d0 0x7fe47013ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:43.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe475ceb640 1 -- 172.21.15.154:0/4195353161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe470145680 msgr2=0x7fe47013b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe475ceb640 1 --2- 172.21.15.154:0/4195353161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe470145680 0x7fe47013b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe475ceb640 1 -- 172.21.15.154:0/4195353161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe47006c7d0 msgr2=0x7fe47013ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:43.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe475ceb640 1 --2- 172.21.15.154:0/4195353161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe47006c7d0 0x7fe47013ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:43.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe475ceb640 1 -- 172.21.15.154:0/4195353161 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4701597a0 con 0x7fe47006e440 2024-05-14T01:23:43.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe4764ec640 1 --2- 172.21.15.154:0/4195353161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe47006c7d0 0x7fe47013ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:43.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe475ceb640 1 --2- 172.21.15.154:0/4195353161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe47006e440 0x7fe47009aa10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe46400e980 tx=0x7fe46400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:43.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe46effd640 1 -- 172.21.15.154:0/4195353161 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe464017070 con 0x7fe47006e440 2024-05-14T01:23:43.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe46effd640 1 -- 172.21.15.154:0/4195353161 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe46400ca00 con 0x7fe47006e440 2024-05-14T01:23:43.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe46effd640 1 -- 172.21.15.154:0/4195353161 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46400cdd0 con 0x7fe47006e440 2024-05-14T01:23:43.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe478750640 1 -- 172.21.15.154:0/4195353161 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe47009d8b0 con 0x7fe47006e440 2024-05-14T01:23:43.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe478750640 1 -- 172.21.15.154:0/4195353161 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe47013b160 con 0x7fe47006e440 2024-05-14T01:23:43.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe478750640 1 -- 172.21.15.154:0/4195353161 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe470075470 con 0x7fe47006e440 2024-05-14T01:23:43.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe46effd640 1 -- 172.21.15.154:0/4195353161 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe46401a070 con 0x7fe47006e440 2024-05-14T01:23:43.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe46effd640 1 --2- 172.21.15.154:0/4195353161 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe45c0678c0 0x7fe45c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:43.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe46effd640 1 -- 172.21.15.154:0/4195353161 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe464085ba0 con 0x7fe47006e440 2024-05-14T01:23:43.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe4764ec640 1 --2- 172.21.15.154:0/4195353161 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe45c0678c0 0x7fe45c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:43.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.902+0000 7fe4764ec640 1 --2- 172.21.15.154:0/4195353161 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe45c0678c0 0x7fe45c069d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe4600ae000 tx=0x7fe4600a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:43.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:43.906+0000 7fe46effd640 1 -- 172.21.15.154:0/4195353161 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fe4640566e0 con 0x7fe47006e440 2024-05-14T01:23:44.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.090+0000 7fe478750640 1 -- 172.21.15.154:0/4195353161 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe470158190 con 0x7fe47006e440 2024-05-14T01:23:44.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.090+0000 7fe46effd640 1 -- 172.21.15.154:0/4195353161 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7fe464055fe0 con 0x7fe47006e440 2024-05-14T01:23:44.074 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:44.074 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2575586302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2575586302},{"type":"v1","addr":"172.21.15.154:6836","nonce":2575586302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3108110937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3108110937},{"type":"v1","addr":"172.21.15.154:6837","nonce":3108110937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/77727941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":77727941},{"type":"v1","addr":"172.21.15.176:6833","nonce":77727941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T01:23:34.570674+0000","modified":"2024-05-14T01:23:37.636442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6835/2614790445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2614790445},{"type":"v1","addr":"172.21.15.176:6835","nonce":2614790445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-14T01:23:44.075 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 8 2024-05-14T01:23:44.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.094+0000 7fe478750640 1 -- 172.21.15.154:0/4195353161 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe45c0678c0 msgr2=0x7fe45c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.094+0000 7fe478750640 1 --2- 172.21.15.154:0/4195353161 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe45c0678c0 0x7fe45c069d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe4600ae000 tx=0x7fe4600a7070 comp rx=0 tx=0).stop 2024-05-14T01:23:44.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.094+0000 7fe478750640 1 -- 172.21.15.154:0/4195353161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe47006e440 msgr2=0x7fe47009aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.094+0000 7fe478750640 1 --2- 172.21.15.154:0/4195353161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe47006e440 0x7fe47009aa10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe46400e980 tx=0x7fe46400ee40 comp rx=0 tx=0).stop 2024-05-14T01:23:44.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.094+0000 7fe478750640 1 -- 172.21.15.154:0/4195353161 shutdown_connections 2024-05-14T01:23:44.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.094+0000 7fe478750640 1 --2- 172.21.15.154:0/4195353161 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe45c0678c0 0x7fe45c069d80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.094+0000 7fe478750640 1 --2- 172.21.15.154:0/4195353161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe470145680 0x7fe47013b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.094+0000 7fe478750640 1 --2- 172.21.15.154:0/4195353161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe47006e440 0x7fe47009aa10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.094+0000 7fe478750640 1 --2- 172.21.15.154:0/4195353161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe47006c7d0 0x7fe47013ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.094+0000 7fe478750640 1 -- 172.21.15.154:0/4195353161 >> 172.21.15.154:0/4195353161 conn(0x7fe470071fc0 msgr2=0x7fe4701423f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:44.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.094+0000 7fe478750640 1 -- 172.21.15.154:0/4195353161 shutdown_connections 2024-05-14T01:23:44.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.094+0000 7fe478750640 1 -- 172.21.15.154:0/4195353161 wait complete. 2024-05-14T01:23:44.092 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:23:44.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.222+0000 7f7d8edbc640 1 Processor -- start 2024-05-14T01:23:44.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.222+0000 7f7d8edbc640 1 -- start start 2024-05-14T01:23:44.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.226+0000 7f7d8edbc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d88141d00 0x7f7d880ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.226+0000 7f7d8edbc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7d880ce880 0x7f7d8806d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.226+0000 7f7d8edbc640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d880cf100 con 0x7f7d8813ede0 2024-05-14T01:23:44.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.226+0000 7f7d8edbc640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7d8806cff0 con 0x7f7d880ce880 2024-05-14T01:23:44.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.226+0000 7f7d8edbc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7d880cf3e0 con 0x7f7d88141d00 2024-05-14T01:23:44.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.226+0000 7f7d87fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d88141d00 0x7f7d880ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.226+0000 7f7d87fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d88141d00 0x7f7d880ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:59420/0 (socket says 172.21.15.154:59420) 2024-05-14T01:23:44.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.226+0000 7f7d87fff640 1 -- 172.21.15.154:0/3319701580 learned_addr learned my addr 172.21.15.154:0/3319701580 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:44.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.226+0000 7f7d8d359640 1 --2- 172.21.15.154:0/3319701580 >> v2:172.21.15.176:3300/0 conn(0x7f7d880ce880 0x7f7d8806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.226+0000 7f7d87fff640 1 -- 172.21.15.154:0/3319701580 >> v2:172.21.15.176:3300/0 conn(0x7f7d880ce880 msgr2=0x7f7d8806d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:44.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.226+0000 7f7d87fff640 1 --2- 172.21.15.154:0/3319701580 >> v2:172.21.15.176:3300/0 conn(0x7f7d880ce880 0x7f7d8806d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.226+0000 7f7d87fff640 1 -- 172.21.15.154:0/3319701580 >> v1:172.21.15.176:6789/0 conn(0x7f7d8813ede0 legacy=0x7f7d881415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.226+0000 7f7d87fff640 1 -- 172.21.15.154:0/3319701580 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8806cc80 con 0x7f7d88141d00 2024-05-14T01:23:44.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.226+0000 7f7d877fe640 1 -- 172.21.15.154:0/3319701580 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1199625668 0 0) 0x7f7d880cf100 con 0x7f7d8813ede0 2024-05-14T01:23:44.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d87fff640 1 --2- 172.21.15.154:0/3319701580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d88141d00 0x7f7d880ce340 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009870 tx=0x7f7d7c01c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2540a866db15706 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d877fe640 1 -- 172.21.15.154:0/3319701580 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0aa650 con 0x7f7d88141d00 2024-05-14T01:23:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d877fe640 1 -- 172.21.15.154:0/3319701580 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7c0af070 con 0x7f7d88141d00 2024-05-14T01:23:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d877fe640 1 -- 172.21.15.154:0/3319701580 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0aaa10 con 0x7f7d88141d00 2024-05-14T01:23:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8edbc640 1 -- 172.21.15.154:0/3319701580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d88141d00 msgr2=0x7f7d880ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8edbc640 1 --2- 172.21.15.154:0/3319701580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d88141d00 0x7f7d880ce340 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009870 tx=0x7f7d7c01c520 comp rx=0 tx=0).stop 2024-05-14T01:23:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8edbc640 1 -- 172.21.15.154:0/3319701580 shutdown_connections 2024-05-14T01:23:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8edbc640 1 --2- 172.21.15.154:0/3319701580 >> v2:172.21.15.176:3300/0 conn(0x7f7d880ce880 0x7f7d8806d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8edbc640 1 --2- 172.21.15.154:0/3319701580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d88141d00 0x7f7d880ce340 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8edbc640 1 -- 172.21.15.154:0/3319701580 >> 172.21.15.154:0/3319701580 conn(0x7f7d880b1850 msgr2=0x7f7d880b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8edbc640 1 -- 172.21.15.154:0/3319701580 shutdown_connections 2024-05-14T01:23:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8edbc640 1 -- 172.21.15.154:0/3319701580 wait complete. 2024-05-14T01:23:44.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8edbc640 1 Processor -- start 2024-05-14T01:23:44.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8edbc640 1 -- start start 2024-05-14T01:23:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8edbc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d880ce880 0x7f7d88144fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8edbc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8813ede0 0x7f7d880b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8edbc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d88141d00 0x7f7d880b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8edbc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8806e1d0 con 0x7f7d880ce880 2024-05-14T01:23:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8edbc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7d880cee70 con 0x7f7d88141d00 2024-05-14T01:23:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8edbc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8806e350 con 0x7f7d8813ede0 2024-05-14T01:23:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8cb58640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d880ce880 0x7f7d88144fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8cb58640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d880ce880 0x7f7d88144fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46578/0 (socket says 172.21.15.154:46578) 2024-05-14T01:23:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.230+0000 7f7d8cb58640 1 -- 172.21.15.154:0/4133561533 learned_addr learned my addr 172.21.15.154:0/4133561533 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d87fff640 1 --2- 172.21.15.154:0/4133561533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8813ede0 0x7f7d880b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d8d359640 1 --2- 172.21.15.154:0/4133561533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d88141d00 0x7f7d880b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d8cb58640 1 -- 172.21.15.154:0/4133561533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8813ede0 msgr2=0x7f7d880b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d8cb58640 1 --2- 172.21.15.154:0/4133561533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8813ede0 0x7f7d880b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d8cb58640 1 -- 172.21.15.154:0/4133561533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d88141d00 msgr2=0x7f7d880b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d8cb58640 1 --2- 172.21.15.154:0/4133561533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d88141d00 0x7f7d880b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d8cb58640 1 -- 172.21.15.154:0/4133561533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d88156b70 con 0x7f7d880ce880 2024-05-14T01:23:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d8cb58640 1 --2- 172.21.15.154:0/4133561533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d880ce880 0x7f7d88144fb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800c500 tx=0x7f7d7800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d857fa640 1 -- 172.21.15.154:0/4133561533 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d78017070 con 0x7f7d880ce880 2024-05-14T01:23:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d857fa640 1 -- 172.21.15.154:0/4133561533 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d78003600 con 0x7f7d880ce880 2024-05-14T01:23:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d8edbc640 1 -- 172.21.15.154:0/4133561533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d88156e50 con 0x7f7d880ce880 2024-05-14T01:23:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d857fa640 1 -- 172.21.15.154:0/4133561533 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d780039f0 con 0x7f7d880ce880 2024-05-14T01:23:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d8edbc640 1 -- 172.21.15.154:0/4133561533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d88157410 con 0x7f7d880ce880 2024-05-14T01:23:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d8edbc640 1 -- 172.21.15.154:0/4133561533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d88075470 con 0x7f7d880ce880 2024-05-14T01:23:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d857fa640 1 -- 172.21.15.154:0/4133561533 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7d7801a070 con 0x7f7d880ce880 2024-05-14T01:23:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d857fa640 1 --2- 172.21.15.154:0/4133561533 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7d740678c0 0x7f7d74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d857fa640 1 -- 172.21.15.154:0/4133561533 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7d78085040 con 0x7f7d880ce880 2024-05-14T01:23:44.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d87fff640 1 --2- 172.21.15.154:0/4133561533 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7d740678c0 0x7f7d74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.234+0000 7f7d87fff640 1 --2- 172.21.15.154:0/4133561533 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7d740678c0 0x7f7d74069d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0ae000 tx=0x7f7d7c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:44.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.238+0000 7f7d857fa640 1 -- 172.21.15.154:0/4133561533 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f7d78055680 con 0x7f7d880ce880 2024-05-14T01:23:44.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.390+0000 7f7d8edbc640 1 -- 172.21.15.154:0/4133561533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d880cce00 con 0x7f7d880ce880 2024-05-14T01:23:44.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.390+0000 7f7d857fa640 1 -- 172.21.15.154:0/4133561533 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f7d78059980 con 0x7f7d880ce880 2024-05-14T01:23:44.375 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:44.375 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:36.232271+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:23:44.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.394+0000 7f7d8edbc640 1 -- 172.21.15.154:0/4133561533 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7d740678c0 msgr2=0x7f7d74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.394+0000 7f7d8edbc640 1 --2- 172.21.15.154:0/4133561533 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7d740678c0 0x7f7d74069d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0ae000 tx=0x7f7d7c0a7000 comp rx=0 tx=0).stop 2024-05-14T01:23:44.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.394+0000 7f7d8edbc640 1 -- 172.21.15.154:0/4133561533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d880ce880 msgr2=0x7f7d88144fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.394+0000 7f7d8edbc640 1 --2- 172.21.15.154:0/4133561533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d880ce880 0x7f7d88144fb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800c500 tx=0x7f7d7800c9c0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.394+0000 7f7d8edbc640 1 -- 172.21.15.154:0/4133561533 shutdown_connections 2024-05-14T01:23:44.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.394+0000 7f7d8edbc640 1 --2- 172.21.15.154:0/4133561533 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7d740678c0 0x7f7d74069d80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.394+0000 7f7d8edbc640 1 --2- 172.21.15.154:0/4133561533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d88141d00 0x7f7d880b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.394+0000 7f7d8edbc640 1 --2- 172.21.15.154:0/4133561533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8813ede0 0x7f7d880b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.394+0000 7f7d8edbc640 1 --2- 172.21.15.154:0/4133561533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d880ce880 0x7f7d88144fb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.394+0000 7f7d8edbc640 1 -- 172.21.15.154:0/4133561533 >> 172.21.15.154:0/4133561533 conn(0x7f7d880b1850 msgr2=0x7f7d8813c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:44.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.394+0000 7f7d8edbc640 1 -- 172.21.15.154:0/4133561533 shutdown_connections 2024-05-14T01:23:44.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.394+0000 7f7d8edbc640 1 -- 172.21.15.154:0/4133561533 wait complete. 2024-05-14T01:23:44.392 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T01:23:33.083538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T01:23:33.556058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:23:44.393 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:23:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.530+0000 7f5b8e19f640 1 Processor -- start 2024-05-14T01:23:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.530+0000 7f5b8e19f640 1 -- start start 2024-05-14T01:23:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b8e19f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b880b6240 0x7f5b8815cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b8e19f640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5b88074990 0x7f5b8806dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b8e19f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b8815d2f0 con 0x7f5b8815f990 2024-05-14T01:23:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b8e19f640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f5b88160370 con 0x7f5b88074990 2024-05-14T01:23:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b8e19f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5b88160650 con 0x7f5b880b6240 2024-05-14T01:23:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b86ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5b8815f990 0x7f5b88074280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57328/0 (socket says 172.21.15.154:57328) 2024-05-14T01:23:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b86ffd640 1 -- 172.21.15.154:0/2052784643 learned_addr learned my addr 172.21.15.154:0/2052784643 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b87fff640 1 --2- 172.21.15.154:0/2052784643 >> v2:172.21.15.176:3300/0 conn(0x7f5b88074990 0x7f5b8806dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b877fe640 1 --2- 172.21.15.154:0/2052784643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b880b6240 0x7f5b8815cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b867fc640 1 -- 172.21.15.154:0/2052784643 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3985723239 0 0) 0x7f5b8815d2f0 con 0x7f5b8815f990 2024-05-14T01:23:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b867fc640 1 -- 172.21.15.154:0/2052784643 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b70003530 con 0x7f5b8815f990 2024-05-14T01:23:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b867fc640 1 -- 172.21.15.154:0/2052784643 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1002694838 0 0) 0x7f5b70003530 con 0x7f5b8815f990 2024-05-14T01:23:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b867fc640 1 -- 172.21.15.154:0/2052784643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b880b6240 msgr2=0x7f5b8815cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:44.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b867fc640 1 --2- 172.21.15.154:0/2052784643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b880b6240 0x7f5b8815cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b867fc640 1 -- 172.21.15.154:0/2052784643 >> v2:172.21.15.176:3300/0 conn(0x7f5b88074990 msgr2=0x7f5b8806dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:44.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b867fc640 1 --2- 172.21.15.154:0/2052784643 >> v2:172.21.15.176:3300/0 conn(0x7f5b88074990 0x7f5b8806dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b867fc640 1 -- 172.21.15.154:0/2052784643 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8815c5b0 con 0x7f5b8815f990 2024-05-14T01:23:44.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b867fc640 1 -- 172.21.15.154:0/2052784643 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f5b7c001680 con 0x7f5b8815f990 2024-05-14T01:23:44.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b867fc640 1 -- 172.21.15.154:0/2052784643 >> v1:172.21.15.154:6789/0 conn(0x7f5b8815f990 legacy=0x7f5b88074280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b867fc640 1 --2- 172.21.15.154:0/2052784643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b700039c0 0x7f5b70003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b867fc640 1 --2- 172.21.15.154:0/2052784643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b70004810 0x7f5b70004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b867fc640 1 --2- 172.21.15.154:0/2052784643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b880b6240 0x7f5b700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b867fc640 1 -- 172.21.15.154:0/2052784643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b88160370 con 0x7f5b70004810 2024-05-14T01:23:44.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b867fc640 1 -- 172.21.15.154:0/2052784643 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5b88160650 con 0x7f5b700039c0 2024-05-14T01:23:44.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b867fc640 1 -- 172.21.15.154:0/2052784643 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5b7000b9d0 con 0x7f5b880b6240 2024-05-14T01:23:44.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b86ffd640 1 --2- 172.21.15.154:0/2052784643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b70004810 0x7f5b70004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b877fe640 1 --2- 172.21.15.154:0/2052784643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b700039c0 0x7f5b70003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b86ffd640 1 -- 172.21.15.154:0/2052784643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b880b6240 msgr2=0x7f5b700051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:44.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b87fff640 1 --2- 172.21.15.154:0/2052784643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b880b6240 0x7f5b700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b86ffd640 1 --2- 172.21.15.154:0/2052784643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b880b6240 0x7f5b700051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b86ffd640 1 -- 172.21.15.154:0/2052784643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b700039c0 msgr2=0x7f5b70003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:44.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b86ffd640 1 --2- 172.21.15.154:0/2052784643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b700039c0 0x7f5b70003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b86ffd640 1 -- 172.21.15.154:0/2052784643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b70003530 con 0x7f5b70004810 2024-05-14T01:23:44.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.534+0000 7f5b877fe640 1 --2- 172.21.15.154:0/2052784643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b700039c0 0x7f5b70003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:23:44.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b86ffd640 1 --2- 172.21.15.154:0/2052784643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b70004810 0x7f5b70004c90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00c210 tx=0x7f5b7c01f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8516538c65371e86 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:44.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b867fc640 1 -- 172.21.15.154:0/2052784643 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c007d60 con 0x7f5b70004810 2024-05-14T01:23:44.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b867fc640 1 -- 172.21.15.154:0/2052784643 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7c005ae0 con 0x7f5b70004810 2024-05-14T01:23:44.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b867fc640 1 -- 172.21.15.154:0/2052784643 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c007070 con 0x7f5b70004810 2024-05-14T01:23:44.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b8e19f640 1 -- 172.21.15.154:0/2052784643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b70004810 msgr2=0x7f5b70004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b8e19f640 1 --2- 172.21.15.154:0/2052784643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b70004810 0x7f5b70004c90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00c210 tx=0x7f5b7c01f3f0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b87fff640 1 -- 172.21.15.154:0/2052784643 reap_dead start 2024-05-14T01:23:44.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b8e19f640 1 -- 172.21.15.154:0/2052784643 shutdown_connections 2024-05-14T01:23:44.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b8e19f640 1 -- 172.21.15.154:0/2052784643 >> 172.21.15.154:0/2052784643 conn(0x7f5b880cd6f0 msgr2=0x7f5b880cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:44.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b8e19f640 1 -- 172.21.15.154:0/2052784643 shutdown_connections 2024-05-14T01:23:44.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b8e19f640 1 -- 172.21.15.154:0/2052784643 wait complete. 2024-05-14T01:23:44.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b8e19f640 1 Processor -- start 2024-05-14T01:23:44.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b8e19f640 1 -- start start 2024-05-14T01:23:44.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b8e19f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b881f7e80 0x7f5b880cf670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b8e19f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b880cfbb0 0x7f5b88148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b8e19f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b881f8260 0x7f5b88149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b8e19f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8806cb80 con 0x7f5b881f8260 2024-05-14T01:23:44.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b8e19f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8806ca00 con 0x7f5b880cfbb0 2024-05-14T01:23:44.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b8e19f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5b8815fe10 con 0x7f5b881f7e80 2024-05-14T01:23:44.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b87fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b881f8260 0x7f5b88149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b87fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b881f8260 0x7f5b88149130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46598/0 (socket says 172.21.15.154:46598) 2024-05-14T01:23:44.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b87fff640 1 -- 172.21.15.154:0/508849321 learned_addr learned my addr 172.21.15.154:0/508849321 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:44.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b877fe640 1 --2- 172.21.15.154:0/508849321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b881f7e80 0x7f5b880cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b86ffd640 1 --2- 172.21.15.154:0/508849321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b880cfbb0 0x7f5b88148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b87fff640 1 -- 172.21.15.154:0/508849321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b881f7e80 msgr2=0x7f5b880cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b87fff640 1 --2- 172.21.15.154:0/508849321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b881f7e80 0x7f5b880cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b87fff640 1 -- 172.21.15.154:0/508849321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b880cfbb0 msgr2=0x7f5b88148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b87fff640 1 --2- 172.21.15.154:0/508849321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b880cfbb0 0x7f5b88148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b87fff640 1 -- 172.21.15.154:0/508849321 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b88149670 con 0x7f5b881f8260 2024-05-14T01:23:44.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b877fe640 1 --2- 172.21.15.154:0/508849321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b881f7e80 0x7f5b880cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:23:44.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b87fff640 1 --2- 172.21.15.154:0/508849321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b881f8260 0x7f5b88149130 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5b880c7cf0 tx=0x7f5b8000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:44.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b6ffff640 1 -- 172.21.15.154:0/508849321 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8001c070 con 0x7f5b881f8260 2024-05-14T01:23:44.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b6ffff640 1 -- 172.21.15.154:0/508849321 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b80017400 con 0x7f5b881f8260 2024-05-14T01:23:44.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.538+0000 7f5b6ffff640 1 -- 172.21.15.154:0/508849321 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b800177f0 con 0x7f5b881f8260 2024-05-14T01:23:44.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.542+0000 7f5b8e19f640 1 -- 172.21.15.154:0/508849321 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b880d0130 con 0x7f5b881f8260 2024-05-14T01:23:44.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.542+0000 7f5b8e19f640 1 -- 172.21.15.154:0/508849321 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b880c4600 con 0x7f5b881f8260 2024-05-14T01:23:44.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.542+0000 7f5b8e19f640 1 -- 172.21.15.154:0/508849321 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b88067cd0 con 0x7f5b881f8260 2024-05-14T01:23:44.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.542+0000 7f5b6ffff640 1 -- 172.21.15.154:0/508849321 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5b8001f070 con 0x7f5b881f8260 2024-05-14T01:23:44.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.542+0000 7f5b6ffff640 1 --2- 172.21.15.154:0/508849321 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f5b740678f0 0x7f5b74069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.542+0000 7f5b877fe640 1 --2- 172.21.15.154:0/508849321 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f5b740678f0 0x7f5b74069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.542+0000 7f5b6ffff640 1 -- 172.21.15.154:0/508849321 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5b80085ef0 con 0x7f5b881f8260 2024-05-14T01:23:44.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.542+0000 7f5b877fe640 1 --2- 172.21.15.154:0/508849321 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f5b740678f0 0x7f5b74069db0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009990 tx=0x7f5b78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:44.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.546+0000 7f5b6ffff640 1 -- 172.21.15.154:0/508849321 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f5b80012070 con 0x7f5b881f8260 2024-05-14T01:23:44.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.706+0000 7f5b8e19f640 1 -- 172.21.15.154:0/508849321 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5b88068360 con 0x7f5b881f8260 2024-05-14T01:23:44.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.706+0000 7f5b6ffff640 1 -- 172.21.15.154:0/508849321 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f5b800569a0 con 0x7f5b881f8260 2024-05-14T01:23:44.691 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:23:44.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.710+0000 7f5b8e19f640 1 -- 172.21.15.154:0/508849321 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f5b740678f0 msgr2=0x7f5b74069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.710+0000 7f5b8e19f640 1 --2- 172.21.15.154:0/508849321 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f5b740678f0 0x7f5b74069db0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009990 tx=0x7f5b78008040 comp rx=0 tx=0).stop 2024-05-14T01:23:44.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.710+0000 7f5b8e19f640 1 -- 172.21.15.154:0/508849321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b881f8260 msgr2=0x7f5b88149130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.710+0000 7f5b8e19f640 1 --2- 172.21.15.154:0/508849321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b881f8260 0x7f5b88149130 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5b880c7cf0 tx=0x7f5b8000f4a0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.710+0000 7f5b8e19f640 1 -- 172.21.15.154:0/508849321 shutdown_connections 2024-05-14T01:23:44.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.710+0000 7f5b8e19f640 1 --2- 172.21.15.154:0/508849321 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f5b740678f0 0x7f5b74069db0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.710+0000 7f5b8e19f640 1 --2- 172.21.15.154:0/508849321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b881f8260 0x7f5b88149130 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.710+0000 7f5b8e19f640 1 --2- 172.21.15.154:0/508849321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b880cfbb0 0x7f5b88148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.710+0000 7f5b8e19f640 1 --2- 172.21.15.154:0/508849321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b881f7e80 0x7f5b880cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.710+0000 7f5b8e19f640 1 -- 172.21.15.154:0/508849321 >> 172.21.15.154:0/508849321 conn(0x7f5b880cd6f0 msgr2=0x7f5b8815d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:44.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.710+0000 7f5b8e19f640 1 -- 172.21.15.154:0/508849321 shutdown_connections 2024-05-14T01:23:44.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.710+0000 7f5b8e19f640 1 -- 172.21.15.154:0/508849321 wait complete. 2024-05-14T01:23:44.710 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T01:23:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.850+0000 7fbfa11fa640 1 Processor -- start 2024-05-14T01:23:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbfa11fa640 1 -- start start 2024-05-14T01:23:44.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbfa11fa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf9c15e530 0x7fbf9c0d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbfa11fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf9c0726c0 con 0x7fbf9c0b3590 2024-05-14T01:23:44.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbfa11fa640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf9c0d3440 con 0x7fbf9c162a60 2024-05-14T01:23:44.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbfa11fa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbf9c15e910 con 0x7fbf9c15e530 2024-05-14T01:23:44.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf9b59e640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbf9c0b3590 0x7fbf9c071fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57336/0 (socket says 172.21.15.154:57336) 2024-05-14T01:23:44.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf9b59e640 1 -- 172.21.15.154:0/1394966635 learned_addr learned my addr 172.21.15.154:0/1394966635 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:44.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf9ad9d640 1 --2- 172.21.15.154:0/1394966635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf9c15e530 0x7fbf9c0d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf99d9b640 1 -- 172.21.15.154:0/1394966635 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 397146933 0 0) 0x7fbf9c0726c0 con 0x7fbf9c0b3590 2024-05-14T01:23:44.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf99d9b640 1 -- 172.21.15.154:0/1394966635 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf84003530 con 0x7fbf9c0b3590 2024-05-14T01:23:44.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf99d9b640 1 -- 172.21.15.154:0/1394966635 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2952076365 0 0) 0x7fbf84003530 con 0x7fbf9c0b3590 2024-05-14T01:23:44.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf99d9b640 1 -- 172.21.15.154:0/1394966635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf9c15e530 msgr2=0x7fbf9c0d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:44.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf99d9b640 1 --2- 172.21.15.154:0/1394966635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf9c15e530 0x7fbf9c0d0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf99d9b640 1 -- 172.21.15.154:0/1394966635 >> v1:172.21.15.176:6789/0 conn(0x7fbf9c162a60 legacy=0x7fbf9c0718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf99d9b640 1 -- 172.21.15.154:0/1394966635 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9c0cec20 con 0x7fbf9c0b3590 2024-05-14T01:23:44.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf99d9b640 1 -- 172.21.15.154:0/1394966635 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fbf94001a00 con 0x7fbf9c0b3590 2024-05-14T01:23:44.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf99d9b640 1 -- 172.21.15.154:0/1394966635 >> v1:172.21.15.154:6789/0 conn(0x7fbf9c0b3590 legacy=0x7fbf9c071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf99d9b640 1 --2- 172.21.15.154:0/1394966635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf9c15e530 0x7fbf840039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf99d9b640 1 --2- 172.21.15.154:0/1394966635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf84003f30 0x7fbf84004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf99d9b640 1 --2- 172.21.15.154:0/1394966635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf84004d50 0x7fbf840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf99d9b640 1 -- 172.21.15.154:0/1394966635 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c15e910 con 0x7fbf84003f30 2024-05-14T01:23:44.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf99d9b640 1 -- 172.21.15.154:0/1394966635 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8400ba30 con 0x7fbf84004d50 2024-05-14T01:23:44.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf99d9b640 1 -- 172.21.15.154:0/1394966635 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbf8400bc30 con 0x7fbf9c15e530 2024-05-14T01:23:44.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf9a59c640 1 --2- 172.21.15.154:0/1394966635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf84003f30 0x7fbf84004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf9ad9d640 1 --2- 172.21.15.154:0/1394966635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf9c15e530 0x7fbf840039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf9b59e640 1 --2- 172.21.15.154:0/1394966635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf84004d50 0x7fbf840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf9a59c640 1 -- 172.21.15.154:0/1394966635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf9c15e530 msgr2=0x7fbf840039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:44.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf9a59c640 1 --2- 172.21.15.154:0/1394966635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf9c15e530 0x7fbf840039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf9a59c640 1 -- 172.21.15.154:0/1394966635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf84004d50 msgr2=0x7fbf840051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:44.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf9a59c640 1 --2- 172.21.15.154:0/1394966635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf84004d50 0x7fbf840051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.854+0000 7fbf9a59c640 1 -- 172.21.15.154:0/1394966635 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf84003530 con 0x7fbf84003f30 2024-05-14T01:23:44.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.858+0000 7fbf9a59c640 1 --2- 172.21.15.154:0/1394966635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf84003f30 0x7fbf84004810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbf90001860 tx=0x7fbf9001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b761dc201935d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:44.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.858+0000 7fbf99d9b640 1 -- 172.21.15.154:0/1394966635 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf900b0070 con 0x7fbf84003f30 2024-05-14T01:23:44.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.858+0000 7fbf99d9b640 1 -- 172.21.15.154:0/1394966635 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf900ab600 con 0x7fbf84003f30 2024-05-14T01:23:44.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.858+0000 7fbf99d9b640 1 -- 172.21.15.154:0/1394966635 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90001460 con 0x7fbf84003f30 2024-05-14T01:23:44.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.858+0000 7fbfa11fa640 1 -- 172.21.15.154:0/1394966635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf84003f30 msgr2=0x7fbf84004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.858+0000 7fbfa11fa640 1 --2- 172.21.15.154:0/1394966635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf84003f30 0x7fbf84004810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbf90001860 tx=0x7fbf9001c440 comp rx=0 tx=0).stop 2024-05-14T01:23:44.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.858+0000 7fbf9b59e640 1 -- 172.21.15.154:0/1394966635 reap_dead start 2024-05-14T01:23:44.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.858+0000 7fbfa11fa640 1 -- 172.21.15.154:0/1394966635 shutdown_connections 2024-05-14T01:23:44.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.858+0000 7fbfa11fa640 1 -- 172.21.15.154:0/1394966635 >> 172.21.15.154:0/1394966635 conn(0x7fbf9c0b5b80 msgr2=0x7fbf9c0b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:44.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.858+0000 7fbfa11fa640 1 -- 172.21.15.154:0/1394966635 shutdown_connections 2024-05-14T01:23:44.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.858+0000 7fbfa11fa640 1 -- 172.21.15.154:0/1394966635 wait complete. 2024-05-14T01:23:44.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.858+0000 7fbfa11fa640 1 Processor -- start 2024-05-14T01:23:44.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.858+0000 7fbfa11fa640 1 -- start start 2024-05-14T01:23:44.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.858+0000 7fbfa11fa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf84003f30 0x7fbf9c161630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbfa11fa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf9c0ca030 0x7fbf9c1533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbfa11fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf9c0b4de0 0x7fbf9c0b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbfa11fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c0cf9e0 con 0x7fbf9c0b4de0 2024-05-14T01:23:44.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbfa11fa640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c0b2d10 con 0x7fbf84003f30 2024-05-14T01:23:44.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbfa11fa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbf9c0cfb60 con 0x7fbf9c0ca030 2024-05-14T01:23:44.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf9b59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf9c0b4de0 0x7fbf9c0b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf9b59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf9c0b4de0 0x7fbf9c0b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46616/0 (socket says 172.21.15.154:46616) 2024-05-14T01:23:44.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf9b59e640 1 -- 172.21.15.154:0/336863704 learned_addr learned my addr 172.21.15.154:0/336863704 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:44.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf9ad9d640 1 --2- 172.21.15.154:0/336863704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf84003f30 0x7fbf9c161630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf9a59c640 1 --2- 172.21.15.154:0/336863704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf9c0ca030 0x7fbf9c1533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf9b59e640 1 -- 172.21.15.154:0/336863704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf9c0ca030 msgr2=0x7fbf9c1533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf9b59e640 1 --2- 172.21.15.154:0/336863704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf9c0ca030 0x7fbf9c1533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf9b59e640 1 -- 172.21.15.154:0/336863704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf84003f30 msgr2=0x7fbf9c161630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:44.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf9b59e640 1 --2- 172.21.15.154:0/336863704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf84003f30 0x7fbf9c161630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:44.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf9b59e640 1 -- 172.21.15.154:0/336863704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9c0ca840 con 0x7fbf9c0b4de0 2024-05-14T01:23:44.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf9b59e640 1 --2- 172.21.15.154:0/336863704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf9c0b4de0 0x7fbf9c0b5260 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c072900 tx=0x7fbf9400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:44.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf837fe640 1 -- 172.21.15.154:0/336863704 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9400ec10 con 0x7fbf9c0b4de0 2024-05-14T01:23:44.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf837fe640 1 -- 172.21.15.154:0/336863704 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf94018070 con 0x7fbf9c0b4de0 2024-05-14T01:23:44.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbfa11fa640 1 -- 172.21.15.154:0/336863704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf9c0cab20 con 0x7fbf9c0b4de0 2024-05-14T01:23:44.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf837fe640 1 -- 172.21.15.154:0/336863704 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf94013420 con 0x7fbf9c0b4de0 2024-05-14T01:23:44.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbfa11fa640 1 -- 172.21.15.154:0/336863704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf9c15ef50 con 0x7fbf9c0b4de0 2024-05-14T01:23:44.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbfa11fa640 1 -- 172.21.15.154:0/336863704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf9c075470 con 0x7fbf9c0b4de0 2024-05-14T01:23:44.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf837fe640 1 -- 172.21.15.154:0/336863704 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbf940135c0 con 0x7fbf9c0b4de0 2024-05-14T01:23:44.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf837fe640 1 --2- 172.21.15.154:0/336863704 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fbf880678c0 0x7fbf88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:44.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf837fe640 1 -- 172.21.15.154:0/336863704 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbf94085fe0 con 0x7fbf9c0b4de0 2024-05-14T01:23:44.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf9ad9d640 1 --2- 172.21.15.154:0/336863704 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fbf880678c0 0x7fbf88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:44.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.862+0000 7fbf9ad9d640 1 --2- 172.21.15.154:0/336863704 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fbf880678c0 0x7fbf88069d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c009a30 tx=0x7fbf8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:44.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:44.866+0000 7fbf837fe640 1 -- 172.21.15.154:0/336863704 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fbf94056bb0 con 0x7fbf9c0b4de0 2024-05-14T01:23:45.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.026+0000 7fbfa11fa640 1 -- 172.21.15.154:0/336863704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbf9c0b9b30 con 0x7fbf9c0b4de0 2024-05-14T01:23:45.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.026+0000 7fbf837fe640 1 -- 172.21.15.154:0/336863704 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fbf940564b0 con 0x7fbf9c0b4de0 2024-05-14T01:23:45.011 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-05-14T01:23:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.030+0000 7fbfa11fa640 1 -- 172.21.15.154:0/336863704 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fbf880678c0 msgr2=0x7fbf88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.030+0000 7fbfa11fa640 1 --2- 172.21.15.154:0/336863704 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fbf880678c0 0x7fbf88069d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c009a30 tx=0x7fbf8c008040 comp rx=0 tx=0).stop 2024-05-14T01:23:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.030+0000 7fbfa11fa640 1 -- 172.21.15.154:0/336863704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf9c0b4de0 msgr2=0x7fbf9c0b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.030+0000 7fbfa11fa640 1 --2- 172.21.15.154:0/336863704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf9c0b4de0 0x7fbf9c0b5260 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c072900 tx=0x7fbf9400e530 comp rx=0 tx=0).stop 2024-05-14T01:23:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.030+0000 7fbfa11fa640 1 -- 172.21.15.154:0/336863704 shutdown_connections 2024-05-14T01:23:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.030+0000 7fbfa11fa640 1 --2- 172.21.15.154:0/336863704 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fbf880678c0 0x7fbf88069d80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.030+0000 7fbfa11fa640 1 --2- 172.21.15.154:0/336863704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf9c0b4de0 0x7fbf9c0b5260 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.030+0000 7fbfa11fa640 1 --2- 172.21.15.154:0/336863704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf9c0ca030 0x7fbf9c1533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.030+0000 7fbfa11fa640 1 --2- 172.21.15.154:0/336863704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf84003f30 0x7fbf9c161630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.030+0000 7fbfa11fa640 1 -- 172.21.15.154:0/336863704 >> 172.21.15.154:0/336863704 conn(0x7fbf9c0b5b80 msgr2=0x7fbf9c0b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.030+0000 7fbfa11fa640 1 -- 172.21.15.154:0/336863704 shutdown_connections 2024-05-14T01:23:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.030+0000 7fbfa11fa640 1 -- 172.21.15.154:0/336863704 wait complete. 2024-05-14T01:23:45.030 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T01:23:45.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.170+0000 7fa3df149640 1 Processor -- start 2024-05-14T01:23:45.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.170+0000 7fa3df149640 1 -- start start 2024-05-14T01:23:45.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.170+0000 7fa3df149640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa3d80ced50 0x7fa3d80cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:45.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.170+0000 7fa3df149640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa3d80cd160 0x7fa3d80cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:45.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.170+0000 7fa3df149640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3d80cdcb0 con 0x7fa3d8071ef0 2024-05-14T01:23:45.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.170+0000 7fa3df149640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d80ce8c0 con 0x7fa3d80ced50 2024-05-14T01:23:45.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.170+0000 7fa3df149640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d80cdf90 con 0x7fa3d80cd160 2024-05-14T01:23:45.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.170+0000 7fa3cffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa3d80ced50 0x7fa3d80cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:45.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.170+0000 7fa3dcee5640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa3d8071ef0 0x7fa3d80722d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57352/0 (socket says 172.21.15.154:57352) 2024-05-14T01:23:45.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.170+0000 7fa3dcee5640 1 -- 172.21.15.154:0/2904904574 learned_addr learned my addr 172.21.15.154:0/2904904574 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:45.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.170+0000 7fa3dd6e6640 1 --2- 172.21.15.154:0/2904904574 >> v2:172.21.15.176:3300/0 conn(0x7fa3d80cd160 0x7fa3d80cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:45.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.170+0000 7fa3cffff640 1 -- 172.21.15.154:0/2904904574 >> v2:172.21.15.176:3300/0 conn(0x7fa3d80cd160 msgr2=0x7fa3d80cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:45.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.170+0000 7fa3cffff640 1 --2- 172.21.15.154:0/2904904574 >> v2:172.21.15.176:3300/0 conn(0x7fa3d80cd160 0x7fa3d80cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.170+0000 7fa3cffff640 1 -- 172.21.15.154:0/2904904574 >> v1:172.21.15.154:6789/0 conn(0x7fa3d8071ef0 legacy=0x7fa3d80722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.170+0000 7fa3cffff640 1 -- 172.21.15.154:0/2904904574 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d80ce270 con 0x7fa3d80ced50 2024-05-14T01:23:45.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.170+0000 7fa3cf7fe640 1 -- 172.21.15.154:0/2904904574 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76440329 0 0) 0x7fa3d80cdcb0 con 0x7fa3d8071ef0 2024-05-14T01:23:45.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.170+0000 7fa3dd6e6640 1 --2- 172.21.15.154:0/2904904574 >> v2:172.21.15.176:3300/0 conn(0x7fa3d80cd160 0x7fa3d80cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:23:45.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3cffff640 1 --2- 172.21.15.154:0/2904904574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3d80ced50 0x7fa3d80cf1b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80732c0 tx=0x7fa3c801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c404c2831ca691 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:45.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3cf7fe640 1 -- 172.21.15.154:0/2904904574 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80ab430 con 0x7fa3d80ced50 2024-05-14T01:23:45.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3cf7fe640 1 -- 172.21.15.154:0/2904904574 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c80b0070 con 0x7fa3d80ced50 2024-05-14T01:23:45.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3cf7fe640 1 -- 172.21.15.154:0/2904904574 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80ab7f0 con 0x7fa3d80ced50 2024-05-14T01:23:45.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3df149640 1 -- 172.21.15.154:0/2904904574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3d80ced50 msgr2=0x7fa3d80cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3df149640 1 --2- 172.21.15.154:0/2904904574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3d80ced50 0x7fa3d80cf1b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80732c0 tx=0x7fa3c801c450 comp rx=0 tx=0).stop 2024-05-14T01:23:45.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3df149640 1 -- 172.21.15.154:0/2904904574 shutdown_connections 2024-05-14T01:23:45.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3df149640 1 --2- 172.21.15.154:0/2904904574 >> v2:172.21.15.176:3300/0 conn(0x7fa3d80cd160 0x7fa3d80cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3df149640 1 --2- 172.21.15.154:0/2904904574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3d80ced50 0x7fa3d80cf1b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3df149640 1 -- 172.21.15.154:0/2904904574 >> 172.21.15.154:0/2904904574 conn(0x7fa3d80b1770 msgr2=0x7fa3d80b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:45.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3df149640 1 -- 172.21.15.154:0/2904904574 shutdown_connections 2024-05-14T01:23:45.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3df149640 1 -- 172.21.15.154:0/2904904574 wait complete. 2024-05-14T01:23:45.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3df149640 1 Processor -- start 2024-05-14T01:23:45.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3df149640 1 -- start start 2024-05-14T01:23:45.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3df149640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3d8071ef0 0x7fa3d814ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:45.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3df149640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3d80cd160 0x7fa3d80c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:45.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3df149640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3d80ced50 0x7fa3d80c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:45.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3df149640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d8167b40 con 0x7fa3d8071ef0 2024-05-14T01:23:45.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3df149640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d81679c0 con 0x7fa3d80cd160 2024-05-14T01:23:45.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3df149640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d8167cc0 con 0x7fa3d80ced50 2024-05-14T01:23:45.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3dcee5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3d8071ef0 0x7fa3d814ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:45.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3dcee5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3d8071ef0 0x7fa3d814ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46630/0 (socket says 172.21.15.154:46630) 2024-05-14T01:23:45.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3dcee5640 1 -- 172.21.15.154:0/2094901838 learned_addr learned my addr 172.21.15.154:0/2094901838 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:45.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3cffff640 1 --2- 172.21.15.154:0/2094901838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3d80cd160 0x7fa3d80c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:45.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3dd6e6640 1 --2- 172.21.15.154:0/2094901838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3d80ced50 0x7fa3d80c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:45.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3dcee5640 1 -- 172.21.15.154:0/2094901838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3d80ced50 msgr2=0x7fa3d80c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3dcee5640 1 --2- 172.21.15.154:0/2094901838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3d80ced50 0x7fa3d80c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3dcee5640 1 -- 172.21.15.154:0/2094901838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3d80cd160 msgr2=0x7fa3d80c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3dcee5640 1 --2- 172.21.15.154:0/2094901838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3d80cd160 0x7fa3d80c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3dcee5640 1 -- 172.21.15.154:0/2094901838 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d813e280 con 0x7fa3d8071ef0 2024-05-14T01:23:45.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3dd6e6640 1 --2- 172.21.15.154:0/2094901838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3d80ced50 0x7fa3d80c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:45.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3dcee5640 1 --2- 172.21.15.154:0/2094901838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3d8071ef0 0x7fa3d814ba30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40011f0 tx=0x7fa3d400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:45.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3cd7fa640 1 -- 172.21.15.154:0/2094901838 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4018070 con 0x7fa3d8071ef0 2024-05-14T01:23:45.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3cd7fa640 1 -- 172.21.15.154:0/2094901838 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d40074e0 con 0x7fa3d8071ef0 2024-05-14T01:23:45.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3df149640 1 -- 172.21.15.154:0/2094901838 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d813e520 con 0x7fa3d8071ef0 2024-05-14T01:23:45.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3cd7fa640 1 -- 172.21.15.154:0/2094901838 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4004a10 con 0x7fa3d8071ef0 2024-05-14T01:23:45.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.174+0000 7fa3df149640 1 -- 172.21.15.154:0/2094901838 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d813eae0 con 0x7fa3d8071ef0 2024-05-14T01:23:45.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.178+0000 7fa3df149640 1 -- 172.21.15.154:0/2094901838 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d813f1a0 con 0x7fa3d8071ef0 2024-05-14T01:23:45.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.178+0000 7fa3cd7fa640 1 -- 172.21.15.154:0/2094901838 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3d401b070 con 0x7fa3d8071ef0 2024-05-14T01:23:45.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.178+0000 7fa3cd7fa640 1 --2- 172.21.15.154:0/2094901838 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa3c40678f0 0x7fa3c4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:45.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.178+0000 7fa3cd7fa640 1 -- 172.21.15.154:0/2094901838 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa3d4084f60 con 0x7fa3d8071ef0 2024-05-14T01:23:45.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.178+0000 7fa3cffff640 1 --2- 172.21.15.154:0/2094901838 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa3c40678f0 0x7fa3c4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:45.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.178+0000 7fa3cffff640 1 --2- 172.21.15.154:0/2094901838 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa3c40678f0 0x7fa3c4069db0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80af000 tx=0x7fa3c80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:45.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.182+0000 7fa3cd7fa640 1 -- 172.21.15.154:0/2094901838 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fa3d813f1a0 con 0x7fa3d8071ef0 2024-05-14T01:23:45.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.330+0000 7fa3df149640 1 -- 172.21.15.154:0/2094901838 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa3d8075470 con 0x7fa3d8071ef0 2024-05-14T01:23:45.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.330+0000 7fa3cd7fa640 1 -- 172.21.15.154:0/2094901838 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fa3d4055aa0 con 0x7fa3d8071ef0 2024-05-14T01:23:45.315 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-05-14T01:23:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.334+0000 7fa3df149640 1 -- 172.21.15.154:0/2094901838 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa3c40678f0 msgr2=0x7fa3c4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.334+0000 7fa3df149640 1 --2- 172.21.15.154:0/2094901838 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa3c40678f0 0x7fa3c4069db0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80af000 tx=0x7fa3c80a7000 comp rx=0 tx=0).stop 2024-05-14T01:23:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.334+0000 7fa3df149640 1 -- 172.21.15.154:0/2094901838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3d8071ef0 msgr2=0x7fa3d814ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.334+0000 7fa3df149640 1 --2- 172.21.15.154:0/2094901838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3d8071ef0 0x7fa3d814ba30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40011f0 tx=0x7fa3d400c9b0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.334+0000 7fa3df149640 1 -- 172.21.15.154:0/2094901838 shutdown_connections 2024-05-14T01:23:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.334+0000 7fa3df149640 1 --2- 172.21.15.154:0/2094901838 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa3c40678f0 0x7fa3c4069db0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.334+0000 7fa3df149640 1 --2- 172.21.15.154:0/2094901838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3d80ced50 0x7fa3d80c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.334+0000 7fa3df149640 1 --2- 172.21.15.154:0/2094901838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3d80cd160 0x7fa3d80c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.334+0000 7fa3df149640 1 --2- 172.21.15.154:0/2094901838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3d8071ef0 0x7fa3d814ba30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.334+0000 7fa3df149640 1 -- 172.21.15.154:0/2094901838 >> 172.21.15.154:0/2094901838 conn(0x7fa3d80b1770 msgr2=0x7fa3d80b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.334+0000 7fa3df149640 1 -- 172.21.15.154:0/2094901838 shutdown_connections 2024-05-14T01:23:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.334+0000 7fa3df149640 1 -- 172.21.15.154:0/2094901838 wait complete. 2024-05-14T01:23:45.333 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T01:23:45.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.466+0000 7f1476fa1640 1 Processor -- start 2024-05-14T01:23:45.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.466+0000 7f1476fa1640 1 -- start start 2024-05-14T01:23:45.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f1476fa1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f147015c310 0x7f14700d1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:45.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f1476fa1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14700d08e0 0x7f14700d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:45.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f1476fa1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14700b30b0 con 0x7f147015bf30 2024-05-14T01:23:45.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f1476fa1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f14700b3390 con 0x7f147015c310 2024-05-14T01:23:45.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f1476fa1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f14700b3670 con 0x7f14700d08e0 2024-05-14T01:23:45.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f1474d3d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f147015bf30 0x7f14700b27b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57362/0 (socket says 172.21.15.154:57362) 2024-05-14T01:23:45.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f1474d3d640 1 -- 172.21.15.154:0/718493 learned_addr learned my addr 172.21.15.154:0/718493 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:45.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f146ffff640 1 --2- 172.21.15.154:0/718493 >> v2:172.21.15.154:3300/0 conn(0x7f147015c310 0x7f14700d1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:45.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f147553e640 1 --2- 172.21.15.154:0/718493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14700d08e0 0x7f14700d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:45.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f146f7fe640 1 -- 172.21.15.154:0/718493 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2022183802 0 0) 0x7f14700b30b0 con 0x7f147015bf30 2024-05-14T01:23:45.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f146f7fe640 1 -- 172.21.15.154:0/718493 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1458003530 con 0x7f147015bf30 2024-05-14T01:23:45.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f146ffff640 1 -- 172.21.15.154:0/718493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14700d08e0 msgr2=0x7f14700d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:45.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f146ffff640 1 --2- 172.21.15.154:0/718493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14700d08e0 0x7f14700d21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f146ffff640 1 -- 172.21.15.154:0/718493 >> v1:172.21.15.154:6789/0 conn(0x7f147015bf30 legacy=0x7f14700b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f146ffff640 1 -- 172.21.15.154:0/718493 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14700aec10 con 0x7f147015c310 2024-05-14T01:23:45.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f146ffff640 1 --2- 172.21.15.154:0/718493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147015c310 0x7f14700d1c90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f14640097c0 tx=0x7f146401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91749f28b92a1bf3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:45.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f146f7fe640 1 -- 172.21.15.154:0/718493 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14640b5070 con 0x7f147015c310 2024-05-14T01:23:45.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f146f7fe640 1 -- 172.21.15.154:0/718493 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14640a8990 con 0x7f147015c310 2024-05-14T01:23:45.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.470+0000 7f146f7fe640 1 -- 172.21.15.154:0/718493 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14640a8d60 con 0x7f147015c310 2024-05-14T01:23:45.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1476fa1640 1 -- 172.21.15.154:0/718493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147015c310 msgr2=0x7f14700d1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1476fa1640 1 --2- 172.21.15.154:0/718493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147015c310 0x7f14700d1c90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f14640097c0 tx=0x7f146401ec90 comp rx=0 tx=0).stop 2024-05-14T01:23:45.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1476fa1640 1 -- 172.21.15.154:0/718493 shutdown_connections 2024-05-14T01:23:45.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1476fa1640 1 --2- 172.21.15.154:0/718493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14700d08e0 0x7f14700d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1476fa1640 1 --2- 172.21.15.154:0/718493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147015c310 0x7f14700d1c90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1476fa1640 1 -- 172.21.15.154:0/718493 >> 172.21.15.154:0/718493 conn(0x7f147009aa10 msgr2=0x7f147009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:45.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1476fa1640 1 -- 172.21.15.154:0/718493 shutdown_connections 2024-05-14T01:23:45.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1476fa1640 1 -- 172.21.15.154:0/718493 wait complete. 2024-05-14T01:23:45.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1476fa1640 1 Processor -- start 2024-05-14T01:23:45.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1476fa1640 1 -- start start 2024-05-14T01:23:45.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1476fa1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14700d08e0 0x7f14700b6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:45.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1476fa1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147015bf30 0x7f14701500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1476fa1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147015c310 0x7f14700b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1476fa1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f14700af7a0 con 0x7f147015bf30 2024-05-14T01:23:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1476fa1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f14700af620 con 0x7f147015c310 2024-05-14T01:23:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1476fa1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f14700af920 con 0x7f14700d08e0 2024-05-14T01:23:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f146ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147015bf30 0x7f14701500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f146ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147015bf30 0x7f14701500e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46648/0 (socket says 172.21.15.154:46648) 2024-05-14T01:23:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f146ffff640 1 -- 172.21.15.154:0/3342097374 learned_addr learned my addr 172.21.15.154:0/3342097374 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1474d3d640 1 --2- 172.21.15.154:0/3342097374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14700d08e0 0x7f14700b6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f147553e640 1 --2- 172.21.15.154:0/3342097374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147015c310 0x7f14700b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f146ffff640 1 -- 172.21.15.154:0/3342097374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14700d08e0 msgr2=0x7f14700b6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f146ffff640 1 --2- 172.21.15.154:0/3342097374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14700d08e0 0x7f14700b6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f146ffff640 1 -- 172.21.15.154:0/3342097374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147015c310 msgr2=0x7f14700b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f146ffff640 1 --2- 172.21.15.154:0/3342097374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147015c310 0x7f14700b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f146ffff640 1 -- 172.21.15.154:0/3342097374 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147015ab10 con 0x7f147015bf30 2024-05-14T01:23:45.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f146ffff640 1 --2- 172.21.15.154:0/3342097374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147015bf30 0x7f14701500e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f14640b3040 tx=0x7f146401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:45.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f146d7fa640 1 -- 172.21.15.154:0/3342097374 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14640bf070 con 0x7f147015bf30 2024-05-14T01:23:45.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f146d7fa640 1 -- 172.21.15.154:0/3342097374 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14640b0660 con 0x7f147015bf30 2024-05-14T01:23:45.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1476fa1640 1 -- 172.21.15.154:0/3342097374 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14700b52e0 con 0x7f147015bf30 2024-05-14T01:23:45.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f146d7fa640 1 -- 172.21.15.154:0/3342097374 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14640b5040 con 0x7f147015bf30 2024-05-14T01:23:45.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.474+0000 7f1476fa1640 1 -- 172.21.15.154:0/3342097374 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14700b58a0 con 0x7f147015bf30 2024-05-14T01:23:45.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.478+0000 7f1476fa1640 1 -- 172.21.15.154:0/3342097374 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1470068360 con 0x7f147015bf30 2024-05-14T01:23:45.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.478+0000 7f146d7fa640 1 -- 172.21.15.154:0/3342097374 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f14640c2070 con 0x7f147015bf30 2024-05-14T01:23:45.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.478+0000 7f146d7fa640 1 --2- 172.21.15.154:0/3342097374 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f145c0678f0 0x7f145c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:45.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.478+0000 7f1474d3d640 1 --2- 172.21.15.154:0/3342097374 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f145c0678f0 0x7f145c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:45.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.478+0000 7f146d7fa640 1 -- 172.21.15.154:0/3342097374 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1464122360 con 0x7f147015bf30 2024-05-14T01:23:45.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.478+0000 7f1474d3d640 1 --2- 172.21.15.154:0/3342097374 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f145c0678f0 0x7f145c069db0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1460005890 tx=0x7f1460009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:45.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.482+0000 7f146d7fa640 1 -- 172.21.15.154:0/3342097374 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f14640187f0 con 0x7f147015bf30 2024-05-14T01:23:45.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.678+0000 7f1476fa1640 1 -- 172.21.15.154:0/3342097374 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14700b7d40 con 0x7f147015bf30 2024-05-14T01:23:45.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.682+0000 7f146d7fa640 1 -- 172.21.15.154:0/3342097374 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f14640f2d70 con 0x7f147015bf30 2024-05-14T01:23:45.665 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:45.666 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2575586302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2575586302},{"type":"v1","addr":"172.21.15.154:6836","nonce":2575586302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3108110937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3108110937},{"type":"v1","addr":"172.21.15.154:6837","nonce":3108110937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/77727941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":77727941},{"type":"v1","addr":"172.21.15.176:6833","nonce":77727941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T01:23:34.570674+0000","modified":"2024-05-14T01:23:37.636442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6835/2614790445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2614790445},{"type":"v1","addr":"172.21.15.176:6835","nonce":2614790445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-14T01:23:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 8 2024-05-14T01:23:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.682+0000 7f1476fa1640 1 -- 172.21.15.154:0/3342097374 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f145c0678f0 msgr2=0x7f145c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.682+0000 7f1476fa1640 1 --2- 172.21.15.154:0/3342097374 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f145c0678f0 0x7f145c069db0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1460005890 tx=0x7f1460009040 comp rx=0 tx=0).stop 2024-05-14T01:23:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.682+0000 7f1476fa1640 1 -- 172.21.15.154:0/3342097374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147015bf30 msgr2=0x7f14701500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.682+0000 7f1476fa1640 1 --2- 172.21.15.154:0/3342097374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147015bf30 0x7f14701500e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f14640b3040 tx=0x7f146401ba30 comp rx=0 tx=0).stop 2024-05-14T01:23:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.682+0000 7f1476fa1640 1 -- 172.21.15.154:0/3342097374 shutdown_connections 2024-05-14T01:23:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.682+0000 7f1476fa1640 1 --2- 172.21.15.154:0/3342097374 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f145c0678f0 0x7f145c069db0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.682+0000 7f1476fa1640 1 --2- 172.21.15.154:0/3342097374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147015c310 0x7f14700b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.682+0000 7f1476fa1640 1 --2- 172.21.15.154:0/3342097374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147015bf30 0x7f14701500e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.682+0000 7f1476fa1640 1 --2- 172.21.15.154:0/3342097374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14700d08e0 0x7f14700b6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.682+0000 7f1476fa1640 1 -- 172.21.15.154:0/3342097374 >> 172.21.15.154:0/3342097374 conn(0x7f147009aa10 msgr2=0x7f14700b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.682+0000 7f1476fa1640 1 -- 172.21.15.154:0/3342097374 shutdown_connections 2024-05-14T01:23:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.682+0000 7f1476fa1640 1 -- 172.21.15.154:0/3342097374 wait complete. 2024-05-14T01:23:45.684 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:23:45.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.826+0000 7f2eccb49640 1 Processor -- start 2024-05-14T01:23:45.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.826+0000 7f2eccb49640 1 -- start start 2024-05-14T01:23:45.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.826+0000 7f2eccb49640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ec8141d00 0x7f2ec80ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:45.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.826+0000 7f2eccb49640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2ec80ce880 0x7f2ec806d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:45.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.826+0000 7f2eccb49640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec80cf100 con 0x7f2ec813ede0 2024-05-14T01:23:45.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.826+0000 7f2eccb49640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2ec806cff0 con 0x7f2ec8141d00 2024-05-14T01:23:45.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.826+0000 7f2eccb49640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2ec80cf3e0 con 0x7f2ec80ce880 2024-05-14T01:23:45.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.826+0000 7f2ec659c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2ec813ede0 0x7f2ec81415f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57378/0 (socket says 172.21.15.154:57378) 2024-05-14T01:23:45.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.826+0000 7f2ec659c640 1 -- 172.21.15.154:0/3410501293 learned_addr learned my addr 172.21.15.154:0/3410501293 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:45.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.826+0000 7f2ec5d9b640 1 --2- 172.21.15.154:0/3410501293 >> v2:172.21.15.154:3300/0 conn(0x7f2ec8141d00 0x7f2ec80ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:45.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.826+0000 7f2ec559a640 1 -- 172.21.15.154:0/3410501293 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 530213306 0 0) 0x7f2ec80cf100 con 0x7f2ec813ede0 2024-05-14T01:23:45.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.826+0000 7f2ec6d9d640 1 --2- 172.21.15.154:0/3410501293 >> v2:172.21.15.176:3300/0 conn(0x7f2ec80ce880 0x7f2ec806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:45.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.826+0000 7f2ec559a640 1 -- 172.21.15.154:0/3410501293 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2eb0003530 con 0x7f2ec813ede0 2024-05-14T01:23:45.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.826+0000 7f2ec559a640 1 -- 172.21.15.154:0/3410501293 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3841859968 0 0) 0x7f2eb0003530 con 0x7f2ec813ede0 2024-05-14T01:23:45.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.826+0000 7f2ec5d9b640 1 -- 172.21.15.154:0/3410501293 >> v2:172.21.15.176:3300/0 conn(0x7f2ec80ce880 msgr2=0x7f2ec806d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:45.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.826+0000 7f2ec5d9b640 1 --2- 172.21.15.154:0/3410501293 >> v2:172.21.15.176:3300/0 conn(0x7f2ec80ce880 0x7f2ec806d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.826+0000 7f2ec5d9b640 1 -- 172.21.15.154:0/3410501293 >> v1:172.21.15.154:6789/0 conn(0x7f2ec813ede0 legacy=0x7f2ec81415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.826+0000 7f2ec5d9b640 1 -- 172.21.15.154:0/3410501293 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec806cc80 con 0x7f2ec8141d00 2024-05-14T01:23:45.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.830+0000 7f2ec5d9b640 1 --2- 172.21.15.154:0/3410501293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ec8141d00 0x7f2ec80ce340 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0097c0 tx=0x7f2ebc01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06aecb4b60b8bd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:45.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.830+0000 7f2ec559a640 1 -- 172.21.15.154:0/3410501293 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0b0070 con 0x7f2ec8141d00 2024-05-14T01:23:45.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.830+0000 7f2ec559a640 1 -- 172.21.15.154:0/3410501293 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ebc0ab400 con 0x7f2ec8141d00 2024-05-14T01:23:45.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.830+0000 7f2ec559a640 1 -- 172.21.15.154:0/3410501293 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8001680 con 0x7f2ec8141d00 2024-05-14T01:23:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.830+0000 7f2eccb49640 1 -- 172.21.15.154:0/3410501293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ec8141d00 msgr2=0x7f2ec80ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.830+0000 7f2eccb49640 1 --2- 172.21.15.154:0/3410501293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ec8141d00 0x7f2ec80ce340 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0097c0 tx=0x7f2ebc01c340 comp rx=0 tx=0).stop 2024-05-14T01:23:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.830+0000 7f2eccb49640 1 -- 172.21.15.154:0/3410501293 shutdown_connections 2024-05-14T01:23:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.830+0000 7f2eccb49640 1 --2- 172.21.15.154:0/3410501293 >> v2:172.21.15.176:3300/0 conn(0x7f2ec80ce880 0x7f2ec806d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.830+0000 7f2eccb49640 1 --2- 172.21.15.154:0/3410501293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ec8141d00 0x7f2ec80ce340 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.830+0000 7f2eccb49640 1 -- 172.21.15.154:0/3410501293 >> 172.21.15.154:0/3410501293 conn(0x7f2ec80b1850 msgr2=0x7f2ec80b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.830+0000 7f2eccb49640 1 -- 172.21.15.154:0/3410501293 shutdown_connections 2024-05-14T01:23:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.830+0000 7f2eccb49640 1 -- 172.21.15.154:0/3410501293 wait complete. 2024-05-14T01:23:45.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.830+0000 7f2eccb49640 1 Processor -- start 2024-05-14T01:23:45.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.830+0000 7f2eccb49640 1 -- start start 2024-05-14T01:23:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2eccb49640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ec80ce880 0x7f2ec813b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2eccb49640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ec813ede0 0x7f2ec813abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2eccb49640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ec8141d00 0x7f2ec8142f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2eccb49640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec806e1d0 con 0x7f2ec8141d00 2024-05-14T01:23:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2eccb49640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec80ceea0 con 0x7f2ec80ce880 2024-05-14T01:23:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2eccb49640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec806e350 con 0x7f2ec813ede0 2024-05-14T01:23:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2ec6d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ec8141d00 0x7f2ec8142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2ec6d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ec8141d00 0x7f2ec8142f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46656/0 (socket says 172.21.15.154:46656) 2024-05-14T01:23:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2ec6d9d640 1 -- 172.21.15.154:0/1788063135 learned_addr learned my addr 172.21.15.154:0/1788063135 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2ec6d9d640 1 -- 172.21.15.154:0/1788063135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ec813ede0 msgr2=0x7f2ec813abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2ec6d9d640 1 --2- 172.21.15.154:0/1788063135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ec813ede0 0x7f2ec813abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2ec6d9d640 1 -- 172.21.15.154:0/1788063135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ec80ce880 msgr2=0x7f2ec813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2ec6d9d640 1 --2- 172.21.15.154:0/1788063135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ec80ce880 0x7f2ec813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2ec6d9d640 1 -- 172.21.15.154:0/1788063135 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec813b9e0 con 0x7f2ec8141d00 2024-05-14T01:23:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2ec6d9d640 1 --2- 172.21.15.154:0/1788063135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ec8141d00 0x7f2ec8142f00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009dd0 tx=0x7f2ec000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:45.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2eb6ffd640 1 -- 172.21.15.154:0/1788063135 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0018020 con 0x7f2ec8141d00 2024-05-14T01:23:45.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2eb6ffd640 1 -- 172.21.15.154:0/1788063135 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec0014480 con 0x7f2ec8141d00 2024-05-14T01:23:45.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2eb6ffd640 1 -- 172.21.15.154:0/1788063135 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0014870 con 0x7f2ec8141d00 2024-05-14T01:23:45.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2eccb49640 1 -- 172.21.15.154:0/1788063135 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec8164150 con 0x7f2ec8141d00 2024-05-14T01:23:45.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2eccb49640 1 -- 172.21.15.154:0/1788063135 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec8164710 con 0x7f2ec8141d00 2024-05-14T01:23:45.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2eccb49640 1 -- 172.21.15.154:0/1788063135 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec8075470 con 0x7f2ec8141d00 2024-05-14T01:23:45.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2eb6ffd640 1 -- 172.21.15.154:0/1788063135 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ec001b020 con 0x7f2ec8141d00 2024-05-14T01:23:45.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2eb6ffd640 1 --2- 172.21.15.154:0/1788063135 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2ea80678c0 0x7f2ea8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:45.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2eb6ffd640 1 -- 172.21.15.154:0/1788063135 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2ec00866b0 con 0x7f2ec8141d00 2024-05-14T01:23:45.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2ec659c640 1 --2- 172.21.15.154:0/1788063135 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2ea80678c0 0x7f2ea8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:45.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.834+0000 7f2ec659c640 1 --2- 172.21.15.154:0/1788063135 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2ea80678c0 0x7f2ea8069d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8001ec0 tx=0x7f2eb8001a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:45.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.838+0000 7f2eb6ffd640 1 -- 172.21.15.154:0/1788063135 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f2ec0022070 con 0x7f2ec8141d00 2024-05-14T01:23:45.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.994+0000 7f2eccb49640 1 -- 172.21.15.154:0/1788063135 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ec8153310 con 0x7f2ec8141d00 2024-05-14T01:23:45.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.994+0000 7f2eb6ffd640 1 -- 172.21.15.154:0/1788063135 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f2ec813b9e0 con 0x7f2ec8141d00 2024-05-14T01:23:45.979 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:45.980 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:36.232271+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.998+0000 7f2eccb49640 1 -- 172.21.15.154:0/1788063135 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2ea80678c0 msgr2=0x7f2ea8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.998+0000 7f2eccb49640 1 --2- 172.21.15.154:0/1788063135 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2ea80678c0 0x7f2ea8069d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8001ec0 tx=0x7f2eb8001a50 comp rx=0 tx=0).stop 2024-05-14T01:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.998+0000 7f2eccb49640 1 -- 172.21.15.154:0/1788063135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ec8141d00 msgr2=0x7f2ec8142f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.998+0000 7f2eccb49640 1 --2- 172.21.15.154:0/1788063135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ec8141d00 0x7f2ec8142f00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009dd0 tx=0x7f2ec000c490 comp rx=0 tx=0).stop 2024-05-14T01:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.998+0000 7f2eccb49640 1 -- 172.21.15.154:0/1788063135 shutdown_connections 2024-05-14T01:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.998+0000 7f2eccb49640 1 --2- 172.21.15.154:0/1788063135 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2ea80678c0 0x7f2ea8069d80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.998+0000 7f2eccb49640 1 --2- 172.21.15.154:0/1788063135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ec8141d00 0x7f2ec8142f00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.998+0000 7f2eccb49640 1 --2- 172.21.15.154:0/1788063135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ec813ede0 0x7f2ec813abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.998+0000 7f2eccb49640 1 --2- 172.21.15.154:0/1788063135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ec80ce880 0x7f2ec813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:45.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.998+0000 7f2eccb49640 1 -- 172.21.15.154:0/1788063135 >> 172.21.15.154:0/1788063135 conn(0x7f2ec80b1850 msgr2=0x7f2ec815c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:45.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.998+0000 7f2eccb49640 1 -- 172.21.15.154:0/1788063135 shutdown_connections 2024-05-14T01:23:45.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:45.998+0000 7f2eccb49640 1 -- 172.21.15.154:0/1788063135 wait complete. 2024-05-14T01:23:45.999 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T01:23:46.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.126+0000 7f7d919e6640 1 Processor -- start 2024-05-14T01:23:46.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.126+0000 7f7d919e6640 1 -- start start 2024-05-14T01:23:46.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.130+0000 7f7d919e6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7d8c1513c0 0x7f7d8c0cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.130+0000 7f7d919e6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8c06d470 0x7f7d8c06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.130+0000 7f7d919e6640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d8c0b2ec0 con 0x7f7d8c15e040 2024-05-14T01:23:46.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.130+0000 7f7d919e6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7d8c0cf9d0 con 0x7f7d8c1513c0 2024-05-14T01:23:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.130+0000 7f7d919e6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8c06de10 con 0x7f7d8c06d470 2024-05-14T01:23:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.130+0000 7f7d8affd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7d8c1513c0 0x7f7d8c0cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.130+0000 7f7d8affd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7d8c1513c0 0x7f7d8c0cf490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46666/0 (socket says 172.21.15.154:46666) 2024-05-14T01:23:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.130+0000 7f7d8affd640 1 -- 172.21.15.154:0/3722647293 learned_addr learned my addr 172.21.15.154:0/3722647293 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.130+0000 7f7d8a7fc640 1 --2- 172.21.15.154:0/3722647293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8c06d470 0x7f7d8c06d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.130+0000 7f7d8affd640 1 -- 172.21.15.154:0/3722647293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8c06d470 msgr2=0x7f7d8c06d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.130+0000 7f7d8affd640 1 --2- 172.21.15.154:0/3722647293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8c06d470 0x7f7d8c06d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.130+0000 7f7d8affd640 1 -- 172.21.15.154:0/3722647293 >> v1:172.21.15.176:6789/0 conn(0x7f7d8c15e040 legacy=0x7f7d8c15e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.130+0000 7f7d8affd640 1 -- 172.21.15.154:0/3722647293 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c0b31a0 con 0x7f7d8c1513c0 2024-05-14T01:23:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.130+0000 7f7d8a7fc640 1 --2- 172.21.15.154:0/3722647293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8c06d470 0x7f7d8c06d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:46.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.130+0000 7f7d8affd640 1 --2- 172.21.15.154:0/3722647293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c1513c0 0x7f7d8c0cf490 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009e80 tx=0x7f7d8401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c0bc95963acfe1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:46.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.130+0000 7f7d89ffb640 1 -- 172.21.15.154:0/3722647293 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d840a5740 con 0x7f7d8c1513c0 2024-05-14T01:23:46.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.130+0000 7f7d89ffb640 1 -- 172.21.15.154:0/3722647293 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d840a58e0 con 0x7f7d8c1513c0 2024-05-14T01:23:46.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.130+0000 7f7d89ffb640 1 -- 172.21.15.154:0/3722647293 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d840a5cb0 con 0x7f7d8c1513c0 2024-05-14T01:23:46.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 -- 172.21.15.154:0/3722647293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c1513c0 msgr2=0x7f7d8c0cf490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:46.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 --2- 172.21.15.154:0/3722647293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c1513c0 0x7f7d8c0cf490 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009e80 tx=0x7f7d8401c9d0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 -- 172.21.15.154:0/3722647293 shutdown_connections 2024-05-14T01:23:46.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 --2- 172.21.15.154:0/3722647293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8c06d470 0x7f7d8c06d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 --2- 172.21.15.154:0/3722647293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c1513c0 0x7f7d8c0cf490 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 -- 172.21.15.154:0/3722647293 >> 172.21.15.154:0/3722647293 conn(0x7f7d8c0b1850 msgr2=0x7f7d8c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:46.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 -- 172.21.15.154:0/3722647293 shutdown_connections 2024-05-14T01:23:46.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 -- 172.21.15.154:0/3722647293 wait complete. 2024-05-14T01:23:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 Processor -- start 2024-05-14T01:23:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 -- start start 2024-05-14T01:23:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c06d470 0x7f7d8c147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d8c1513c0 0x7f7d8c156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8c15e040 0x7f7d8c155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c06e810 con 0x7f7d8c06d470 2024-05-14T01:23:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c0b2b50 con 0x7f7d8c1513c0 2024-05-14T01:23:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8c06e990 con 0x7f7d8c15e040 2024-05-14T01:23:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d8affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c06d470 0x7f7d8c147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d8affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c06d470 0x7f7d8c147620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46674/0 (socket says 172.21.15.154:46674) 2024-05-14T01:23:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d8affd640 1 -- 172.21.15.154:0/4105244479 learned_addr learned my addr 172.21.15.154:0/4105244479 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d8a7fc640 1 --2- 172.21.15.154:0/4105244479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d8c1513c0 0x7f7d8c156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d8affd640 1 -- 172.21.15.154:0/4105244479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8c15e040 msgr2=0x7f7d8c155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d8affd640 1 --2- 172.21.15.154:0/4105244479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8c15e040 0x7f7d8c155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d8affd640 1 -- 172.21.15.154:0/4105244479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d8c1513c0 msgr2=0x7f7d8c156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d8affd640 1 --2- 172.21.15.154:0/4105244479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d8c1513c0 0x7f7d8c156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d8affd640 1 -- 172.21.15.154:0/4105244479 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c1557f0 con 0x7f7d8c06d470 2024-05-14T01:23:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d8a7fc640 1 --2- 172.21.15.154:0/4105244479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d8c1513c0 0x7f7d8c156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d8affd640 1 --2- 172.21.15.154:0/4105244479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c06d470 0x7f7d8c147620 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7d840af040 tx=0x7f7d84019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d83fff640 1 -- 172.21.15.154:0/4105244479 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d840b8670 con 0x7f7d8c06d470 2024-05-14T01:23:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d83fff640 1 -- 172.21.15.154:0/4105244479 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d840be070 con 0x7f7d8c06d470 2024-05-14T01:23:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 -- 172.21.15.154:0/4105244479 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d8c155ad0 con 0x7f7d8c06d470 2024-05-14T01:23:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d83fff640 1 -- 172.21.15.154:0/4105244479 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d840b8a50 con 0x7f7d8c06d470 2024-05-14T01:23:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 -- 172.21.15.154:0/4105244479 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d8c156090 con 0x7f7d8c06d470 2024-05-14T01:23:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.134+0000 7f7d919e6640 1 -- 172.21.15.154:0/4105244479 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d8c075470 con 0x7f7d8c06d470 2024-05-14T01:23:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.138+0000 7f7d83fff640 1 -- 172.21.15.154:0/4105244479 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7d840b8bf0 con 0x7f7d8c06d470 2024-05-14T01:23:46.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.138+0000 7f7d83fff640 1 --2- 172.21.15.154:0/4105244479 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7d6c0678c0 0x7f7d6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.138+0000 7f7d83fff640 1 -- 172.21.15.154:0/4105244479 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7d84120e50 con 0x7f7d8c06d470 2024-05-14T01:23:46.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.138+0000 7f7d8a7fc640 1 --2- 172.21.15.154:0/4105244479 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7d6c0678c0 0x7f7d6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.138+0000 7f7d8a7fc640 1 --2- 172.21.15.154:0/4105244479 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7d6c0678c0 0x7f7d6c069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0cf0f0 tx=0x7f7d74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:46.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.142+0000 7f7d83fff640 1 -- 172.21.15.154:0/4105244479 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f7d840165c0 con 0x7f7d8c06d470 2024-05-14T01:23:46.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.330+0000 7f7d919e6640 1 -- 172.21.15.154:0/4105244479 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d8c06e3d0 con 0x7f7d8c06d470 2024-05-14T01:23:46.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.334+0000 7f7d83fff640 1 -- 172.21.15.154:0/4105244479 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f7d840f1990 con 0x7f7d8c06d470 2024-05-14T01:23:46.317 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:46.317 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2575586302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2575586302},{"type":"v1","addr":"172.21.15.154:6836","nonce":2575586302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3108110937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3108110937},{"type":"v1","addr":"172.21.15.154:6837","nonce":3108110937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/77727941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":77727941},{"type":"v1","addr":"172.21.15.176:6833","nonce":77727941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T01:23:34.570674+0000","modified":"2024-05-14T01:23:37.636442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6835/2614790445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2614790445},{"type":"v1","addr":"172.21.15.176:6835","nonce":2614790445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-14T01:23:46.317 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 8 2024-05-14T01:23:46.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.334+0000 7f7d919e6640 1 -- 172.21.15.154:0/4105244479 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7d6c0678c0 msgr2=0x7f7d6c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:46.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.334+0000 7f7d919e6640 1 --2- 172.21.15.154:0/4105244479 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7d6c0678c0 0x7f7d6c069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0cf0f0 tx=0x7f7d74008040 comp rx=0 tx=0).stop 2024-05-14T01:23:46.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.334+0000 7f7d919e6640 1 -- 172.21.15.154:0/4105244479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c06d470 msgr2=0x7f7d8c147620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:46.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.334+0000 7f7d919e6640 1 --2- 172.21.15.154:0/4105244479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c06d470 0x7f7d8c147620 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7d840af040 tx=0x7f7d84019770 comp rx=0 tx=0).stop 2024-05-14T01:23:46.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.334+0000 7f7d919e6640 1 -- 172.21.15.154:0/4105244479 shutdown_connections 2024-05-14T01:23:46.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.334+0000 7f7d919e6640 1 --2- 172.21.15.154:0/4105244479 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7d6c0678c0 0x7f7d6c069d80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.334+0000 7f7d919e6640 1 --2- 172.21.15.154:0/4105244479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8c15e040 0x7f7d8c155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.334+0000 7f7d919e6640 1 --2- 172.21.15.154:0/4105244479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d8c1513c0 0x7f7d8c156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.334+0000 7f7d919e6640 1 --2- 172.21.15.154:0/4105244479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c06d470 0x7f7d8c147620 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.334+0000 7f7d919e6640 1 -- 172.21.15.154:0/4105244479 >> 172.21.15.154:0/4105244479 conn(0x7f7d8c0b1850 msgr2=0x7f7d8c0b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:46.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.334+0000 7f7d919e6640 1 -- 172.21.15.154:0/4105244479 shutdown_connections 2024-05-14T01:23:46.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.334+0000 7f7d919e6640 1 -- 172.21.15.154:0/4105244479 wait complete. 2024-05-14T01:23:46.738 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-14T01:23:34.570674+0000', 'modified': '2024-05-14T01:23:37.636442+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.176:6835/2614790445', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6834', 'nonce': 2614790445}, {'type': 'v1', 'addr': '172.21.15.176:6835', 'nonce': 2614790445}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4267, 'qdb_cluster': [4267]} 2024-05-14T01:23:46.738 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-14T01:23:46.739 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-14T01:23:46.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda2c36c640 1 Processor -- start 2024-05-14T01:23:46.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda2c36c640 1 -- start start 2024-05-14T01:23:46.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda2c36c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fda2406c9a0 0x7fda2415be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda2c36c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda240b5780 0x7fda2406ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda2c36c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda240b3ec0 con 0x7fda2415abf0 2024-05-14T01:23:46.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda2c36c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fda240b3c70 con 0x7fda2406c9a0 2024-05-14T01:23:46.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda2c36c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fda2415c3c0 con 0x7fda240b5780 2024-05-14T01:23:46.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda2a108640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fda2415abf0 0x7fda2406c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57386/0 (socket says 172.21.15.154:57386) 2024-05-14T01:23:46.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda2a108640 1 -- 172.21.15.154:0/581815110 learned_addr learned my addr 172.21.15.154:0/581815110 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:46.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda2a909640 1 --2- 172.21.15.154:0/581815110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda240b5780 0x7fda2406ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29907640 1 --2- 172.21.15.154:0/581815110 >> v2:172.21.15.176:3300/0 conn(0x7fda2406c9a0 0x7fda2415be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29106640 1 -- 172.21.15.154:0/581815110 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 925426313 0 0) 0x7fda240b3ec0 con 0x7fda2415abf0 2024-05-14T01:23:46.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29106640 1 -- 172.21.15.154:0/581815110 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda10003530 con 0x7fda2415abf0 2024-05-14T01:23:46.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29106640 1 -- 172.21.15.154:0/581815110 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3107273300 0 0) 0x7fda10003530 con 0x7fda2415abf0 2024-05-14T01:23:46.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29106640 1 -- 172.21.15.154:0/581815110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda240b5780 msgr2=0x7fda2406ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:46.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29106640 1 --2- 172.21.15.154:0/581815110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda240b5780 0x7fda2406ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29106640 1 -- 172.21.15.154:0/581815110 >> v2:172.21.15.176:3300/0 conn(0x7fda2406c9a0 msgr2=0x7fda2415be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:46.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29106640 1 --2- 172.21.15.154:0/581815110 >> v2:172.21.15.176:3300/0 conn(0x7fda2406c9a0 0x7fda2415be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29106640 1 -- 172.21.15.154:0/581815110 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda240b41a0 con 0x7fda2415abf0 2024-05-14T01:23:46.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29106640 1 -- 172.21.15.154:0/581815110 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fda20001680 con 0x7fda2415abf0 2024-05-14T01:23:46.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29106640 1 -- 172.21.15.154:0/581815110 >> v1:172.21.15.154:6789/0 conn(0x7fda2415abf0 legacy=0x7fda2406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:46.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29106640 1 --2- 172.21.15.154:0/581815110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda100039c0 0x7fda10003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29106640 1 --2- 172.21.15.154:0/581815110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda240b5780 0x7fda10004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29106640 1 --2- 172.21.15.154:0/581815110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda10004d50 0x7fda100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29106640 1 -- 172.21.15.154:0/581815110 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fda240b3c70 con 0x7fda10004d50 2024-05-14T01:23:46.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29106640 1 -- 172.21.15.154:0/581815110 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fda2415c3c0 con 0x7fda100039c0 2024-05-14T01:23:46.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29106640 1 -- 172.21.15.154:0/581815110 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fda1000dbe0 con 0x7fda240b5780 2024-05-14T01:23:46.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda2a909640 1 --2- 172.21.15.154:0/581815110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda10004d50 0x7fda100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29907640 1 --2- 172.21.15.154:0/581815110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda240b5780 0x7fda10004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda2a909640 1 -- 172.21.15.154:0/581815110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda240b5780 msgr2=0x7fda10004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:46.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda2a909640 1 --2- 172.21.15.154:0/581815110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda240b5780 0x7fda10004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda2a909640 1 -- 172.21.15.154:0/581815110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda100039c0 msgr2=0x7fda10003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:46.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda2a909640 1 --2- 172.21.15.154:0/581815110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda100039c0 0x7fda10003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda2a909640 1 -- 172.21.15.154:0/581815110 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda10003530 con 0x7fda10004d50 2024-05-14T01:23:46.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.890+0000 7fda29907640 1 --2- 172.21.15.154:0/581815110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda240b5780 0x7fda10004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:23:46.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.894+0000 7fda2a909640 1 --2- 172.21.15.154:0/581815110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda10004d50 0x7fda100051d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009f90 tx=0x7fda1c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe577085c3deefc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:46.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.894+0000 7fda29106640 1 -- 172.21.15.154:0/581815110 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0b2070 con 0x7fda10004d50 2024-05-14T01:23:46.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.894+0000 7fda29106640 1 -- 172.21.15.154:0/581815110 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda1c0a5c50 con 0x7fda10004d50 2024-05-14T01:23:46.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.894+0000 7fda29106640 1 -- 172.21.15.154:0/581815110 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c009c10 con 0x7fda10004d50 2024-05-14T01:23:46.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.894+0000 7fda2c36c640 1 -- 172.21.15.154:0/581815110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda10004d50 msgr2=0x7fda100051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:46.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.894+0000 7fda2c36c640 1 --2- 172.21.15.154:0/581815110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda10004d50 0x7fda100051d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009f90 tx=0x7fda1c01cc40 comp rx=0 tx=0).stop 2024-05-14T01:23:46.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.894+0000 7fda2a909640 1 -- 172.21.15.154:0/581815110 reap_dead start 2024-05-14T01:23:46.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.894+0000 7fda2c36c640 1 -- 172.21.15.154:0/581815110 shutdown_connections 2024-05-14T01:23:46.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.894+0000 7fda2c36c640 1 -- 172.21.15.154:0/581815110 >> 172.21.15.154:0/581815110 conn(0x7fda24071fc0 msgr2=0x7fda240723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:46.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.894+0000 7fda2c36c640 1 -- 172.21.15.154:0/581815110 shutdown_connections 2024-05-14T01:23:46.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.894+0000 7fda2c36c640 1 -- 172.21.15.154:0/581815110 wait complete. 2024-05-14T01:23:46.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2c36c640 1 Processor -- start 2024-05-14T01:23:46.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2c36c640 1 -- start start 2024-05-14T01:23:46.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2c36c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda10004d50 0x7fda2414a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2c36c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda240cd6d0 0x7fda2415ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2c36c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda2415d670 0x7fda240ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2c36c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fda240b4a40 con 0x7fda2415d670 2024-05-14T01:23:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2c36c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fda240b4760 con 0x7fda10004d50 2024-05-14T01:23:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2c36c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fda2415afd0 con 0x7fda240cd6d0 2024-05-14T01:23:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2a909640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda2415d670 0x7fda240ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2a909640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda2415d670 0x7fda240ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46698/0 (socket says 172.21.15.154:46698) 2024-05-14T01:23:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2a909640 1 -- 172.21.15.154:0/2299985461 learned_addr learned my addr 172.21.15.154:0/2299985461 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2a108640 1 --2- 172.21.15.154:0/2299985461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda10004d50 0x7fda2414a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2a909640 1 -- 172.21.15.154:0/2299985461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda240cd6d0 msgr2=0x7fda2415ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda29907640 1 --2- 172.21.15.154:0/2299985461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda240cd6d0 0x7fda2415ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2a909640 1 --2- 172.21.15.154:0/2299985461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda240cd6d0 0x7fda2415ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2a909640 1 -- 172.21.15.154:0/2299985461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda10004d50 msgr2=0x7fda2414a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2a909640 1 --2- 172.21.15.154:0/2299985461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda10004d50 0x7fda2414a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2a909640 1 -- 172.21.15.154:0/2299985461 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2415dc30 con 0x7fda2415d670 2024-05-14T01:23:46.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2a108640 1 --2- 172.21.15.154:0/2299985461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda10004d50 0x7fda2414a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:46.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2a909640 1 --2- 172.21.15.154:0/2299985461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda2415d670 0x7fda240ce050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0b0040 tx=0x7fda1c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:46.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda1affd640 1 -- 172.21.15.154:0/2299985461 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0bd070 con 0x7fda2415d670 2024-05-14T01:23:46.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda1affd640 1 -- 172.21.15.154:0/2299985461 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda1c0a5a50 con 0x7fda2415d670 2024-05-14T01:23:46.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2c36c640 1 -- 172.21.15.154:0/2299985461 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda2415df10 con 0x7fda2415d670 2024-05-14T01:23:46.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda1affd640 1 -- 172.21.15.154:0/2299985461 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0b2040 con 0x7fda2415d670 2024-05-14T01:23:46.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2c36c640 1 -- 172.21.15.154:0/2299985461 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda2415e4d0 con 0x7fda2415d670 2024-05-14T01:23:46.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda1affd640 1 -- 172.21.15.154:0/2299985461 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fda1c0c0070 con 0x7fda2415d670 2024-05-14T01:23:46.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda1affd640 1 --2- 172.21.15.154:0/2299985461 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fda080678f0 0x7fda08069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda1affd640 1 -- 172.21.15.154:0/2299985461 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fda1c11f9a0 con 0x7fda2415d670 2024-05-14T01:23:46.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.898+0000 7fda2a108640 1 --2- 172.21.15.154:0/2299985461 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fda080678f0 0x7fda08069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2a108640 1 --2- 172.21.15.154:0/2299985461 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fda080678f0 0x7fda08069db0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fda20001ec0 tx=0x7fda20009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:46.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 Processor -- start 2024-05-14T01:23:46.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 -- start start 2024-05-14T01:23:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc3e3370 0x5652cc3e3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc3e3c90 0x5652cc396e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc397340 0x5652cc397720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5652cc1e6c20 con 0x5652cc3e3c90 2024-05-14T01:23:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5652cc183a80 con 0x5652cc397340 2024-05-14T01:23:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5652cc1e2be0 con 0x5652cc3e3370 2024-05-14T01:23:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda29907640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc3e3c90 0x5652cc396e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda29907640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc3e3c90 0x5652cc396e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46702/0 (socket says 172.21.15.154:46702) 2024-05-14T01:23:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda29907640 1 -- 172.21.15.154:0/3162579761 learned_addr learned my addr 172.21.15.154:0/3162579761 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2a108640 1 --2- 172.21.15.154:0/3162579761 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc3e3370 0x5652cc3e3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2a909640 1 --2- 172.21.15.154:0/3162579761 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc397340 0x5652cc397720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda29907640 1 -- 172.21.15.154:0/3162579761 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc3e3370 msgr2=0x5652cc3e3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda29907640 1 --2- 172.21.15.154:0/3162579761 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc3e3370 0x5652cc3e3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda29907640 1 -- 172.21.15.154:0/3162579761 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc397340 msgr2=0x5652cc397720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda29907640 1 --2- 172.21.15.154:0/3162579761 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc397340 0x5652cc397720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda29907640 1 -- 172.21.15.154:0/3162579761 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652cc16db20 con 0x5652cc3e3c90 2024-05-14T01:23:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda29907640 1 --2- 172.21.15.154:0/3162579761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc3e3c90 0x5652cc396e00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fda14009a90 tx=0x7fda14009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e710890fc0ee4c21 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda07fff640 1 -- 172.21.15.154:0/3162579761 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1401a070 con 0x5652cc3e3c90 2024-05-14T01:23:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda07fff640 1 -- 172.21.15.154:0/3162579761 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda14012e40 con 0x5652cc3e3c90 2024-05-14T01:23:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda07fff640 1 -- 172.21.15.154:0/3162579761 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14015650 con 0x5652cc3e3c90 2024-05-14T01:23:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3162579761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc3e3c90 msgr2=0x5652cc396e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/3162579761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc3e3c90 0x5652cc396e00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fda14009a90 tx=0x7fda14009190 comp rx=0 tx=0).stop 2024-05-14T01:23:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3162579761 shutdown_connections 2024-05-14T01:23:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/3162579761 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc397340 0x5652cc397720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/3162579761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc3e3c90 0x5652cc396e00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/3162579761 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc3e3370 0x5652cc3e3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3162579761 >> 172.21.15.154:0/3162579761 conn(0x5652cc280df0 msgr2=0x5652cc3c6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3162579761 shutdown_connections 2024-05-14T01:23:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3162579761 wait complete. 2024-05-14T01:23:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 -- start start 2024-05-14T01:23:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.902+0000 7fda2f4e6000 1 Processor -- start 2024-05-14T01:23:46.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2f4e6000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc397340 0x5652cc39efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2f4e6000 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc3e3370 0x5652cc39f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2f4e6000 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc3e3c90 0x5652cc3c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2f4e6000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5652cc1a4000 con 0x5652cc397340 2024-05-14T01:23:46.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2f4e6000 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5652cc1a9a70 con 0x5652cc3e3c90 2024-05-14T01:23:46.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2f4e6000 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5652cc29a2b0 con 0x5652cc3e3370 2024-05-14T01:23:46.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2f4e6000 10 client.0 _ll_register_callbacks cb 0x5652cc384aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T01:23:46.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2a108640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc397340 0x5652cc39efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2a108640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc397340 0x5652cc39efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46716/0 (socket says 172.21.15.154:46716) 2024-05-14T01:23:46.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2a108640 1 -- 172.21.15.154:0/3793928298 learned_addr learned my addr 172.21.15.154:0/3793928298 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:46.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda29907640 1 --2- 172.21.15.154:0/3793928298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc3e3370 0x5652cc39f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2a909640 1 --2- 172.21.15.154:0/3793928298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc3e3c90 0x5652cc3c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2a108640 1 -- 172.21.15.154:0/3793928298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc3e3370 msgr2=0x5652cc39f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:46.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2a108640 1 --2- 172.21.15.154:0/3793928298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc3e3370 0x5652cc39f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2a108640 1 -- 172.21.15.154:0/3793928298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc3e3c90 msgr2=0x5652cc3c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:46.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2a108640 1 --2- 172.21.15.154:0/3793928298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc3e3c90 0x5652cc3c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2a108640 1 -- 172.21.15.154:0/3793928298 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652cc16ee80 con 0x5652cc397340 2024-05-14T01:23:46.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda29907640 1 --2- 172.21.15.154:0/3793928298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc3e3370 0x5652cc39f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:46.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2a108640 1 --2- 172.21.15.154:0/3793928298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc397340 0x5652cc39efc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fda20005de0 tx=0x7fda20010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457d278ca16ba1fd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:46.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda057fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-14T01:23:46.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda057fa640 1 -- 172.21.15.154:0/3793928298 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20026060 con 0x5652cc397340 2024-05-14T01:23:46.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3793928298 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda14012e40 con 0x5652cc397340 2024-05-14T01:23:46.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda057fa640 1 -- 172.21.15.154:0/3793928298 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fda20021a90 con 0x5652cc397340 2024-05-14T01:23:46.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda057fa640 1 -- 172.21.15.154:0/3793928298 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fda20021c90 con 0x5652cc397340 2024-05-14T01:23:46.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2f4e6000 10 client.4599 fetch_fsmap learned FSMap version 8 2024-05-14T01:23:46.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3793928298 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5652cc1b3760 con 0x5652cc397340 2024-05-14T01:23:46.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda057fa640 1 -- 172.21.15.154:0/3793928298 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda14012e40 con 0x5652cc397340 2024-05-14T01:23:46.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda057fa640 1 -- 172.21.15.154:0/3793928298 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7fda20012620 con 0x5652cc397340 2024-05-14T01:23:46.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2f4e6000 10 client.4599 fetch_fsmap finished waiting for FSMap version 8 2024-05-14T01:23:46.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2f4e6000 10 client.4599 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T01:23:46.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2f4e6000 20 client.4599 populate_metadata read hostname 'smithi154' 2024-05-14T01:23:46.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/3793928298 >> [v2:172.21.15.176:6834/2614790445,v1:172.21.15.176:6835/2614790445] conn(0x5652cc3c8fc0 0x5652cc3f5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2f4e6000 4 client.4599 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T01:23:46.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3793928298 --> [v2:172.21.15.176:6834/2614790445,v1:172.21.15.176:6835/2614790445] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652cc181ab0 con 0x5652cc3c8fc0 2024-05-14T01:23:46.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda29907640 1 --2- 172.21.15.154:0/3793928298 >> [v2:172.21.15.176:6834/2614790445,v1:172.21.15.176:6835/2614790445] conn(0x5652cc3c8fc0 0x5652cc3f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda29907640 1 --2- 172.21.15.154:0/3793928298 >> [v2:172.21.15.176:6834/2614790445,v1:172.21.15.176:6835/2614790445] conn(0x5652cc3c8fc0 0x5652cc3f5630 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b94747770878b1 server_cookie=e71dd31f11ad6ec in_seq=0 out_seq=0 2024-05-14T01:23:46.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.906+0000 7fda057fa640 10 client.4599 ms_handle_connect on v2:172.21.15.176:6834/2614790445 2024-05-14T01:23:46.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.910+0000 7fda057fa640 1 -- 172.21.15.154:0/3793928298 <== mds.0 v2:172.21.15.176:6834/2614790445 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5652cc181ab0 con 0x5652cc3c8fc0 2024-05-14T01:23:46.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.910+0000 7fda057fa640 10 client.4599 handle_command_reply: tid=0 2024-05-14T01:23:46.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.910+0000 7fda2f4e6000 1 client.4599 shutdown 2024-05-14T01:23:46.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.910+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3793928298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc397340 msgr2=0x5652cc39efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:46.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.910+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/3793928298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc397340 0x5652cc39efc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fda20005de0 tx=0x7fda20010000 comp rx=0 tx=0).stop 2024-05-14T01:23:46.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.910+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3793928298 shutdown_connections 2024-05-14T01:23:46.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.910+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/3793928298 >> [v2:172.21.15.176:6834/2614790445,v1:172.21.15.176:6835/2614790445] conn(0x5652cc3c8fc0 0x5652cc3f5630 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.910+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/3793928298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc3e3c90 0x5652cc3c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.910+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/3793928298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc3e3370 0x5652cc39f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.910+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/3793928298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc397340 0x5652cc39efc0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.910+0000 7fda057fa640 0 client.4599 ms_handle_reset on v2:172.21.15.176:6834/2614790445 2024-05-14T01:23:46.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.910+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3793928298 >> 172.21.15.154:0/3793928298 conn(0x5652cc280df0 msgr2=0x5652cc396500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:46.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.910+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3793928298 shutdown_connections 2024-05-14T01:23:46.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.910+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3793928298 wait complete. 2024-05-14T01:23:46.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.910+0000 7fda2f4e6000 20 client.4599 trim_cache size 0 max 16384 2024-05-14T01:23:46.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2f4e6000 1 Processor -- start 2024-05-14T01:23:46.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2f4e6000 1 -- start start 2024-05-14T01:23:46.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2f4e6000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc397340 0x5652cc3f07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2f4e6000 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc3e3370 0x5652cc3f0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2f4e6000 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc3e3c90 0x5652cc3e1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2f4e6000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fda241ffa90 con 0x5652cc397340 2024-05-14T01:23:46.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2f4e6000 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fda2415d1a0 con 0x5652cc3e3370 2024-05-14T01:23:46.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2f4e6000 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fda241ff440 con 0x5652cc3e3c90 2024-05-14T01:23:46.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2a108640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc397340 0x5652cc3f07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2a108640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc397340 0x5652cc3f07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46724/0 (socket says 172.21.15.154:46724) 2024-05-14T01:23:46.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2a108640 1 -- 172.21.15.154:0/1564072628 learned_addr learned my addr 172.21.15.154:0/1564072628 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:46.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda29907640 1 --2- 172.21.15.154:0/1564072628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc3e3370 0x5652cc3f0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2a108640 1 -- 172.21.15.154:0/1564072628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc3e3c90 msgr2=0x5652cc3e1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:46.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2a108640 1 --2- 172.21.15.154:0/1564072628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc3e3c90 0x5652cc3e1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2a108640 1 -- 172.21.15.154:0/1564072628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc3e3370 msgr2=0x5652cc3f0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:46.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2a108640 1 --2- 172.21.15.154:0/1564072628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc3e3370 0x5652cc3f0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2a108640 1 -- 172.21.15.154:0/1564072628 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652cc23fd10 con 0x5652cc397340 2024-05-14T01:23:46.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2a108640 1 --2- 172.21.15.154:0/1564072628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc397340 0x5652cc3f07e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda20001060 tx=0x7fda20012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7004599b9b1e3498 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:46.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda077fe640 1 -- 172.21.15.154:0/1564072628 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20012620 con 0x5652cc397340 2024-05-14T01:23:46.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda077fe640 1 -- 172.21.15.154:0/1564072628 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda20012b70 con 0x5652cc397340 2024-05-14T01:23:46.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda077fe640 1 -- 172.21.15.154:0/1564072628 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20012d20 con 0x5652cc397340 2024-05-14T01:23:46.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2f4e6000 1 -- 172.21.15.154:0/1564072628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc397340 msgr2=0x5652cc3f07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:46.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/1564072628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc397340 0x5652cc3f07e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda20001060 tx=0x7fda20012000 comp rx=0 tx=0).stop 2024-05-14T01:23:46.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2f4e6000 1 -- 172.21.15.154:0/1564072628 shutdown_connections 2024-05-14T01:23:46.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/1564072628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc3e3c90 0x5652cc3e1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/1564072628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc3e3370 0x5652cc3f0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/1564072628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc397340 0x5652cc3f07e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2f4e6000 1 -- 172.21.15.154:0/1564072628 >> 172.21.15.154:0/1564072628 conn(0x5652cc280df0 msgr2=0x5652cc3f00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:46.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.926+0000 7fda2f4e6000 1 -- 172.21.15.154:0/1564072628 shutdown_connections 2024-05-14T01:23:46.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 -- 172.21.15.154:0/1564072628 wait complete. 2024-05-14T01:23:46.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 -- start start 2024-05-14T01:23:46.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 Processor -- start 2024-05-14T01:23:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc397340 0x5652cc3f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc3e3370 0x5652cc455600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc3e3c90 0x5652cc457b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5652cc1e3bb0 con 0x5652cc3e3c90 2024-05-14T01:23:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5652cc188f90 con 0x5652cc3e3370 2024-05-14T01:23:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5652cc1a2170 con 0x5652cc397340 2024-05-14T01:23:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 10 client.0 _ll_register_callbacks cb 0x7fda2000d9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T01:23:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2a909640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc3e3c90 0x5652cc457b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2a909640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc3e3c90 0x5652cc457b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46740/0 (socket says 172.21.15.154:46740) 2024-05-14T01:23:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2a909640 1 -- 172.21.15.154:0/3136011450 learned_addr learned my addr 172.21.15.154:0/3136011450 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2a108640 1 --2- 172.21.15.154:0/3136011450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc397340 0x5652cc3f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2a909640 1 -- 172.21.15.154:0/3136011450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc397340 msgr2=0x5652cc3f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2a909640 1 --2- 172.21.15.154:0/3136011450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc397340 0x5652cc3f8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2a909640 1 -- 172.21.15.154:0/3136011450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc3e3370 msgr2=0x5652cc455600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda29907640 1 --2- 172.21.15.154:0/3136011450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc3e3370 0x5652cc455600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2a909640 1 --2- 172.21.15.154:0/3136011450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc3e3370 0x5652cc455600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2a909640 1 -- 172.21.15.154:0/3136011450 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652cc175b60 con 0x5652cc3e3c90 2024-05-14T01:23:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2a108640 1 --2- 172.21.15.154:0/3136011450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc397340 0x5652cc3f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2a909640 1 --2- 172.21.15.154:0/3136011450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc3e3c90 0x5652cc457b50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fda1c01d120 tx=0x7fda1c0a5890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbc8885085e543b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda057fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-14T01:23:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda057fa640 1 -- 172.21.15.154:0/3136011450 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0f4100 con 0x5652cc3e3c90 2024-05-14T01:23:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda057fa640 1 -- 172.21.15.154:0/3136011450 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fda1c10e2e0 con 0x5652cc3e3c90 2024-05-14T01:23:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3136011450 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda20012b70 con 0x5652cc3e3c90 2024-05-14T01:23:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda057fa640 1 -- 172.21.15.154:0/3136011450 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fda1c0f89c0 con 0x5652cc3e3c90 2024-05-14T01:23:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 10 client.4605 fetch_fsmap learned FSMap version 8 2024-05-14T01:23:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3136011450 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5652cc18ced0 con 0x5652cc3e3c90 2024-05-14T01:23:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda057fa640 1 -- 172.21.15.154:0/3136011450 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda20012b70 con 0x5652cc3e3c90 2024-05-14T01:23:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda057fa640 1 -- 172.21.15.154:0/3136011450 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7fda1c11f040 con 0x5652cc3e3c90 2024-05-14T01:23:46.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 10 client.4605 fetch_fsmap finished waiting for FSMap version 8 2024-05-14T01:23:46.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 10 client.4605 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T01:23:46.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 20 client.4605 populate_metadata read hostname 'smithi154' 2024-05-14T01:23:46.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/3136011450 >> [v2:172.21.15.176:6834/2614790445,v1:172.21.15.176:6835/2614790445] conn(0x5652cc4582a0 0x5652cc45a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:46.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 4 client.4605 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T01:23:46.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3136011450 --> [v2:172.21.15.176:6834/2614790445,v1:172.21.15.176:6835/2614790445] -- command(tid 0: {"prefix": "status"}) -- 0x5652cc1f4350 con 0x5652cc4582a0 2024-05-14T01:23:46.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2a108640 1 --2- 172.21.15.154:0/3136011450 >> [v2:172.21.15.176:6834/2614790445,v1:172.21.15.176:6835/2614790445] conn(0x5652cc4582a0 0x5652cc45a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:46.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda057fa640 10 client.4605 ms_handle_connect on v2:172.21.15.176:6834/2614790445 2024-05-14T01:23:46.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2a108640 1 --2- 172.21.15.154:0/3136011450 >> [v2:172.21.15.176:6834/2614790445,v1:172.21.15.176:6835/2614790445] conn(0x5652cc4582a0 0x5652cc45a690 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47c1fa0d0108c25 server_cookie=434e06f1e21ce1f1 in_seq=0 out_seq=0 2024-05-14T01:23:46.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda057fa640 1 -- 172.21.15.154:0/3136011450 <== mds.0 v2:172.21.15.176:6834/2614790445 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5652cc1f4350 con 0x5652cc4582a0 2024-05-14T01:23:46.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda057fa640 10 client.4605 handle_command_reply: tid=0 2024-05-14T01:23:46.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 client.4605 shutdown 2024-05-14T01:23:46.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3136011450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc3e3c90 msgr2=0x5652cc457b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:46.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/3136011450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc3e3c90 0x5652cc457b50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fda1c01d120 tx=0x7fda1c0a5890 comp rx=0 tx=0).stop 2024-05-14T01:23:46.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3136011450 shutdown_connections 2024-05-14T01:23:46.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/3136011450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652cc3e3c90 0x5652cc457b50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/3136011450 >> [v2:172.21.15.176:6834/2614790445,v1:172.21.15.176:6835/2614790445] conn(0x5652cc4582a0 0x5652cc45a690 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/3136011450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5652cc3e3370 0x5652cc455600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda057fa640 0 client.4605 ms_handle_reset on v2:172.21.15.176:6834/2614790445 2024-05-14T01:23:46.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 --2- 172.21.15.154:0/3136011450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5652cc397340 0x5652cc3f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.930+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3136011450 >> 172.21.15.154:0/3136011450 conn(0x5652cc280df0 msgr2=0x5652cc3f0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:46.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.934+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3136011450 shutdown_connections 2024-05-14T01:23:46.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.934+0000 7fda2f4e6000 1 -- 172.21.15.154:0/3136011450 wait complete. 2024-05-14T01:23:46.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.934+0000 7fda2f4e6000 20 client.4605 trim_cache size 0 max 16384 2024-05-14T01:23:46.922 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-14T01:23:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "ed6da4f4-feae-4641-a379-d93fb409ad95", 2024-05-14T01:23:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2024-05-14T01:23:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4267, 2024-05-14T01:23:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2024-05-14T01:23:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2024-05-14T01:23:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2024-05-14T01:23:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 11.659211968999999, 2024-05-14T01:23:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 8, 2024-05-14T01:23:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 21, 2024-05-14T01:23:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 21, 2024-05-14T01:23:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 18.312250421000002 2024-05-14T01:23:46.923 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-14T01:23:46.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.934+0000 7fda2c36c640 1 -- 172.21.15.154:0/2299985461 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fda080678f0 msgr2=0x7fda08069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:46.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.934+0000 7fda2c36c640 1 --2- 172.21.15.154:0/2299985461 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fda080678f0 0x7fda08069db0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fda20001ec0 tx=0x7fda20009040 comp rx=0 tx=0).stop 2024-05-14T01:23:46.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.934+0000 7fda2c36c640 1 -- 172.21.15.154:0/2299985461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda2415d670 msgr2=0x7fda240ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:46.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.934+0000 7fda2c36c640 1 --2- 172.21.15.154:0/2299985461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda2415d670 0x7fda240ce050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0b0040 tx=0x7fda1c009750 comp rx=0 tx=0).stop 2024-05-14T01:23:46.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.934+0000 7fda2c36c640 1 -- 172.21.15.154:0/2299985461 shutdown_connections 2024-05-14T01:23:46.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.934+0000 7fda2c36c640 1 --2- 172.21.15.154:0/2299985461 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fda080678f0 0x7fda08069db0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.934+0000 7fda2c36c640 1 --2- 172.21.15.154:0/2299985461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda2415d670 0x7fda240ce050 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.934+0000 7fda2c36c640 1 --2- 172.21.15.154:0/2299985461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda240cd6d0 0x7fda2415ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.934+0000 7fda2c36c640 1 --2- 172.21.15.154:0/2299985461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda10004d50 0x7fda2414a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:46.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.934+0000 7fda2c36c640 1 -- 172.21.15.154:0/2299985461 >> 172.21.15.154:0/2299985461 conn(0x7fda24071fc0 msgr2=0x7fda240723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:46.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.934+0000 7fda2c36c640 1 -- 172.21.15.154:0/2299985461 shutdown_connections 2024-05-14T01:23:46.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:46.934+0000 7fda2c36c640 1 -- 172.21.15.154:0/2299985461 wait complete. 2024-05-14T01:23:46.932 INFO:teuthology.run_tasks:Running task sequential... 2024-05-14T01:23:46.946 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-14T01:23:46.946 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-14T01:23:46.947 INFO:teuthology.task.print:Enabling mgr modules 2024-05-14T01:23:46.947 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-14T01:23:46.971 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-14T01:23:46.971 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-14T01:23:46.971 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-14T01:23:46.971 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T01:23:46.971 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-14T01:23:46.971 INFO:tasks.ceph_fuse:client.2 config is {} 2024-05-14T01:23:46.972 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T01:23:46.972 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-14T01:23:46.972 INFO:tasks.ceph_fuse:client.1 config is {} 2024-05-14T01:23:46.972 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T01:23:46.972 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-14T01:23:46.972 INFO:tasks.ceph_fuse:client.3 config is {} 2024-05-14T01:23:46.972 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T01:23:46.972 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-14T01:23:46.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:46.972 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-05-14T01:23:46.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:46.980 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-05-14T01:23:47.040 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-05-14T01:23:47.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T01:23:47.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:47.042 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-05-14T01:23:47.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:47.048 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2024-05-14T01:23:47.112 INFO:teuthology.orchestra.run.smithi154.stderr:Cannot find device "ceph-brx" 2024-05-14T01:23:47.114 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T01:23:47.114 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-14T01:23:47.115 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T01:23:47.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f35186d3640 1 Processor -- start 2024-05-14T01:23:47.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f35186d3640 1 -- start start 2024-05-14T01:23:47.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f35186d3640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f35100d23a0 0x7f3510166f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:47.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f35186d3640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35100b30b0 con 0x7f351015bf30 2024-05-14T01:23:47.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f35186d3640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35100b3390 con 0x7f351015c310 2024-05-14T01:23:47.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f35186d3640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f35100b3670 con 0x7f35100d23a0 2024-05-14T01:23:47.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f351646f640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f351015bf30 0x7f35100b27b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54252/0 (socket says 172.21.15.154:54252) 2024-05-14T01:23:47.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f351646f640 1 -- 172.21.15.154:0/2175917307 learned_addr learned my addr 172.21.15.154:0/2175917307 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f3516c70640 1 --2- 172.21.15.154:0/2175917307 >> v2:172.21.15.176:3300/0 conn(0x7f35100d23a0 0x7f3510166f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f351546d640 1 -- 172.21.15.154:0/2175917307 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3214625709 0 0) 0x7f35100b30b0 con 0x7f351015bf30 2024-05-14T01:23:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f351546d640 1 -- 172.21.15.154:0/2175917307 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34fc003530 con 0x7f351015bf30 2024-05-14T01:23:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f351546d640 1 -- 172.21.15.154:0/2175917307 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2562036281 0 0) 0x7f34fc003530 con 0x7f351015bf30 2024-05-14T01:23:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f351546d640 1 -- 172.21.15.154:0/2175917307 >> v2:172.21.15.176:3300/0 conn(0x7f35100d23a0 msgr2=0x7f3510166f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f351546d640 1 --2- 172.21.15.154:0/2175917307 >> v2:172.21.15.176:3300/0 conn(0x7f35100d23a0 0x7f3510166f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f351546d640 1 -- 172.21.15.154:0/2175917307 >> v1:172.21.15.176:6789/0 conn(0x7f351015c310 legacy=0x7f35100d1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f351546d640 1 -- 172.21.15.154:0/2175917307 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35100aec10 con 0x7f351015bf30 2024-05-14T01:23:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f351546d640 1 -- 172.21.15.154:0/2175917307 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f350c001680 con 0x7f351015bf30 2024-05-14T01:23:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f351546d640 1 -- 172.21.15.154:0/2175917307 >> v1:172.21.15.154:6789/0 conn(0x7f351015bf30 legacy=0x7f35100b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f351546d640 1 --2- 172.21.15.154:0/2175917307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34fc0039c0 0x7f34fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f351546d640 1 --2- 172.21.15.154:0/2175917307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34fc004810 0x7f34fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f351546d640 1 --2- 172.21.15.154:0/2175917307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34fc0051d0 0x7f34fc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f351546d640 1 -- 172.21.15.154:0/2175917307 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f35100b3670 con 0x7f34fc0051d0 2024-05-14T01:23:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f351546d640 1 -- 172.21.15.154:0/2175917307 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f34fc00c080 con 0x7f34fc0039c0 2024-05-14T01:23:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f351546d640 1 -- 172.21.15.154:0/2175917307 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f34fc00c280 con 0x7f34fc004810 2024-05-14T01:23:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f3516c70640 1 --2- 172.21.15.154:0/2175917307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34fc0051d0 0x7f34fc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f3515c6e640 1 --2- 172.21.15.154:0/2175917307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34fc004810 0x7f34fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f3516c70640 1 -- 172.21.15.154:0/2175917307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34fc004810 msgr2=0x7f34fc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f3516c70640 1 --2- 172.21.15.154:0/2175917307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34fc004810 0x7f34fc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f3516c70640 1 -- 172.21.15.154:0/2175917307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34fc0039c0 msgr2=0x7f34fc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f3516c70640 1 --2- 172.21.15.154:0/2175917307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34fc0039c0 0x7f34fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.298+0000 7f3516c70640 1 -- 172.21.15.154:0/2175917307 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34fc003530 con 0x7f34fc0051d0 2024-05-14T01:23:47.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f3516c70640 1 -- 172.21.15.154:0/2175917307 reap_dead start 2024-05-14T01:23:47.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f3516c70640 1 --2- 172.21.15.154:0/2175917307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34fc0051d0 0x7f34fc00b9d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3508009fa0 tx=0x7f350801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d067c8155bb9f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:47.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f351546d640 1 -- 172.21.15.154:0/2175917307 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35080b2070 con 0x7f34fc0051d0 2024-05-14T01:23:47.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f351546d640 1 -- 172.21.15.154:0/2175917307 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35080a5d50 con 0x7f34fc0051d0 2024-05-14T01:23:47.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f351546d640 1 -- 172.21.15.154:0/2175917307 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3508009bf0 con 0x7f34fc0051d0 2024-05-14T01:23:47.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f35186d3640 1 -- 172.21.15.154:0/2175917307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34fc0051d0 msgr2=0x7f34fc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:47.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f35186d3640 1 --2- 172.21.15.154:0/2175917307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34fc0051d0 0x7f34fc00b9d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3508009fa0 tx=0x7f350801cc80 comp rx=0 tx=0).stop 2024-05-14T01:23:47.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f35186d3640 1 -- 172.21.15.154:0/2175917307 shutdown_connections 2024-05-14T01:23:47.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f35186d3640 1 --2- 172.21.15.154:0/2175917307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34fc0051d0 0x7f34fc00b9d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:47.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f35186d3640 1 -- 172.21.15.154:0/2175917307 >> 172.21.15.154:0/2175917307 conn(0x7f351009aa10 msgr2=0x7f351009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:47.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f35186d3640 1 -- 172.21.15.154:0/2175917307 shutdown_connections 2024-05-14T01:23:47.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f35186d3640 1 -- 172.21.15.154:0/2175917307 wait complete. 2024-05-14T01:23:47.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f35186d3640 1 Processor -- start 2024-05-14T01:23:47.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f35186d3640 1 -- start start 2024-05-14T01:23:47.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f35186d3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34fc0051d0 0x7f351015ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:47.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f35186d3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3510152670 0x7f35100cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:47.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f35186d3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35100cd940 0x7f35100cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:47.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f35186d3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f35100d1c90 con 0x7f3510152670 2024-05-14T01:23:47.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f35186d3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f35100d0af0 con 0x7f35100cd940 2024-05-14T01:23:47.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f35186d3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f35100d1e10 con 0x7f34fc0051d0 2024-05-14T01:23:47.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f3515c6e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3510152670 0x7f35100cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:47.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f3515c6e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3510152670 0x7f35100cd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55250/0 (socket says 172.21.15.154:55250) 2024-05-14T01:23:47.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f3515c6e640 1 -- 172.21.15.154:0/1199730534 learned_addr learned my addr 172.21.15.154:0/1199730534 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:47.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f351646f640 1 --2- 172.21.15.154:0/1199730534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34fc0051d0 0x7f351015ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:47.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f3516c70640 1 --2- 172.21.15.154:0/1199730534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35100cd940 0x7f35100cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:47.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f3515c6e640 1 -- 172.21.15.154:0/1199730534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34fc0051d0 msgr2=0x7f351015ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:47.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f3515c6e640 1 --2- 172.21.15.154:0/1199730534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34fc0051d0 0x7f351015ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:47.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f3515c6e640 1 -- 172.21.15.154:0/1199730534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35100cd940 msgr2=0x7f35100cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:47.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f3515c6e640 1 --2- 172.21.15.154:0/1199730534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35100cd940 0x7f35100cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:47.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f3515c6e640 1 -- 172.21.15.154:0/1199730534 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3510152af0 con 0x7f3510152670 2024-05-14T01:23:47.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.302+0000 7f3516c70640 1 --2- 172.21.15.154:0/1199730534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35100cd940 0x7f35100cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:47.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.306+0000 7f3515c6e640 1 --2- 172.21.15.154:0/1199730534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3510152670 0x7f35100cd400 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f350000e4e0 tx=0x7f350000e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:47.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.306+0000 7f3506ffd640 1 -- 172.21.15.154:0/1199730534 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35000052e0 con 0x7f3510152670 2024-05-14T01:23:47.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.306+0000 7f3506ffd640 1 -- 172.21.15.154:0/1199730534 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3500018070 con 0x7f3510152670 2024-05-14T01:23:47.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.306+0000 7f3506ffd640 1 -- 172.21.15.154:0/1199730534 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3500005480 con 0x7f3510152670 2024-05-14T01:23:47.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.306+0000 7f35186d3640 1 -- 172.21.15.154:0/1199730534 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f351015f4a0 con 0x7f3510152670 2024-05-14T01:23:47.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.306+0000 7f35186d3640 1 -- 172.21.15.154:0/1199730534 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f351015d480 con 0x7f3510152670 2024-05-14T01:23:47.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.306+0000 7f35186d3640 1 -- 172.21.15.154:0/1199730534 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3510068360 con 0x7f3510152670 2024-05-14T01:23:47.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.306+0000 7f3506ffd640 1 -- 172.21.15.154:0/1199730534 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3500003840 con 0x7f3510152670 2024-05-14T01:23:47.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.306+0000 7f3506ffd640 1 --2- 172.21.15.154:0/1199730534 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f34f40678f0 0x7f34f4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:47.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.306+0000 7f351646f640 1 --2- 172.21.15.154:0/1199730534 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f34f40678f0 0x7f34f4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:47.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.306+0000 7f3506ffd640 1 -- 172.21.15.154:0/1199730534 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3500085600 con 0x7f3510152670 2024-05-14T01:23:47.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.306+0000 7f351646f640 1 --2- 172.21.15.154:0/1199730534 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f34f40678f0 0x7f34f4069db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f350c0011f0 tx=0x7f350c0016b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:47.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.310+0000 7f3506ffd640 1 -- 172.21.15.154:0/1199730534 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f35000560c0 con 0x7f3510152670 2024-05-14T01:23:47.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.506+0000 7f35186d3640 1 -- 172.21.15.154:0/1199730534 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f351015b830 con 0x7f3510152670 2024-05-14T01:23:47.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.506+0000 7f3506ffd640 1 -- 172.21.15.154:0/1199730534 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f35000559c0 con 0x7f3510152670 2024-05-14T01:23:47.492 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-14T01:23:47.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.510+0000 7f35186d3640 1 -- 172.21.15.154:0/1199730534 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f34f40678f0 msgr2=0x7f34f4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:47.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.510+0000 7f35186d3640 1 --2- 172.21.15.154:0/1199730534 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f34f40678f0 0x7f34f4069db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f350c0011f0 tx=0x7f350c0016b0 comp rx=0 tx=0).stop 2024-05-14T01:23:47.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.510+0000 7f35186d3640 1 -- 172.21.15.154:0/1199730534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3510152670 msgr2=0x7f35100cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:47.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.510+0000 7f35186d3640 1 --2- 172.21.15.154:0/1199730534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3510152670 0x7f35100cd400 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f350000e4e0 tx=0x7f350000e9a0 comp rx=0 tx=0).stop 2024-05-14T01:23:47.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.510+0000 7f35186d3640 1 -- 172.21.15.154:0/1199730534 shutdown_connections 2024-05-14T01:23:47.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.510+0000 7f35186d3640 1 --2- 172.21.15.154:0/1199730534 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f34f40678f0 0x7f34f4069db0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:47.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.510+0000 7f35186d3640 1 --2- 172.21.15.154:0/1199730534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35100cd940 0x7f35100cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:47.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.510+0000 7f35186d3640 1 --2- 172.21.15.154:0/1199730534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3510152670 0x7f35100cd400 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:47.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.510+0000 7f35186d3640 1 --2- 172.21.15.154:0/1199730534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34fc0051d0 0x7f351015ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:47.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.510+0000 7f35186d3640 1 -- 172.21.15.154:0/1199730534 >> 172.21.15.154:0/1199730534 conn(0x7f351009aa10 msgr2=0x7f351009adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:47.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.510+0000 7f35186d3640 1 -- 172.21.15.154:0/1199730534 shutdown_connections 2024-05-14T01:23:47.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47.510+0000 7f35186d3640 1 -- 172.21.15.154:0/1199730534 wait complete. 2024-05-14T01:23:47.511 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-14T01:23:47.511 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T01:23:47.511 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-05-14T01:23:47.511 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-14T01:23:47.511 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-14T01:23:47.511 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-14T01:23:47.511 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T01:23:47.511 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T01:23:47.511 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-14T01:23:47.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:47.512 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-05-14T01:23:47.517 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T01:23:47.518 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T01:23:47.518 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T01:23:47.518 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:47.518 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-05-14T01:23:47.518 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:47.518 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-14T01:23:47.518 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:47.518 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-05-14T01:23:47.518 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-14T01:23:47.518 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:47.518 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-05-14T01:23:47.518 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-14T01:23:47.519 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:47.519 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T01:23:47.519 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:47.519 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-14T01:23:47.519 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42475sec preferred_lft 42475sec 2024-05-14T01:23:47.519 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2024-05-14T01:23:47.519 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:47.519 INFO:teuthology.orchestra.run.smithi154.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-14T01:23:47.519 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 02:42:d7:5b:6a:85 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:47.519 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-14T01:23:47.519 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:47.520 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-14T01:23:47.520 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:23:47.520 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-05-14T01:23:47.520 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add name ceph-brx type bridge 2024-05-14T01:23:47.520 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip addr flush dev ceph-brx 2024-05-14T01:23:47.520 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set ceph-brx up 2024-05-14T01:23:47.520 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-14T01:23:47.520 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-05-14T01:23:47.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:23:47.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:47.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:47.634 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T01:23:47.684 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-05-14T01:23:47.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:47.686 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-05-14T01:23:47.756 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-05-14T01:23:47.756 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T01:23:47.756 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-14T01:23:47.756 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-14T01:23:47.756 INFO:teuthology.orchestra.run.smithi154.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-14T01:23:47.757 INFO:teuthology.orchestra.run.smithi154.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-14T01:23:47.757 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-14T01:23:47.757 INFO:teuthology.orchestra.run.smithi154.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-14T01:23:47.757 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-14T01:23:47.757 INFO:teuthology.orchestra.run.smithi154.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-14T01:23:47.757 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T01:23:47.757 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:23:47.758 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-05-14T01:23:47.758 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-14T01:23:47.758 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-14T01:23:47.758 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-14T01:23:47.758 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-05-14T01:23:47.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:23:47.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:47.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:47.879 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-05-14T01:23:47.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:47.926 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list-id 2024-05-14T01:23:47.973 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:23:47.974 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-05-14T01:23:47.974 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:23:47.974 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-14T01:23:47.974 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-05-14T01:23:48.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:23:48.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:48.089 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-14T01:23:48.089 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:23:48.089 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-05-14T01:23:48.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-14T01:23:48.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-14T01:23:48.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-14T01:23:48.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-14T01:23:48.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-14T01:23:48.090 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-05-14T01:23:48.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:23:48.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:48.190 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:23:48.190 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-05-14T01:23:48.190 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-05-14T01:23:48.190 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set dev brx.0 master ceph-brx 2024-05-14T01:23:48.190 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-05-14T01:23:48.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:23:48.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:48.292 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-14T01:23:48.292 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T01:23:48.292 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-14T01:23:48.337 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-14T01:23:48.337 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T01:23:48.337 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-14T01:23:48.384 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2024-05-14T01:23:48.442 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T01:23:48.490 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2024-05-14T01:23:48.490 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2024-05-14T01:23:48.490 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2024-05-14T01:23:48.490 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2024-05-14T01:23:48.490 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2024-05-14T01:23:48.490 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2024-05-14T01:23:48.490 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2024-05-14T01:23:48.490 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2024-05-14T01:23:48.490 INFO:teuthology.orchestra.run.smithi154.stdout:/run/lock 2024-05-14T01:23:48.490 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2024-05-14T01:23:48.491 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2024-05-14T01:23:48.491 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2024-05-14T01:23:48.491 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T01:23:48.491 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2024-05-14T01:23:48.491 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2024-05-14T01:23:48.491 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2024-05-14T01:23:48.491 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2024-05-14T01:23:48.491 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/fs/nfsd 2024-05-14T01:23:48.491 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2024-05-14T01:23:48.491 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2024-05-14T01:23:48.491 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysusers.service 2024-05-14T01:23:48.491 INFO:teuthology.orchestra.run.smithi154.stdout:/run/rpc_pipefs 2024-05-14T01:23:48.491 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2024-05-14T01:23:48.492 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2024-05-14T01:23:48.492 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T01:23:48.492 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T01:23:48.492 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T01:23:48.492 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T01:23:48.492 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2024-05-14T01:23:48.492 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:23:48.492 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:23:48.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:48.493 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2024-05-14T01:23:48.542 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-14T01:23:48.542 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-14T01:23:48.586 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2024-05-14T01:23:48.600 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T01:23:48.649 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2024-05-14T01:23:48.649 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2024-05-14T01:23:48.649 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2024-05-14T01:23:48.650 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2024-05-14T01:23:48.650 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2024-05-14T01:23:48.650 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2024-05-14T01:23:48.650 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2024-05-14T01:23:48.650 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2024-05-14T01:23:48.650 INFO:teuthology.orchestra.run.smithi154.stdout:/run/lock 2024-05-14T01:23:48.650 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2024-05-14T01:23:48.650 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2024-05-14T01:23:48.650 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2024-05-14T01:23:48.650 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T01:23:48.650 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2024-05-14T01:23:48.650 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2024-05-14T01:23:48.650 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2024-05-14T01:23:48.651 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2024-05-14T01:23:48.651 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/fs/nfsd 2024-05-14T01:23:48.651 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2024-05-14T01:23:48.651 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2024-05-14T01:23:48.651 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysusers.service 2024-05-14T01:23:48.651 INFO:teuthology.orchestra.run.smithi154.stdout:/run/rpc_pipefs 2024-05-14T01:23:48.651 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2024-05-14T01:23:48.651 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2024-05-14T01:23:48.651 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T01:23:48.651 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T01:23:48.651 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T01:23:48.651 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T01:23:48.651 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2024-05-14T01:23:48.651 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:23:48.651 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:23:48.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:48.653 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2024-05-14T01:23:48.668 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi154.stderr:2024-05-14T01:23:48.682+0000 7fefab15c580 -1 init, newargv = 0x5600d5505e90 newargc=15 2024-05-14T01:23:48.668 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi154.stderr:ceph-fuse[34896]: starting ceph client 2024-05-14T01:23:48.676 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi154.stderr:ceph-fuse[34896]: starting fuse 2024-05-14T01:23:49.774 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2024-05-14T01:23:49.791 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T01:23:49.838 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2024-05-14T01:23:49.838 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2024-05-14T01:23:49.838 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2024-05-14T01:23:49.838 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2024-05-14T01:23:49.838 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2024-05-14T01:23:49.838 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2024-05-14T01:23:49.838 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2024-05-14T01:23:49.839 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2024-05-14T01:23:49.839 INFO:teuthology.orchestra.run.smithi154.stdout:/run/lock 2024-05-14T01:23:49.839 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2024-05-14T01:23:49.839 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2024-05-14T01:23:49.839 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2024-05-14T01:23:49.839 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T01:23:49.839 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2024-05-14T01:23:49.839 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2024-05-14T01:23:49.839 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2024-05-14T01:23:49.839 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2024-05-14T01:23:49.839 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/fs/nfsd 2024-05-14T01:23:49.839 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2024-05-14T01:23:49.839 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2024-05-14T01:23:49.840 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysusers.service 2024-05-14T01:23:49.840 INFO:teuthology.orchestra.run.smithi154.stdout:/run/rpc_pipefs 2024-05-14T01:23:49.840 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2024-05-14T01:23:49.840 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2024-05-14T01:23:49.840 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T01:23:49.840 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T01:23:49.840 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T01:23:49.840 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T01:23:49.840 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2024-05-14T01:23:49.840 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:23:49.840 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:23:49.840 INFO:teuthology.orchestra.run.smithi154.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-14T01:23:49.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:49.841 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2024-05-14T01:23:49.889 INFO:teuthology.orchestra.run.smithi154.stdout:45 2024-05-14T01:23:49.889 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-05-14T01:23:49.890 DEBUG:teuthology.orchestra.run.smithi154:> sudo stdin-killer -- python3 -c ' 2024-05-14T01:23:49.890 DEBUG:teuthology.orchestra.run.smithi154:> import glob 2024-05-14T01:23:49.890 DEBUG:teuthology.orchestra.run.smithi154:> import re 2024-05-14T01:23:49.890 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-05-14T01:23:49.890 DEBUG:teuthology.orchestra.run.smithi154:> import subprocess 2024-05-14T01:23:49.890 DEBUG:teuthology.orchestra.run.smithi154:> 2024-05-14T01:23:49.890 DEBUG:teuthology.orchestra.run.smithi154:> def _find_admin_socket(client_name): 2024-05-14T01:23:49.890 DEBUG:teuthology.orchestra.run.smithi154:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-14T01:23:49.890 DEBUG:teuthology.orchestra.run.smithi154:> files = glob.glob(asok_path) 2024-05-14T01:23:49.890 DEBUG:teuthology.orchestra.run.smithi154:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-14T01:23:49.890 DEBUG:teuthology.orchestra.run.smithi154:> 2024-05-14T01:23:49.890 DEBUG:teuthology.orchestra.run.smithi154:> # Given a non-glob path, it better be there 2024-05-14T01:23:49.890 DEBUG:teuthology.orchestra.run.smithi154:> if "*" not in asok_path: 2024-05-14T01:23:49.890 DEBUG:teuthology.orchestra.run.smithi154:> assert(len(files) == 1) 2024-05-14T01:23:49.891 DEBUG:teuthology.orchestra.run.smithi154:> return files[0] 2024-05-14T01:23:49.891 DEBUG:teuthology.orchestra.run.smithi154:> 2024-05-14T01:23:49.891 DEBUG:teuthology.orchestra.run.smithi154:> for f in files: 2024-05-14T01:23:49.891 DEBUG:teuthology.orchestra.run.smithi154:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-14T01:23:49.891 DEBUG:teuthology.orchestra.run.smithi154:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-14T01:23:49.891 DEBUG:teuthology.orchestra.run.smithi154:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-14T01:23:49.891 DEBUG:teuthology.orchestra.run.smithi154:> contents = proc_f.read() 2024-05-14T01:23:49.891 DEBUG:teuthology.orchestra.run.smithi154:> if mountpoint in contents: 2024-05-14T01:23:49.891 DEBUG:teuthology.orchestra.run.smithi154:> return f 2024-05-14T01:23:49.891 DEBUG:teuthology.orchestra.run.smithi154:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-14T01:23:49.891 DEBUG:teuthology.orchestra.run.smithi154:> 2024-05-14T01:23:49.891 DEBUG:teuthology.orchestra.run.smithi154:> print(_find_admin_socket("client.0")) 2024-05-14T01:23:49.891 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-05-14T01:23:50.014 INFO:teuthology.orchestra.run.smithi154.stdout:/var/run/ceph/ceph-client.0.34896.asok 2024-05-14T01:23:50.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:50.026 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34896.asok 2024-05-14T01:23:50.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:50.026 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34896.asok status 2024-05-14T01:23:50.181 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-14T01:23:50.181 INFO:teuthology.orchestra.run.smithi154.stdout: "metadata": { 2024-05-14T01:23:50.181 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_sha1": "2ba596c3826798bb3a2f22bc9b02848b92dbe579", 2024-05-14T01:23:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 19.0.0-2569-g2ba596c3 (2ba596c3826798bb3a2f22bc9b02848b92dbe579) squid (dev)", 2024-05-14T01:23:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: "entity_id": "0", 2024-05-14T01:23:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: "hostname": "smithi154", 2024-05-14T01:23:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-14T01:23:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: "pid": "34896", 2024-05-14T01:23:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: "root": "/" 2024-05-14T01:23:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:23:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_count": 0, 2024-05-14T01:23:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_pinned_count": 0, 2024-05-14T01:23:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4617, 2024-05-14T01:23:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: "inst": { 2024-05-14T01:23:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: "name": { 2024-05-14T01:23:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "client", 2024-05-14T01:23:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: "num": 4617 2024-05-14T01:23:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:23:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2024-05-14T01:23:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2024-05-14T01:23:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.1:0", 2024-05-14T01:23:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 2425949067 2024-05-14T01:23:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:23:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:23:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2024-05-14T01:23:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2024-05-14T01:23:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.1:0", 2024-05-14T01:23:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 2425949067 2024-05-14T01:23:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:23:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: "inst_str": "client.4617 192.168.0.1:0/2425949067", 2024-05-14T01:23:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: "addr_str": "192.168.0.1:0/2425949067", 2024-05-14T01:23:50.184 INFO:teuthology.orchestra.run.smithi154.stdout: "inode_count": 1, 2024-05-14T01:23:50.184 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_epoch": 8, 2024-05-14T01:23:50.184 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch": 21, 2024-05-14T01:23:50.184 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch_barrier": 0, 2024-05-14T01:23:50.184 INFO:teuthology.orchestra.run.smithi154.stdout: "blocklisted": false, 2024-05-14T01:23:50.184 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs" 2024-05-14T01:23:50.184 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-14T01:23:50.196 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T01:23:50.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.334+0000 7fb112507640 1 Processor -- start 2024-05-14T01:23:50.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.334+0000 7fb112507640 1 -- start start 2024-05-14T01:23:50.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.334+0000 7fb112507640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb10c15bd80 0x7fb10c15d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:50.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.334+0000 7fb112507640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb10c06f8a0 0x7fb10c1604c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:50.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.334+0000 7fb112507640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb10c160a00 con 0x7fb10c06d730 2024-05-14T01:23:50.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.334+0000 7fb112507640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb10c06fd40 con 0x7fb10c15bd80 2024-05-14T01:23:50.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.334+0000 7fb112507640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb10c070020 con 0x7fb10c06f8a0 2024-05-14T01:23:50.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.334+0000 7fb10bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb10c15bd80 0x7fb10c15d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:50.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.334+0000 7fb10bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb10c15bd80 0x7fb10c15d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55266/0 (socket says 172.21.15.154:55266) 2024-05-14T01:23:50.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.334+0000 7fb10bfff640 1 -- 172.21.15.154:0/660290149 learned_addr learned my addr 172.21.15.154:0/660290149 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:50.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.334+0000 7fb10b7fe640 1 --2- 172.21.15.154:0/660290149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb10c06f8a0 0x7fb10c1604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:50.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.334+0000 7fb10bfff640 1 -- 172.21.15.154:0/660290149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb10c06f8a0 msgr2=0x7fb10c1604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:50.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.334+0000 7fb10bfff640 1 --2- 172.21.15.154:0/660290149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb10c06f8a0 0x7fb10c1604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:50.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.334+0000 7fb10bfff640 1 -- 172.21.15.154:0/660290149 >> v1:172.21.15.176:6789/0 conn(0x7fb10c06d730 legacy=0x7fb10c0caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:50.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.334+0000 7fb10bfff640 1 -- 172.21.15.154:0/660290149 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10c15c5d0 con 0x7fb10c15bd80 2024-05-14T01:23:50.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb10bfff640 1 --2- 172.21.15.154:0/660290149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c15bd80 0x7fb10c15d0b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009870 tx=0x7fb0f401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9262b528d3db6a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:50.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb10affd640 1 -- 172.21.15.154:0/660290149 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f40aa600 con 0x7fb10c15bd80 2024-05-14T01:23:50.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb10affd640 1 -- 172.21.15.154:0/660290149 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f40af070 con 0x7fb10c15bd80 2024-05-14T01:23:50.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb10affd640 1 -- 172.21.15.154:0/660290149 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f40aa9c0 con 0x7fb10c15bd80 2024-05-14T01:23:50.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb112507640 1 -- 172.21.15.154:0/660290149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c15bd80 msgr2=0x7fb10c15d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:50.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb112507640 1 --2- 172.21.15.154:0/660290149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c15bd80 0x7fb10c15d0b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009870 tx=0x7fb0f401c4a0 comp rx=0 tx=0).stop 2024-05-14T01:23:50.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb112507640 1 -- 172.21.15.154:0/660290149 shutdown_connections 2024-05-14T01:23:50.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb112507640 1 --2- 172.21.15.154:0/660290149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb10c06f8a0 0x7fb10c1604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:50.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb112507640 1 --2- 172.21.15.154:0/660290149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c15bd80 0x7fb10c15d0b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:50.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb112507640 1 -- 172.21.15.154:0/660290149 >> 172.21.15.154:0/660290149 conn(0x7fb10c0ccef0 msgr2=0x7fb10c0cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:50.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb112507640 1 -- 172.21.15.154:0/660290149 shutdown_connections 2024-05-14T01:23:50.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb112507640 1 -- 172.21.15.154:0/660290149 wait complete. 2024-05-14T01:23:50.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb112507640 1 Processor -- start 2024-05-14T01:23:50.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb112507640 1 -- start start 2024-05-14T01:23:50.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb112507640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb10c06d730 0x7fb10c1face0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:50.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb112507640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c06f8a0 0x7fb10c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:50.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb112507640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb10c15bd80 0x7fb10c14c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:50.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb112507640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c15c160 con 0x7fb10c06f8a0 2024-05-14T01:23:50.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb112507640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c06df70 con 0x7fb10c15bd80 2024-05-14T01:23:50.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb112507640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb10c15c2e0 con 0x7fb10c06d730 2024-05-14T01:23:50.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb10b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c06f8a0 0x7fb10c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:50.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb10b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c06f8a0 0x7fb10c0cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55278/0 (socket says 172.21.15.154:55278) 2024-05-14T01:23:50.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb10b7fe640 1 -- 172.21.15.154:0/475234433 learned_addr learned my addr 172.21.15.154:0/475234433 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:50.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb110aa4640 1 --2- 172.21.15.154:0/475234433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb10c15bd80 0x7fb10c14c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:50.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb10bfff640 1 --2- 172.21.15.154:0/475234433 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb10c06d730 0x7fb10c1face0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:50.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb10b7fe640 1 -- 172.21.15.154:0/475234433 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb10c06d730 msgr2=0x7fb10c1face0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:50.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb10b7fe640 1 --2- 172.21.15.154:0/475234433 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb10c06d730 0x7fb10c1face0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:50.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb10b7fe640 1 -- 172.21.15.154:0/475234433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb10c15bd80 msgr2=0x7fb10c14c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:50.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb10b7fe640 1 --2- 172.21.15.154:0/475234433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb10c15bd80 0x7fb10c14c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:50.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb10b7fe640 1 -- 172.21.15.154:0/475234433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10c1fa270 con 0x7fb10c06f8a0 2024-05-14T01:23:50.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb10b7fe640 1 --2- 172.21.15.154:0/475234433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c06f8a0 0x7fb10c0cfb10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00d800 tx=0x7fb0fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:50.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb108ff9640 1 -- 172.21.15.154:0/475234433 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc00b6c0 con 0x7fb10c06f8a0 2024-05-14T01:23:50.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb108ff9640 1 -- 172.21.15.154:0/475234433 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0fc019070 con 0x7fb10c06f8a0 2024-05-14T01:23:50.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb112507640 1 -- 172.21.15.154:0/475234433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb10c14ca50 con 0x7fb10c06f8a0 2024-05-14T01:23:50.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.338+0000 7fb108ff9640 1 -- 172.21.15.154:0/475234433 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc00ba60 con 0x7fb10c06f8a0 2024-05-14T01:23:50.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.342+0000 7fb112507640 1 -- 172.21.15.154:0/475234433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb10c1fa4e0 con 0x7fb10c06f8a0 2024-05-14T01:23:50.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.342+0000 7fb112507640 1 -- 172.21.15.154:0/475234433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb10c068360 con 0x7fb10c06f8a0 2024-05-14T01:23:50.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.342+0000 7fb108ff9640 1 -- 172.21.15.154:0/475234433 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb0fc00bc00 con 0x7fb10c06f8a0 2024-05-14T01:23:50.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.342+0000 7fb108ff9640 1 --2- 172.21.15.154:0/475234433 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb0ec0678c0 0x7fb0ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:50.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.342+0000 7fb108ff9640 1 -- 172.21.15.154:0/475234433 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb0fc086100 con 0x7fb10c06f8a0 2024-05-14T01:23:50.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.342+0000 7fb10bfff640 1 --2- 172.21.15.154:0/475234433 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb0ec0678c0 0x7fb0ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:50.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.342+0000 7fb10bfff640 1 --2- 172.21.15.154:0/475234433 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb0ec0678c0 0x7fb0ec069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40ae000 tx=0x7fb0f40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:50.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.346+0000 7fb108ff9640 1 -- 172.21.15.154:0/475234433 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb0fc056c40 con 0x7fb10c06f8a0 2024-05-14T01:23:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.546+0000 7fb112507640 1 -- 172.21.15.154:0/475234433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb10c06c690 con 0x7fb10c06f8a0 2024-05-14T01:23:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.546+0000 7fb108ff9640 1 -- 172.21.15.154:0/475234433 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fb0fc056540 con 0x7fb10c06f8a0 2024-05-14T01:23:50.530 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-14T01:23:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.546+0000 7fb112507640 1 -- 172.21.15.154:0/475234433 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb0ec0678c0 msgr2=0x7fb0ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.546+0000 7fb112507640 1 --2- 172.21.15.154:0/475234433 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb0ec0678c0 0x7fb0ec069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40ae000 tx=0x7fb0f40a7000 comp rx=0 tx=0).stop 2024-05-14T01:23:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.546+0000 7fb112507640 1 -- 172.21.15.154:0/475234433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c06f8a0 msgr2=0x7fb10c0cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.546+0000 7fb112507640 1 --2- 172.21.15.154:0/475234433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c06f8a0 0x7fb10c0cfb10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00d800 tx=0x7fb0fc00dcc0 comp rx=0 tx=0).stop 2024-05-14T01:23:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.546+0000 7fb112507640 1 -- 172.21.15.154:0/475234433 shutdown_connections 2024-05-14T01:23:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.546+0000 7fb112507640 1 --2- 172.21.15.154:0/475234433 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb0ec0678c0 0x7fb0ec069d80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.546+0000 7fb112507640 1 --2- 172.21.15.154:0/475234433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb10c15bd80 0x7fb10c14c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.546+0000 7fb112507640 1 --2- 172.21.15.154:0/475234433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c06f8a0 0x7fb10c0cfb10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.546+0000 7fb112507640 1 --2- 172.21.15.154:0/475234433 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb10c06d730 0x7fb10c1face0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.546+0000 7fb112507640 1 -- 172.21.15.154:0/475234433 >> 172.21.15.154:0/475234433 conn(0x7fb10c0ccef0 msgr2=0x7fb10c15f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.546+0000 7fb112507640 1 -- 172.21.15.154:0/475234433 shutdown_connections 2024-05-14T01:23:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50.546+0000 7fb112507640 1 -- 172.21.15.154:0/475234433 wait complete. 2024-05-14T01:23:50.547 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-14T01:23:50.547 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T01:23:50.547 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-05-14T01:23:50.547 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-14T01:23:50.547 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-14T01:23:50.547 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-14T01:23:50.547 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T01:23:50.547 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T01:23:50.547 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-14T01:23:50.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:50.548 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-05-14T01:23:50.553 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T01:23:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T01:23:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T01:23:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-05-14T01:23:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:50.554 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-14T01:23:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-05-14T01:23:50.554 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-14T01:23:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-05-14T01:23:50.554 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-14T01:23:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:50.554 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T01:23:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-14T01:23:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42472sec preferred_lft 42472sec 2024-05-14T01:23:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2024-05-14T01:23:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:50.555 INFO:teuthology.orchestra.run.smithi154.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-14T01:23:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 02:42:d7:5b:6a:85 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-14T01:23:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:50.555 INFO:teuthology.orchestra.run.smithi154.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T01:23:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-14T01:23:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-14T01:23:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:50.556 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-14T01:23:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:23:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-14T01:23:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:50.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:50.556 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T01:23:50.607 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-05-14T01:23:50.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:50.608 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-05-14T01:23:50.659 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-05-14T01:23:50.660 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T01:23:50.660 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-14T01:23:50.660 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-14T01:23:50.660 INFO:teuthology.orchestra.run.smithi154.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-14T01:23:50.660 INFO:teuthology.orchestra.run.smithi154.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-14T01:23:50.660 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-14T01:23:50.660 INFO:teuthology.orchestra.run.smithi154.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-14T01:23:50.660 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-14T01:23:50.660 INFO:teuthology.orchestra.run.smithi154.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-14T01:23:50.660 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T01:23:50.661 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:23:50.661 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-05-14T01:23:50.661 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-14T01:23:50.661 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-14T01:23:50.661 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-14T01:23:50.661 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-05-14T01:23:50.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:23:50.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:50.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:50.776 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-05-14T01:23:50.825 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-14T01:23:50.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:50.826 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list-id 2024-05-14T01:23:50.873 INFO:teuthology.orchestra.run.smithi154.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-14T01:23:50.874 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:23:50.874 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-05-14T01:23:50.874 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T01:23:50.874 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-14T01:23:50.874 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-05-14T01:23:50.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:23:50.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:50.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:50.988 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-14T01:23:50.998 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T01:23:50.998 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T01:23:50.998 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T01:23:50.998 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:50.998 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-05-14T01:23:50.999 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:50.999 INFO:teuthology.orchestra.run.smithi154.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T01:23:50.999 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0e:71:73:bd:62:9a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-14T01:23:50.999 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-14T01:23:50.999 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:50.999 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::c71:73ff:febd:629a/64 scope link 2024-05-14T01:23:50.999 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:51.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:51.000 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-14T01:23:51.054 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T01:23:51.054 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T01:23:51.055 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T01:23:51.055 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:51.055 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-05-14T01:23:51.055 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:51.055 INFO:teuthology.orchestra.run.smithi154.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T01:23:51.055 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0e:71:73:bd:62:9a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-14T01:23:51.055 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-14T01:23:51.055 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:51.055 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::c71:73ff:febd:629a/64 scope link 2024-05-14T01:23:51.055 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:51.056 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-14T01:23:51.056 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:23:51.056 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-05-14T01:23:51.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-14T01:23:51.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-14T01:23:51.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-14T01:23:51.057 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-14T01:23:51.057 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-14T01:23:51.057 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-05-14T01:23:51.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:23:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:51.192 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:23:51.192 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-05-14T01:23:51.192 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.1 up 2024-05-14T01:23:51.192 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set dev brx.1 master ceph-brx 2024-05-14T01:23:51.192 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-05-14T01:23:51.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:23:51.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:51.295 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-05-14T01:23:51.296 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T01:23:51.296 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-14T01:23:51.340 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-14T01:23:51.340 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T01:23:51.340 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-14T01:23:51.389 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2024-05-14T01:23:51.443 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T01:23:51.489 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2024-05-14T01:23:51.490 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2024-05-14T01:23:51.490 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2024-05-14T01:23:51.490 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2024-05-14T01:23:51.490 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2024-05-14T01:23:51.490 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2024-05-14T01:23:51.490 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2024-05-14T01:23:51.490 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2024-05-14T01:23:51.490 INFO:teuthology.orchestra.run.smithi154.stdout:/run/lock 2024-05-14T01:23:51.490 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2024-05-14T01:23:51.490 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2024-05-14T01:23:51.491 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2024-05-14T01:23:51.491 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T01:23:51.491 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2024-05-14T01:23:51.491 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2024-05-14T01:23:51.491 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2024-05-14T01:23:51.491 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2024-05-14T01:23:51.491 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/fs/nfsd 2024-05-14T01:23:51.491 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2024-05-14T01:23:51.491 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2024-05-14T01:23:51.491 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysusers.service 2024-05-14T01:23:51.491 INFO:teuthology.orchestra.run.smithi154.stdout:/run/rpc_pipefs 2024-05-14T01:23:51.491 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2024-05-14T01:23:51.492 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2024-05-14T01:23:51.492 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T01:23:51.492 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T01:23:51.492 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T01:23:51.492 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T01:23:51.492 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2024-05-14T01:23:51.492 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:23:51.492 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:23:51.492 INFO:teuthology.orchestra.run.smithi154.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-14T01:23:51.492 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T01:23:51.492 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T01:23:51.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:51.493 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2024-05-14T01:23:51.540 INFO:teuthology.orchestra.run.smithi154.stdout:45 2024-05-14T01:23:51.541 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-05-14T01:23:51.541 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-05-14T01:23:51.585 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2024-05-14T01:23:51.599 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T01:23:51.646 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2024-05-14T01:23:51.646 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2024-05-14T01:23:51.646 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2024-05-14T01:23:51.646 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2024-05-14T01:23:51.646 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2024-05-14T01:23:51.646 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2024-05-14T01:23:51.646 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2024-05-14T01:23:51.647 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2024-05-14T01:23:51.647 INFO:teuthology.orchestra.run.smithi154.stdout:/run/lock 2024-05-14T01:23:51.647 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2024-05-14T01:23:51.647 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2024-05-14T01:23:51.647 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2024-05-14T01:23:51.647 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T01:23:51.647 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2024-05-14T01:23:51.647 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2024-05-14T01:23:51.647 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2024-05-14T01:23:51.647 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2024-05-14T01:23:51.647 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/fs/nfsd 2024-05-14T01:23:51.647 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2024-05-14T01:23:51.648 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2024-05-14T01:23:51.648 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysusers.service 2024-05-14T01:23:51.648 INFO:teuthology.orchestra.run.smithi154.stdout:/run/rpc_pipefs 2024-05-14T01:23:51.648 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2024-05-14T01:23:51.648 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2024-05-14T01:23:51.648 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T01:23:51.648 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T01:23:51.648 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T01:23:51.648 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T01:23:51.648 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2024-05-14T01:23:51.649 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:23:51.649 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:23:51.649 INFO:teuthology.orchestra.run.smithi154.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-14T01:23:51.649 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T01:23:51.649 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T01:23:51.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:51.649 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2024-05-14T01:23:51.658 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi154.stderr:2024-05-14T01:23:51.674+0000 7f9bd3a9c580 -1 init, newargv = 0x55b36ad53cb0 newargc=15 2024-05-14T01:23:51.658 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi154.stderr:ceph-fuse[35041]: starting ceph client 2024-05-14T01:23:51.662 INFO:teuthology.orchestra.run.smithi154.stdout:45 2024-05-14T01:23:51.665 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi154.stderr:ceph-fuse[35041]: starting fuse 2024-05-14T01:23:52.764 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2024-05-14T01:23:52.780 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T01:23:52.826 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2024-05-14T01:23:52.826 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2024-05-14T01:23:52.826 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2024-05-14T01:23:52.826 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2024-05-14T01:23:52.826 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2024-05-14T01:23:52.826 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2024-05-14T01:23:52.827 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2024-05-14T01:23:52.827 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2024-05-14T01:23:52.827 INFO:teuthology.orchestra.run.smithi154.stdout:/run/lock 2024-05-14T01:23:52.827 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2024-05-14T01:23:52.827 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2024-05-14T01:23:52.827 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2024-05-14T01:23:52.827 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T01:23:52.827 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2024-05-14T01:23:52.827 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2024-05-14T01:23:52.827 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2024-05-14T01:23:52.827 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2024-05-14T01:23:52.827 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/fs/nfsd 2024-05-14T01:23:52.828 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2024-05-14T01:23:52.828 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2024-05-14T01:23:52.828 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysusers.service 2024-05-14T01:23:52.828 INFO:teuthology.orchestra.run.smithi154.stdout:/run/rpc_pipefs 2024-05-14T01:23:52.828 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2024-05-14T01:23:52.828 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2024-05-14T01:23:52.828 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T01:23:52.828 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T01:23:52.828 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T01:23:52.828 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T01:23:52.828 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2024-05-14T01:23:52.828 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:23:52.829 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:23:52.829 INFO:teuthology.orchestra.run.smithi154.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-14T01:23:52.829 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T01:23:52.829 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T01:23:52.829 INFO:teuthology.orchestra.run.smithi154.stdout:/home/ubuntu/cephtest/mnt.2 2024-05-14T01:23:52.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:52.830 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2024-05-14T01:23:52.878 INFO:teuthology.orchestra.run.smithi154.stdout:45 2024-05-14T01:23:52.878 INFO:teuthology.orchestra.run.smithi154.stdout:46 2024-05-14T01:23:52.878 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-05-14T01:23:52.878 DEBUG:teuthology.orchestra.run.smithi154:> sudo stdin-killer -- python3 -c ' 2024-05-14T01:23:52.878 DEBUG:teuthology.orchestra.run.smithi154:> import glob 2024-05-14T01:23:52.878 DEBUG:teuthology.orchestra.run.smithi154:> import re 2024-05-14T01:23:52.879 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-05-14T01:23:52.879 DEBUG:teuthology.orchestra.run.smithi154:> import subprocess 2024-05-14T01:23:52.879 DEBUG:teuthology.orchestra.run.smithi154:> 2024-05-14T01:23:52.879 DEBUG:teuthology.orchestra.run.smithi154:> def _find_admin_socket(client_name): 2024-05-14T01:23:52.879 DEBUG:teuthology.orchestra.run.smithi154:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-05-14T01:23:52.879 DEBUG:teuthology.orchestra.run.smithi154:> files = glob.glob(asok_path) 2024-05-14T01:23:52.879 DEBUG:teuthology.orchestra.run.smithi154:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-05-14T01:23:52.879 DEBUG:teuthology.orchestra.run.smithi154:> 2024-05-14T01:23:52.879 DEBUG:teuthology.orchestra.run.smithi154:> # Given a non-glob path, it better be there 2024-05-14T01:23:52.879 DEBUG:teuthology.orchestra.run.smithi154:> if "*" not in asok_path: 2024-05-14T01:23:52.880 DEBUG:teuthology.orchestra.run.smithi154:> assert(len(files) == 1) 2024-05-14T01:23:52.880 DEBUG:teuthology.orchestra.run.smithi154:> return files[0] 2024-05-14T01:23:52.880 DEBUG:teuthology.orchestra.run.smithi154:> 2024-05-14T01:23:52.880 DEBUG:teuthology.orchestra.run.smithi154:> for f in files: 2024-05-14T01:23:52.880 DEBUG:teuthology.orchestra.run.smithi154:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-14T01:23:52.880 DEBUG:teuthology.orchestra.run.smithi154:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-14T01:23:52.880 DEBUG:teuthology.orchestra.run.smithi154:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-14T01:23:52.880 DEBUG:teuthology.orchestra.run.smithi154:> contents = proc_f.read() 2024-05-14T01:23:52.880 DEBUG:teuthology.orchestra.run.smithi154:> if mountpoint in contents: 2024-05-14T01:23:52.880 DEBUG:teuthology.orchestra.run.smithi154:> return f 2024-05-14T01:23:52.880 DEBUG:teuthology.orchestra.run.smithi154:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-14T01:23:52.881 DEBUG:teuthology.orchestra.run.smithi154:> 2024-05-14T01:23:52.881 DEBUG:teuthology.orchestra.run.smithi154:> print(_find_admin_socket("client.2")) 2024-05-14T01:23:52.881 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-05-14T01:23:53.003 INFO:teuthology.orchestra.run.smithi154.stdout:/var/run/ceph/ceph-client.2.35041.asok 2024-05-14T01:23:53.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:53.015 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.35041.asok 2024-05-14T01:23:53.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:53.016 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.35041.asok status 2024-05-14T01:23:53.169 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-14T01:23:53.169 INFO:teuthology.orchestra.run.smithi154.stdout: "metadata": { 2024-05-14T01:23:53.169 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_sha1": "2ba596c3826798bb3a2f22bc9b02848b92dbe579", 2024-05-14T01:23:53.169 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 19.0.0-2569-g2ba596c3 (2ba596c3826798bb3a2f22bc9b02848b92dbe579) squid (dev)", 2024-05-14T01:23:53.169 INFO:teuthology.orchestra.run.smithi154.stdout: "entity_id": "2", 2024-05-14T01:23:53.169 INFO:teuthology.orchestra.run.smithi154.stdout: "hostname": "smithi154", 2024-05-14T01:23:53.169 INFO:teuthology.orchestra.run.smithi154.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-05-14T01:23:53.169 INFO:teuthology.orchestra.run.smithi154.stdout: "pid": "35041", 2024-05-14T01:23:53.169 INFO:teuthology.orchestra.run.smithi154.stdout: "root": "/" 2024-05-14T01:23:53.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:23:53.170 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_count": 0, 2024-05-14T01:23:53.170 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_pinned_count": 0, 2024-05-14T01:23:53.170 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4629, 2024-05-14T01:23:53.170 INFO:teuthology.orchestra.run.smithi154.stdout: "inst": { 2024-05-14T01:23:53.170 INFO:teuthology.orchestra.run.smithi154.stdout: "name": { 2024-05-14T01:23:53.170 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "client", 2024-05-14T01:23:53.170 INFO:teuthology.orchestra.run.smithi154.stdout: "num": 4629 2024-05-14T01:23:53.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:23:53.170 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2024-05-14T01:23:53.170 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2024-05-14T01:23:53.171 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.2:0", 2024-05-14T01:23:53.171 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 18212252 2024-05-14T01:23:53.171 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:23:53.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:23:53.171 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2024-05-14T01:23:53.171 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2024-05-14T01:23:53.171 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.2:0", 2024-05-14T01:23:53.171 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 18212252 2024-05-14T01:23:53.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:23:53.171 INFO:teuthology.orchestra.run.smithi154.stdout: "inst_str": "client.4629 192.168.0.2:0/18212252", 2024-05-14T01:23:53.171 INFO:teuthology.orchestra.run.smithi154.stdout: "addr_str": "192.168.0.2:0/18212252", 2024-05-14T01:23:53.171 INFO:teuthology.orchestra.run.smithi154.stdout: "inode_count": 1, 2024-05-14T01:23:53.171 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_epoch": 8, 2024-05-14T01:23:53.171 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch": 21, 2024-05-14T01:23:53.172 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch_barrier": 0, 2024-05-14T01:23:53.172 INFO:teuthology.orchestra.run.smithi154.stdout: "blocklisted": false, 2024-05-14T01:23:53.172 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs" 2024-05-14T01:23:53.172 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-14T01:23:53.183 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T01:23:53.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.326+0000 7efc82145640 1 Processor -- start 2024-05-14T01:23:53.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.326+0000 7efc82145640 1 -- start start 2024-05-14T01:23:53.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.326+0000 7efc82145640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efc7c13ede0 0x7efc7c1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:53.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.326+0000 7efc82145640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efc7c141b30 0x7efc7c0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:53.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.326+0000 7efc82145640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc7c0ce880 0x7efc7c15fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:53.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.326+0000 7efc82145640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7efc7c141f90 con 0x7efc7c141b30 2024-05-14T01:23:53.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.326+0000 7efc82145640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7efc7c06cff0 con 0x7efc7c13ede0 2024-05-14T01:23:53.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.326+0000 7efc82145640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efc7c0cf100 con 0x7efc7c0ce880 2024-05-14T01:23:53.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.326+0000 7efc7affd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efc7c141b30 0x7efc7c0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.326+0000 7efc7affd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efc7c141b30 0x7efc7c0ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55292/0 (socket says 172.21.15.154:55292) 2024-05-14T01:23:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.326+0000 7efc7affd640 1 -- 172.21.15.154:0/2125424801 learned_addr learned my addr 172.21.15.154:0/2125424801 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.326+0000 7efc7b7fe640 1 --2- 172.21.15.154:0/2125424801 >> v2:172.21.15.176:3300/0 conn(0x7efc7c13ede0 0x7efc7c1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.326+0000 7efc7bfff640 1 --2- 172.21.15.154:0/2125424801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc7c0ce880 0x7efc7c15fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.326+0000 7efc7affd640 1 -- 172.21.15.154:0/2125424801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc7c0ce880 msgr2=0x7efc7c15fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.326+0000 7efc7affd640 1 --2- 172.21.15.154:0/2125424801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc7c0ce880 0x7efc7c15fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.326+0000 7efc7affd640 1 -- 172.21.15.154:0/2125424801 >> v2:172.21.15.176:3300/0 conn(0x7efc7c13ede0 msgr2=0x7efc7c1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.326+0000 7efc7affd640 1 --2- 172.21.15.154:0/2125424801 >> v2:172.21.15.176:3300/0 conn(0x7efc7c13ede0 0x7efc7c1415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.326+0000 7efc7affd640 1 -- 172.21.15.154:0/2125424801 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc7c0cf3e0 con 0x7efc7c141b30 2024-05-14T01:23:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.330+0000 7efc7affd640 1 --2- 172.21.15.154:0/2125424801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc7c141b30 0x7efc7c0ce340 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efc7c06c250 tx=0x7efc7001c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482499df1552e80f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.330+0000 7efc7a7fc640 1 -- 172.21.15.154:0/2125424801 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc700b0070 con 0x7efc7c141b30 2024-05-14T01:23:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.330+0000 7efc7a7fc640 1 -- 172.21.15.154:0/2125424801 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc700ab600 con 0x7efc7c141b30 2024-05-14T01:23:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.330+0000 7efc7a7fc640 1 -- 172.21.15.154:0/2125424801 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc700a4e60 con 0x7efc7c141b30 2024-05-14T01:23:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.330+0000 7efc82145640 1 -- 172.21.15.154:0/2125424801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc7c141b30 msgr2=0x7efc7c0ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:53.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.330+0000 7efc82145640 1 --2- 172.21.15.154:0/2125424801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc7c141b30 0x7efc7c0ce340 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efc7c06c250 tx=0x7efc7001c230 comp rx=0 tx=0).stop 2024-05-14T01:23:53.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.330+0000 7efc82145640 1 -- 172.21.15.154:0/2125424801 shutdown_connections 2024-05-14T01:23:53.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.330+0000 7efc82145640 1 --2- 172.21.15.154:0/2125424801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc7c0ce880 0x7efc7c15fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:53.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.330+0000 7efc82145640 1 --2- 172.21.15.154:0/2125424801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc7c141b30 0x7efc7c0ce340 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:53.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.330+0000 7efc82145640 1 --2- 172.21.15.154:0/2125424801 >> v2:172.21.15.176:3300/0 conn(0x7efc7c13ede0 0x7efc7c1415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:53.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.330+0000 7efc82145640 1 -- 172.21.15.154:0/2125424801 >> 172.21.15.154:0/2125424801 conn(0x7efc7c0b1850 msgr2=0x7efc7c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:53.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.330+0000 7efc82145640 1 -- 172.21.15.154:0/2125424801 shutdown_connections 2024-05-14T01:23:53.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.330+0000 7efc82145640 1 -- 172.21.15.154:0/2125424801 wait complete. 2024-05-14T01:23:53.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.330+0000 7efc82145640 1 Processor -- start 2024-05-14T01:23:53.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.330+0000 7efc82145640 1 -- start start 2024-05-14T01:23:53.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc82145640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc7c0ce880 0x7efc7c1520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:53.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc82145640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc7c13ede0 0x7efc7c155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:53.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc82145640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc7c141b30 0x7efc7c1555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:53.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc82145640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c0cee10 con 0x7efc7c141b30 2024-05-14T01:23:53.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc82145640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c0cec90 con 0x7efc7c0ce880 2024-05-14T01:23:53.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc82145640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efc7c06d460 con 0x7efc7c13ede0 2024-05-14T01:23:53.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc7bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc7c141b30 0x7efc7c1555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:53.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc7bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc7c141b30 0x7efc7c1555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55298/0 (socket says 172.21.15.154:55298) 2024-05-14T01:23:53.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc7bfff640 1 -- 172.21.15.154:0/2254232347 learned_addr learned my addr 172.21.15.154:0/2254232347 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:53.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc7b7fe640 1 --2- 172.21.15.154:0/2254232347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc7c0ce880 0x7efc7c1520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:53.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc7affd640 1 --2- 172.21.15.154:0/2254232347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc7c13ede0 0x7efc7c155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:53.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc7bfff640 1 -- 172.21.15.154:0/2254232347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc7c13ede0 msgr2=0x7efc7c155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:53.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc7bfff640 1 --2- 172.21.15.154:0/2254232347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc7c13ede0 0x7efc7c155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:53.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc7bfff640 1 -- 172.21.15.154:0/2254232347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc7c0ce880 msgr2=0x7efc7c1520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:53.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc7bfff640 1 --2- 172.21.15.154:0/2254232347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc7c0ce880 0x7efc7c1520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:53.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc7bfff640 1 -- 172.21.15.154:0/2254232347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc7c1525f0 con 0x7efc7c141b30 2024-05-14T01:23:53.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc7b7fe640 1 --2- 172.21.15.154:0/2254232347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc7c0ce880 0x7efc7c1520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:53.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc7affd640 1 --2- 172.21.15.154:0/2254232347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc7c13ede0 0x7efc7c155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:53.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc7bfff640 1 --2- 172.21.15.154:0/2254232347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc7c141b30 0x7efc7c1555a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efc74007e40 tx=0x7efc7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:53.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc63fff640 1 -- 172.21.15.154:0/2254232347 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc74014620 con 0x7efc7c141b30 2024-05-14T01:23:53.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc63fff640 1 -- 172.21.15.154:0/2254232347 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc74019070 con 0x7efc7c141b30 2024-05-14T01:23:53.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc82145640 1 -- 172.21.15.154:0/2254232347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc7c153660 con 0x7efc7c141b30 2024-05-14T01:23:53.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc63fff640 1 -- 172.21.15.154:0/2254232347 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc74014a20 con 0x7efc7c141b30 2024-05-14T01:23:53.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc82145640 1 -- 172.21.15.154:0/2254232347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc7c153c20 con 0x7efc7c141b30 2024-05-14T01:23:53.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc82145640 1 -- 172.21.15.154:0/2254232347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc7c075470 con 0x7efc7c141b30 2024-05-14T01:23:53.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc63fff640 1 -- 172.21.15.154:0/2254232347 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efc74014bc0 con 0x7efc7c141b30 2024-05-14T01:23:53.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc63fff640 1 --2- 172.21.15.154:0/2254232347 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7efc680678c0 0x7efc68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:53.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc63fff640 1 -- 172.21.15.154:0/2254232347 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efc74086510 con 0x7efc7c141b30 2024-05-14T01:23:53.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc7b7fe640 1 --2- 172.21.15.154:0/2254232347 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7efc680678c0 0x7efc68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:53.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.334+0000 7efc7b7fe640 1 --2- 172.21.15.154:0/2254232347 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7efc680678c0 0x7efc68069d80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0097c0 tx=0x7efc6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:53.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.338+0000 7efc63fff640 1 -- 172.21.15.154:0/2254232347 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7efc740570e0 con 0x7efc7c141b30 2024-05-14T01:23:53.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.542+0000 7efc82145640 1 -- 172.21.15.154:0/2254232347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efc7c0b1600 con 0x7efc7c141b30 2024-05-14T01:23:53.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.542+0000 7efc63fff640 1 -- 172.21.15.154:0/2254232347 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7efc740569e0 con 0x7efc7c141b30 2024-05-14T01:23:53.528 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-14T01:23:53.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.546+0000 7efc82145640 1 -- 172.21.15.154:0/2254232347 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7efc680678c0 msgr2=0x7efc68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:53.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.546+0000 7efc82145640 1 --2- 172.21.15.154:0/2254232347 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7efc680678c0 0x7efc68069d80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0097c0 tx=0x7efc6c008040 comp rx=0 tx=0).stop 2024-05-14T01:23:53.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.546+0000 7efc82145640 1 -- 172.21.15.154:0/2254232347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc7c141b30 msgr2=0x7efc7c1555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:53.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.546+0000 7efc82145640 1 --2- 172.21.15.154:0/2254232347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc7c141b30 0x7efc7c1555a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efc74007e40 tx=0x7efc7400e4b0 comp rx=0 tx=0).stop 2024-05-14T01:23:53.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.546+0000 7efc82145640 1 -- 172.21.15.154:0/2254232347 shutdown_connections 2024-05-14T01:23:53.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.546+0000 7efc82145640 1 --2- 172.21.15.154:0/2254232347 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7efc680678c0 0x7efc68069d80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:53.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.546+0000 7efc82145640 1 --2- 172.21.15.154:0/2254232347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc7c141b30 0x7efc7c1555a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:53.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.546+0000 7efc82145640 1 --2- 172.21.15.154:0/2254232347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc7c13ede0 0x7efc7c155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:53.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.546+0000 7efc82145640 1 --2- 172.21.15.154:0/2254232347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc7c0ce880 0x7efc7c1520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:53.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.546+0000 7efc82145640 1 -- 172.21.15.154:0/2254232347 >> 172.21.15.154:0/2254232347 conn(0x7efc7c0b1850 msgr2=0x7efc7c15a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:53.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.546+0000 7efc82145640 1 -- 172.21.15.154:0/2254232347 shutdown_connections 2024-05-14T01:23:53.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:53.546+0000 7efc82145640 1 -- 172.21.15.154:0/2254232347 wait complete. 2024-05-14T01:23:53.548 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-14T01:23:53.548 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T01:23:53.548 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-05-14T01:23:53.548 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-14T01:23:53.548 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-14T01:23:53.548 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-14T01:23:53.548 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T01:23:53.548 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T01:23:53.548 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-14T01:23:53.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:53.549 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-05-14T01:23:53.556 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T01:23:53.556 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T01:23:53.556 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T01:23:53.556 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:53.556 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-05-14T01:23:53.556 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:53.556 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-14T01:23:53.556 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:53.556 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-05-14T01:23:53.556 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-14T01:23:53.557 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:53.557 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-05-14T01:23:53.557 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-14T01:23:53.557 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:53.557 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T01:23:53.557 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:53.557 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-14T01:23:53.557 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42464sec preferred_lft 42464sec 2024-05-14T01:23:53.557 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link 2024-05-14T01:23:53.557 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:53.557 INFO:teuthology.orchestra.run.smithi176.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-14T01:23:53.557 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 02:42:52:2b:f7:1e brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:53.557 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-14T01:23:53.558 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:53.558 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-14T01:23:53.558 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:23:53.558 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-05-14T01:23:53.558 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add name ceph-brx type bridge 2024-05-14T01:23:53.558 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr flush dev ceph-brx 2024-05-14T01:23:53.558 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set ceph-brx up 2024-05-14T01:23:53.558 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-14T01:23:53.558 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-05-14T01:23:53.645 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:23:53.684 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:53.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:53.692 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T01:23:53.702 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-05-14T01:23:53.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:53.703 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-05-14T01:23:53.775 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-05-14T01:23:53.775 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T01:23:53.775 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-14T01:23:53.775 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-14T01:23:53.776 INFO:teuthology.orchestra.run.smithi176.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-14T01:23:53.776 INFO:teuthology.orchestra.run.smithi176.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-14T01:23:53.776 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-14T01:23:53.776 INFO:teuthology.orchestra.run.smithi176.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-14T01:23:53.776 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-14T01:23:53.776 INFO:teuthology.orchestra.run.smithi176.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-14T01:23:53.776 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T01:23:53.776 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:23:53.776 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-05-14T01:23:53.777 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-14T01:23:53.777 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-14T01:23:53.777 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-14T01:23:53.777 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-05-14T01:23:53.866 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:23:53.896 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:53.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:53.903 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-05-14T01:23:53.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:53.908 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2024-05-14T01:23:53.956 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:23:53.957 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-05-14T01:23:53.957 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T01:23:53.957 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-14T01:23:53.957 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-05-14T01:23:54.044 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:23:54.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:54.073 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-14T01:23:54.073 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:23:54.073 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-05-14T01:23:54.073 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-14T01:23:54.073 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-14T01:23:54.073 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-14T01:23:54.073 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-14T01:23:54.073 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-14T01:23:54.073 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-05-14T01:23:54.118 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:23:54.181 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:54.188 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:23:54.188 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-05-14T01:23:54.188 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-05-14T01:23:54.188 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.0 master ceph-brx 2024-05-14T01:23:54.188 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-05-14T01:23:54.269 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:23:54.284 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:54.291 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-05-14T01:23:54.291 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T01:23:54.291 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-14T01:23:54.335 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-14T01:23:54.336 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T01:23:54.336 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-14T01:23:54.384 DEBUG:teuthology.orchestra.run.smithi176:> sudo modprobe fuse 2024-05-14T01:23:54.439 DEBUG:teuthology.orchestra.run.smithi176:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T01:23:54.494 INFO:teuthology.orchestra.run.smithi176.stdout:/sys 2024-05-14T01:23:54.494 INFO:teuthology.orchestra.run.smithi176.stdout:/proc 2024-05-14T01:23:54.494 INFO:teuthology.orchestra.run.smithi176.stdout:/dev 2024-05-14T01:23:54.494 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/pts 2024-05-14T01:23:54.494 INFO:teuthology.orchestra.run.smithi176.stdout:/run 2024-05-14T01:23:54.494 INFO:teuthology.orchestra.run.smithi176.stdout:/ 2024-05-14T01:23:54.494 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/security 2024-05-14T01:23:54.494 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/shm 2024-05-14T01:23:54.495 INFO:teuthology.orchestra.run.smithi176.stdout:/run/lock 2024-05-14T01:23:54.495 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/cgroup 2024-05-14T01:23:54.495 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/pstore 2024-05-14T01:23:54.495 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/bpf 2024-05-14T01:23:54.495 INFO:teuthology.orchestra.run.smithi176.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T01:23:54.495 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/hugepages 2024-05-14T01:23:54.495 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/mqueue 2024-05-14T01:23:54.495 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/debug 2024-05-14T01:23:54.495 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/tracing 2024-05-14T01:23:54.495 INFO:teuthology.orchestra.run.smithi176.stdout:/proc/fs/nfsd 2024-05-14T01:23:54.495 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/fuse/connections 2024-05-14T01:23:54.495 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/config 2024-05-14T01:23:54.495 INFO:teuthology.orchestra.run.smithi176.stdout:/run/credentials/systemd-sysusers.service 2024-05-14T01:23:54.496 INFO:teuthology.orchestra.run.smithi176.stdout:/run/rpc_pipefs 2024-05-14T01:23:54.496 INFO:teuthology.orchestra.run.smithi176.stdout:/run/user/1000 2024-05-14T01:23:54.496 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph 2024-05-14T01:23:54.496 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-4 2024-05-14T01:23:54.496 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-5 2024-05-14T01:23:54.496 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-6 2024-05-14T01:23:54.496 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-7 2024-05-14T01:23:54.496 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns 2024-05-14T01:23:54.496 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T01:23:54.496 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T01:23:54.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:54.497 DEBUG:teuthology.orchestra.run.smithi176:> ls /sys/fs/fuse/connections 2024-05-14T01:23:54.544 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-14T01:23:54.544 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-05-14T01:23:54.589 DEBUG:teuthology.orchestra.run.smithi176:> sudo modprobe fuse 2024-05-14T01:23:54.601 DEBUG:teuthology.orchestra.run.smithi176:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T01:23:54.649 INFO:teuthology.orchestra.run.smithi176.stdout:/sys 2024-05-14T01:23:54.649 INFO:teuthology.orchestra.run.smithi176.stdout:/proc 2024-05-14T01:23:54.649 INFO:teuthology.orchestra.run.smithi176.stdout:/dev 2024-05-14T01:23:54.649 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/pts 2024-05-14T01:23:54.649 INFO:teuthology.orchestra.run.smithi176.stdout:/run 2024-05-14T01:23:54.649 INFO:teuthology.orchestra.run.smithi176.stdout:/ 2024-05-14T01:23:54.649 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/security 2024-05-14T01:23:54.649 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/shm 2024-05-14T01:23:54.650 INFO:teuthology.orchestra.run.smithi176.stdout:/run/lock 2024-05-14T01:23:54.650 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/cgroup 2024-05-14T01:23:54.650 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/pstore 2024-05-14T01:23:54.650 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/bpf 2024-05-14T01:23:54.650 INFO:teuthology.orchestra.run.smithi176.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T01:23:54.650 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/hugepages 2024-05-14T01:23:54.650 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/mqueue 2024-05-14T01:23:54.650 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/debug 2024-05-14T01:23:54.650 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/tracing 2024-05-14T01:23:54.650 INFO:teuthology.orchestra.run.smithi176.stdout:/proc/fs/nfsd 2024-05-14T01:23:54.650 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/fuse/connections 2024-05-14T01:23:54.651 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/config 2024-05-14T01:23:54.651 INFO:teuthology.orchestra.run.smithi176.stdout:/run/credentials/systemd-sysusers.service 2024-05-14T01:23:54.651 INFO:teuthology.orchestra.run.smithi176.stdout:/run/rpc_pipefs 2024-05-14T01:23:54.651 INFO:teuthology.orchestra.run.smithi176.stdout:/run/user/1000 2024-05-14T01:23:54.651 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph 2024-05-14T01:23:54.651 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-4 2024-05-14T01:23:54.651 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-5 2024-05-14T01:23:54.651 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-6 2024-05-14T01:23:54.651 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-7 2024-05-14T01:23:54.651 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns 2024-05-14T01:23:54.651 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T01:23:54.651 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T01:23:54.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:54.652 DEBUG:teuthology.orchestra.run.smithi176:> ls /sys/fs/fuse/connections 2024-05-14T01:23:54.667 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi176.stderr:2024-05-14T01:23:54.679+0000 7fb24564a580 -1 init, newargv = 0x55e48944f9a0 newargc=15 2024-05-14T01:23:54.667 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi176.stderr:ceph-fuse[33363]: starting ceph client 2024-05-14T01:23:54.673 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi176.stderr:ceph-fuse[33363]: starting fuse 2024-05-14T01:23:55.772 DEBUG:teuthology.orchestra.run.smithi176:> sudo modprobe fuse 2024-05-14T01:23:55.789 DEBUG:teuthology.orchestra.run.smithi176:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T01:23:55.837 INFO:teuthology.orchestra.run.smithi176.stdout:/sys 2024-05-14T01:23:55.837 INFO:teuthology.orchestra.run.smithi176.stdout:/proc 2024-05-14T01:23:55.837 INFO:teuthology.orchestra.run.smithi176.stdout:/dev 2024-05-14T01:23:55.837 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/pts 2024-05-14T01:23:55.838 INFO:teuthology.orchestra.run.smithi176.stdout:/run 2024-05-14T01:23:55.838 INFO:teuthology.orchestra.run.smithi176.stdout:/ 2024-05-14T01:23:55.838 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/security 2024-05-14T01:23:55.838 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/shm 2024-05-14T01:23:55.838 INFO:teuthology.orchestra.run.smithi176.stdout:/run/lock 2024-05-14T01:23:55.838 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/cgroup 2024-05-14T01:23:55.838 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/pstore 2024-05-14T01:23:55.838 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/bpf 2024-05-14T01:23:55.838 INFO:teuthology.orchestra.run.smithi176.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T01:23:55.838 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/hugepages 2024-05-14T01:23:55.838 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/mqueue 2024-05-14T01:23:55.838 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/debug 2024-05-14T01:23:55.839 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/tracing 2024-05-14T01:23:55.839 INFO:teuthology.orchestra.run.smithi176.stdout:/proc/fs/nfsd 2024-05-14T01:23:55.839 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/fuse/connections 2024-05-14T01:23:55.839 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/config 2024-05-14T01:23:55.839 INFO:teuthology.orchestra.run.smithi176.stdout:/run/credentials/systemd-sysusers.service 2024-05-14T01:23:55.839 INFO:teuthology.orchestra.run.smithi176.stdout:/run/rpc_pipefs 2024-05-14T01:23:55.839 INFO:teuthology.orchestra.run.smithi176.stdout:/run/user/1000 2024-05-14T01:23:55.839 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph 2024-05-14T01:23:55.839 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-4 2024-05-14T01:23:55.839 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-5 2024-05-14T01:23:55.839 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-6 2024-05-14T01:23:55.839 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-7 2024-05-14T01:23:55.839 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns 2024-05-14T01:23:55.839 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T01:23:55.839 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T01:23:55.839 INFO:teuthology.orchestra.run.smithi176.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-14T01:23:55.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:55.840 DEBUG:teuthology.orchestra.run.smithi176:> ls /sys/fs/fuse/connections 2024-05-14T01:23:55.888 INFO:teuthology.orchestra.run.smithi176.stdout:45 2024-05-14T01:23:55.888 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-05-14T01:23:55.888 DEBUG:teuthology.orchestra.run.smithi176:> sudo stdin-killer -- python3 -c ' 2024-05-14T01:23:55.888 DEBUG:teuthology.orchestra.run.smithi176:> import glob 2024-05-14T01:23:55.889 DEBUG:teuthology.orchestra.run.smithi176:> import re 2024-05-14T01:23:55.889 DEBUG:teuthology.orchestra.run.smithi176:> import os 2024-05-14T01:23:55.889 DEBUG:teuthology.orchestra.run.smithi176:> import subprocess 2024-05-14T01:23:55.889 DEBUG:teuthology.orchestra.run.smithi176:> 2024-05-14T01:23:55.889 DEBUG:teuthology.orchestra.run.smithi176:> def _find_admin_socket(client_name): 2024-05-14T01:23:55.889 DEBUG:teuthology.orchestra.run.smithi176:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-05-14T01:23:55.889 DEBUG:teuthology.orchestra.run.smithi176:> files = glob.glob(asok_path) 2024-05-14T01:23:55.889 DEBUG:teuthology.orchestra.run.smithi176:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-05-14T01:23:55.889 DEBUG:teuthology.orchestra.run.smithi176:> 2024-05-14T01:23:55.889 DEBUG:teuthology.orchestra.run.smithi176:> # Given a non-glob path, it better be there 2024-05-14T01:23:55.889 DEBUG:teuthology.orchestra.run.smithi176:> if "*" not in asok_path: 2024-05-14T01:23:55.889 DEBUG:teuthology.orchestra.run.smithi176:> assert(len(files) == 1) 2024-05-14T01:23:55.889 DEBUG:teuthology.orchestra.run.smithi176:> return files[0] 2024-05-14T01:23:55.889 DEBUG:teuthology.orchestra.run.smithi176:> 2024-05-14T01:23:55.889 DEBUG:teuthology.orchestra.run.smithi176:> for f in files: 2024-05-14T01:23:55.889 DEBUG:teuthology.orchestra.run.smithi176:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-14T01:23:55.889 DEBUG:teuthology.orchestra.run.smithi176:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-14T01:23:55.890 DEBUG:teuthology.orchestra.run.smithi176:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-14T01:23:55.890 DEBUG:teuthology.orchestra.run.smithi176:> contents = proc_f.read() 2024-05-14T01:23:55.890 DEBUG:teuthology.orchestra.run.smithi176:> if mountpoint in contents: 2024-05-14T01:23:55.890 DEBUG:teuthology.orchestra.run.smithi176:> return f 2024-05-14T01:23:55.890 DEBUG:teuthology.orchestra.run.smithi176:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-14T01:23:55.890 DEBUG:teuthology.orchestra.run.smithi176:> 2024-05-14T01:23:55.890 DEBUG:teuthology.orchestra.run.smithi176:> print(_find_admin_socket("client.1")) 2024-05-14T01:23:55.890 DEBUG:teuthology.orchestra.run.smithi176:> ' 2024-05-14T01:23:56.013 INFO:teuthology.orchestra.run.smithi176.stdout:/var/run/ceph/ceph-client.1.33363.asok 2024-05-14T01:23:56.017 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:56.026 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33363.asok 2024-05-14T01:23:56.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:56.026 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33363.asok status 2024-05-14T01:23:56.181 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-05-14T01:23:56.182 INFO:teuthology.orchestra.run.smithi176.stdout: "metadata": { 2024-05-14T01:23:56.182 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_sha1": "2ba596c3826798bb3a2f22bc9b02848b92dbe579", 2024-05-14T01:23:56.182 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_version": "ceph version 19.0.0-2569-g2ba596c3 (2ba596c3826798bb3a2f22bc9b02848b92dbe579) squid (dev)", 2024-05-14T01:23:56.182 INFO:teuthology.orchestra.run.smithi176.stdout: "entity_id": "1", 2024-05-14T01:23:56.182 INFO:teuthology.orchestra.run.smithi176.stdout: "hostname": "smithi176", 2024-05-14T01:23:56.182 INFO:teuthology.orchestra.run.smithi176.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-05-14T01:23:56.182 INFO:teuthology.orchestra.run.smithi176.stdout: "pid": "33363", 2024-05-14T01:23:56.182 INFO:teuthology.orchestra.run.smithi176.stdout: "root": "/" 2024-05-14T01:23:56.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-14T01:23:56.182 INFO:teuthology.orchestra.run.smithi176.stdout: "dentry_count": 0, 2024-05-14T01:23:56.182 INFO:teuthology.orchestra.run.smithi176.stdout: "dentry_pinned_count": 0, 2024-05-14T01:23:56.183 INFO:teuthology.orchestra.run.smithi176.stdout: "id": 4537, 2024-05-14T01:23:56.183 INFO:teuthology.orchestra.run.smithi176.stdout: "inst": { 2024-05-14T01:23:56.183 INFO:teuthology.orchestra.run.smithi176.stdout: "name": { 2024-05-14T01:23:56.183 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "client", 2024-05-14T01:23:56.183 INFO:teuthology.orchestra.run.smithi176.stdout: "num": 4537 2024-05-14T01:23:56.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-14T01:23:56.183 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": { 2024-05-14T01:23:56.183 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "v1", 2024-05-14T01:23:56.183 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": "192.168.0.1:0", 2024-05-14T01:23:56.183 INFO:teuthology.orchestra.run.smithi176.stdout: "nonce": 182659566 2024-05-14T01:23:56.183 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-14T01:23:56.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-14T01:23:56.183 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": { 2024-05-14T01:23:56.183 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "v1", 2024-05-14T01:23:56.184 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": "192.168.0.1:0", 2024-05-14T01:23:56.184 INFO:teuthology.orchestra.run.smithi176.stdout: "nonce": 182659566 2024-05-14T01:23:56.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-14T01:23:56.184 INFO:teuthology.orchestra.run.smithi176.stdout: "inst_str": "client.4537 192.168.0.1:0/182659566", 2024-05-14T01:23:56.184 INFO:teuthology.orchestra.run.smithi176.stdout: "addr_str": "192.168.0.1:0/182659566", 2024-05-14T01:23:56.184 INFO:teuthology.orchestra.run.smithi176.stdout: "inode_count": 1, 2024-05-14T01:23:56.184 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_epoch": 8, 2024-05-14T01:23:56.184 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_epoch": 21, 2024-05-14T01:23:56.184 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_epoch_barrier": 0, 2024-05-14T01:23:56.184 INFO:teuthology.orchestra.run.smithi176.stdout: "blocklisted": false, 2024-05-14T01:23:56.184 INFO:teuthology.orchestra.run.smithi176.stdout: "fs_name": "cephfs" 2024-05-14T01:23:56.184 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-05-14T01:23:56.195 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T01:23:56.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.337+0000 7fd4dcae1640 1 Processor -- start 2024-05-14T01:23:56.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.337+0000 7fd4dcae1640 1 -- start start 2024-05-14T01:23:56.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4dcae1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4d80b4820 0x7fd4d806d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:56.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4dcae1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4d80b4110 con 0x7fd4d8071240 2024-05-14T01:23:56.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4dcae1640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4d80ad880 con 0x7fd4d8070e60 2024-05-14T01:23:56.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4dcae1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd4d80b2d60 con 0x7fd4d80b4820 2024-05-14T01:23:56.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d6d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd4d8071240 0x7fd4d80716d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54260/0 (socket says 172.21.15.154:54260) 2024-05-14T01:23:56.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d6d9d640 1 -- 172.21.15.154:0/2597378374 learned_addr learned my addr 172.21.15.154:0/2597378374 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:23:56.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d5d9b640 1 --2- 172.21.15.154:0/2597378374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4d80b4820 0x7fd4d806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:56.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d559a640 1 -- 172.21.15.154:0/2597378374 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4286286910 0 0) 0x7fd4d80b4110 con 0x7fd4d8071240 2024-05-14T01:23:56.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d559a640 1 -- 172.21.15.154:0/2597378374 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4c0003530 con 0x7fd4d8071240 2024-05-14T01:23:56.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d559a640 1 -- 172.21.15.154:0/2597378374 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2552825858 0 0) 0x7fd4c0003530 con 0x7fd4d8071240 2024-05-14T01:23:56.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d559a640 1 -- 172.21.15.154:0/2597378374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4d80b4820 msgr2=0x7fd4d806d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:56.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d559a640 1 --2- 172.21.15.154:0/2597378374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4d80b4820 0x7fd4d806d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:56.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d559a640 1 -- 172.21.15.154:0/2597378374 >> v1:172.21.15.176:6789/0 conn(0x7fd4d8070e60 legacy=0x7fd4d80b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:56.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d559a640 1 -- 172.21.15.154:0/2597378374 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d80adb60 con 0x7fd4d8071240 2024-05-14T01:23:56.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d559a640 1 -- 172.21.15.154:0/2597378374 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fd4d0001a00 con 0x7fd4d8071240 2024-05-14T01:23:56.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d559a640 1 -- 172.21.15.154:0/2597378374 >> v1:172.21.15.154:6789/0 conn(0x7fd4d8071240 legacy=0x7fd4d80716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:56.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d559a640 1 --2- 172.21.15.154:0/2597378374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c00039f0 0x7fd4c0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:56.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d559a640 1 --2- 172.21.15.154:0/2597378374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4c0004810 0x7fd4c0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:56.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d559a640 1 --2- 172.21.15.154:0/2597378374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4d80b4820 0x7fd4c00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:56.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d559a640 1 -- 172.21.15.154:0/2597378374 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c000ba80 con 0x7fd4c00039f0 2024-05-14T01:23:56.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d559a640 1 -- 172.21.15.154:0/2597378374 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c000bc00 con 0x7fd4c0004810 2024-05-14T01:23:56.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d559a640 1 -- 172.21.15.154:0/2597378374 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd4c000be00 con 0x7fd4d80b4820 2024-05-14T01:23:56.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d659c640 1 --2- 172.21.15.154:0/2597378374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c00039f0 0x7fd4c0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:56.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d6d9d640 1 --2- 172.21.15.154:0/2597378374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4d80b4820 0x7fd4c00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:56.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d5d9b640 1 --2- 172.21.15.154:0/2597378374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4c0004810 0x7fd4c0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:56.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d659c640 1 -- 172.21.15.154:0/2597378374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4d80b4820 msgr2=0x7fd4c00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:56.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d659c640 1 --2- 172.21.15.154:0/2597378374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4d80b4820 0x7fd4c00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:56.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d659c640 1 -- 172.21.15.154:0/2597378374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4c0004810 msgr2=0x7fd4c0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:56.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d659c640 1 --2- 172.21.15.154:0/2597378374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4c0004810 0x7fd4c0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:56.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.341+0000 7fd4d659c640 1 -- 172.21.15.154:0/2597378374 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c0003530 con 0x7fd4c00039f0 2024-05-14T01:23:56.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4d659c640 1 --2- 172.21.15.154:0/2597378374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c00039f0 0x7fd4c0003e10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc001750 tx=0x7fd4cc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12456d5d4f08c9ec server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:56.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4d559a640 1 -- 172.21.15.154:0/2597378374 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc0013a0 con 0x7fd4c00039f0 2024-05-14T01:23:56.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4d559a640 1 -- 172.21.15.154:0/2597378374 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4cc0052f0 con 0x7fd4c00039f0 2024-05-14T01:23:56.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4d559a640 1 -- 172.21.15.154:0/2597378374 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc003840 con 0x7fd4c00039f0 2024-05-14T01:23:56.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4dcae1640 1 -- 172.21.15.154:0/2597378374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c00039f0 msgr2=0x7fd4c0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:56.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4dcae1640 1 --2- 172.21.15.154:0/2597378374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c00039f0 0x7fd4c0003e10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc001750 tx=0x7fd4cc01c3c0 comp rx=0 tx=0).stop 2024-05-14T01:23:56.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4d6d9d640 1 -- 172.21.15.154:0/2597378374 reap_dead start 2024-05-14T01:23:56.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4dcae1640 1 -- 172.21.15.154:0/2597378374 shutdown_connections 2024-05-14T01:23:56.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4dcae1640 1 -- 172.21.15.154:0/2597378374 >> 172.21.15.154:0/2597378374 conn(0x7fd4d80b1850 msgr2=0x7fd4d80b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:56.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4dcae1640 1 -- 172.21.15.154:0/2597378374 shutdown_connections 2024-05-14T01:23:56.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4dcae1640 1 -- 172.21.15.154:0/2597378374 wait complete. 2024-05-14T01:23:56.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4dcae1640 1 Processor -- start 2024-05-14T01:23:56.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4dcae1640 1 -- start start 2024-05-14T01:23:56.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4dcae1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4d813f780 0x7fd4d814d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:56.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4dcae1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d815f8c0 0x7fd4d8160f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:56.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4dcae1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4d81684c0 0x7fd4d8168940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:56.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4dcae1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d80af080 con 0x7fd4d815f8c0 2024-05-14T01:23:56.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4dcae1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d8169d10 con 0x7fd4d81684c0 2024-05-14T01:23:56.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4dcae1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd4d8160a90 con 0x7fd4d813f780 2024-05-14T01:23:56.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4d5d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d815f8c0 0x7fd4d8160f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:56.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4d5d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d815f8c0 0x7fd4d8160f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55312/0 (socket says 172.21.15.154:55312) 2024-05-14T01:23:56.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4d5d9b640 1 -- 172.21.15.154:0/4041275493 learned_addr learned my addr 172.21.15.154:0/4041275493 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:56.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4d659c640 1 --2- 172.21.15.154:0/4041275493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4d813f780 0x7fd4d814d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:56.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4d6d9d640 1 --2- 172.21.15.154:0/4041275493 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4d81684c0 0x7fd4d8168940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:56.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4d5d9b640 1 -- 172.21.15.154:0/4041275493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4d813f780 msgr2=0x7fd4d814d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:56.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4d5d9b640 1 --2- 172.21.15.154:0/4041275493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4d813f780 0x7fd4d814d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:56.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4d5d9b640 1 -- 172.21.15.154:0/4041275493 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4d81684c0 msgr2=0x7fd4d8168940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:56.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4d5d9b640 1 --2- 172.21.15.154:0/4041275493 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4d81684c0 0x7fd4d8168940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:56.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4d5d9b640 1 -- 172.21.15.154:0/4041275493 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d815fe80 con 0x7fd4d815f8c0 2024-05-14T01:23:56.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.345+0000 7fd4d6d9d640 1 --2- 172.21.15.154:0/4041275493 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4d81684c0 0x7fd4d8168940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:56.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.349+0000 7fd4d5d9b640 1 --2- 172.21.15.154:0/4041275493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d815f8c0 0x7fd4d8160f20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80115e0 tx=0x7fd4c8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:56.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.349+0000 7fd4c6ffd640 1 -- 172.21.15.154:0/4041275493 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c800f8f0 con 0x7fd4d815f8c0 2024-05-14T01:23:56.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.349+0000 7fd4c6ffd640 1 -- 172.21.15.154:0/4041275493 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4c800fa90 con 0x7fd4d815f8c0 2024-05-14T01:23:56.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.349+0000 7fd4dcae1640 1 -- 172.21.15.154:0/4041275493 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4d8160160 con 0x7fd4d815f8c0 2024-05-14T01:23:56.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.349+0000 7fd4c6ffd640 1 -- 172.21.15.154:0/4041275493 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c800fe60 con 0x7fd4d815f8c0 2024-05-14T01:23:56.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.349+0000 7fd4dcae1640 1 -- 172.21.15.154:0/4041275493 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4d8160720 con 0x7fd4d815f8c0 2024-05-14T01:23:56.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.349+0000 7fd4dcae1640 1 -- 172.21.15.154:0/4041275493 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4d8075470 con 0x7fd4d815f8c0 2024-05-14T01:23:56.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.349+0000 7fd4c6ffd640 1 -- 172.21.15.154:0/4041275493 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd4c8015460 con 0x7fd4d815f8c0 2024-05-14T01:23:56.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.349+0000 7fd4c6ffd640 1 --2- 172.21.15.154:0/4041275493 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd4b80678c0 0x7fd4b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:56.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.349+0000 7fd4c6ffd640 1 -- 172.21.15.154:0/4041275493 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd4c80865f0 con 0x7fd4d815f8c0 2024-05-14T01:23:56.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.349+0000 7fd4d659c640 1 --2- 172.21.15.154:0/4041275493 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd4b80678c0 0x7fd4b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:56.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.349+0000 7fd4d659c640 1 --2- 172.21.15.154:0/4041275493 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd4b80678c0 0x7fd4b8069d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00057f0 tx=0x7fd4cc0011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:56.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.353+0000 7fd4c6ffd640 1 -- 172.21.15.154:0/4041275493 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fd4c8019030 con 0x7fd4d815f8c0 2024-05-14T01:23:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.553+0000 7fd4dcae1640 1 -- 172.21.15.154:0/4041275493 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd4d8155260 con 0x7fd4d815f8c0 2024-05-14T01:23:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.553+0000 7fd4c6ffd640 1 -- 172.21.15.154:0/4041275493 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fd4c8057130 con 0x7fd4d815f8c0 2024-05-14T01:23:56.539 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-14T01:23:56.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.557+0000 7fd4dcae1640 1 -- 172.21.15.154:0/4041275493 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd4b80678c0 msgr2=0x7fd4b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:56.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.557+0000 7fd4dcae1640 1 --2- 172.21.15.154:0/4041275493 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd4b80678c0 0x7fd4b8069d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00057f0 tx=0x7fd4cc0011a0 comp rx=0 tx=0).stop 2024-05-14T01:23:56.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.557+0000 7fd4dcae1640 1 -- 172.21.15.154:0/4041275493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d815f8c0 msgr2=0x7fd4d8160f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:56.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.557+0000 7fd4dcae1640 1 --2- 172.21.15.154:0/4041275493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d815f8c0 0x7fd4d8160f20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80115e0 tx=0x7fd4c8011aa0 comp rx=0 tx=0).stop 2024-05-14T01:23:56.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.557+0000 7fd4dcae1640 1 -- 172.21.15.154:0/4041275493 shutdown_connections 2024-05-14T01:23:56.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.557+0000 7fd4dcae1640 1 --2- 172.21.15.154:0/4041275493 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd4b80678c0 0x7fd4b8069d80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:56.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.557+0000 7fd4dcae1640 1 --2- 172.21.15.154:0/4041275493 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4d81684c0 0x7fd4d8168940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:56.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.557+0000 7fd4dcae1640 1 --2- 172.21.15.154:0/4041275493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d815f8c0 0x7fd4d8160f20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:56.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.557+0000 7fd4dcae1640 1 --2- 172.21.15.154:0/4041275493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4d813f780 0x7fd4d814d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:56.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.557+0000 7fd4dcae1640 1 -- 172.21.15.154:0/4041275493 >> 172.21.15.154:0/4041275493 conn(0x7fd4d80b1850 msgr2=0x7fd4d80b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:56.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.557+0000 7fd4dcae1640 1 -- 172.21.15.154:0/4041275493 shutdown_connections 2024-05-14T01:23:56.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:56.557+0000 7fd4dcae1640 1 -- 172.21.15.154:0/4041275493 wait complete. 2024-05-14T01:23:56.558 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-14T01:23:56.558 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T01:23:56.558 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-05-14T01:23:56.558 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-14T01:23:56.558 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-14T01:23:56.558 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-14T01:23:56.558 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T01:23:56.558 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T01:23:56.558 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-14T01:23:56.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:56.558 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-05-14T01:23:56.565 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T01:23:56.565 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T01:23:56.565 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T01:23:56.565 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:56.566 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-05-14T01:23:56.566 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:56.566 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-14T01:23:56.566 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:56.566 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-05-14T01:23:56.566 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-14T01:23:56.566 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:56.566 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-05-14T01:23:56.566 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-14T01:23:56.566 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:56.566 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T01:23:56.566 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:56.567 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-14T01:23:56.567 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42461sec preferred_lft 42461sec 2024-05-14T01:23:56.567 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link 2024-05-14T01:23:56.567 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:56.567 INFO:teuthology.orchestra.run.smithi176.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-14T01:23:56.567 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 02:42:52:2b:f7:1e brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:56.567 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-14T01:23:56.567 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:56.567 INFO:teuthology.orchestra.run.smithi176.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T01:23:56.567 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-14T01:23:56.567 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-14T01:23:56.567 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:56.567 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-14T01:23:56.567 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:56.568 INFO:teuthology.orchestra.run.smithi176.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-14T01:23:56.568 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T01:23:56.568 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-14T01:23:56.568 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:56.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:56.568 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T01:23:56.626 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-05-14T01:23:56.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:56.628 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-05-14T01:23:56.680 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-05-14T01:23:56.681 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T01:23:56.681 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-14T01:23:56.681 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-14T01:23:56.681 INFO:teuthology.orchestra.run.smithi176.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-14T01:23:56.681 INFO:teuthology.orchestra.run.smithi176.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-14T01:23:56.681 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-14T01:23:56.681 INFO:teuthology.orchestra.run.smithi176.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-14T01:23:56.681 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-14T01:23:56.681 INFO:teuthology.orchestra.run.smithi176.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-14T01:23:56.681 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T01:23:56.682 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:23:56.682 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-05-14T01:23:56.682 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-14T01:23:56.682 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-14T01:23:56.682 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-14T01:23:56.682 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-05-14T01:23:56.769 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:23:56.797 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:56.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:56.805 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-05-14T01:23:56.811 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-14T01:23:56.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:56.811 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2024-05-14T01:23:56.856 INFO:teuthology.orchestra.run.smithi176.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-14T01:23:56.856 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:23:56.856 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-05-14T01:23:56.856 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-14T01:23:56.856 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-14T01:23:56.856 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-05-14T01:23:56.944 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:23:56.964 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:56.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:56.972 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-14T01:23:56.982 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T01:23:56.983 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T01:23:56.983 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T01:23:56.983 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:56.983 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-05-14T01:23:56.983 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:56.983 INFO:teuthology.orchestra.run.smithi176.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T01:23:56.983 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d2:96:79:09:09:eb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-14T01:23:56.983 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-14T01:23:56.983 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:56.983 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::d096:79ff:fe09:9eb/64 scope link 2024-05-14T01:23:56.983 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:56.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:56.984 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-14T01:23:57.040 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T01:23:57.040 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T01:23:57.040 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T01:23:57.040 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:57.041 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-05-14T01:23:57.041 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:57.041 INFO:teuthology.orchestra.run.smithi176.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T01:23:57.041 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d2:96:79:09:09:eb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-14T01:23:57.041 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-14T01:23:57.041 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:57.041 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::d096:79ff:fe09:9eb/64 scope link 2024-05-14T01:23:57.041 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:23:57.042 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-14T01:23:57.043 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:23:57.043 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-05-14T01:23:57.043 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-14T01:23:57.043 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-14T01:23:57.043 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-14T01:23:57.043 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-14T01:23:57.043 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-14T01:23:57.043 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-05-14T01:23:57.130 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:23:57.177 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:57.184 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:23:57.184 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-05-14T01:23:57.184 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.1 up 2024-05-14T01:23:57.184 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.1 master ceph-brx 2024-05-14T01:23:57.184 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-05-14T01:23:57.223 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:23:57.239 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:57.245 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-05-14T01:23:57.245 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T01:23:57.246 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-14T01:23:57.292 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-14T01:23:57.293 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T01:23:57.293 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-14T01:23:57.339 DEBUG:teuthology.orchestra.run.smithi176:> sudo modprobe fuse 2024-05-14T01:23:57.401 DEBUG:teuthology.orchestra.run.smithi176:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T01:23:57.450 INFO:teuthology.orchestra.run.smithi176.stdout:/sys 2024-05-14T01:23:57.451 INFO:teuthology.orchestra.run.smithi176.stdout:/proc 2024-05-14T01:23:57.451 INFO:teuthology.orchestra.run.smithi176.stdout:/dev 2024-05-14T01:23:57.451 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/pts 2024-05-14T01:23:57.451 INFO:teuthology.orchestra.run.smithi176.stdout:/run 2024-05-14T01:23:57.451 INFO:teuthology.orchestra.run.smithi176.stdout:/ 2024-05-14T01:23:57.451 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/security 2024-05-14T01:23:57.451 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/shm 2024-05-14T01:23:57.451 INFO:teuthology.orchestra.run.smithi176.stdout:/run/lock 2024-05-14T01:23:57.451 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/cgroup 2024-05-14T01:23:57.451 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/pstore 2024-05-14T01:23:57.451 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/bpf 2024-05-14T01:23:57.451 INFO:teuthology.orchestra.run.smithi176.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T01:23:57.451 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/hugepages 2024-05-14T01:23:57.451 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/mqueue 2024-05-14T01:23:57.451 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/debug 2024-05-14T01:23:57.452 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/tracing 2024-05-14T01:23:57.452 INFO:teuthology.orchestra.run.smithi176.stdout:/proc/fs/nfsd 2024-05-14T01:23:57.452 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/fuse/connections 2024-05-14T01:23:57.452 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/config 2024-05-14T01:23:57.452 INFO:teuthology.orchestra.run.smithi176.stdout:/run/credentials/systemd-sysusers.service 2024-05-14T01:23:57.452 INFO:teuthology.orchestra.run.smithi176.stdout:/run/rpc_pipefs 2024-05-14T01:23:57.452 INFO:teuthology.orchestra.run.smithi176.stdout:/run/user/1000 2024-05-14T01:23:57.452 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph 2024-05-14T01:23:57.452 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-4 2024-05-14T01:23:57.452 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-5 2024-05-14T01:23:57.452 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-6 2024-05-14T01:23:57.452 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-7 2024-05-14T01:23:57.452 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns 2024-05-14T01:23:57.452 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T01:23:57.452 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T01:23:57.452 INFO:teuthology.orchestra.run.smithi176.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-14T01:23:57.453 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-14T01:23:57.453 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-14T01:23:57.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:57.453 DEBUG:teuthology.orchestra.run.smithi176:> ls /sys/fs/fuse/connections 2024-05-14T01:23:57.504 INFO:teuthology.orchestra.run.smithi176.stdout:45 2024-05-14T01:23:57.504 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-05-14T01:23:57.504 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-05-14T01:23:57.553 DEBUG:teuthology.orchestra.run.smithi176:> sudo modprobe fuse 2024-05-14T01:23:57.566 DEBUG:teuthology.orchestra.run.smithi176:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T01:23:57.612 INFO:teuthology.orchestra.run.smithi176.stdout:/sys 2024-05-14T01:23:57.612 INFO:teuthology.orchestra.run.smithi176.stdout:/proc 2024-05-14T01:23:57.612 INFO:teuthology.orchestra.run.smithi176.stdout:/dev 2024-05-14T01:23:57.612 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/pts 2024-05-14T01:23:57.613 INFO:teuthology.orchestra.run.smithi176.stdout:/run 2024-05-14T01:23:57.613 INFO:teuthology.orchestra.run.smithi176.stdout:/ 2024-05-14T01:23:57.613 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/security 2024-05-14T01:23:57.613 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/shm 2024-05-14T01:23:57.613 INFO:teuthology.orchestra.run.smithi176.stdout:/run/lock 2024-05-14T01:23:57.613 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/cgroup 2024-05-14T01:23:57.613 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/pstore 2024-05-14T01:23:57.613 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/bpf 2024-05-14T01:23:57.613 INFO:teuthology.orchestra.run.smithi176.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T01:23:57.613 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/hugepages 2024-05-14T01:23:57.613 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/mqueue 2024-05-14T01:23:57.613 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/debug 2024-05-14T01:23:57.613 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/tracing 2024-05-14T01:23:57.613 INFO:teuthology.orchestra.run.smithi176.stdout:/proc/fs/nfsd 2024-05-14T01:23:57.613 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/fuse/connections 2024-05-14T01:23:57.613 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/config 2024-05-14T01:23:57.614 INFO:teuthology.orchestra.run.smithi176.stdout:/run/credentials/systemd-sysusers.service 2024-05-14T01:23:57.614 INFO:teuthology.orchestra.run.smithi176.stdout:/run/rpc_pipefs 2024-05-14T01:23:57.614 INFO:teuthology.orchestra.run.smithi176.stdout:/run/user/1000 2024-05-14T01:23:57.614 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph 2024-05-14T01:23:57.614 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-4 2024-05-14T01:23:57.614 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-5 2024-05-14T01:23:57.614 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-6 2024-05-14T01:23:57.614 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-7 2024-05-14T01:23:57.614 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns 2024-05-14T01:23:57.614 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T01:23:57.614 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T01:23:57.614 INFO:teuthology.orchestra.run.smithi176.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-14T01:23:57.614 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-14T01:23:57.614 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-14T01:23:57.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:57.615 DEBUG:teuthology.orchestra.run.smithi176:> ls /sys/fs/fuse/connections 2024-05-14T01:23:57.629 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi176.stderr:2024-05-14T01:23:57.643+0000 7f0d977a3580 -1 init, newargv = 0x564b43066eb0 newargc=15 2024-05-14T01:23:57.629 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi176.stderr:ceph-fuse[33482]: starting ceph client 2024-05-14T01:23:57.633 INFO:teuthology.orchestra.run.smithi176.stdout:45 2024-05-14T01:23:57.635 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi176.stderr:ceph-fuse[33482]: starting fuse 2024-05-14T01:23:58.736 DEBUG:teuthology.orchestra.run.smithi176:> sudo modprobe fuse 2024-05-14T01:23:58.751 DEBUG:teuthology.orchestra.run.smithi176:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T01:23:58.797 INFO:teuthology.orchestra.run.smithi176.stdout:/sys 2024-05-14T01:23:58.798 INFO:teuthology.orchestra.run.smithi176.stdout:/proc 2024-05-14T01:23:58.798 INFO:teuthology.orchestra.run.smithi176.stdout:/dev 2024-05-14T01:23:58.798 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/pts 2024-05-14T01:23:58.798 INFO:teuthology.orchestra.run.smithi176.stdout:/run 2024-05-14T01:23:58.798 INFO:teuthology.orchestra.run.smithi176.stdout:/ 2024-05-14T01:23:58.798 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/security 2024-05-14T01:23:58.798 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/shm 2024-05-14T01:23:58.798 INFO:teuthology.orchestra.run.smithi176.stdout:/run/lock 2024-05-14T01:23:58.798 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/cgroup 2024-05-14T01:23:58.798 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/pstore 2024-05-14T01:23:58.798 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/bpf 2024-05-14T01:23:58.798 INFO:teuthology.orchestra.run.smithi176.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T01:23:58.799 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/hugepages 2024-05-14T01:23:58.799 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/mqueue 2024-05-14T01:23:58.799 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/debug 2024-05-14T01:23:58.799 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/tracing 2024-05-14T01:23:58.799 INFO:teuthology.orchestra.run.smithi176.stdout:/proc/fs/nfsd 2024-05-14T01:23:58.799 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/fuse/connections 2024-05-14T01:23:58.799 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/config 2024-05-14T01:23:58.799 INFO:teuthology.orchestra.run.smithi176.stdout:/run/credentials/systemd-sysusers.service 2024-05-14T01:23:58.799 INFO:teuthology.orchestra.run.smithi176.stdout:/run/rpc_pipefs 2024-05-14T01:23:58.799 INFO:teuthology.orchestra.run.smithi176.stdout:/run/user/1000 2024-05-14T01:23:58.799 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph 2024-05-14T01:23:58.799 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-4 2024-05-14T01:23:58.799 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-5 2024-05-14T01:23:58.799 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-6 2024-05-14T01:23:58.799 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph/osd/ceph-7 2024-05-14T01:23:58.799 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns 2024-05-14T01:23:58.800 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T01:23:58.800 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T01:23:58.800 INFO:teuthology.orchestra.run.smithi176.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-14T01:23:58.800 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-14T01:23:58.800 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-14T01:23:58.800 INFO:teuthology.orchestra.run.smithi176.stdout:/home/ubuntu/cephtest/mnt.3 2024-05-14T01:23:58.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:58.801 DEBUG:teuthology.orchestra.run.smithi176:> ls /sys/fs/fuse/connections 2024-05-14T01:23:58.848 INFO:teuthology.orchestra.run.smithi176.stdout:45 2024-05-14T01:23:58.848 INFO:teuthology.orchestra.run.smithi176.stdout:46 2024-05-14T01:23:58.848 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-05-14T01:23:58.849 DEBUG:teuthology.orchestra.run.smithi176:> sudo stdin-killer -- python3 -c ' 2024-05-14T01:23:58.849 DEBUG:teuthology.orchestra.run.smithi176:> import glob 2024-05-14T01:23:58.849 DEBUG:teuthology.orchestra.run.smithi176:> import re 2024-05-14T01:23:58.849 DEBUG:teuthology.orchestra.run.smithi176:> import os 2024-05-14T01:23:58.849 DEBUG:teuthology.orchestra.run.smithi176:> import subprocess 2024-05-14T01:23:58.849 DEBUG:teuthology.orchestra.run.smithi176:> 2024-05-14T01:23:58.849 DEBUG:teuthology.orchestra.run.smithi176:> def _find_admin_socket(client_name): 2024-05-14T01:23:58.849 DEBUG:teuthology.orchestra.run.smithi176:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-05-14T01:23:58.849 DEBUG:teuthology.orchestra.run.smithi176:> files = glob.glob(asok_path) 2024-05-14T01:23:58.849 DEBUG:teuthology.orchestra.run.smithi176:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-05-14T01:23:58.849 DEBUG:teuthology.orchestra.run.smithi176:> 2024-05-14T01:23:58.849 DEBUG:teuthology.orchestra.run.smithi176:> # Given a non-glob path, it better be there 2024-05-14T01:23:58.849 DEBUG:teuthology.orchestra.run.smithi176:> if "*" not in asok_path: 2024-05-14T01:23:58.849 DEBUG:teuthology.orchestra.run.smithi176:> assert(len(files) == 1) 2024-05-14T01:23:58.849 DEBUG:teuthology.orchestra.run.smithi176:> return files[0] 2024-05-14T01:23:58.849 DEBUG:teuthology.orchestra.run.smithi176:> 2024-05-14T01:23:58.850 DEBUG:teuthology.orchestra.run.smithi176:> for f in files: 2024-05-14T01:23:58.850 DEBUG:teuthology.orchestra.run.smithi176:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-14T01:23:58.850 DEBUG:teuthology.orchestra.run.smithi176:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-14T01:23:58.850 DEBUG:teuthology.orchestra.run.smithi176:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-14T01:23:58.850 DEBUG:teuthology.orchestra.run.smithi176:> contents = proc_f.read() 2024-05-14T01:23:58.850 DEBUG:teuthology.orchestra.run.smithi176:> if mountpoint in contents: 2024-05-14T01:23:58.850 DEBUG:teuthology.orchestra.run.smithi176:> return f 2024-05-14T01:23:58.850 DEBUG:teuthology.orchestra.run.smithi176:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-14T01:23:58.850 DEBUG:teuthology.orchestra.run.smithi176:> 2024-05-14T01:23:58.850 DEBUG:teuthology.orchestra.run.smithi176:> print(_find_admin_socket("client.3")) 2024-05-14T01:23:58.850 DEBUG:teuthology.orchestra.run.smithi176:> ' 2024-05-14T01:23:58.974 INFO:teuthology.orchestra.run.smithi176.stdout:/var/run/ceph/ceph-client.3.33482.asok 2024-05-14T01:23:58.978 INFO:teuthology.orchestra.run.smithi176.stderr:2024-05-14T01:23:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:23:58.986 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.33482.asok 2024-05-14T01:23:58.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:58.986 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.33482.asok status 2024-05-14T01:23:59.141 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-05-14T01:23:59.141 INFO:teuthology.orchestra.run.smithi176.stdout: "metadata": { 2024-05-14T01:23:59.141 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_sha1": "2ba596c3826798bb3a2f22bc9b02848b92dbe579", 2024-05-14T01:23:59.141 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_version": "ceph version 19.0.0-2569-g2ba596c3 (2ba596c3826798bb3a2f22bc9b02848b92dbe579) squid (dev)", 2024-05-14T01:23:59.142 INFO:teuthology.orchestra.run.smithi176.stdout: "entity_id": "3", 2024-05-14T01:23:59.142 INFO:teuthology.orchestra.run.smithi176.stdout: "hostname": "smithi176", 2024-05-14T01:23:59.142 INFO:teuthology.orchestra.run.smithi176.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-05-14T01:23:59.142 INFO:teuthology.orchestra.run.smithi176.stdout: "pid": "33482", 2024-05-14T01:23:59.142 INFO:teuthology.orchestra.run.smithi176.stdout: "root": "/" 2024-05-14T01:23:59.142 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-14T01:23:59.142 INFO:teuthology.orchestra.run.smithi176.stdout: "dentry_count": 0, 2024-05-14T01:23:59.142 INFO:teuthology.orchestra.run.smithi176.stdout: "dentry_pinned_count": 0, 2024-05-14T01:23:59.142 INFO:teuthology.orchestra.run.smithi176.stdout: "id": 4481, 2024-05-14T01:23:59.142 INFO:teuthology.orchestra.run.smithi176.stdout: "inst": { 2024-05-14T01:23:59.142 INFO:teuthology.orchestra.run.smithi176.stdout: "name": { 2024-05-14T01:23:59.142 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "client", 2024-05-14T01:23:59.142 INFO:teuthology.orchestra.run.smithi176.stdout: "num": 4481 2024-05-14T01:23:59.142 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-14T01:23:59.143 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": { 2024-05-14T01:23:59.143 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "v1", 2024-05-14T01:23:59.143 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": "192.168.0.2:0", 2024-05-14T01:23:59.143 INFO:teuthology.orchestra.run.smithi176.stdout: "nonce": 3406902164 2024-05-14T01:23:59.143 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-05-14T01:23:59.143 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-14T01:23:59.143 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": { 2024-05-14T01:23:59.143 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "v1", 2024-05-14T01:23:59.143 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": "192.168.0.2:0", 2024-05-14T01:23:59.143 INFO:teuthology.orchestra.run.smithi176.stdout: "nonce": 3406902164 2024-05-14T01:23:59.143 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-05-14T01:23:59.143 INFO:teuthology.orchestra.run.smithi176.stdout: "inst_str": "client.4481 192.168.0.2:0/3406902164", 2024-05-14T01:23:59.143 INFO:teuthology.orchestra.run.smithi176.stdout: "addr_str": "192.168.0.2:0/3406902164", 2024-05-14T01:23:59.143 INFO:teuthology.orchestra.run.smithi176.stdout: "inode_count": 1, 2024-05-14T01:23:59.143 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_epoch": 8, 2024-05-14T01:23:59.143 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_epoch": 21, 2024-05-14T01:23:59.144 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_epoch_barrier": 0, 2024-05-14T01:23:59.144 INFO:teuthology.orchestra.run.smithi176.stdout: "blocklisted": false, 2024-05-14T01:23:59.144 INFO:teuthology.orchestra.run.smithi176.stdout: "fs_name": "cephfs" 2024-05-14T01:23:59.144 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-05-14T01:23:59.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:59.158 DEBUG:teuthology.orchestra.run.smithi154:> stat --file-system '--printf=%T 2024-05-14T01:23:59.158 DEBUG:teuthology.orchestra.run.smithi154:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-14T01:23:59.165 INFO:teuthology.orchestra.run.smithi154.stdout:fuseblk 2024-05-14T01:23:59.165 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-14T01:23:59.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:59.166 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-14T01:23:59.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:59.232 DEBUG:teuthology.orchestra.run.smithi154:> stat --file-system '--printf=%T 2024-05-14T01:23:59.232 DEBUG:teuthology.orchestra.run.smithi154:> ' -- /home/ubuntu/cephtest/mnt.2 2024-05-14T01:23:59.286 INFO:teuthology.orchestra.run.smithi154.stdout:fuseblk 2024-05-14T01:23:59.286 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-05-14T01:23:59.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:59.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-14T01:23:59.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:59.355 DEBUG:teuthology.orchestra.run.smithi176:> stat --file-system '--printf=%T 2024-05-14T01:23:59.355 DEBUG:teuthology.orchestra.run.smithi176:> ' -- /home/ubuntu/cephtest/mnt.1 2024-05-14T01:23:59.366 INFO:teuthology.orchestra.run.smithi176.stdout:fuseblk 2024-05-14T01:23:59.367 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-05-14T01:23:59.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:59.367 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-14T01:23:59.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:59.426 DEBUG:teuthology.orchestra.run.smithi176:> stat --file-system '--printf=%T 2024-05-14T01:23:59.426 DEBUG:teuthology.orchestra.run.smithi176:> ' -- /home/ubuntu/cephtest/mnt.3 2024-05-14T01:23:59.478 INFO:teuthology.orchestra.run.smithi176.stdout:fuseblk 2024-05-14T01:23:59.479 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-05-14T01:23:59.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:23:59.479 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-14T01:23:59.546 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-14T01:23:59.613 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:23:59.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.761+0000 7f150fc3c640 1 Processor -- start 2024-05-14T01:23:59.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.761+0000 7f150fc3c640 1 -- start start 2024-05-14T01:23:59.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.761+0000 7f150fc3c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15081513c0 0x7f15080cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:59.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.761+0000 7f150fc3c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f150806d8d0 0x7f150815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:59.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.761+0000 7f150fc3c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15080b2ec0 con 0x7f150806d470 2024-05-14T01:23:59.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.761+0000 7f150fc3c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f15080cf9d0 con 0x7f150806d8d0 2024-05-14T01:23:59.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.761+0000 7f150fc3c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f15080b3ad0 con 0x7f15081513c0 2024-05-14T01:23:59.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.761+0000 7f150e1d9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f150806d8d0 0x7f150815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:59.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.761+0000 7f150e1d9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f150806d8d0 0x7f150815e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59144/0 (socket says 172.21.15.154:59144) 2024-05-14T01:23:59.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.761+0000 7f150e1d9640 1 -- 172.21.15.154:0/1050790339 learned_addr learned my addr 172.21.15.154:0/1050790339 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:59.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.761+0000 7f150d9d8640 1 --2- 172.21.15.154:0/1050790339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15081513c0 0x7f15080cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:59.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.761+0000 7f150e1d9640 1 -- 172.21.15.154:0/1050790339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15081513c0 msgr2=0x7f15080cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:23:59.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.761+0000 7f150e1d9640 1 --2- 172.21.15.154:0/1050790339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15081513c0 0x7f15080cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:59.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.761+0000 7f150e1d9640 1 -- 172.21.15.154:0/1050790339 >> v1:172.21.15.176:6789/0 conn(0x7f150806d470 legacy=0x7f150815e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:59.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.761+0000 7f150e1d9640 1 -- 172.21.15.154:0/1050790339 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15080b31a0 con 0x7f150806d8d0 2024-05-14T01:23:59.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150e1d9640 1 --2- 172.21.15.154:0/1050790339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f150806d8d0 0x7f150815e750 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f150000d150 tx=0x7f150001ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88107cf7c4b91d27 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:59.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150c9d6640 1 -- 172.21.15.154:0/1050790339 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150000b2d0 con 0x7f150806d8d0 2024-05-14T01:23:59.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150c9d6640 1 -- 172.21.15.154:0/1050790339 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150000b470 con 0x7f150806d8d0 2024-05-14T01:23:59.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150c9d6640 1 -- 172.21.15.154:0/1050790339 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15000a7c70 con 0x7f150806d8d0 2024-05-14T01:23:59.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150fc3c640 1 -- 172.21.15.154:0/1050790339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f150806d8d0 msgr2=0x7f150815e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:59.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150fc3c640 1 --2- 172.21.15.154:0/1050790339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f150806d8d0 0x7f150815e750 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f150000d150 tx=0x7f150001ec00 comp rx=0 tx=0).stop 2024-05-14T01:23:59.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150fc3c640 1 -- 172.21.15.154:0/1050790339 shutdown_connections 2024-05-14T01:23:59.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150fc3c640 1 --2- 172.21.15.154:0/1050790339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f150806d8d0 0x7f150815e750 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:59.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150fc3c640 1 --2- 172.21.15.154:0/1050790339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15081513c0 0x7f15080cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:59.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150fc3c640 1 -- 172.21.15.154:0/1050790339 >> 172.21.15.154:0/1050790339 conn(0x7f15080b1850 msgr2=0x7f15080b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:59.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150fc3c640 1 -- 172.21.15.154:0/1050790339 shutdown_connections 2024-05-14T01:23:59.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150fc3c640 1 -- 172.21.15.154:0/1050790339 wait complete. 2024-05-14T01:23:59.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150fc3c640 1 Processor -- start 2024-05-14T01:23:59.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150fc3c640 1 -- start start 2024-05-14T01:23:59.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150fc3c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f150806d470 0x7f1508142f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:59.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150fc3c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f150806d8d0 0x7f15081481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:59.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150fc3c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15081513c0 0x7f150815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:59.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150fc3c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f15080b2b50 con 0x7f15081513c0 2024-05-14T01:23:59.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150fc3c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f150806dd60 con 0x7f150806d8d0 2024-05-14T01:23:59.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150fc3c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f150806e810 con 0x7f150806d470 2024-05-14T01:23:59.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150e1d9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15081513c0 0x7f150815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:59.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150e1d9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15081513c0 0x7f150815bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59150/0 (socket says 172.21.15.154:59150) 2024-05-14T01:23:59.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150e1d9640 1 -- 172.21.15.154:0/1796700794 learned_addr learned my addr 172.21.15.154:0/1796700794 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:23:59.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150d9d8640 1 --2- 172.21.15.154:0/1796700794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f150806d470 0x7f1508142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:59.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150d1d7640 1 --2- 172.21.15.154:0/1796700794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f150806d8d0 0x7f15081481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:59.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150e1d9640 1 -- 172.21.15.154:0/1796700794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f150806d470 msgr2=0x7f1508142f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:59.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150e1d9640 1 --2- 172.21.15.154:0/1796700794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f150806d470 0x7f1508142f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:59.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150e1d9640 1 -- 172.21.15.154:0/1796700794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f150806d8d0 msgr2=0x7f15081481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:59.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150e1d9640 1 --2- 172.21.15.154:0/1796700794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f150806d8d0 0x7f15081481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:59.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150e1d9640 1 -- 172.21.15.154:0/1796700794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1508071d60 con 0x7f15081513c0 2024-05-14T01:23:59.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150d9d8640 1 --2- 172.21.15.154:0/1796700794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f150806d470 0x7f1508142f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:59.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.765+0000 7f150d1d7640 1 --2- 172.21.15.154:0/1796700794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f150806d8d0 0x7f15081481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:23:59.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.769+0000 7f150e1d9640 1 --2- 172.21.15.154:0/1796700794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15081513c0 0x7f150815bed0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f15000b1040 tx=0x7f150001b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:59.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.769+0000 7f14fe7fc640 1 -- 172.21.15.154:0/1796700794 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500009800 con 0x7f15081513c0 2024-05-14T01:23:59.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.769+0000 7f14fe7fc640 1 -- 172.21.15.154:0/1796700794 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15000c0070 con 0x7f15081513c0 2024-05-14T01:23:59.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.769+0000 7f150fc3c640 1 -- 172.21.15.154:0/1796700794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1508148ad0 con 0x7f15081513c0 2024-05-14T01:23:59.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.769+0000 7f14fe7fc640 1 -- 172.21.15.154:0/1796700794 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500009bc0 con 0x7f15081513c0 2024-05-14T01:23:59.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.769+0000 7f150fc3c640 1 -- 172.21.15.154:0/1796700794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15081f6110 con 0x7f15081513c0 2024-05-14T01:23:59.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.769+0000 7f150fc3c640 1 -- 172.21.15.154:0/1796700794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1508075470 con 0x7f15081513c0 2024-05-14T01:23:59.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.769+0000 7f14fe7fc640 1 -- 172.21.15.154:0/1796700794 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f15000ba470 con 0x7f15081513c0 2024-05-14T01:23:59.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.769+0000 7f14fe7fc640 1 --2- 172.21.15.154:0/1796700794 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f14ec0678c0 0x7f14ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:23:59.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.769+0000 7f150d9d8640 1 --2- 172.21.15.154:0/1796700794 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f14ec0678c0 0x7f14ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:23:59.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.769+0000 7f14fe7fc640 1 -- 172.21.15.154:0/1796700794 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1500123c70 con 0x7f15081513c0 2024-05-14T01:23:59.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.769+0000 7f150d9d8640 1 --2- 172.21.15.154:0/1796700794 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f14ec0678c0 0x7f14ec069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f15040097a0 tx=0x7f1504008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:23:59.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.773+0000 7f14fe7fc640 1 -- 172.21.15.154:0/1796700794 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1500018820 con 0x7f15081513c0 2024-05-14T01:23:59.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.933+0000 7f150fc3c640 1 -- 172.21.15.154:0/1796700794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15081497f0 con 0x7f15081513c0 2024-05-14T01:23:59.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.937+0000 7f14fe7fc640 1 -- 172.21.15.154:0/1796700794 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f15000f49b0 con 0x7f15081513c0 2024-05-14T01:23:59.921 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:23:59.921 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:36.232271+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:23:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.937+0000 7f150fc3c640 1 -- 172.21.15.154:0/1796700794 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f14ec0678c0 msgr2=0x7f14ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.937+0000 7f150fc3c640 1 --2- 172.21.15.154:0/1796700794 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f14ec0678c0 0x7f14ec069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f15040097a0 tx=0x7f1504008040 comp rx=0 tx=0).stop 2024-05-14T01:23:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.937+0000 7f150fc3c640 1 -- 172.21.15.154:0/1796700794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15081513c0 msgr2=0x7f150815bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:23:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.937+0000 7f150fc3c640 1 --2- 172.21.15.154:0/1796700794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15081513c0 0x7f150815bed0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f15000b1040 tx=0x7f150001b9a0 comp rx=0 tx=0).stop 2024-05-14T01:23:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.937+0000 7f150fc3c640 1 -- 172.21.15.154:0/1796700794 shutdown_connections 2024-05-14T01:23:59.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.937+0000 7f150fc3c640 1 --2- 172.21.15.154:0/1796700794 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f14ec0678c0 0x7f14ec069d80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:59.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.937+0000 7f150fc3c640 1 --2- 172.21.15.154:0/1796700794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15081513c0 0x7f150815bed0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:59.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.937+0000 7f150fc3c640 1 --2- 172.21.15.154:0/1796700794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f150806d8d0 0x7f15081481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:59.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.937+0000 7f150fc3c640 1 --2- 172.21.15.154:0/1796700794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f150806d470 0x7f1508142f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:23:59.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.937+0000 7f150fc3c640 1 -- 172.21.15.154:0/1796700794 >> 172.21.15.154:0/1796700794 conn(0x7f15080b1850 msgr2=0x7f15080b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:23:59.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.937+0000 7f150fc3c640 1 -- 172.21.15.154:0/1796700794 shutdown_connections 2024-05-14T01:23:59.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:23:59.937+0000 7f150fc3c640 1 -- 172.21.15.154:0/1796700794 wait complete. 2024-05-14T01:23:59.940 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T01:23:33.083538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T01:23:33.556058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:23:59.940 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:24:00.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.081+0000 7ff0e01a7640 1 Processor -- start 2024-05-14T01:24:00.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.081+0000 7ff0e01a7640 1 -- start start 2024-05-14T01:24:00.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.081+0000 7ff0e01a7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0d80ced50 0x7ff0d80cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.081+0000 7ff0e01a7640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff0d80cd160 0x7ff0d80cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.081+0000 7ff0e01a7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0d80cdcb0 con 0x7ff0d8071ef0 2024-05-14T01:24:00.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.081+0000 7ff0e01a7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff0d80ce8c0 con 0x7ff0d80ced50 2024-05-14T01:24:00.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.081+0000 7ff0e01a7640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff0d80cdf90 con 0x7ff0d80cd160 2024-05-14T01:24:00.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.081+0000 7ff0ddf43640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff0d8071ef0 0x7ff0d80722d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54182/0 (socket says 172.21.15.154:54182) 2024-05-14T01:24:00.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.081+0000 7ff0ddf43640 1 -- 172.21.15.154:0/3889654862 learned_addr learned my addr 172.21.15.154:0/3889654862 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:00.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.081+0000 7ff0dd742640 1 --2- 172.21.15.154:0/3889654862 >> v2:172.21.15.154:3300/0 conn(0x7ff0d80ced50 0x7ff0d80cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.081+0000 7ff0dcf41640 1 -- 172.21.15.154:0/3889654862 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4136862380 0 0) 0x7ff0d80cdcb0 con 0x7ff0d8071ef0 2024-05-14T01:24:00.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.081+0000 7ff0dcf41640 1 -- 172.21.15.154:0/3889654862 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0c4003530 con 0x7ff0d8071ef0 2024-05-14T01:24:00.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.081+0000 7ff0de744640 1 --2- 172.21.15.154:0/3889654862 >> v2:172.21.15.176:3300/0 conn(0x7ff0d80cd160 0x7ff0d80cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.081+0000 7ff0dd742640 1 -- 172.21.15.154:0/3889654862 >> v2:172.21.15.176:3300/0 conn(0x7ff0d80cd160 msgr2=0x7ff0d80cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:00.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.081+0000 7ff0dd742640 1 --2- 172.21.15.154:0/3889654862 >> v2:172.21.15.176:3300/0 conn(0x7ff0d80cd160 0x7ff0d80cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.081+0000 7ff0dd742640 1 -- 172.21.15.154:0/3889654862 >> v1:172.21.15.154:6789/0 conn(0x7ff0d8071ef0 legacy=0x7ff0d80722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.081+0000 7ff0dd742640 1 -- 172.21.15.154:0/3889654862 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d80ce270 con 0x7ff0d80ced50 2024-05-14T01:24:00.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.085+0000 7ff0dd742640 1 --2- 172.21.15.154:0/3889654862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d80ced50 0x7ff0d80cf1b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80732c0 tx=0x7ff0c801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ee302f2383ac69 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:00.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.085+0000 7ff0dcf41640 1 -- 172.21.15.154:0/3889654862 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c80ab430 con 0x7ff0d80ced50 2024-05-14T01:24:00.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.085+0000 7ff0dcf41640 1 -- 172.21.15.154:0/3889654862 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c80b0070 con 0x7ff0d80ced50 2024-05-14T01:24:00.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.085+0000 7ff0dcf41640 1 -- 172.21.15.154:0/3889654862 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c80ab7f0 con 0x7ff0d80ced50 2024-05-14T01:24:00.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.085+0000 7ff0e01a7640 1 -- 172.21.15.154:0/3889654862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d80ced50 msgr2=0x7ff0d80cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.085+0000 7ff0e01a7640 1 --2- 172.21.15.154:0/3889654862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d80ced50 0x7ff0d80cf1b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80732c0 tx=0x7ff0c801c450 comp rx=0 tx=0).stop 2024-05-14T01:24:00.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.085+0000 7ff0e01a7640 1 -- 172.21.15.154:0/3889654862 shutdown_connections 2024-05-14T01:24:00.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.085+0000 7ff0e01a7640 1 --2- 172.21.15.154:0/3889654862 >> v2:172.21.15.176:3300/0 conn(0x7ff0d80cd160 0x7ff0d80cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.085+0000 7ff0e01a7640 1 --2- 172.21.15.154:0/3889654862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d80ced50 0x7ff0d80cf1b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.085+0000 7ff0e01a7640 1 -- 172.21.15.154:0/3889654862 >> 172.21.15.154:0/3889654862 conn(0x7ff0d80b1770 msgr2=0x7ff0d80b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:00.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.085+0000 7ff0e01a7640 1 -- 172.21.15.154:0/3889654862 shutdown_connections 2024-05-14T01:24:00.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.085+0000 7ff0e01a7640 1 -- 172.21.15.154:0/3889654862 wait complete. 2024-05-14T01:24:00.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.085+0000 7ff0e01a7640 1 Processor -- start 2024-05-14T01:24:00.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.085+0000 7ff0e01a7640 1 -- start start 2024-05-14T01:24:00.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0e01a7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0d8071ef0 0x7ff0d8159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0e01a7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d80cd160 0x7ff0d8158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0e01a7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0d80ced50 0x7ff0d80c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0e01a7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d8167b40 con 0x7ff0d80cd160 2024-05-14T01:24:00.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0e01a7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d81679c0 con 0x7ff0d80ced50 2024-05-14T01:24:00.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0e01a7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff0d8167cc0 con 0x7ff0d8071ef0 2024-05-14T01:24:00.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0dd742640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d80cd160 0x7ff0d8158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0dd742640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d80cd160 0x7ff0d8158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59182/0 (socket says 172.21.15.154:59182) 2024-05-14T01:24:00.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0dd742640 1 -- 172.21.15.154:0/2018098299 learned_addr learned my addr 172.21.15.154:0/2018098299 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:00.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0de744640 1 --2- 172.21.15.154:0/2018098299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0d80ced50 0x7ff0d80c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0ddf43640 1 --2- 172.21.15.154:0/2018098299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0d8071ef0 0x7ff0d8159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0dd742640 1 -- 172.21.15.154:0/2018098299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0d8071ef0 msgr2=0x7ff0d8159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0dd742640 1 --2- 172.21.15.154:0/2018098299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0d8071ef0 0x7ff0d8159650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0dd742640 1 -- 172.21.15.154:0/2018098299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0d80ced50 msgr2=0x7ff0d80c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0dd742640 1 --2- 172.21.15.154:0/2018098299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0d80ced50 0x7ff0d80c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0dd742640 1 -- 172.21.15.154:0/2018098299 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d80c5b90 con 0x7ff0d80cd160 2024-05-14T01:24:00.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0de744640 1 --2- 172.21.15.154:0/2018098299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0d80ced50 0x7ff0d80c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:00.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0dd742640 1 --2- 172.21.15.154:0/2018098299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d80cd160 0x7ff0d8158e20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0c80ad040 tx=0x7ff0c801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:00.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0ce7fc640 1 -- 172.21.15.154:0/2018098299 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c80bf610 con 0x7ff0d80cd160 2024-05-14T01:24:00.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0ce7fc640 1 -- 172.21.15.154:0/2018098299 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c80bf7d0 con 0x7ff0d80cd160 2024-05-14T01:24:00.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0e01a7640 1 -- 172.21.15.154:0/2018098299 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d80c5e70 con 0x7ff0d80cd160 2024-05-14T01:24:00.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0ce7fc640 1 -- 172.21.15.154:0/2018098299 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c80bfbc0 con 0x7ff0d80cd160 2024-05-14T01:24:00.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0e01a7640 1 -- 172.21.15.154:0/2018098299 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d80c7670 con 0x7ff0d80cd160 2024-05-14T01:24:00.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0e01a7640 1 -- 172.21.15.154:0/2018098299 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d8075470 con 0x7ff0d80cd160 2024-05-14T01:24:00.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0ce7fc640 1 -- 172.21.15.154:0/2018098299 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff0c80bd020 con 0x7ff0d80cd160 2024-05-14T01:24:00.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0ce7fc640 1 --2- 172.21.15.154:0/2018098299 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff0bc0678f0 0x7ff0bc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0ce7fc640 1 -- 172.21.15.154:0/2018098299 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff0c80a8030 con 0x7ff0d80cd160 2024-05-14T01:24:00.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0ddf43640 1 --2- 172.21.15.154:0/2018098299 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff0bc0678f0 0x7ff0bc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.089+0000 7ff0ddf43640 1 --2- 172.21.15.154:0/2018098299 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff0bc0678f0 0x7ff0bc069db0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4007fd0 tx=0x7ff0d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:00.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.093+0000 7ff0ce7fc640 1 -- 172.21.15.154:0/2018098299 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7ff0c80c4060 con 0x7ff0d80cd160 2024-05-14T01:24:00.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.257+0000 7ff0e01a7640 1 -- 172.21.15.154:0/2018098299 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff0d80c6040 con 0x7ff0d80cd160 2024-05-14T01:24:00.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.257+0000 7ff0ce7fc640 1 -- 172.21.15.154:0/2018098299 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7ff0c8016070 con 0x7ff0d80cd160 2024-05-14T01:24:00.242 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:24:00.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.257+0000 7ff0e01a7640 1 -- 172.21.15.154:0/2018098299 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff0bc0678f0 msgr2=0x7ff0bc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.257+0000 7ff0e01a7640 1 --2- 172.21.15.154:0/2018098299 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff0bc0678f0 0x7ff0bc069db0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4007fd0 tx=0x7ff0d4009040 comp rx=0 tx=0).stop 2024-05-14T01:24:00.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.257+0000 7ff0e01a7640 1 -- 172.21.15.154:0/2018098299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d80cd160 msgr2=0x7ff0d8158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.257+0000 7ff0e01a7640 1 --2- 172.21.15.154:0/2018098299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d80cd160 0x7ff0d8158e20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0c80ad040 tx=0x7ff0c801ac90 comp rx=0 tx=0).stop 2024-05-14T01:24:00.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.257+0000 7ff0e01a7640 1 -- 172.21.15.154:0/2018098299 shutdown_connections 2024-05-14T01:24:00.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.257+0000 7ff0e01a7640 1 --2- 172.21.15.154:0/2018098299 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff0bc0678f0 0x7ff0bc069db0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.257+0000 7ff0e01a7640 1 --2- 172.21.15.154:0/2018098299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0d80ced50 0x7ff0d80c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.257+0000 7ff0e01a7640 1 --2- 172.21.15.154:0/2018098299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d80cd160 0x7ff0d8158e20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.257+0000 7ff0e01a7640 1 --2- 172.21.15.154:0/2018098299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0d8071ef0 0x7ff0d8159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.257+0000 7ff0e01a7640 1 -- 172.21.15.154:0/2018098299 >> 172.21.15.154:0/2018098299 conn(0x7ff0d80b1770 msgr2=0x7ff0d81427c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:00.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.257+0000 7ff0e01a7640 1 -- 172.21.15.154:0/2018098299 shutdown_connections 2024-05-14T01:24:00.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.257+0000 7ff0e01a7640 1 -- 172.21.15.154:0/2018098299 wait complete. 2024-05-14T01:24:00.260 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T01:24:00.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.389+0000 7fc63926b640 1 Processor -- start 2024-05-14T01:24:00.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.389+0000 7fc63926b640 1 -- start start 2024-05-14T01:24:00.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc63926b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6340ced50 0x7fc6340cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc63926b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc6340cd160 0x7fc6340cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc63926b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6340cdcb0 con 0x7fc634071ef0 2024-05-14T01:24:00.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc63926b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc6340ce8c0 con 0x7fc6340cd160 2024-05-14T01:24:00.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc63926b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc6340cdf90 con 0x7fc6340ced50 2024-05-14T01:24:00.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc632ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc634071ef0 0x7fc6340722d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54184/0 (socket says 172.21.15.154:54184) 2024-05-14T01:24:00.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc632ffd640 1 -- 172.21.15.154:0/2237095971 learned_addr learned my addr 172.21.15.154:0/2237095971 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:00.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc6337fe640 1 --2- 172.21.15.154:0/2237095971 >> v2:172.21.15.176:3300/0 conn(0x7fc6340cd160 0x7fc6340cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc6327fc640 1 --2- 172.21.15.154:0/2237095971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6340ced50 0x7fc6340cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc631ffb640 1 -- 172.21.15.154:0/2237095971 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 968757143 0 0) 0x7fc6340cdcb0 con 0x7fc634071ef0 2024-05-14T01:24:00.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc631ffb640 1 -- 172.21.15.154:0/2237095971 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc61c003530 con 0x7fc634071ef0 2024-05-14T01:24:00.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc631ffb640 1 -- 172.21.15.154:0/2237095971 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3849555292 0 0) 0x7fc61c003530 con 0x7fc634071ef0 2024-05-14T01:24:00.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc631ffb640 1 -- 172.21.15.154:0/2237095971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6340ced50 msgr2=0x7fc6340cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:00.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc631ffb640 1 --2- 172.21.15.154:0/2237095971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6340ced50 0x7fc6340cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc631ffb640 1 -- 172.21.15.154:0/2237095971 >> v2:172.21.15.176:3300/0 conn(0x7fc6340cd160 msgr2=0x7fc6340cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:00.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc631ffb640 1 --2- 172.21.15.154:0/2237095971 >> v2:172.21.15.176:3300/0 conn(0x7fc6340cd160 0x7fc6340cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc631ffb640 1 -- 172.21.15.154:0/2237095971 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6340ce270 con 0x7fc634071ef0 2024-05-14T01:24:00.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc631ffb640 1 -- 172.21.15.154:0/2237095971 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fc628001680 con 0x7fc634071ef0 2024-05-14T01:24:00.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc631ffb640 1 -- 172.21.15.154:0/2237095971 >> v1:172.21.15.154:6789/0 conn(0x7fc634071ef0 legacy=0x7fc6340722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc631ffb640 1 --2- 172.21.15.154:0/2237095971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6340ced50 0x7fc61c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc631ffb640 1 --2- 172.21.15.154:0/2237095971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc61c003f40 0x7fc61c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc631ffb640 1 --2- 172.21.15.154:0/2237095971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc61c004d50 0x7fc61c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc631ffb640 1 -- 172.21.15.154:0/2237095971 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc6340ce8c0 con 0x7fc61c004d50 2024-05-14T01:24:00.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc631ffb640 1 -- 172.21.15.154:0/2237095971 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc6340cdf90 con 0x7fc61c003f40 2024-05-14T01:24:00.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc631ffb640 1 -- 172.21.15.154:0/2237095971 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc61c00b9d0 con 0x7fc6340ced50 2024-05-14T01:24:00.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc6337fe640 1 --2- 172.21.15.154:0/2237095971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc61c004d50 0x7fc61c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc632ffd640 1 --2- 172.21.15.154:0/2237095971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6340ced50 0x7fc61c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc6327fc640 1 --2- 172.21.15.154:0/2237095971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc61c003f40 0x7fc61c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc6337fe640 1 -- 172.21.15.154:0/2237095971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6340ced50 msgr2=0x7fc61c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:00.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc6337fe640 1 --2- 172.21.15.154:0/2237095971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6340ced50 0x7fc61c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc6337fe640 1 -- 172.21.15.154:0/2237095971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc61c003f40 msgr2=0x7fc61c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:00.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc6337fe640 1 --2- 172.21.15.154:0/2237095971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc61c003f40 0x7fc61c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc6337fe640 1 -- 172.21.15.154:0/2237095971 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61c003530 con 0x7fc61c004d50 2024-05-14T01:24:00.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.393+0000 7fc6337fe640 1 --2- 172.21.15.154:0/2237095971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc61c004d50 0x7fc61c0051d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009fc0 tx=0x7fc62c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891d4a941fa3a2f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:00.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc631ffb640 1 -- 172.21.15.154:0/2237095971 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0b2070 con 0x7fc61c004d50 2024-05-14T01:24:00.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc631ffb640 1 -- 172.21.15.154:0/2237095971 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc62c0a5cd0 con 0x7fc61c004d50 2024-05-14T01:24:00.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc631ffb640 1 -- 172.21.15.154:0/2237095971 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c009c10 con 0x7fc61c004d50 2024-05-14T01:24:00.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc63926b640 1 -- 172.21.15.154:0/2237095971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc61c004d50 msgr2=0x7fc61c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc63926b640 1 --2- 172.21.15.154:0/2237095971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc61c004d50 0x7fc61c0051d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009fc0 tx=0x7fc62c01cc60 comp rx=0 tx=0).stop 2024-05-14T01:24:00.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc6337fe640 1 -- 172.21.15.154:0/2237095971 reap_dead start 2024-05-14T01:24:00.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc63926b640 1 -- 172.21.15.154:0/2237095971 shutdown_connections 2024-05-14T01:24:00.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc63926b640 1 -- 172.21.15.154:0/2237095971 >> 172.21.15.154:0/2237095971 conn(0x7fc6340b1770 msgr2=0x7fc6340b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:00.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc63926b640 1 -- 172.21.15.154:0/2237095971 shutdown_connections 2024-05-14T01:24:00.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc63926b640 1 -- 172.21.15.154:0/2237095971 wait complete. 2024-05-14T01:24:00.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc63926b640 1 Processor -- start 2024-05-14T01:24:00.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc63926b640 1 -- start start 2024-05-14T01:24:00.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc63926b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6341f4bf0 0x7fc6341e2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc63926b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6341f4fd0 0x7fc6341e2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc63926b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6341e0250 0x7fc6341e06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc63926b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc63406e990 con 0x7fc6341f4bf0 2024-05-14T01:24:00.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc63926b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc634143f20 con 0x7fc6341e0250 2024-05-14T01:24:00.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc63926b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc63406eb10 con 0x7fc6341f4fd0 2024-05-14T01:24:00.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc632ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6341f4bf0 0x7fc6341e2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc632ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6341f4bf0 0x7fc6341e2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59196/0 (socket says 172.21.15.154:59196) 2024-05-14T01:24:00.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc632ffd640 1 -- 172.21.15.154:0/843128905 learned_addr learned my addr 172.21.15.154:0/843128905 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:00.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc6327fc640 1 --2- 172.21.15.154:0/843128905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6341f4fd0 0x7fc6341e2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc6337fe640 1 --2- 172.21.15.154:0/843128905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6341e0250 0x7fc6341e06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc632ffd640 1 -- 172.21.15.154:0/843128905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6341f4fd0 msgr2=0x7fc6341e2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc632ffd640 1 --2- 172.21.15.154:0/843128905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6341f4fd0 0x7fc6341e2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc632ffd640 1 -- 172.21.15.154:0/843128905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6341e0250 msgr2=0x7fc6341e06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc632ffd640 1 --2- 172.21.15.154:0/843128905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6341e0250 0x7fc6341e06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc632ffd640 1 -- 172.21.15.154:0/843128905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6341e0ff0 con 0x7fc6341f4bf0 2024-05-14T01:24:00.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc632ffd640 1 --2- 172.21.15.154:0/843128905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6341f4bf0 0x7fc6341e2560 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc62800eb30 tx=0x7fc628005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:00.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc61b7fe640 1 -- 172.21.15.154:0/843128905 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62800c990 con 0x7fc6341f4bf0 2024-05-14T01:24:00.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc61b7fe640 1 -- 172.21.15.154:0/843128905 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc628018070 con 0x7fc6341f4bf0 2024-05-14T01:24:00.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc63926b640 1 -- 172.21.15.154:0/843128905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6341e12d0 con 0x7fc6341f4bf0 2024-05-14T01:24:00.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc61b7fe640 1 -- 172.21.15.154:0/843128905 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62800cd70 con 0x7fc6341f4bf0 2024-05-14T01:24:00.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.397+0000 7fc63926b640 1 -- 172.21.15.154:0/843128905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6341e1890 con 0x7fc6341f4bf0 2024-05-14T01:24:00.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.401+0000 7fc63926b640 1 -- 172.21.15.154:0/843128905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc634075470 con 0x7fc6341f4bf0 2024-05-14T01:24:00.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.401+0000 7fc61b7fe640 1 -- 172.21.15.154:0/843128905 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc62801d460 con 0x7fc6341f4bf0 2024-05-14T01:24:00.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.401+0000 7fc61b7fe640 1 --2- 172.21.15.154:0/843128905 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc6200678c0 0x7fc620069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.401+0000 7fc6327fc640 1 --2- 172.21.15.154:0/843128905 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc6200678c0 0x7fc620069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.401+0000 7fc61b7fe640 1 -- 172.21.15.154:0/843128905 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc628085d70 con 0x7fc6341f4bf0 2024-05-14T01:24:00.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.401+0000 7fc6327fc640 1 --2- 172.21.15.154:0/843128905 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc6200678c0 0x7fc620069d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc634140770 tx=0x7fc624008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:00.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.405+0000 7fc61b7fe640 1 -- 172.21.15.154:0/843128905 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fc628056820 con 0x7fc6341f4bf0 2024-05-14T01:24:00.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.561+0000 7fc63926b640 1 -- 172.21.15.154:0/843128905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc6340b49b0 con 0x7fc6341f4bf0 2024-05-14T01:24:00.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.561+0000 7fc61b7fe640 1 -- 172.21.15.154:0/843128905 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fc628056120 con 0x7fc6341f4bf0 2024-05-14T01:24:00.546 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-05-14T01:24:00.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.561+0000 7fc63926b640 1 -- 172.21.15.154:0/843128905 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc6200678c0 msgr2=0x7fc620069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.561+0000 7fc63926b640 1 --2- 172.21.15.154:0/843128905 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc6200678c0 0x7fc620069d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc634140770 tx=0x7fc624008040 comp rx=0 tx=0).stop 2024-05-14T01:24:00.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.561+0000 7fc63926b640 1 -- 172.21.15.154:0/843128905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6341f4bf0 msgr2=0x7fc6341e2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.561+0000 7fc63926b640 1 --2- 172.21.15.154:0/843128905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6341f4bf0 0x7fc6341e2560 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc62800eb30 tx=0x7fc628005e20 comp rx=0 tx=0).stop 2024-05-14T01:24:00.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.561+0000 7fc63926b640 1 -- 172.21.15.154:0/843128905 shutdown_connections 2024-05-14T01:24:00.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.561+0000 7fc63926b640 1 --2- 172.21.15.154:0/843128905 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc6200678c0 0x7fc620069d80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.561+0000 7fc63926b640 1 --2- 172.21.15.154:0/843128905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6341e0250 0x7fc6341e06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.561+0000 7fc63926b640 1 --2- 172.21.15.154:0/843128905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6341f4fd0 0x7fc6341e2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.561+0000 7fc63926b640 1 --2- 172.21.15.154:0/843128905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6341f4bf0 0x7fc6341e2560 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.561+0000 7fc63926b640 1 -- 172.21.15.154:0/843128905 >> 172.21.15.154:0/843128905 conn(0x7fc6340b1770 msgr2=0x7fc6340716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:00.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.561+0000 7fc63926b640 1 -- 172.21.15.154:0/843128905 shutdown_connections 2024-05-14T01:24:00.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.561+0000 7fc63926b640 1 -- 172.21.15.154:0/843128905 wait complete. 2024-05-14T01:24:00.563 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T01:24:00.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f6a06a43640 1 Processor -- start 2024-05-14T01:24:00.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f6a06a43640 1 -- start start 2024-05-14T01:24:00.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f6a06a43640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6a00071ef0 0x7f6a000722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f6a06a43640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6a000ced50 0x7f6a000cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f6a06a43640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a00072810 con 0x7f6a000cd160 2024-05-14T01:24:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f6a06a43640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6a000ce8c0 con 0x7f6a000ced50 2024-05-14T01:24:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f6a06a43640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6a000cdcb0 con 0x7f6a00071ef0 2024-05-14T01:24:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f69ff7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6a000ced50 0x7f6a000cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f6a04fe0640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6a000cd160 0x7f6a000b2a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54194/0 (socket says 172.21.15.154:54194) 2024-05-14T01:24:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f6a04fe0640 1 -- 172.21.15.154:0/4170522989 learned_addr learned my addr 172.21.15.154:0/4170522989 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f69fffff640 1 --2- 172.21.15.154:0/4170522989 >> v2:172.21.15.176:3300/0 conn(0x7f6a00071ef0 0x7f6a000722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f69ff7fe640 1 -- 172.21.15.154:0/4170522989 >> v2:172.21.15.176:3300/0 conn(0x7f6a00071ef0 msgr2=0x7f6a000722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f69ff7fe640 1 --2- 172.21.15.154:0/4170522989 >> v2:172.21.15.176:3300/0 conn(0x7f6a00071ef0 0x7f6a000722d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f69ff7fe640 1 -- 172.21.15.154:0/4170522989 >> v1:172.21.15.154:6789/0 conn(0x7f6a000cd160 legacy=0x7f6a000b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f69ff7fe640 1 -- 172.21.15.154:0/4170522989 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a000cdf90 con 0x7f6a000ced50 2024-05-14T01:24:00.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f69ff7fe640 1 --2- 172.21.15.154:0/4170522989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a000ced50 0x7f6a000cf1b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6a00073a40 tx=0x7f69f401eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8fdccc13926ad52 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:00.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f69feffd640 1 -- 172.21.15.154:0/4170522989 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f40b4070 con 0x7f6a000ced50 2024-05-14T01:24:00.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f69feffd640 1 -- 172.21.15.154:0/4170522989 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f40a7af0 con 0x7f6a000ced50 2024-05-14T01:24:00.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.697+0000 7f69feffd640 1 -- 172.21.15.154:0/4170522989 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f40af440 con 0x7f6a000ced50 2024-05-14T01:24:00.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a06a43640 1 -- 172.21.15.154:0/4170522989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a000ced50 msgr2=0x7f6a000cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a06a43640 1 --2- 172.21.15.154:0/4170522989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a000ced50 0x7f6a000cf1b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6a00073a40 tx=0x7f69f401eb20 comp rx=0 tx=0).stop 2024-05-14T01:24:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a06a43640 1 -- 172.21.15.154:0/4170522989 shutdown_connections 2024-05-14T01:24:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a06a43640 1 --2- 172.21.15.154:0/4170522989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a000ced50 0x7f6a000cf1b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a06a43640 1 --2- 172.21.15.154:0/4170522989 >> v2:172.21.15.176:3300/0 conn(0x7f6a00071ef0 0x7f6a000722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a06a43640 1 -- 172.21.15.154:0/4170522989 >> 172.21.15.154:0/4170522989 conn(0x7f6a000b1770 msgr2=0x7f6a000b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a06a43640 1 -- 172.21.15.154:0/4170522989 shutdown_connections 2024-05-14T01:24:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a06a43640 1 -- 172.21.15.154:0/4170522989 wait complete. 2024-05-14T01:24:00.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a06a43640 1 Processor -- start 2024-05-14T01:24:00.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a06a43640 1 -- start start 2024-05-14T01:24:00.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a06a43640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a00071ef0 0x7f6a000c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a06a43640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a000cd160 0x7f6a000c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a06a43640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a000ced50 0x7f6a0013d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a06a43640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0006e990 con 0x7f6a00071ef0 2024-05-14T01:24:00.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a06a43640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6a000cd980 con 0x7f6a000cd160 2024-05-14T01:24:00.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a06a43640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6a0006eb10 con 0x7f6a000ced50 2024-05-14T01:24:00.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f69fffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a00071ef0 0x7f6a000c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f69fffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a00071ef0 0x7f6a000c56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59206/0 (socket says 172.21.15.154:59206) 2024-05-14T01:24:00.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f69fffff640 1 -- 172.21.15.154:0/3346471124 learned_addr learned my addr 172.21.15.154:0/3346471124 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:00.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a04fe0640 1 --2- 172.21.15.154:0/3346471124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a000ced50 0x7f6a0013d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f69ff7fe640 1 --2- 172.21.15.154:0/3346471124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a000cd160 0x7f6a000c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f69fffff640 1 -- 172.21.15.154:0/3346471124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a000ced50 msgr2=0x7f6a0013d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f69fffff640 1 --2- 172.21.15.154:0/3346471124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a000ced50 0x7f6a0013d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f69fffff640 1 -- 172.21.15.154:0/3346471124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a000cd160 msgr2=0x7f6a000c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f69fffff640 1 --2- 172.21.15.154:0/3346471124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a000cd160 0x7f6a000c5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f69fffff640 1 -- 172.21.15.154:0/3346471124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a00141560 con 0x7f6a00071ef0 2024-05-14T01:24:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a04fe0640 1 --2- 172.21.15.154:0/3346471124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a000ced50 0x7f6a0013d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f69fffff640 1 --2- 172.21.15.154:0/3346471124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a00071ef0 0x7f6a000c56d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f69f000c7f0 tx=0x7f69f000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f69fcff9640 1 -- 172.21.15.154:0/3346471124 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0015070 con 0x7f6a00071ef0 2024-05-14T01:24:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f69fcff9640 1 -- 172.21.15.154:0/3346471124 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f0004240 con 0x7f6a00071ef0 2024-05-14T01:24:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a06a43640 1 -- 172.21.15.154:0/3346471124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0013f180 con 0x7f6a00071ef0 2024-05-14T01:24:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f69fcff9640 1 -- 172.21.15.154:0/3346471124 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0003620 con 0x7f6a00071ef0 2024-05-14T01:24:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.701+0000 7f6a06a43640 1 -- 172.21.15.154:0/3346471124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a0013f740 con 0x7f6a00071ef0 2024-05-14T01:24:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.705+0000 7f6a06a43640 1 -- 172.21.15.154:0/3346471124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a0013ef80 con 0x7f6a00071ef0 2024-05-14T01:24:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.705+0000 7f69fcff9640 1 -- 172.21.15.154:0/3346471124 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f69f00039d0 con 0x7f6a00071ef0 2024-05-14T01:24:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.705+0000 7f69fcff9640 1 --2- 172.21.15.154:0/3346471124 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f69ec0678c0 0x7f69ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.705+0000 7f69ff7fe640 1 --2- 172.21.15.154:0/3346471124 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f69ec0678c0 0x7f69ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.705+0000 7f69fcff9640 1 -- 172.21.15.154:0/3346471124 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f69f0086130 con 0x7f6a00071ef0 2024-05-14T01:24:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.705+0000 7f69ff7fe640 1 --2- 172.21.15.154:0/3346471124 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f69ec0678c0 0x7f69ec069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f69f40b1000 tx=0x7f69f40a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:00.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.709+0000 7f69fcff9640 1 -- 172.21.15.154:0/3346471124 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f69f0056d50 con 0x7f6a00071ef0 2024-05-14T01:24:00.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.857+0000 7f6a06a43640 1 -- 172.21.15.154:0/3346471124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6a00075470 con 0x7f6a00071ef0 2024-05-14T01:24:00.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.857+0000 7f69fcff9640 1 -- 172.21.15.154:0/3346471124 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f69f0056650 con 0x7f6a00071ef0 2024-05-14T01:24:00.843 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-05-14T01:24:00.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.861+0000 7f6a06a43640 1 -- 172.21.15.154:0/3346471124 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f69ec0678c0 msgr2=0x7f69ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.861+0000 7f6a06a43640 1 --2- 172.21.15.154:0/3346471124 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f69ec0678c0 0x7f69ec069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f69f40b1000 tx=0x7f69f40a9070 comp rx=0 tx=0).stop 2024-05-14T01:24:00.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.861+0000 7f6a06a43640 1 -- 172.21.15.154:0/3346471124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a00071ef0 msgr2=0x7f6a000c56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.861+0000 7f6a06a43640 1 --2- 172.21.15.154:0/3346471124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a00071ef0 0x7f6a000c56d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f69f000c7f0 tx=0x7f69f000ccb0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.861+0000 7f6a06a43640 1 -- 172.21.15.154:0/3346471124 shutdown_connections 2024-05-14T01:24:00.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.861+0000 7f6a06a43640 1 --2- 172.21.15.154:0/3346471124 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f69ec0678c0 0x7f69ec069d80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.861+0000 7f6a06a43640 1 --2- 172.21.15.154:0/3346471124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a000ced50 0x7f6a0013d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.861+0000 7f6a06a43640 1 --2- 172.21.15.154:0/3346471124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a000cd160 0x7f6a000c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.861+0000 7f6a06a43640 1 --2- 172.21.15.154:0/3346471124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a00071ef0 0x7f6a000c56d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.861+0000 7f6a06a43640 1 -- 172.21.15.154:0/3346471124 >> 172.21.15.154:0/3346471124 conn(0x7f6a000b1770 msgr2=0x7f6a000b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:00.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.861+0000 7f6a06a43640 1 -- 172.21.15.154:0/3346471124 shutdown_connections 2024-05-14T01:24:00.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.861+0000 7f6a06a43640 1 -- 172.21.15.154:0/3346471124 wait complete. 2024-05-14T01:24:00.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:00.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.981+0000 7f65e79e2640 1 Processor -- start 2024-05-14T01:24:00.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.981+0000 7f65e79e2640 1 -- start start 2024-05-14T01:24:00.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65e79e2640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f65e0144760 0x7f65e006e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65e79e2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e0144b40 con 0x7f65e015bae0 2024-05-14T01:24:00.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65e79e2640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e00b3a40 con 0x7f65e00b3530 2024-05-14T01:24:00.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65e79e2640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f65e00b4650 con 0x7f65e0144760 2024-05-14T01:24:00.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65e5f7f640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f65e015bae0 0x7f65e015c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54202/0 (socket says 172.21.15.154:54202) 2024-05-14T01:24:00.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65e5f7f640 1 -- 172.21.15.154:0/1182128730 learned_addr learned my addr 172.21.15.154:0/1182128730 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65e577e640 1 --2- 172.21.15.154:0/1182128730 >> v2:172.21.15.176:3300/0 conn(0x7f65e0144760 0x7f65e006e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65d7fff640 1 -- 172.21.15.154:0/1182128730 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1755602250 0 0) 0x7f65e0144b40 con 0x7f65e015bae0 2024-05-14T01:24:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65d7fff640 1 -- 172.21.15.154:0/1182128730 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65cc003530 con 0x7f65e015bae0 2024-05-14T01:24:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65d7fff640 1 -- 172.21.15.154:0/1182128730 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1275967361 0 0) 0x7f65cc003530 con 0x7f65e015bae0 2024-05-14T01:24:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65d7fff640 1 -- 172.21.15.154:0/1182128730 >> v2:172.21.15.176:3300/0 conn(0x7f65e0144760 msgr2=0x7f65e006e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65d7fff640 1 --2- 172.21.15.154:0/1182128730 >> v2:172.21.15.176:3300/0 conn(0x7f65e0144760 0x7f65e006e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65d7fff640 1 -- 172.21.15.154:0/1182128730 >> v1:172.21.15.176:6789/0 conn(0x7f65e00b3530 legacy=0x7f65e015b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65d7fff640 1 -- 172.21.15.154:0/1182128730 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e00b3d20 con 0x7f65e015bae0 2024-05-14T01:24:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65d7fff640 1 -- 172.21.15.154:0/1182128730 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f65d8001a20 con 0x7f65e015bae0 2024-05-14T01:24:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65d7fff640 1 -- 172.21.15.154:0/1182128730 >> v1:172.21.15.154:6789/0 conn(0x7f65e015bae0 legacy=0x7f65e015c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65d7fff640 1 --2- 172.21.15.154:0/1182128730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65cc0039c0 0x7f65cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65d7fff640 1 --2- 172.21.15.154:0/1182128730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65cc004810 0x7f65cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65d7fff640 1 --2- 172.21.15.154:0/1182128730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65cc0051d0 0x7f65cc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65d7fff640 1 -- 172.21.15.154:0/1182128730 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65e00b4650 con 0x7f65cc0039c0 2024-05-14T01:24:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65d7fff640 1 -- 172.21.15.154:0/1182128730 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc00c070 con 0x7f65cc0051d0 2024-05-14T01:24:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65d7fff640 1 -- 172.21.15.154:0/1182128730 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f65cc00c270 con 0x7f65cc004810 2024-05-14T01:24:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65e577e640 1 --2- 172.21.15.154:0/1182128730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65cc0039c0 0x7f65cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65e5f7f640 1 --2- 172.21.15.154:0/1182128730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65cc0051d0 0x7f65cc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65e4f7d640 1 --2- 172.21.15.154:0/1182128730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65cc004810 0x7f65cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65e577e640 1 -- 172.21.15.154:0/1182128730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65cc004810 msgr2=0x7f65cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65e577e640 1 --2- 172.21.15.154:0/1182128730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65cc004810 0x7f65cc004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65e577e640 1 -- 172.21.15.154:0/1182128730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65cc0051d0 msgr2=0x7f65cc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65e577e640 1 --2- 172.21.15.154:0/1182128730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65cc0051d0 0x7f65cc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65e577e640 1 -- 172.21.15.154:0/1182128730 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65cc003530 con 0x7f65cc0039c0 2024-05-14T01:24:00.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65e5f7f640 1 --2- 172.21.15.154:0/1182128730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65cc0051d0 0x7f65cc00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:00.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65e5f7f640 1 -- 172.21.15.154:0/1182128730 reap_dead start 2024-05-14T01:24:00.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.985+0000 7f65e577e640 1 --2- 172.21.15.154:0/1182128730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65cc0039c0 0x7f65cc003de0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f65dc009ac0 tx=0x7f65dc01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2aed02efb2d587 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:00.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65d7fff640 1 -- 172.21.15.154:0/1182128730 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0b2070 con 0x7f65cc0039c0 2024-05-14T01:24:00.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65d7fff640 1 -- 172.21.15.154:0/1182128730 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65dc0a5580 con 0x7f65cc0039c0 2024-05-14T01:24:00.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65d7fff640 1 -- 172.21.15.154:0/1182128730 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc009690 con 0x7f65cc0039c0 2024-05-14T01:24:00.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e79e2640 1 -- 172.21.15.154:0/1182128730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65cc0039c0 msgr2=0x7f65cc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e79e2640 1 --2- 172.21.15.154:0/1182128730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65cc0039c0 0x7f65cc003de0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f65dc009ac0 tx=0x7f65dc01ca20 comp rx=0 tx=0).stop 2024-05-14T01:24:00.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e79e2640 1 -- 172.21.15.154:0/1182128730 shutdown_connections 2024-05-14T01:24:00.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e79e2640 1 --2- 172.21.15.154:0/1182128730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65cc0039c0 0x7f65cc003de0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e79e2640 1 -- 172.21.15.154:0/1182128730 >> 172.21.15.154:0/1182128730 conn(0x7f65e00b1850 msgr2=0x7f65e00b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:00.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e79e2640 1 -- 172.21.15.154:0/1182128730 shutdown_connections 2024-05-14T01:24:00.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e79e2640 1 -- 172.21.15.154:0/1182128730 wait complete. 2024-05-14T01:24:00.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e79e2640 1 Processor -- start 2024-05-14T01:24:00.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e79e2640 1 -- start start 2024-05-14T01:24:00.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e79e2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65cc0039c0 0x7f65e013cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e79e2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65e015a200 0x7f65e013eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e79e2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e013f420 0x7f65e01e7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e79e2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65e015eb00 con 0x7f65e013f420 2024-05-14T01:24:00.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e79e2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f65e015e980 con 0x7f65e015a200 2024-05-14T01:24:00.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e79e2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f65e015ec80 con 0x7f65cc0039c0 2024-05-14T01:24:00.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e5f7f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e013f420 0x7f65e01e7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e5f7f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e013f420 0x7f65e01e7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59224/0 (socket says 172.21.15.154:59224) 2024-05-14T01:24:00.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e5f7f640 1 -- 172.21.15.154:0/2998842373 learned_addr learned my addr 172.21.15.154:0/2998842373 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:00.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e5f7f640 1 -- 172.21.15.154:0/2998842373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65cc0039c0 msgr2=0x7f65e013cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e577e640 1 --2- 172.21.15.154:0/2998842373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65cc0039c0 0x7f65e013cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e5f7f640 1 --2- 172.21.15.154:0/2998842373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65cc0039c0 0x7f65e013cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e4f7d640 1 --2- 172.21.15.154:0/2998842373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65e015a200 0x7f65e013eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e5f7f640 1 -- 172.21.15.154:0/2998842373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65e015a200 msgr2=0x7f65e013eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:00.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e5f7f640 1 --2- 172.21.15.154:0/2998842373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65e015a200 0x7f65e013eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:00.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e5f7f640 1 -- 172.21.15.154:0/2998842373 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e013b7c0 con 0x7f65e013f420 2024-05-14T01:24:00.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e5f7f640 1 --2- 172.21.15.154:0/2998842373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e013f420 0x7f65e01e7410 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f65d8000f90 tx=0x7f65d800b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:00.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65d5ffb640 1 -- 172.21.15.154:0/2998842373 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d800b8d0 con 0x7f65e013f420 2024-05-14T01:24:00.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65d5ffb640 1 -- 172.21.15.154:0/2998842373 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d800ba90 con 0x7f65e013f420 2024-05-14T01:24:00.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65d5ffb640 1 -- 172.21.15.154:0/2998842373 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d800be80 con 0x7f65e013f420 2024-05-14T01:24:00.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e79e2640 1 -- 172.21.15.154:0/2998842373 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65e013ba60 con 0x7f65e013f420 2024-05-14T01:24:00.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.989+0000 7f65e79e2640 1 -- 172.21.15.154:0/2998842373 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65e013c020 con 0x7f65e013f420 2024-05-14T01:24:00.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.993+0000 7f65e79e2640 1 -- 172.21.15.154:0/2998842373 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65e0075470 con 0x7f65e013f420 2024-05-14T01:24:00.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.993+0000 7f65d5ffb640 1 -- 172.21.15.154:0/2998842373 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f65d801b020 con 0x7f65e013f420 2024-05-14T01:24:00.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.993+0000 7f65d5ffb640 1 --2- 172.21.15.154:0/2998842373 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f65c40678c0 0x7f65c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:00.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.993+0000 7f65d5ffb640 1 -- 172.21.15.154:0/2998842373 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f65d8085dc0 con 0x7f65e013f420 2024-05-14T01:24:00.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.993+0000 7f65e577e640 1 --2- 172.21.15.154:0/2998842373 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f65c40678c0 0x7f65c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:00.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.993+0000 7f65e577e640 1 --2- 172.21.15.154:0/2998842373 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f65c40678c0 0x7f65c4069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f65dc0af000 tx=0x7f65dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:00.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:00.997+0000 7f65d5ffb640 1 -- 172.21.15.154:0/2998842373 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f65d8056860 con 0x7f65e013f420 2024-05-14T01:24:01.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.145+0000 7f65e79e2640 1 -- 172.21.15.154:0/2998842373 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65e015c220 con 0x7f65e013f420 2024-05-14T01:24:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.149+0000 7f65d5ffb640 1 -- 172.21.15.154:0/2998842373 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f65d8056160 con 0x7f65e013f420 2024-05-14T01:24:01.133 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:01.133 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:36.232271+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:01.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.149+0000 7f65e79e2640 1 -- 172.21.15.154:0/2998842373 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f65c40678c0 msgr2=0x7f65c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:01.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.149+0000 7f65e79e2640 1 --2- 172.21.15.154:0/2998842373 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f65c40678c0 0x7f65c4069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f65dc0af000 tx=0x7f65dc008040 comp rx=0 tx=0).stop 2024-05-14T01:24:01.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.149+0000 7f65e79e2640 1 -- 172.21.15.154:0/2998842373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e013f420 msgr2=0x7f65e01e7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:01.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.149+0000 7f65e79e2640 1 --2- 172.21.15.154:0/2998842373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e013f420 0x7f65e01e7410 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f65d8000f90 tx=0x7f65d800b0d0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.149+0000 7f65e79e2640 1 -- 172.21.15.154:0/2998842373 shutdown_connections 2024-05-14T01:24:01.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.149+0000 7f65e79e2640 1 --2- 172.21.15.154:0/2998842373 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f65c40678c0 0x7f65c4069d80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.149+0000 7f65e79e2640 1 --2- 172.21.15.154:0/2998842373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e013f420 0x7f65e01e7410 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.149+0000 7f65e79e2640 1 --2- 172.21.15.154:0/2998842373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65e015a200 0x7f65e013eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.149+0000 7f65e79e2640 1 --2- 172.21.15.154:0/2998842373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65cc0039c0 0x7f65e013cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.149+0000 7f65e79e2640 1 -- 172.21.15.154:0/2998842373 >> 172.21.15.154:0/2998842373 conn(0x7f65e00b1850 msgr2=0x7f65e015f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:01.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.149+0000 7f65e79e2640 1 -- 172.21.15.154:0/2998842373 shutdown_connections 2024-05-14T01:24:01.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.149+0000 7f65e79e2640 1 -- 172.21.15.154:0/2998842373 wait complete. 2024-05-14T01:24:01.151 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T01:23:33.083538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T01:23:33.556058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:24:01.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:24:01.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.289+0000 7fd74f534640 1 Processor -- start 2024-05-14T01:24:01.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.289+0000 7fd74f534640 1 -- start start 2024-05-14T01:24:01.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.293+0000 7fd74f534640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd74815e530 0x7fd7480d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.293+0000 7fd74f534640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd748162a60 0x7fd7480d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.293+0000 7fd74f534640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7480d3440 con 0x7fd7480b3590 2024-05-14T01:24:01.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.293+0000 7fd74f534640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd74815e910 con 0x7fd74815e530 2024-05-14T01:24:01.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.293+0000 7fd74f534640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd7480cec20 con 0x7fd748162a60 2024-05-14T01:24:01.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.293+0000 7fd74d2d0640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd74815e530 0x7fd7480d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.293+0000 7fd74cacf640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd748162a60 0x7fd7480d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.293+0000 7fd74d2d0640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd74815e530 0x7fd7480d0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:57196/0 (socket says 172.21.15.154:57196) 2024-05-14T01:24:01.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.293+0000 7fd74d2d0640 1 -- 172.21.15.154:0/1209906963 learned_addr learned my addr 172.21.15.154:0/1209906963 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:01.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.293+0000 7fd74dad1640 1 --1- 172.21.15.154:0/1209906963 >> v1:172.21.15.176:6789/0 conn(0x7fd7480b3590 0x7fd7480718a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:45430/0 (socket says 172.21.15.154:45430) 2024-05-14T01:24:01.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.293+0000 7fd74cacf640 1 -- 172.21.15.154:0/1209906963 >> v2:172.21.15.176:3300/0 conn(0x7fd74815e530 msgr2=0x7fd7480d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:01.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.293+0000 7fd74cacf640 1 --2- 172.21.15.154:0/1209906963 >> v2:172.21.15.176:3300/0 conn(0x7fd74815e530 0x7fd7480d0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.293+0000 7fd74cacf640 1 -- 172.21.15.154:0/1209906963 >> v1:172.21.15.176:6789/0 conn(0x7fd7480b3590 legacy=0x7fd7480718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:01.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.293+0000 7fd74cacf640 1 -- 172.21.15.154:0/1209906963 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7480cef00 con 0x7fd748162a60 2024-05-14T01:24:01.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74cacf640 1 --2- 172.21.15.154:0/1209906963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd748162a60 0x7fd7480d0da0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd7380097c0 tx=0x7fd73801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1764edefe8eef106 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:01.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd73ffff640 1 -- 172.21.15.154:0/1209906963 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7380b0070 con 0x7fd748162a60 2024-05-14T01:24:01.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd73ffff640 1 -- 172.21.15.154:0/1209906963 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7380a4e50 con 0x7fd748162a60 2024-05-14T01:24:01.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd73ffff640 1 -- 172.21.15.154:0/1209906963 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7380ab820 con 0x7fd748162a60 2024-05-14T01:24:01.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74f534640 1 -- 172.21.15.154:0/1209906963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd748162a60 msgr2=0x7fd7480d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:01.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74f534640 1 --2- 172.21.15.154:0/1209906963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd748162a60 0x7fd7480d0da0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd7380097c0 tx=0x7fd73801c4a0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74f534640 1 -- 172.21.15.154:0/1209906963 shutdown_connections 2024-05-14T01:24:01.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74f534640 1 --2- 172.21.15.154:0/1209906963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd748162a60 0x7fd7480d0da0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74f534640 1 --2- 172.21.15.154:0/1209906963 >> v2:172.21.15.176:3300/0 conn(0x7fd74815e530 0x7fd7480d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74f534640 1 -- 172.21.15.154:0/1209906963 >> 172.21.15.154:0/1209906963 conn(0x7fd7480b5b80 msgr2=0x7fd7480b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:01.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74f534640 1 -- 172.21.15.154:0/1209906963 shutdown_connections 2024-05-14T01:24:01.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74f534640 1 -- 172.21.15.154:0/1209906963 wait complete. 2024-05-14T01:24:01.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74f534640 1 Processor -- start 2024-05-14T01:24:01.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74f534640 1 -- start start 2024-05-14T01:24:01.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74f534640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7480b3590 0x7fd7480cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74f534640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd74815e530 0x7fd7480d3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74f534640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd748162a60 0x7fd748152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74f534640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7480cfb60 con 0x7fd7480b3590 2024-05-14T01:24:01.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74f534640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd7480cf9e0 con 0x7fd74815e530 2024-05-14T01:24:01.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74f534640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd74816b390 con 0x7fd748162a60 2024-05-14T01:24:01.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74d2d0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7480b3590 0x7fd7480cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.297+0000 7fd74d2d0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7480b3590 0x7fd7480cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59238/0 (socket says 172.21.15.154:59238) 2024-05-14T01:24:01.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd74d2d0640 1 -- 172.21.15.154:0/627002098 learned_addr learned my addr 172.21.15.154:0/627002098 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:01.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd74cacf640 1 --2- 172.21.15.154:0/627002098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd74815e530 0x7fd7480d3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd74dad1640 1 --2- 172.21.15.154:0/627002098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd748162a60 0x7fd748152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd74d2d0640 1 -- 172.21.15.154:0/627002098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd748162a60 msgr2=0x7fd748152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:01.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd74d2d0640 1 --2- 172.21.15.154:0/627002098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd748162a60 0x7fd748152550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd74d2d0640 1 -- 172.21.15.154:0/627002098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd74815e530 msgr2=0x7fd7480d3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:01.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd74d2d0640 1 --2- 172.21.15.154:0/627002098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd74815e530 0x7fd7480d3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd74d2d0640 1 -- 172.21.15.154:0/627002098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd748154980 con 0x7fd7480b3590 2024-05-14T01:24:01.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd74d2d0640 1 --2- 172.21.15.154:0/627002098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7480b3590 0x7fd7480cdbd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd74400e890 tx=0x7fd74400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:01.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd73dffb640 1 -- 172.21.15.154:0/627002098 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744017070 con 0x7fd7480b3590 2024-05-14T01:24:01.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd73dffb640 1 -- 172.21.15.154:0/627002098 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd74400c940 con 0x7fd7480b3590 2024-05-14T01:24:01.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd74f534640 1 -- 172.21.15.154:0/627002098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74815b680 con 0x7fd7480b3590 2024-05-14T01:24:01.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd73dffb640 1 -- 172.21.15.154:0/627002098 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74400cd30 con 0x7fd7480b3590 2024-05-14T01:24:01.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd74f534640 1 -- 172.21.15.154:0/627002098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd74815bc40 con 0x7fd7480b3590 2024-05-14T01:24:01.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd74f534640 1 -- 172.21.15.154:0/627002098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd748075470 con 0x7fd7480b3590 2024-05-14T01:24:01.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd73dffb640 1 -- 172.21.15.154:0/627002098 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd74401a070 con 0x7fd7480b3590 2024-05-14T01:24:01.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd73dffb640 1 --2- 172.21.15.154:0/627002098 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd72c0678c0 0x7fd72c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd73dffb640 1 -- 172.21.15.154:0/627002098 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd7440862a0 con 0x7fd7480b3590 2024-05-14T01:24:01.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd74cacf640 1 --2- 172.21.15.154:0/627002098 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd72c0678c0 0x7fd72c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.301+0000 7fd74cacf640 1 --2- 172.21.15.154:0/627002098 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd72c0678c0 0x7fd72c069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd7380ad000 tx=0x7fd7380a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:01.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.305+0000 7fd73dffb640 1 -- 172.21.15.154:0/627002098 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fd744056f50 con 0x7fd7480b3590 2024-05-14T01:24:01.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.469+0000 7fd74f534640 1 -- 172.21.15.154:0/627002098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd748071be0 con 0x7fd7480b3590 2024-05-14T01:24:01.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.469+0000 7fd73dffb640 1 -- 172.21.15.154:0/627002098 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fd744056850 con 0x7fd7480b3590 2024-05-14T01:24:01.456 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:24:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.473+0000 7fd74f534640 1 -- 172.21.15.154:0/627002098 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd72c0678c0 msgr2=0x7fd72c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.473+0000 7fd74f534640 1 --2- 172.21.15.154:0/627002098 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd72c0678c0 0x7fd72c069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd7380ad000 tx=0x7fd7380a6000 comp rx=0 tx=0).stop 2024-05-14T01:24:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.473+0000 7fd74f534640 1 -- 172.21.15.154:0/627002098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7480b3590 msgr2=0x7fd7480cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.473+0000 7fd74f534640 1 --2- 172.21.15.154:0/627002098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7480b3590 0x7fd7480cdbd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd74400e890 tx=0x7fd74400ed50 comp rx=0 tx=0).stop 2024-05-14T01:24:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.473+0000 7fd74f534640 1 -- 172.21.15.154:0/627002098 shutdown_connections 2024-05-14T01:24:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.473+0000 7fd74f534640 1 --2- 172.21.15.154:0/627002098 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd72c0678c0 0x7fd72c069d80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.473+0000 7fd74f534640 1 --2- 172.21.15.154:0/627002098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd748162a60 0x7fd748152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.473+0000 7fd74f534640 1 --2- 172.21.15.154:0/627002098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd74815e530 0x7fd7480d3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.473+0000 7fd74f534640 1 --2- 172.21.15.154:0/627002098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7480b3590 0x7fd7480cdbd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.473+0000 7fd74f534640 1 -- 172.21.15.154:0/627002098 >> 172.21.15.154:0/627002098 conn(0x7fd7480b5b80 msgr2=0x7fd748156f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:01.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.473+0000 7fd74f534640 1 -- 172.21.15.154:0/627002098 shutdown_connections 2024-05-14T01:24:01.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.473+0000 7fd74f534640 1 -- 172.21.15.154:0/627002098 wait complete. 2024-05-14T01:24:01.476 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T01:24:01.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c8f3f640 1 Processor -- start 2024-05-14T01:24:01.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c8f3f640 1 -- start start 2024-05-14T01:24:01.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c8f3f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c40d0210 0x7fb1c40d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c8f3f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1c40cf580 con 0x7fb1c40cd390 2024-05-14T01:24:01.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c8f3f640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1c40d0b30 con 0x7fb1c40b3080 2024-05-14T01:24:01.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c8f3f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c40d1e10 con 0x7fb1c40d0210 2024-05-14T01:24:01.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c1d9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb1c40cd390 0x7fb1c40ce760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54214/0 (socket says 172.21.15.154:54214) 2024-05-14T01:24:01.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c1d9b640 1 -- 172.21.15.154:0/3948151094 learned_addr learned my addr 172.21.15.154:0/3948151094 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:01.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c259c640 1 --2- 172.21.15.154:0/3948151094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c40d0210 0x7fb1c40d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c159a640 1 -- 172.21.15.154:0/3948151094 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2074778457 0 0) 0x7fb1c40cf580 con 0x7fb1c40cd390 2024-05-14T01:24:01.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c159a640 1 -- 172.21.15.154:0/3948151094 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1ac003530 con 0x7fb1c40cd390 2024-05-14T01:24:01.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c159a640 1 -- 172.21.15.154:0/3948151094 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3480589998 0 0) 0x7fb1ac003530 con 0x7fb1c40cd390 2024-05-14T01:24:01.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c159a640 1 -- 172.21.15.154:0/3948151094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c40d0210 msgr2=0x7fb1c40d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:01.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c159a640 1 --2- 172.21.15.154:0/3948151094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c40d0210 0x7fb1c40d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c159a640 1 -- 172.21.15.154:0/3948151094 >> v1:172.21.15.176:6789/0 conn(0x7fb1c40b3080 legacy=0x7fb1c40cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:01.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c159a640 1 -- 172.21.15.154:0/3948151094 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c40cdf70 con 0x7fb1c40cd390 2024-05-14T01:24:01.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c159a640 1 -- 172.21.15.154:0/3948151094 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fb1b4001680 con 0x7fb1c40cd390 2024-05-14T01:24:01.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c159a640 1 -- 172.21.15.154:0/3948151094 >> v1:172.21.15.154:6789/0 conn(0x7fb1c40cd390 legacy=0x7fb1c40ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:01.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c159a640 1 --2- 172.21.15.154:0/3948151094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c40d0210 0x7fb1ac0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c159a640 1 --2- 172.21.15.154:0/3948151094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac003f30 0x7fb1ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c159a640 1 --2- 172.21.15.154:0/3948151094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1ac004d50 0x7fb1ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c159a640 1 -- 172.21.15.154:0/3948151094 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ac00bab0 con 0x7fb1ac003f30 2024-05-14T01:24:01.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c159a640 1 -- 172.21.15.154:0/3948151094 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ac00bc60 con 0x7fb1ac004d50 2024-05-14T01:24:01.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c159a640 1 -- 172.21.15.154:0/3948151094 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ac00be60 con 0x7fb1c40d0210 2024-05-14T01:24:01.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c1d9b640 1 --2- 172.21.15.154:0/3948151094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac003f30 0x7fb1ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c259c640 1 --2- 172.21.15.154:0/3948151094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c40d0210 0x7fb1ac0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c2d9d640 1 --2- 172.21.15.154:0/3948151094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1ac004d50 0x7fb1ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c1d9b640 1 -- 172.21.15.154:0/3948151094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c40d0210 msgr2=0x7fb1ac0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:01.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c1d9b640 1 --2- 172.21.15.154:0/3948151094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c40d0210 0x7fb1ac0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c1d9b640 1 -- 172.21.15.154:0/3948151094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1ac004d50 msgr2=0x7fb1ac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:01.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c1d9b640 1 --2- 172.21.15.154:0/3948151094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1ac004d50 0x7fb1ac0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c1d9b640 1 -- 172.21.15.154:0/3948151094 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ac003530 con 0x7fb1ac003f30 2024-05-14T01:24:01.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.613+0000 7fb1c2d9d640 1 --2- 172.21.15.154:0/3948151094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1ac004d50 0x7fb1ac0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:01.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.617+0000 7fb1c1d9b640 1 --2- 172.21.15.154:0/3948151094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac003f30 0x7fb1ac004810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400c190 tx=0x7fb1b401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca64e744a3864765 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:01.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.617+0000 7fb1c159a640 1 -- 172.21.15.154:0/3948151094 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4007cd0 con 0x7fb1ac003f30 2024-05-14T01:24:01.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.617+0000 7fb1c159a640 1 -- 172.21.15.154:0/3948151094 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b40a9070 con 0x7fb1ac003f30 2024-05-14T01:24:01.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.617+0000 7fb1c159a640 1 -- 172.21.15.154:0/3948151094 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40a5da0 con 0x7fb1ac003f30 2024-05-14T01:24:01.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.617+0000 7fb1c8f3f640 1 -- 172.21.15.154:0/3948151094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac003f30 msgr2=0x7fb1ac004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:01.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.617+0000 7fb1c8f3f640 1 --2- 172.21.15.154:0/3948151094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac003f30 0x7fb1ac004810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400c190 tx=0x7fb1b401cc20 comp rx=0 tx=0).stop 2024-05-14T01:24:01.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.617+0000 7fb1c2d9d640 1 -- 172.21.15.154:0/3948151094 reap_dead start 2024-05-14T01:24:01.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.617+0000 7fb1c8f3f640 1 -- 172.21.15.154:0/3948151094 shutdown_connections 2024-05-14T01:24:01.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.617+0000 7fb1c8f3f640 1 -- 172.21.15.154:0/3948151094 >> 172.21.15.154:0/3948151094 conn(0x7fb1c409aa10 msgr2=0x7fb1c409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:01.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.617+0000 7fb1c8f3f640 1 -- 172.21.15.154:0/3948151094 shutdown_connections 2024-05-14T01:24:01.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.617+0000 7fb1c8f3f640 1 -- 172.21.15.154:0/3948151094 wait complete. 2024-05-14T01:24:01.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.617+0000 7fb1c8f3f640 1 Processor -- start 2024-05-14T01:24:01.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.617+0000 7fb1c8f3f640 1 -- start start 2024-05-14T01:24:01.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c8f3f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1ac003f30 0x7fb1c40c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c8f3f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c40c5880 0x7fb1c41f3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c8f3f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c40c7590 0x7fb1c40d1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c8f3f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c40b1870 con 0x7fb1c40c7590 2024-05-14T01:24:01.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c8f3f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c40b1be0 con 0x7fb1c40c5880 2024-05-14T01:24:01.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c8f3f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c415c2a0 con 0x7fb1ac003f30 2024-05-14T01:24:01.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c40c7590 0x7fb1c40d1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c40c7590 0x7fb1c40d1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59250/0 (socket says 172.21.15.154:59250) 2024-05-14T01:24:01.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c2d9d640 1 -- 172.21.15.154:0/475280401 learned_addr learned my addr 172.21.15.154:0/475280401 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:01.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c1d9b640 1 --2- 172.21.15.154:0/475280401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c40c5880 0x7fb1c41f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c259c640 1 --2- 172.21.15.154:0/475280401 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1ac003f30 0x7fb1c40c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c2d9d640 1 -- 172.21.15.154:0/475280401 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1ac003f30 msgr2=0x7fb1c40c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:01.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c2d9d640 1 --2- 172.21.15.154:0/475280401 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1ac003f30 0x7fb1c40c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c2d9d640 1 -- 172.21.15.154:0/475280401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c40c5880 msgr2=0x7fb1c41f3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:01.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c2d9d640 1 --2- 172.21.15.154:0/475280401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c40c5880 0x7fb1c41f3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c2d9d640 1 -- 172.21.15.154:0/475280401 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c41f3bf0 con 0x7fb1c40c7590 2024-05-14T01:24:01.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c2d9d640 1 --2- 172.21.15.154:0/475280401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c40c7590 0x7fb1c40d1b20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40cc670 tx=0x7fb1bc010e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:01.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1b2ffd640 1 -- 172.21.15.154:0/475280401 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc003d90 con 0x7fb1c40c7590 2024-05-14T01:24:01.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1b2ffd640 1 -- 172.21.15.154:0/475280401 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1bc019070 con 0x7fb1c40c7590 2024-05-14T01:24:01.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c8f3f640 1 -- 172.21.15.154:0/475280401 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c41f3ed0 con 0x7fb1c40c7590 2024-05-14T01:24:01.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1b2ffd640 1 -- 172.21.15.154:0/475280401 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc0052b0 con 0x7fb1c40c7590 2024-05-14T01:24:01.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c8f3f640 1 -- 172.21.15.154:0/475280401 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c406b420 con 0x7fb1c40c7590 2024-05-14T01:24:01.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c8f3f640 1 -- 172.21.15.154:0/475280401 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c41f43f0 con 0x7fb1c40c7590 2024-05-14T01:24:01.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1b2ffd640 1 -- 172.21.15.154:0/475280401 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb1bc013070 con 0x7fb1c40c7590 2024-05-14T01:24:01.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1b2ffd640 1 --2- 172.21.15.154:0/475280401 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb1a40678c0 0x7fb1a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1b2ffd640 1 -- 172.21.15.154:0/475280401 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb1bc088a50 con 0x7fb1c40c7590 2024-05-14T01:24:01.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c259c640 1 --2- 172.21.15.154:0/475280401 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb1a40678c0 0x7fb1a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.621+0000 7fb1c259c640 1 --2- 172.21.15.154:0/475280401 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb1a40678c0 0x7fb1a4069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009a20 tx=0x7fb1b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:01.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.625+0000 7fb1b2ffd640 1 -- 172.21.15.154:0/475280401 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb1c41f43f0 con 0x7fb1c40c7590 2024-05-14T01:24:01.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.781+0000 7fb1c8f3f640 1 -- 172.21.15.154:0/475280401 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb1c4068360 con 0x7fb1c40c7590 2024-05-14T01:24:01.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.781+0000 7fb1b2ffd640 1 -- 172.21.15.154:0/475280401 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fb1bc01b310 con 0x7fb1c40c7590 2024-05-14T01:24:01.767 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-05-14T01:24:01.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.785+0000 7fb1c8f3f640 1 -- 172.21.15.154:0/475280401 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb1a40678c0 msgr2=0x7fb1a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:01.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.785+0000 7fb1c8f3f640 1 --2- 172.21.15.154:0/475280401 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb1a40678c0 0x7fb1a4069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009a20 tx=0x7fb1b8008040 comp rx=0 tx=0).stop 2024-05-14T01:24:01.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.785+0000 7fb1c8f3f640 1 -- 172.21.15.154:0/475280401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c40c7590 msgr2=0x7fb1c40d1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:01.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.785+0000 7fb1c8f3f640 1 --2- 172.21.15.154:0/475280401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c40c7590 0x7fb1c40d1b20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40cc670 tx=0x7fb1bc010e70 comp rx=0 tx=0).stop 2024-05-14T01:24:01.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.785+0000 7fb1c8f3f640 1 -- 172.21.15.154:0/475280401 shutdown_connections 2024-05-14T01:24:01.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.785+0000 7fb1c8f3f640 1 --2- 172.21.15.154:0/475280401 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb1a40678c0 0x7fb1a4069d80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.785+0000 7fb1c8f3f640 1 --2- 172.21.15.154:0/475280401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c40c7590 0x7fb1c40d1b20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.785+0000 7fb1c8f3f640 1 --2- 172.21.15.154:0/475280401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c40c5880 0x7fb1c41f3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.785+0000 7fb1c8f3f640 1 --2- 172.21.15.154:0/475280401 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1ac003f30 0x7fb1c40c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.785+0000 7fb1c8f3f640 1 -- 172.21.15.154:0/475280401 >> 172.21.15.154:0/475280401 conn(0x7fb1c409aa10 msgr2=0x7fb1c406fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:01.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.785+0000 7fb1c8f3f640 1 -- 172.21.15.154:0/475280401 shutdown_connections 2024-05-14T01:24:01.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.785+0000 7fb1c8f3f640 1 -- 172.21.15.154:0/475280401 wait complete. 2024-05-14T01:24:01.785 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T01:24:01.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.913+0000 7fb3bd4ef640 1 Processor -- start 2024-05-14T01:24:01.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.913+0000 7fb3bd4ef640 1 -- start start 2024-05-14T01:24:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.913+0000 7fb3bd4ef640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3b80ced50 0x7fb3b80cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.913+0000 7fb3bd4ef640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb3b80cd160 0x7fb3b80cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.913+0000 7fb3bd4ef640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b80cdcb0 con 0x7fb3b8071ef0 2024-05-14T01:24:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.913+0000 7fb3bd4ef640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb3b80ce8c0 con 0x7fb3b80cd160 2024-05-14T01:24:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.913+0000 7fb3bd4ef640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b80cdf90 con 0x7fb3b80ced50 2024-05-14T01:24:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.913+0000 7fb3b77fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb3b80cd160 0x7fb3b80cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.913+0000 7fb3b77fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb3b80cd160 0x7fb3b80cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59264/0 (socket says 172.21.15.154:59264) 2024-05-14T01:24:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.913+0000 7fb3b77fe640 1 -- 172.21.15.154:0/2896956084 learned_addr learned my addr 172.21.15.154:0/2896956084 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.913+0000 7fb3ae7fc640 1 --2- 172.21.15.154:0/2896956084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3b80ced50 0x7fb3b80cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.913+0000 7fb3b77fe640 1 -- 172.21.15.154:0/2896956084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3b80ced50 msgr2=0x7fb3b80cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.913+0000 7fb3b77fe640 1 --2- 172.21.15.154:0/2896956084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3b80ced50 0x7fb3b80cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.913+0000 7fb3b77fe640 1 -- 172.21.15.154:0/2896956084 >> v1:172.21.15.176:6789/0 conn(0x7fb3b8071ef0 legacy=0x7fb3b80722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:01.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.913+0000 7fb3b77fe640 1 -- 172.21.15.154:0/2896956084 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b80ce270 con 0x7fb3b80cd160 2024-05-14T01:24:01.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.913+0000 7fb3b77fe640 1 --2- 172.21.15.154:0/2896956084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3b80cd160 0x7fb3b80cd5c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009e50 tx=0x7fb3b001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb31456052f444b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:01.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3b67fc640 1 -- 172.21.15.154:0/2896956084 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00a5740 con 0x7fb3b80cd160 2024-05-14T01:24:01.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3b67fc640 1 -- 172.21.15.154:0/2896956084 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b00a58e0 con 0x7fb3b80cd160 2024-05-14T01:24:01.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3b67fc640 1 -- 172.21.15.154:0/2896956084 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00a5cb0 con 0x7fb3b80cd160 2024-05-14T01:24:01.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3bd4ef640 1 -- 172.21.15.154:0/2896956084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3b80cd160 msgr2=0x7fb3b80cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:01.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3bd4ef640 1 --2- 172.21.15.154:0/2896956084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3b80cd160 0x7fb3b80cd5c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009e50 tx=0x7fb3b001c9f0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3bd4ef640 1 -- 172.21.15.154:0/2896956084 shutdown_connections 2024-05-14T01:24:01.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3bd4ef640 1 --2- 172.21.15.154:0/2896956084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3b80cd160 0x7fb3b80cd5c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3bd4ef640 1 --2- 172.21.15.154:0/2896956084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3b80ced50 0x7fb3b80cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3bd4ef640 1 -- 172.21.15.154:0/2896956084 >> 172.21.15.154:0/2896956084 conn(0x7fb3b80b1770 msgr2=0x7fb3b80b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:01.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3bd4ef640 1 -- 172.21.15.154:0/2896956084 shutdown_connections 2024-05-14T01:24:01.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3bd4ef640 1 -- 172.21.15.154:0/2896956084 wait complete. 2024-05-14T01:24:01.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3bd4ef640 1 Processor -- start 2024-05-14T01:24:01.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3bd4ef640 1 -- start start 2024-05-14T01:24:01.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3bd4ef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3b8071ef0 0x7fb3b813c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3bd4ef640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3b80cd160 0x7fb3b81f6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3bd4ef640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3b80ced50 0x7fb3b80aa390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3bd4ef640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b8167b40 con 0x7fb3b8071ef0 2024-05-14T01:24:01.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3bd4ef640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b81679c0 con 0x7fb3b80ced50 2024-05-14T01:24:01.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3bd4ef640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b8167cc0 con 0x7fb3b80cd160 2024-05-14T01:24:01.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3b6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3b8071ef0 0x7fb3b813c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3b6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3b8071ef0 0x7fb3b813c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59278/0 (socket says 172.21.15.154:59278) 2024-05-14T01:24:01.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3b6ffd640 1 -- 172.21.15.154:0/2080623424 learned_addr learned my addr 172.21.15.154:0/2080623424 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:01.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3b77fe640 1 --2- 172.21.15.154:0/2080623424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3b80ced50 0x7fb3b80aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3b6ffd640 1 -- 172.21.15.154:0/2080623424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3b80cd160 msgr2=0x7fb3b81f6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:01.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3ae7fc640 1 --2- 172.21.15.154:0/2080623424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3b80cd160 0x7fb3b81f6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3b6ffd640 1 --2- 172.21.15.154:0/2080623424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3b80cd160 0x7fb3b81f6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3b6ffd640 1 -- 172.21.15.154:0/2080623424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3b80ced50 msgr2=0x7fb3b80aa390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:01.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3b6ffd640 1 --2- 172.21.15.154:0/2080623424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3b80ced50 0x7fb3b80aa390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:01.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3b6ffd640 1 -- 172.21.15.154:0/2080623424 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b8140a10 con 0x7fb3b8071ef0 2024-05-14T01:24:01.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3b6ffd640 1 --2- 172.21.15.154:0/2080623424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3b8071ef0 0x7fb3b813c6d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800c450 tx=0x7fb3a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:01.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3affff640 1 -- 172.21.15.154:0/2080623424 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8012830 con 0x7fb3b8071ef0 2024-05-14T01:24:01.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3affff640 1 -- 172.21.15.154:0/2080623424 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a8017070 con 0x7fb3b8071ef0 2024-05-14T01:24:01.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3affff640 1 -- 172.21.15.154:0/2080623424 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8012c30 con 0x7fb3b8071ef0 2024-05-14T01:24:01.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3bd4ef640 1 -- 172.21.15.154:0/2080623424 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b8140cf0 con 0x7fb3b8071ef0 2024-05-14T01:24:01.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.917+0000 7fb3bd4ef640 1 -- 172.21.15.154:0/2080623424 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b80a9740 con 0x7fb3b8071ef0 2024-05-14T01:24:01.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.921+0000 7fb3bd4ef640 1 -- 172.21.15.154:0/2080623424 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b8075470 con 0x7fb3b8071ef0 2024-05-14T01:24:01.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.921+0000 7fb3affff640 1 -- 172.21.15.154:0/2080623424 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb3a801c460 con 0x7fb3b8071ef0 2024-05-14T01:24:01.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.921+0000 7fb3affff640 1 --2- 172.21.15.154:0/2080623424 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb3980678c0 0x7fb398069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:01.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.921+0000 7fb3affff640 1 -- 172.21.15.154:0/2080623424 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb3a8085ac0 con 0x7fb3b8071ef0 2024-05-14T01:24:01.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.921+0000 7fb3ae7fc640 1 --2- 172.21.15.154:0/2080623424 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb3980678c0 0x7fb398069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:01.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.921+0000 7fb3ae7fc640 1 --2- 172.21.15.154:0/2080623424 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb3980678c0 0x7fb398069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8140460 tx=0x7fb3a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:01.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:01.925+0000 7fb3affff640 1 -- 172.21.15.154:0/2080623424 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb3a8056600 con 0x7fb3b8071ef0 2024-05-14T01:24:02.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.073+0000 7fb3bd4ef640 1 -- 172.21.15.154:0/2080623424 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb3b806d0f0 con 0x7fb3b8071ef0 2024-05-14T01:24:02.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.073+0000 7fb3affff640 1 -- 172.21.15.154:0/2080623424 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fb3a8055f00 con 0x7fb3b8071ef0 2024-05-14T01:24:02.059 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-05-14T01:24:02.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.073+0000 7fb3bd4ef640 1 -- 172.21.15.154:0/2080623424 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb3980678c0 msgr2=0x7fb398069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.073+0000 7fb3bd4ef640 1 --2- 172.21.15.154:0/2080623424 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb3980678c0 0x7fb398069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8140460 tx=0x7fb3a0008040 comp rx=0 tx=0).stop 2024-05-14T01:24:02.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.073+0000 7fb3bd4ef640 1 -- 172.21.15.154:0/2080623424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3b8071ef0 msgr2=0x7fb3b813c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.073+0000 7fb3bd4ef640 1 --2- 172.21.15.154:0/2080623424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3b8071ef0 0x7fb3b813c6d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800c450 tx=0x7fb3a800c910 comp rx=0 tx=0).stop 2024-05-14T01:24:02.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.073+0000 7fb3bd4ef640 1 -- 172.21.15.154:0/2080623424 shutdown_connections 2024-05-14T01:24:02.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.073+0000 7fb3bd4ef640 1 --2- 172.21.15.154:0/2080623424 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb3980678c0 0x7fb398069d80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.073+0000 7fb3bd4ef640 1 --2- 172.21.15.154:0/2080623424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3b80ced50 0x7fb3b80aa390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.073+0000 7fb3bd4ef640 1 --2- 172.21.15.154:0/2080623424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3b80cd160 0x7fb3b81f6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.073+0000 7fb3bd4ef640 1 --2- 172.21.15.154:0/2080623424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3b8071ef0 0x7fb3b813c6d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.077+0000 7fb3bd4ef640 1 -- 172.21.15.154:0/2080623424 >> 172.21.15.154:0/2080623424 conn(0x7fb3b80b1770 msgr2=0x7fb3b80c4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:02.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.077+0000 7fb3bd4ef640 1 -- 172.21.15.154:0/2080623424 shutdown_connections 2024-05-14T01:24:02.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.077+0000 7fb3bd4ef640 1 -- 172.21.15.154:0/2080623424 wait complete. 2024-05-14T01:24:02.077 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:02.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.209+0000 7fa314ca0640 1 Processor -- start 2024-05-14T01:24:02.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.209+0000 7fa314ca0640 1 -- start start 2024-05-14T01:24:02.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.213+0000 7fa314ca0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa310144760 0x7fa31006e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.213+0000 7fa314ca0640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa31015bae0 0x7fa31015c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.213+0000 7fa314ca0640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa310144b40 con 0x7fa3100b3530 2024-05-14T01:24:02.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.213+0000 7fa314ca0640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa3100b4650 con 0x7fa31015bae0 2024-05-14T01:24:02.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.213+0000 7fa314ca0640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa3100b3a40 con 0x7fa310144760 2024-05-14T01:24:02.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.213+0000 7fa30e59c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa310144760 0x7fa31006e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.213+0000 7fa30ed9d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa31015bae0 0x7fa31015c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.213+0000 7fa30dd9b640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fa3100b3530 0x7fa31015b3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:45456/0 (socket says 172.21.15.154:45456) 2024-05-14T01:24:02.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.213+0000 7fa30dd9b640 1 -- 172.21.15.154:0/4243170450 learned_addr learned my addr 172.21.15.154:0/4243170450 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.213+0000 7fa30ed9d640 1 -- 172.21.15.154:0/4243170450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa310144760 msgr2=0x7fa31006e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.213+0000 7fa30ed9d640 1 --2- 172.21.15.154:0/4243170450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa310144760 0x7fa31006e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.213+0000 7fa30ed9d640 1 -- 172.21.15.154:0/4243170450 >> v1:172.21.15.176:6789/0 conn(0x7fa3100b3530 legacy=0x7fa31015b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.213+0000 7fa30ed9d640 1 -- 172.21.15.154:0/4243170450 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3100b3d20 con 0x7fa31015bae0 2024-05-14T01:24:02.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa30ed9d640 1 --2- 172.21.15.154:0/4243170450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31015bae0 0x7fa31015c5e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa308009d90 tx=0x7fa30801c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d357e5de120c7572 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:02.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa30d59a640 1 -- 172.21.15.154:0/4243170450 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3080b2070 con 0x7fa31015bae0 2024-05-14T01:24:02.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa30d59a640 1 -- 172.21.15.154:0/4243170450 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3080a5a20 con 0x7fa31015bae0 2024-05-14T01:24:02.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa30d59a640 1 -- 172.21.15.154:0/4243170450 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3080a5df0 con 0x7fa31015bae0 2024-05-14T01:24:02.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa314ca0640 1 -- 172.21.15.154:0/4243170450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31015bae0 msgr2=0x7fa31015c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa314ca0640 1 --2- 172.21.15.154:0/4243170450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31015bae0 0x7fa31015c5e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa308009d90 tx=0x7fa30801c940 comp rx=0 tx=0).stop 2024-05-14T01:24:02.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa314ca0640 1 -- 172.21.15.154:0/4243170450 shutdown_connections 2024-05-14T01:24:02.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa314ca0640 1 --2- 172.21.15.154:0/4243170450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31015bae0 0x7fa31015c5e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa314ca0640 1 --2- 172.21.15.154:0/4243170450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa310144760 0x7fa31006e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa314ca0640 1 -- 172.21.15.154:0/4243170450 >> 172.21.15.154:0/4243170450 conn(0x7fa3100b1850 msgr2=0x7fa3100b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:02.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa314ca0640 1 -- 172.21.15.154:0/4243170450 shutdown_connections 2024-05-14T01:24:02.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa314ca0640 1 -- 172.21.15.154:0/4243170450 wait complete. 2024-05-14T01:24:02.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa314ca0640 1 Processor -- start 2024-05-14T01:24:02.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa314ca0640 1 -- start start 2024-05-14T01:24:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa314ca0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3100b3530 0x7fa3101391d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa314ca0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa310144760 0x7fa3101fa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa314ca0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31015bae0 0x7fa3100cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa314ca0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa31015d4b0 con 0x7fa310144760 2024-05-14T01:24:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa314ca0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa31015d330 con 0x7fa31015bae0 2024-05-14T01:24:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa314ca0640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa31015d630 con 0x7fa3100b3530 2024-05-14T01:24:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa30dd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa310144760 0x7fa3101fa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa30dd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa310144760 0x7fa3101fa720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59294/0 (socket says 172.21.15.154:59294) 2024-05-14T01:24:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa30dd9b640 1 -- 172.21.15.154:0/4200159231 learned_addr learned my addr 172.21.15.154:0/4200159231 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa30ed9d640 1 --2- 172.21.15.154:0/4200159231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31015bae0 0x7fa3100cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa30e59c640 1 --2- 172.21.15.154:0/4200159231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3100b3530 0x7fa3101391d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa30dd9b640 1 -- 172.21.15.154:0/4200159231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3100b3530 msgr2=0x7fa3101391d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa30dd9b640 1 --2- 172.21.15.154:0/4200159231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3100b3530 0x7fa3101391d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa30dd9b640 1 -- 172.21.15.154:0/4200159231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31015bae0 msgr2=0x7fa3100cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa30dd9b640 1 --2- 172.21.15.154:0/4200159231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31015bae0 0x7fa3100cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa30dd9b640 1 -- 172.21.15.154:0/4200159231 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3101fb1e0 con 0x7fa310144760 2024-05-14T01:24:02.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa30dd9b640 1 --2- 172.21.15.154:0/4200159231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa310144760 0x7fa3101fa720 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa30400c430 tx=0x7fa30400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:02.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.217+0000 7fa2feffd640 1 -- 172.21.15.154:0/4200159231 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa304017070 con 0x7fa310144760 2024-05-14T01:24:02.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.221+0000 7fa2feffd640 1 -- 172.21.15.154:0/4200159231 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa304005cf0 con 0x7fa310144760 2024-05-14T01:24:02.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.221+0000 7fa314ca0640 1 -- 172.21.15.154:0/4200159231 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3101fb4c0 con 0x7fa310144760 2024-05-14T01:24:02.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.221+0000 7fa2feffd640 1 -- 172.21.15.154:0/4200159231 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3040072f0 con 0x7fa310144760 2024-05-14T01:24:02.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.221+0000 7fa314ca0640 1 -- 172.21.15.154:0/4200159231 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa31013bef0 con 0x7fa310144760 2024-05-14T01:24:02.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.221+0000 7fa314ca0640 1 -- 172.21.15.154:0/4200159231 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa310075470 con 0x7fa310144760 2024-05-14T01:24:02.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.221+0000 7fa2feffd640 1 -- 172.21.15.154:0/4200159231 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa30401a070 con 0x7fa310144760 2024-05-14T01:24:02.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.221+0000 7fa2feffd640 1 --2- 172.21.15.154:0/4200159231 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa2f00678f0 0x7fa2f0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.221+0000 7fa2feffd640 1 -- 172.21.15.154:0/4200159231 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa304085070 con 0x7fa310144760 2024-05-14T01:24:02.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.221+0000 7fa30e59c640 1 --2- 172.21.15.154:0/4200159231 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa2f00678f0 0x7fa2f0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.221+0000 7fa30e59c640 1 --2- 172.21.15.154:0/4200159231 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa2f00678f0 0x7fa2f0069db0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa300009af0 tx=0x7fa300008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:02.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.225+0000 7fa2feffd640 1 -- 172.21.15.154:0/4200159231 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fa304055b30 con 0x7fa310144760 2024-05-14T01:24:02.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.381+0000 7fa314ca0640 1 -- 172.21.15.154:0/4200159231 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa31006d250 con 0x7fa310144760 2024-05-14T01:24:02.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.385+0000 7fa2feffd640 1 -- 172.21.15.154:0/4200159231 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7fa304055430 con 0x7fa310144760 2024-05-14T01:24:02.369 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:02.369 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:36.232271+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:02.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.385+0000 7fa314ca0640 1 -- 172.21.15.154:0/4200159231 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa2f00678f0 msgr2=0x7fa2f0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.385+0000 7fa314ca0640 1 --2- 172.21.15.154:0/4200159231 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa2f00678f0 0x7fa2f0069db0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa300009af0 tx=0x7fa300008040 comp rx=0 tx=0).stop 2024-05-14T01:24:02.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.385+0000 7fa314ca0640 1 -- 172.21.15.154:0/4200159231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa310144760 msgr2=0x7fa3101fa720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.385+0000 7fa314ca0640 1 --2- 172.21.15.154:0/4200159231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa310144760 0x7fa3101fa720 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa30400c430 tx=0x7fa30400c8f0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.385+0000 7fa314ca0640 1 -- 172.21.15.154:0/4200159231 shutdown_connections 2024-05-14T01:24:02.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.385+0000 7fa314ca0640 1 --2- 172.21.15.154:0/4200159231 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa2f00678f0 0x7fa2f0069db0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.385+0000 7fa314ca0640 1 --2- 172.21.15.154:0/4200159231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31015bae0 0x7fa3100cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.385+0000 7fa314ca0640 1 --2- 172.21.15.154:0/4200159231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa310144760 0x7fa3101fa720 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.385+0000 7fa314ca0640 1 --2- 172.21.15.154:0/4200159231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3100b3530 0x7fa3101391d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.385+0000 7fa314ca0640 1 -- 172.21.15.154:0/4200159231 >> 172.21.15.154:0/4200159231 conn(0x7fa3100b1850 msgr2=0x7fa310142070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:02.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.385+0000 7fa314ca0640 1 -- 172.21.15.154:0/4200159231 shutdown_connections 2024-05-14T01:24:02.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.385+0000 7fa314ca0640 1 -- 172.21.15.154:0/4200159231 wait complete. 2024-05-14T01:24:02.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T01:23:33.083538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T01:23:33.556058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:24:02.389 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:24:02.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.521+0000 7ff86b625640 1 Processor -- start 2024-05-14T01:24:02.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.521+0000 7ff86b625640 1 -- start start 2024-05-14T01:24:02.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.521+0000 7ff86b625640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff864071ef0 0x7ff8640722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.521+0000 7ff86b625640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff8640ced50 0x7ff8640cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.521+0000 7ff86b625640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff864072810 con 0x7ff8640cd160 2024-05-14T01:24:02.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.521+0000 7ff86b625640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff8640ce8c0 con 0x7ff8640ced50 2024-05-14T01:24:02.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.521+0000 7ff86b625640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff8640cdcb0 con 0x7ff864071ef0 2024-05-14T01:24:02.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.521+0000 7ff868bc0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff8640ced50 0x7ff8640cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.521+0000 7ff869bc2640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff8640cd160 0x7ff8640b2a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54226/0 (socket says 172.21.15.154:54226) 2024-05-14T01:24:02.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.521+0000 7ff869bc2640 1 -- 172.21.15.154:0/3483641894 learned_addr learned my addr 172.21.15.154:0/3483641894 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:02.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.521+0000 7ff868bc0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff8640ced50 0x7ff8640cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59310/0 (socket says 172.21.15.154:59310) 2024-05-14T01:24:02.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.521+0000 7ff8693c1640 1 --2- 172.21.15.154:0/3483641894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff864071ef0 0x7ff8640722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.521+0000 7ff868bc0640 1 -- 172.21.15.154:0/3483641894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff864071ef0 msgr2=0x7ff8640722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:02.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.521+0000 7ff868bc0640 1 --2- 172.21.15.154:0/3483641894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff864071ef0 0x7ff8640722d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.521+0000 7ff868bc0640 1 -- 172.21.15.154:0/3483641894 >> v1:172.21.15.154:6789/0 conn(0x7ff8640cd160 legacy=0x7ff8640b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.521+0000 7ff868bc0640 1 -- 172.21.15.154:0/3483641894 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8640cdf90 con 0x7ff8640ced50 2024-05-14T01:24:02.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.521+0000 7ff8693c1640 1 --2- 172.21.15.154:0/3483641894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff864071ef0 0x7ff8640722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:02.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff868bc0640 1 --2- 172.21.15.154:0/3483641894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8640ced50 0x7ff8640cf1b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff8540097c0 tx=0x7ff85401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90959da75aeea8c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:02.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff85bfff640 1 -- 172.21.15.154:0/3483641894 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8540a7070 con 0x7ff8640ced50 2024-05-14T01:24:02.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff85bfff640 1 -- 172.21.15.154:0/3483641894 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8540b0070 con 0x7ff8640ced50 2024-05-14T01:24:02.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff85bfff640 1 -- 172.21.15.154:0/3483641894 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8540ab890 con 0x7ff8640ced50 2024-05-14T01:24:02.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff86b625640 1 -- 172.21.15.154:0/3483641894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8640ced50 msgr2=0x7ff8640cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff86b625640 1 --2- 172.21.15.154:0/3483641894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8640ced50 0x7ff8640cf1b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff8540097c0 tx=0x7ff85401c470 comp rx=0 tx=0).stop 2024-05-14T01:24:02.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff86b625640 1 -- 172.21.15.154:0/3483641894 shutdown_connections 2024-05-14T01:24:02.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff86b625640 1 --2- 172.21.15.154:0/3483641894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8640ced50 0x7ff8640cf1b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff86b625640 1 --2- 172.21.15.154:0/3483641894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff864071ef0 0x7ff8640722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff86b625640 1 -- 172.21.15.154:0/3483641894 >> 172.21.15.154:0/3483641894 conn(0x7ff8640b1770 msgr2=0x7ff8640b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:02.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff86b625640 1 -- 172.21.15.154:0/3483641894 shutdown_connections 2024-05-14T01:24:02.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff86b625640 1 -- 172.21.15.154:0/3483641894 wait complete. 2024-05-14T01:24:02.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff86b625640 1 Processor -- start 2024-05-14T01:24:02.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff86b625640 1 -- start start 2024-05-14T01:24:02.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff86b625640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff864071ef0 0x7ff864137880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff86b625640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8640cd160 0x7ff864158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff86b625640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8640ced50 0x7ff864159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff86b625640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff86406e990 con 0x7ff8640cd160 2024-05-14T01:24:02.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff86b625640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff8640cd950 con 0x7ff8640ced50 2024-05-14T01:24:02.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff86b625640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff86406eb10 con 0x7ff864071ef0 2024-05-14T01:24:02.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff868bc0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8640cd160 0x7ff864158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff868bc0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8640cd160 0x7ff864158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59312/0 (socket says 172.21.15.154:59312) 2024-05-14T01:24:02.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff868bc0640 1 -- 172.21.15.154:0/2613004728 learned_addr learned my addr 172.21.15.154:0/2613004728 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:02.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff8693c1640 1 --2- 172.21.15.154:0/2613004728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff864071ef0 0x7ff864137880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff869bc2640 1 --2- 172.21.15.154:0/2613004728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8640ced50 0x7ff864159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff868bc0640 1 -- 172.21.15.154:0/2613004728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff864071ef0 msgr2=0x7ff864137880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff868bc0640 1 --2- 172.21.15.154:0/2613004728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff864071ef0 0x7ff864137880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff868bc0640 1 -- 172.21.15.154:0/2613004728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8640ced50 msgr2=0x7ff864159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff868bc0640 1 --2- 172.21.15.154:0/2613004728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8640ced50 0x7ff864159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff868bc0640 1 -- 172.21.15.154:0/2613004728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86413f0f0 con 0x7ff8640cd160 2024-05-14T01:24:02.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff868bc0640 1 --2- 172.21.15.154:0/2613004728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8640cd160 0x7ff864158390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff8540097c0 tx=0x7ff85401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:02.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff859ffb640 1 -- 172.21.15.154:0/2613004728 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8540bf610 con 0x7ff8640cd160 2024-05-14T01:24:02.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff859ffb640 1 -- 172.21.15.154:0/2613004728 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8540bf7d0 con 0x7ff8640cd160 2024-05-14T01:24:02.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff86b625640 1 -- 172.21.15.154:0/2613004728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff864138980 con 0x7ff8640cd160 2024-05-14T01:24:02.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.525+0000 7ff859ffb640 1 -- 172.21.15.154:0/2613004728 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8540bfbc0 con 0x7ff8640cd160 2024-05-14T01:24:02.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.529+0000 7ff86b625640 1 -- 172.21.15.154:0/2613004728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff86413e330 con 0x7ff8640cd160 2024-05-14T01:24:02.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.529+0000 7ff86b625640 1 -- 172.21.15.154:0/2613004728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff864075470 con 0x7ff8640cd160 2024-05-14T01:24:02.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.529+0000 7ff859ffb640 1 -- 172.21.15.154:0/2613004728 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff8540bd020 con 0x7ff8640cd160 2024-05-14T01:24:02.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.529+0000 7ff859ffb640 1 --2- 172.21.15.154:0/2613004728 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff8480678c0 0x7ff848069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.529+0000 7ff859ffb640 1 -- 172.21.15.154:0/2613004728 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff854120990 con 0x7ff8640cd160 2024-05-14T01:24:02.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.529+0000 7ff8693c1640 1 --2- 172.21.15.154:0/2613004728 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff8480678c0 0x7ff848069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.529+0000 7ff8693c1640 1 --2- 172.21.15.154:0/2613004728 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff8480678c0 0x7ff848069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff86406f120 tx=0x7ff860008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:02.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.533+0000 7ff859ffb640 1 -- 172.21.15.154:0/2613004728 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7ff854016090 con 0x7ff8640cd160 2024-05-14T01:24:02.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.693+0000 7ff86b625640 1 -- 172.21.15.154:0/2613004728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff86413acd0 con 0x7ff8640cd160 2024-05-14T01:24:02.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.693+0000 7ff859ffb640 1 -- 172.21.15.154:0/2613004728 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7ff8540f1640 con 0x7ff8640cd160 2024-05-14T01:24:02.679 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:24:02.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.697+0000 7ff86b625640 1 -- 172.21.15.154:0/2613004728 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff8480678c0 msgr2=0x7ff848069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.697+0000 7ff86b625640 1 --2- 172.21.15.154:0/2613004728 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff8480678c0 0x7ff848069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff86406f120 tx=0x7ff860008040 comp rx=0 tx=0).stop 2024-05-14T01:24:02.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.697+0000 7ff86b625640 1 -- 172.21.15.154:0/2613004728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8640cd160 msgr2=0x7ff864158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.697+0000 7ff86b625640 1 --2- 172.21.15.154:0/2613004728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8640cd160 0x7ff864158390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff8540097c0 tx=0x7ff85401acb0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.697+0000 7ff86b625640 1 -- 172.21.15.154:0/2613004728 shutdown_connections 2024-05-14T01:24:02.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.697+0000 7ff86b625640 1 --2- 172.21.15.154:0/2613004728 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff8480678c0 0x7ff848069d80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.697+0000 7ff86b625640 1 --2- 172.21.15.154:0/2613004728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8640ced50 0x7ff864159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.697+0000 7ff86b625640 1 --2- 172.21.15.154:0/2613004728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8640cd160 0x7ff864158390 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.697+0000 7ff86b625640 1 --2- 172.21.15.154:0/2613004728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff864071ef0 0x7ff864137880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.697+0000 7ff86b625640 1 -- 172.21.15.154:0/2613004728 >> 172.21.15.154:0/2613004728 conn(0x7ff8640b1770 msgr2=0x7ff8640b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:02.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.697+0000 7ff86b625640 1 -- 172.21.15.154:0/2613004728 shutdown_connections 2024-05-14T01:24:02.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.697+0000 7ff86b625640 1 -- 172.21.15.154:0/2613004728 wait complete. 2024-05-14T01:24:02.698 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T01:24:02.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.833+0000 7f1f31854640 1 Processor -- start 2024-05-14T01:24:02.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.833+0000 7f1f31854640 1 -- start start 2024-05-14T01:24:02.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f31854640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1f2c1458d0 0x7f1f2c0cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f31854640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f2c071060 0x7f1f2c15fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f31854640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1f2c15ff80 0x7f1f2c0ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f31854640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1f2c071840 con 0x7f1f2c1458d0 2024-05-14T01:24:02.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f31854640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1f2c071b20 con 0x7f1f2c15ff80 2024-05-14T01:24:02.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f31854640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1f2c071e00 con 0x7f1f2c071060 2024-05-14T01:24:02.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f2affd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1f2c1458d0 0x7f1f2c0cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f2affd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1f2c1458d0 0x7f1f2c0cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59314/0 (socket says 172.21.15.154:59314) 2024-05-14T01:24:02.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f2affd640 1 -- 172.21.15.154:0/2638309783 learned_addr learned my addr 172.21.15.154:0/2638309783 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:02.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f2b7fe640 1 --2- 172.21.15.154:0/2638309783 >> v2:172.21.15.176:3300/0 conn(0x7f1f2c15ff80 0x7f1f2c0ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f2a7fc640 1 --2- 172.21.15.154:0/2638309783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f2c071060 0x7f1f2c15fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f2affd640 1 -- 172.21.15.154:0/2638309783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f2c071060 msgr2=0x7f1f2c15fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:02.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f2affd640 1 --2- 172.21.15.154:0/2638309783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f2c071060 0x7f1f2c15fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f2affd640 1 -- 172.21.15.154:0/2638309783 >> v2:172.21.15.176:3300/0 conn(0x7f1f2c15ff80 msgr2=0x7f1f2c0ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:02.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f2affd640 1 --2- 172.21.15.154:0/2638309783 >> v2:172.21.15.176:3300/0 conn(0x7f1f2c15ff80 0x7f1f2c0ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f2affd640 1 -- 172.21.15.154:0/2638309783 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2c0720e0 con 0x7f1f2c1458d0 2024-05-14T01:24:02.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f2b7fe640 1 --2- 172.21.15.154:0/2638309783 >> v2:172.21.15.176:3300/0 conn(0x7f1f2c15ff80 0x7f1f2c0ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:02.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f2a7fc640 1 --2- 172.21.15.154:0/2638309783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f2c071060 0x7f1f2c15fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:02.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f2affd640 1 --2- 172.21.15.154:0/2638309783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f2c1458d0 0x7f1f2c0cf610 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0b2770 tx=0x7f1f1c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d04ff253202b33b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:02.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f29ffb640 1 -- 172.21.15.154:0/2638309783 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c0b0070 con 0x7f1f2c1458d0 2024-05-14T01:24:02.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f29ffb640 1 -- 172.21.15.154:0/2638309783 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f1c0ab600 con 0x7f1f2c1458d0 2024-05-14T01:24:02.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f29ffb640 1 -- 172.21.15.154:0/2638309783 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c0ab9d0 con 0x7f1f2c1458d0 2024-05-14T01:24:02.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f31854640 1 -- 172.21.15.154:0/2638309783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f2c1458d0 msgr2=0x7f1f2c0cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.837+0000 7f1f31854640 1 --2- 172.21.15.154:0/2638309783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f2c1458d0 0x7f1f2c0cf610 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0b2770 tx=0x7f1f1c01c520 comp rx=0 tx=0).stop 2024-05-14T01:24:02.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f31854640 1 -- 172.21.15.154:0/2638309783 shutdown_connections 2024-05-14T01:24:02.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f31854640 1 --2- 172.21.15.154:0/2638309783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f2c071060 0x7f1f2c15fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f31854640 1 --2- 172.21.15.154:0/2638309783 >> v2:172.21.15.176:3300/0 conn(0x7f1f2c15ff80 0x7f1f2c0ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f31854640 1 --2- 172.21.15.154:0/2638309783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f2c1458d0 0x7f1f2c0cf610 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f31854640 1 -- 172.21.15.154:0/2638309783 >> 172.21.15.154:0/2638309783 conn(0x7f1f2c0b1770 msgr2=0x7f1f2c0b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:02.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f31854640 1 -- 172.21.15.154:0/2638309783 shutdown_connections 2024-05-14T01:24:02.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f31854640 1 -- 172.21.15.154:0/2638309783 wait complete. 2024-05-14T01:24:02.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f31854640 1 Processor -- start 2024-05-14T01:24:02.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f31854640 1 -- start start 2024-05-14T01:24:02.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f31854640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f2c071060 0x7f1f2c13e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f31854640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f2c1458d0 0x7f1f2c157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f31854640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f2c15ff80 0x7f1f2c15bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f31854640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c06cfc0 con 0x7f1f2c071060 2024-05-14T01:24:02.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f31854640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c06ce40 con 0x7f1f2c1458d0 2024-05-14T01:24:02.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f31854640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1f2c06d140 con 0x7f1f2c15ff80 2024-05-14T01:24:02.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f2affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f2c071060 0x7f1f2c13e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f2affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f2c071060 0x7f1f2c13e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59320/0 (socket says 172.21.15.154:59320) 2024-05-14T01:24:02.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f2affd640 1 -- 172.21.15.154:0/692272824 learned_addr learned my addr 172.21.15.154:0/692272824 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:02.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f2b7fe640 1 --2- 172.21.15.154:0/692272824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f2c15ff80 0x7f1f2c15bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f2a7fc640 1 --2- 172.21.15.154:0/692272824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f2c1458d0 0x7f1f2c157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f2affd640 1 -- 172.21.15.154:0/692272824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f2c15ff80 msgr2=0x7f1f2c15bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f2affd640 1 --2- 172.21.15.154:0/692272824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f2c15ff80 0x7f1f2c15bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f2affd640 1 -- 172.21.15.154:0/692272824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f2c1458d0 msgr2=0x7f1f2c157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f2affd640 1 --2- 172.21.15.154:0/692272824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f2c1458d0 0x7f1f2c157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f2affd640 1 -- 172.21.15.154:0/692272824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2c0b2e10 con 0x7f1f2c071060 2024-05-14T01:24:02.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f2affd640 1 --2- 172.21.15.154:0/692272824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f2c071060 0x7f1f2c13e760 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c01cdc0 tx=0x7f1f1c01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:02.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f13fff640 1 -- 172.21.15.154:0/692272824 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c0ba020 con 0x7f1f2c071060 2024-05-14T01:24:02.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f13fff640 1 -- 172.21.15.154:0/692272824 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f1c0b6640 con 0x7f1f2c071060 2024-05-14T01:24:02.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f31854640 1 -- 172.21.15.154:0/692272824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f2c0b30f0 con 0x7f1f2c071060 2024-05-14T01:24:02.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f13fff640 1 -- 172.21.15.154:0/692272824 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c0b0040 con 0x7f1f2c071060 2024-05-14T01:24:02.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.841+0000 7f1f31854640 1 -- 172.21.15.154:0/692272824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f2c0b36b0 con 0x7f1f2c071060 2024-05-14T01:24:02.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.845+0000 7f1f31854640 1 -- 172.21.15.154:0/692272824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f2c075470 con 0x7f1f2c071060 2024-05-14T01:24:02.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.845+0000 7f1f13fff640 1 -- 172.21.15.154:0/692272824 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f1c0bd020 con 0x7f1f2c071060 2024-05-14T01:24:02.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.845+0000 7f1f13fff640 1 --2- 172.21.15.154:0/692272824 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1f180678c0 0x7f1f18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:02.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.845+0000 7f1f2a7fc640 1 --2- 172.21.15.154:0/692272824 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1f180678c0 0x7f1f18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:02.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.845+0000 7f1f13fff640 1 -- 172.21.15.154:0/692272824 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1f1c11ffe0 con 0x7f1f2c071060 2024-05-14T01:24:02.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.845+0000 7f1f2a7fc640 1 --2- 172.21.15.154:0/692272824 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1f180678c0 0x7f1f18069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1f20006b20 tx=0x7f1f20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:02.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.849+0000 7f1f13fff640 1 -- 172.21.15.154:0/692272824 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1f1c0c4030 con 0x7f1f2c071060 2024-05-14T01:24:02.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.993+0000 7f1f31854640 1 -- 172.21.15.154:0/692272824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1f2c070e40 con 0x7f1f2c071060 2024-05-14T01:24:02.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.997+0000 7f1f13fff640 1 -- 172.21.15.154:0/692272824 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f1f1c016110 con 0x7f1f2c071060 2024-05-14T01:24:02.981 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-05-14T01:24:02.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.997+0000 7f1f31854640 1 -- 172.21.15.154:0/692272824 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1f180678c0 msgr2=0x7f1f18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.997+0000 7f1f31854640 1 --2- 172.21.15.154:0/692272824 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1f180678c0 0x7f1f18069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1f20006b20 tx=0x7f1f20008040 comp rx=0 tx=0).stop 2024-05-14T01:24:02.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.997+0000 7f1f31854640 1 -- 172.21.15.154:0/692272824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f2c071060 msgr2=0x7f1f2c13e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:02.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.997+0000 7f1f31854640 1 --2- 172.21.15.154:0/692272824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f2c071060 0x7f1f2c13e760 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c01cdc0 tx=0x7f1f1c01ad60 comp rx=0 tx=0).stop 2024-05-14T01:24:02.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.997+0000 7f1f31854640 1 -- 172.21.15.154:0/692272824 shutdown_connections 2024-05-14T01:24:02.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.997+0000 7f1f31854640 1 --2- 172.21.15.154:0/692272824 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1f180678c0 0x7f1f18069d80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.997+0000 7f1f31854640 1 --2- 172.21.15.154:0/692272824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f2c15ff80 0x7f1f2c15bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.997+0000 7f1f31854640 1 --2- 172.21.15.154:0/692272824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f2c1458d0 0x7f1f2c157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.997+0000 7f1f31854640 1 --2- 172.21.15.154:0/692272824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f2c071060 0x7f1f2c13e760 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:02.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.997+0000 7f1f31854640 1 -- 172.21.15.154:0/692272824 >> 172.21.15.154:0/692272824 conn(0x7f1f2c0b1770 msgr2=0x7f1f2c0b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:02.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.997+0000 7f1f31854640 1 -- 172.21.15.154:0/692272824 shutdown_connections 2024-05-14T01:24:02.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:02.997+0000 7f1f31854640 1 -- 172.21.15.154:0/692272824 wait complete. 2024-05-14T01:24:02.998 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T01:24:03.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.137+0000 7f691aff3640 1 Processor -- start 2024-05-14T01:24:03.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.137+0000 7f691aff3640 1 -- start start 2024-05-14T01:24:03.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.137+0000 7f691aff3640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6914160150 0x7f6914166dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.137+0000 7f691aff3640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6914071840 con 0x7f69140cf610 2024-05-14T01:24:03.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.137+0000 7f691aff3640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6914071b20 con 0x7f69141458d0 2024-05-14T01:24:03.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.137+0000 7f691aff3640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f691406de50 con 0x7f6914160150 2024-05-14T01:24:03.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.137+0000 7f6913fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f69140cf610 0x7f691415fa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54228/0 (socket says 172.21.15.154:54228) 2024-05-14T01:24:03.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.137+0000 7f6913fff640 1 -- 172.21.15.154:0/1557498225 learned_addr learned my addr 172.21.15.154:0/1557498225 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:03.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.137+0000 7f6919590640 1 --2- 172.21.15.154:0/1557498225 >> v2:172.21.15.176:3300/0 conn(0x7f6914160150 0x7f6914166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f69137fe640 1 -- 172.21.15.154:0/1557498225 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4067019988 0 0) 0x7f6914071840 con 0x7f69140cf610 2024-05-14T01:24:03.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f69137fe640 1 -- 172.21.15.154:0/1557498225 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68fc003530 con 0x7f69140cf610 2024-05-14T01:24:03.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f69137fe640 1 -- 172.21.15.154:0/1557498225 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3831433437 0 0) 0x7f68fc003530 con 0x7f69140cf610 2024-05-14T01:24:03.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f69137fe640 1 -- 172.21.15.154:0/1557498225 >> v2:172.21.15.176:3300/0 conn(0x7f6914160150 msgr2=0x7f6914166dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:03.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f69137fe640 1 --2- 172.21.15.154:0/1557498225 >> v2:172.21.15.176:3300/0 conn(0x7f6914160150 0x7f6914166dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f69137fe640 1 -- 172.21.15.154:0/1557498225 >> v1:172.21.15.176:6789/0 conn(0x7f69141458d0 legacy=0x7f6914071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:03.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f69137fe640 1 -- 172.21.15.154:0/1557498225 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6914071e00 con 0x7f69140cf610 2024-05-14T01:24:03.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f69137fe640 1 -- 172.21.15.154:0/1557498225 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f6904001680 con 0x7f69140cf610 2024-05-14T01:24:03.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f69137fe640 1 -- 172.21.15.154:0/1557498225 >> v1:172.21.15.154:6789/0 conn(0x7f69140cf610 legacy=0x7f691415fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:03.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f69137fe640 1 --2- 172.21.15.154:0/1557498225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0039c0 0x7f68fc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f69137fe640 1 --2- 172.21.15.154:0/1557498225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68fc0043c0 0x7f68fc004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f69137fe640 1 --2- 172.21.15.154:0/1557498225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68fc005090 0x7f68fc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f69137fe640 1 -- 172.21.15.154:0/1557498225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f691406de50 con 0x7f68fc0039c0 2024-05-14T01:24:03.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f69137fe640 1 -- 172.21.15.154:0/1557498225 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc00bff0 con 0x7f68fc005090 2024-05-14T01:24:03.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f69137fe640 1 -- 172.21.15.154:0/1557498225 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f68fc00c1f0 con 0x7f68fc0043c0 2024-05-14T01:24:03.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f6918d8f640 1 --2- 172.21.15.154:0/1557498225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0039c0 0x7f68fc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f6919590640 1 --2- 172.21.15.154:0/1557498225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68fc005090 0x7f68fc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f6913fff640 1 --2- 172.21.15.154:0/1557498225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68fc0043c0 0x7f68fc004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f6918d8f640 1 -- 172.21.15.154:0/1557498225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68fc0043c0 msgr2=0x7f68fc004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:03.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f6918d8f640 1 --2- 172.21.15.154:0/1557498225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68fc0043c0 0x7f68fc004890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f6918d8f640 1 -- 172.21.15.154:0/1557498225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68fc005090 msgr2=0x7f68fc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:03.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f6918d8f640 1 --2- 172.21.15.154:0/1557498225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68fc005090 0x7f68fc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f6918d8f640 1 -- 172.21.15.154:0/1557498225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68fc003530 con 0x7f68fc0039c0 2024-05-14T01:24:03.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f6919590640 1 -- 172.21.15.154:0/1557498225 reap_dead start 2024-05-14T01:24:03.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f6918d8f640 1 --2- 172.21.15.154:0/1557498225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0039c0 0x7f68fc003da0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6908001910 tx=0x7f690801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117f1657972b8f64 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:03.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f69137fe640 1 -- 172.21.15.154:0/1557498225 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908001510 con 0x7f68fc0039c0 2024-05-14T01:24:03.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f69137fe640 1 -- 172.21.15.154:0/1557498225 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69080b0070 con 0x7f68fc0039c0 2024-05-14T01:24:03.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.141+0000 7f69137fe640 1 -- 172.21.15.154:0/1557498225 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69080ab880 con 0x7f68fc0039c0 2024-05-14T01:24:03.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f691aff3640 1 -- 172.21.15.154:0/1557498225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0039c0 msgr2=0x7f68fc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:03.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f691aff3640 1 --2- 172.21.15.154:0/1557498225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0039c0 0x7f68fc003da0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6908001910 tx=0x7f690801c560 comp rx=0 tx=0).stop 2024-05-14T01:24:03.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f691aff3640 1 -- 172.21.15.154:0/1557498225 shutdown_connections 2024-05-14T01:24:03.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f691aff3640 1 --2- 172.21.15.154:0/1557498225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0039c0 0x7f68fc003da0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f691aff3640 1 -- 172.21.15.154:0/1557498225 >> 172.21.15.154:0/1557498225 conn(0x7f69140b1770 msgr2=0x7f69140b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:03.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f691aff3640 1 -- 172.21.15.154:0/1557498225 shutdown_connections 2024-05-14T01:24:03.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f691aff3640 1 -- 172.21.15.154:0/1557498225 wait complete. 2024-05-14T01:24:03.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f691aff3640 1 Processor -- start 2024-05-14T01:24:03.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f691aff3640 1 -- start start 2024-05-14T01:24:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f691aff3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0039c0 0x7f6914142ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f691aff3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6914139c00 0x7f691413f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f691aff3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f691413a080 0x7f691413fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f691aff3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f691415ffd0 con 0x7f68fc0039c0 2024-05-14T01:24:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f691aff3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f691415fe50 con 0x7f6914139c00 2024-05-14T01:24:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f691aff3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f69140728e0 con 0x7f691413a080 2024-05-14T01:24:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f6918d8f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0039c0 0x7f6914142ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f6918d8f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0039c0 0x7f6914142ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59334/0 (socket says 172.21.15.154:59334) 2024-05-14T01:24:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f6918d8f640 1 -- 172.21.15.154:0/3308934818 learned_addr learned my addr 172.21.15.154:0/3308934818 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f6913fff640 1 --2- 172.21.15.154:0/3308934818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6914139c00 0x7f691413f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f6918d8f640 1 -- 172.21.15.154:0/3308934818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f691413a080 msgr2=0x7f691413fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f6918d8f640 1 --2- 172.21.15.154:0/3308934818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f691413a080 0x7f691413fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f6918d8f640 1 -- 172.21.15.154:0/3308934818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6914139c00 msgr2=0x7f691413f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f6918d8f640 1 --2- 172.21.15.154:0/3308934818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6914139c00 0x7f691413f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f6918d8f640 1 -- 172.21.15.154:0/3308934818 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691415bbe0 con 0x7f68fc0039c0 2024-05-14T01:24:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f6918d8f640 1 --2- 172.21.15.154:0/3308934818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0039c0 0x7f6914142ea0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f690801ca40 tx=0x7f68fc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f69117fa640 1 -- 172.21.15.154:0/3308934818 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908007220 con 0x7f68fc0039c0 2024-05-14T01:24:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f69117fa640 1 -- 172.21.15.154:0/3308934818 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69080073c0 con 0x7f68fc0039c0 2024-05-14T01:24:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f69117fa640 1 -- 172.21.15.154:0/3308934818 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69080067e0 con 0x7f68fc0039c0 2024-05-14T01:24:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f691aff3640 1 -- 172.21.15.154:0/3308934818 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69141402a0 con 0x7f68fc0039c0 2024-05-14T01:24:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.145+0000 7f691aff3640 1 -- 172.21.15.154:0/3308934818 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f691415be80 con 0x7f68fc0039c0 2024-05-14T01:24:03.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.149+0000 7f691aff3640 1 -- 172.21.15.154:0/3308934818 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6914075470 con 0x7f68fc0039c0 2024-05-14T01:24:03.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.149+0000 7f69117fa640 1 -- 172.21.15.154:0/3308934818 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6908006980 con 0x7f68fc0039c0 2024-05-14T01:24:03.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.149+0000 7f69117fa640 1 --2- 172.21.15.154:0/3308934818 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f69000678f0 0x7f6900069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.149+0000 7f69117fa640 1 -- 172.21.15.154:0/3308934818 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f690811fe40 con 0x7f68fc0039c0 2024-05-14T01:24:03.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.149+0000 7f6913fff640 1 --2- 172.21.15.154:0/3308934818 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f69000678f0 0x7f6900069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.149+0000 7f6913fff640 1 --2- 172.21.15.154:0/3308934818 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f69000678f0 0x7f6900069db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f69040017f0 tx=0x7f6904009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:03.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.153+0000 7f69117fa640 1 -- 172.21.15.154:0/3308934818 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f6908016270 con 0x7f68fc0039c0 2024-05-14T01:24:03.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.313+0000 7f691aff3640 1 -- 172.21.15.154:0/3308934818 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6914145090 con 0x7f68fc0039c0 2024-05-14T01:24:03.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.313+0000 7f69117fa640 1 -- 172.21.15.154:0/3308934818 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f69080f0a80 con 0x7f68fc0039c0 2024-05-14T01:24:03.300 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-05-14T01:24:03.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.317+0000 7f691aff3640 1 -- 172.21.15.154:0/3308934818 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f69000678f0 msgr2=0x7f6900069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:03.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.317+0000 7f691aff3640 1 --2- 172.21.15.154:0/3308934818 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f69000678f0 0x7f6900069db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f69040017f0 tx=0x7f6904009040 comp rx=0 tx=0).stop 2024-05-14T01:24:03.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.317+0000 7f691aff3640 1 -- 172.21.15.154:0/3308934818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0039c0 msgr2=0x7f6914142ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.317+0000 7f691aff3640 1 --2- 172.21.15.154:0/3308934818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0039c0 0x7f6914142ea0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f690801ca40 tx=0x7f68fc005840 comp rx=0 tx=0).stop 2024-05-14T01:24:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.317+0000 7f691aff3640 1 -- 172.21.15.154:0/3308934818 shutdown_connections 2024-05-14T01:24:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.317+0000 7f691aff3640 1 --2- 172.21.15.154:0/3308934818 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f69000678f0 0x7f6900069db0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.317+0000 7f691aff3640 1 --2- 172.21.15.154:0/3308934818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f691413a080 0x7f691413fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.317+0000 7f691aff3640 1 --2- 172.21.15.154:0/3308934818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6914139c00 0x7f691413f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.317+0000 7f691aff3640 1 --2- 172.21.15.154:0/3308934818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0039c0 0x7f6914142ea0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.317+0000 7f691aff3640 1 -- 172.21.15.154:0/3308934818 >> 172.21.15.154:0/3308934818 conn(0x7f69140b1770 msgr2=0x7f69140aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.317+0000 7f691aff3640 1 -- 172.21.15.154:0/3308934818 shutdown_connections 2024-05-14T01:24:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.317+0000 7f691aff3640 1 -- 172.21.15.154:0/3308934818 wait complete. 2024-05-14T01:24:03.318 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:03.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.445+0000 7f61bef97640 1 Processor -- start 2024-05-14T01:24:03.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.445+0000 7f61bef97640 1 -- start start 2024-05-14T01:24:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61bef97640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61b80cf520 0x7f61b80d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61bef97640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b815e4e0 0x7f61b80b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61bef97640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61b80d29f0 con 0x7f61b815e100 2024-05-14T01:24:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61bef97640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f61b80d2cd0 con 0x7f61b80cf520 2024-05-14T01:24:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61bef97640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f61b80d2fb0 con 0x7f61b815e4e0 2024-05-14T01:24:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61b7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61b80cf520 0x7f61b80d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61b7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61b80cf520 0x7f61b80d22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59348/0 (socket says 172.21.15.154:59348) 2024-05-14T01:24:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61b7fff640 1 -- 172.21.15.154:0/983277293 learned_addr learned my addr 172.21.15.154:0/983277293 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61bd534640 1 --2- 172.21.15.154:0/983277293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b815e4e0 0x7f61b80b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61b7fff640 1 -- 172.21.15.154:0/983277293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b815e4e0 msgr2=0x7f61b80b9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:03.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61b7fff640 1 --2- 172.21.15.154:0/983277293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b815e4e0 0x7f61b80b9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61b7fff640 1 -- 172.21.15.154:0/983277293 >> v1:172.21.15.176:6789/0 conn(0x7f61b815e100 legacy=0x7f61b80cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:03.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61b7fff640 1 -- 172.21.15.154:0/983277293 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b80d3290 con 0x7f61b80cf520 2024-05-14T01:24:03.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61b7fff640 1 --2- 172.21.15.154:0/983277293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b80cf520 0x7f61b80d22f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009870 tx=0x7f61ac01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5e1fefc78f88c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:03.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61b77fe640 1 -- 172.21.15.154:0/983277293 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0b5070 con 0x7f61b80cf520 2024-05-14T01:24:03.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61b77fe640 1 -- 172.21.15.154:0/983277293 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ac0a89d0 con 0x7f61b80cf520 2024-05-14T01:24:03.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61b77fe640 1 -- 172.21.15.154:0/983277293 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0a8da0 con 0x7f61b80cf520 2024-05-14T01:24:03.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61bef97640 1 -- 172.21.15.154:0/983277293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b80cf520 msgr2=0x7f61b80d22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:03.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61bef97640 1 --2- 172.21.15.154:0/983277293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b80cf520 0x7f61b80d22f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009870 tx=0x7f61ac01ed10 comp rx=0 tx=0).stop 2024-05-14T01:24:03.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61bef97640 1 -- 172.21.15.154:0/983277293 shutdown_connections 2024-05-14T01:24:03.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61bef97640 1 --2- 172.21.15.154:0/983277293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b815e4e0 0x7f61b80b9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61bef97640 1 --2- 172.21.15.154:0/983277293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b80cf520 0x7f61b80d22f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61bef97640 1 -- 172.21.15.154:0/983277293 >> 172.21.15.154:0/983277293 conn(0x7f61b80b5b50 msgr2=0x7f61b80b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:03.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61bef97640 1 -- 172.21.15.154:0/983277293 shutdown_connections 2024-05-14T01:24:03.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.449+0000 7f61bef97640 1 -- 172.21.15.154:0/983277293 wait complete. 2024-05-14T01:24:03.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bef97640 1 Processor -- start 2024-05-14T01:24:03.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bef97640 1 -- start start 2024-05-14T01:24:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bef97640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b80cf520 0x7f61b81f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bef97640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61b815e100 0x7f61b80c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bef97640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b815e4e0 0x7f61b815a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bef97640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f61b80d3c10 con 0x7f61b80cf520 2024-05-14T01:24:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bef97640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f61b80d3a90 con 0x7f61b815e100 2024-05-14T01:24:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bef97640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f61b81f7280 con 0x7f61b815e4e0 2024-05-14T01:24:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bcd33640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b80cf520 0x7f61b81f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bcd33640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b80cf520 0x7f61b81f45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59354/0 (socket says 172.21.15.154:59354) 2024-05-14T01:24:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bcd33640 1 -- 172.21.15.154:0/1447519313 learned_addr learned my addr 172.21.15.154:0/1447519313 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61b7fff640 1 --2- 172.21.15.154:0/1447519313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61b815e100 0x7f61b80c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bd534640 1 --2- 172.21.15.154:0/1447519313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b815e4e0 0x7f61b815a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bcd33640 1 -- 172.21.15.154:0/1447519313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b815e4e0 msgr2=0x7f61b815a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bcd33640 1 --2- 172.21.15.154:0/1447519313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b815e4e0 0x7f61b815a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bcd33640 1 -- 172.21.15.154:0/1447519313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61b815e100 msgr2=0x7f61b80c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bcd33640 1 --2- 172.21.15.154:0/1447519313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61b815e100 0x7f61b80c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bcd33640 1 -- 172.21.15.154:0/1447519313 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b81f7560 con 0x7f61b80cf520 2024-05-14T01:24:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bcd33640 1 --2- 172.21.15.154:0/1447519313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b80cf520 0x7f61b81f45e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f61a800c450 tx=0x7f61a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61b57fa640 1 -- 172.21.15.154:0/1447519313 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8012830 con 0x7f61b80cf520 2024-05-14T01:24:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61b57fa640 1 -- 172.21.15.154:0/1447519313 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a8017070 con 0x7f61b80cf520 2024-05-14T01:24:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bef97640 1 -- 172.21.15.154:0/1447519313 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b81f7840 con 0x7f61b80cf520 2024-05-14T01:24:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61b57fa640 1 -- 172.21.15.154:0/1447519313 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8012c30 con 0x7f61b80cf520 2024-05-14T01:24:03.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bef97640 1 -- 172.21.15.154:0/1447519313 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b81f7e00 con 0x7f61b80cf520 2024-05-14T01:24:03.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.453+0000 7f61bef97640 1 -- 172.21.15.154:0/1447519313 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b8075470 con 0x7f61b80cf520 2024-05-14T01:24:03.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.457+0000 7f61b57fa640 1 -- 172.21.15.154:0/1447519313 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f61a801c460 con 0x7f61b80cf520 2024-05-14T01:24:03.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.457+0000 7f61b57fa640 1 --2- 172.21.15.154:0/1447519313 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f61a40678c0 0x7f61a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.457+0000 7f61b57fa640 1 -- 172.21.15.154:0/1447519313 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f61a8085a30 con 0x7f61b80cf520 2024-05-14T01:24:03.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.457+0000 7f61b7fff640 1 --2- 172.21.15.154:0/1447519313 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f61a40678c0 0x7f61a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.457+0000 7f61b7fff640 1 --2- 172.21.15.154:0/1447519313 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f61a40678c0 0x7f61a4069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0b2000 tx=0x7f61ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:03.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.461+0000 7f61b57fa640 1 -- 172.21.15.154:0/1447519313 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f61a8056600 con 0x7f61b80cf520 2024-05-14T01:24:03.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.617+0000 7f61bef97640 1 -- 172.21.15.154:0/1447519313 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61b80cf1c0 con 0x7f61b80cf520 2024-05-14T01:24:03.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.617+0000 7f61b57fa640 1 -- 172.21.15.154:0/1447519313 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f61a8055f00 con 0x7f61b80cf520 2024-05-14T01:24:03.603 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:03.603 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:36.232271+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:03.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.621+0000 7f61bef97640 1 -- 172.21.15.154:0/1447519313 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f61a40678c0 msgr2=0x7f61a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:03.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.621+0000 7f61bef97640 1 --2- 172.21.15.154:0/1447519313 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f61a40678c0 0x7f61a4069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0b2000 tx=0x7f61ac008040 comp rx=0 tx=0).stop 2024-05-14T01:24:03.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.621+0000 7f61bef97640 1 -- 172.21.15.154:0/1447519313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b80cf520 msgr2=0x7f61b81f45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:03.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.621+0000 7f61bef97640 1 --2- 172.21.15.154:0/1447519313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b80cf520 0x7f61b81f45e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f61a800c450 tx=0x7f61a800c910 comp rx=0 tx=0).stop 2024-05-14T01:24:03.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.621+0000 7f61bef97640 1 -- 172.21.15.154:0/1447519313 shutdown_connections 2024-05-14T01:24:03.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.621+0000 7f61bef97640 1 --2- 172.21.15.154:0/1447519313 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f61a40678c0 0x7f61a4069d80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.621+0000 7f61bef97640 1 --2- 172.21.15.154:0/1447519313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b815e4e0 0x7f61b815a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.621+0000 7f61bef97640 1 --2- 172.21.15.154:0/1447519313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61b815e100 0x7f61b80c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.621+0000 7f61bef97640 1 --2- 172.21.15.154:0/1447519313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b80cf520 0x7f61b81f45e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.621+0000 7f61bef97640 1 -- 172.21.15.154:0/1447519313 >> 172.21.15.154:0/1447519313 conn(0x7f61b80b5b50 msgr2=0x7f61b8159b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:03.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.621+0000 7f61bef97640 1 -- 172.21.15.154:0/1447519313 shutdown_connections 2024-05-14T01:24:03.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.621+0000 7f61bef97640 1 -- 172.21.15.154:0/1447519313 wait complete. 2024-05-14T01:24:03.621 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T01:23:33.083538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T01:23:33.556058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:24:03.622 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:24:03.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.749+0000 7faf620fc640 1 Processor -- start 2024-05-14T01:24:03.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.749+0000 7faf620fc640 1 -- start start 2024-05-14T01:24:03.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.749+0000 7faf620fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faf5c0d0350 0x7faf5c0d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.749+0000 7faf620fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf5c06f370 0x7faf5c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.749+0000 7faf620fc640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf5c15d420 con 0x7faf5c0720c0 2024-05-14T01:24:03.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.749+0000 7faf620fc640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7faf5c0725a0 con 0x7faf5c0d0350 2024-05-14T01:24:03.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.749+0000 7faf620fc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faf5c0d0c70 con 0x7faf5c06f370 2024-05-14T01:24:03.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.749+0000 7faf5affd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf5c06f370 0x7faf5c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.749+0000 7faf5b7fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faf5c0d0350 0x7faf5c0d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.749+0000 7faf5b7fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faf5c0d0350 0x7faf5c0d0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:57320/0 (socket says 172.21.15.154:57320) 2024-05-14T01:24:03.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.749+0000 7faf5b7fe640 1 -- 172.21.15.154:0/2615796723 learned_addr learned my addr 172.21.15.154:0/2615796723 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:03.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.749+0000 7faf5affd640 1 -- 172.21.15.154:0/2615796723 >> v2:172.21.15.176:3300/0 conn(0x7faf5c0d0350 msgr2=0x7faf5c0d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:03.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.749+0000 7faf5affd640 1 --2- 172.21.15.154:0/2615796723 >> v2:172.21.15.176:3300/0 conn(0x7faf5c0d0350 0x7faf5c0d0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.749+0000 7faf5affd640 1 -- 172.21.15.154:0/2615796723 >> v1:172.21.15.176:6789/0 conn(0x7faf5c0720c0 legacy=0x7faf5c06dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:03.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.749+0000 7faf5affd640 1 -- 172.21.15.154:0/2615796723 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5c15c660 con 0x7faf5c06f370 2024-05-14T01:24:03.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.749+0000 7faf5b7fe640 1 --2- 172.21.15.154:0/2615796723 >> v2:172.21.15.176:3300/0 conn(0x7faf5c0d0350 0x7faf5c0d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:24:03.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.753+0000 7faf5affd640 1 --2- 172.21.15.154:0/2615796723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf5c06f370 0x7faf5c06d710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faf500097c0 tx=0x7faf5001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b775711ea0d817b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:03.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.753+0000 7faf5a7fc640 1 -- 172.21.15.154:0/2615796723 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf500b2070 con 0x7faf5c06f370 2024-05-14T01:24:03.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.753+0000 7faf5a7fc640 1 -- 172.21.15.154:0/2615796723 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf500ad640 con 0x7faf5c06f370 2024-05-14T01:24:03.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.753+0000 7faf5a7fc640 1 -- 172.21.15.154:0/2615796723 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf500ada10 con 0x7faf5c06f370 2024-05-14T01:24:03.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.753+0000 7faf620fc640 1 -- 172.21.15.154:0/2615796723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf5c06f370 msgr2=0x7faf5c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:03.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.753+0000 7faf620fc640 1 --2- 172.21.15.154:0/2615796723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf5c06f370 0x7faf5c06d710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faf500097c0 tx=0x7faf5001c4a0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.753+0000 7faf620fc640 1 -- 172.21.15.154:0/2615796723 shutdown_connections 2024-05-14T01:24:03.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.753+0000 7faf620fc640 1 --2- 172.21.15.154:0/2615796723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf5c06f370 0x7faf5c06d710 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.753+0000 7faf620fc640 1 --2- 172.21.15.154:0/2615796723 >> v2:172.21.15.176:3300/0 conn(0x7faf5c0d0350 0x7faf5c0d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.753+0000 7faf620fc640 1 -- 172.21.15.154:0/2615796723 >> 172.21.15.154:0/2615796723 conn(0x7faf5c0b21b0 msgr2=0x7faf5c0b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:03.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.753+0000 7faf620fc640 1 -- 172.21.15.154:0/2615796723 shutdown_connections 2024-05-14T01:24:03.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.753+0000 7faf620fc640 1 -- 172.21.15.154:0/2615796723 wait complete. 2024-05-14T01:24:03.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.753+0000 7faf620fc640 1 Processor -- start 2024-05-14T01:24:03.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.753+0000 7faf620fc640 1 -- start start 2024-05-14T01:24:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf620fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf5c06f370 0x7faf5c0b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf620fc640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf5c0720c0 0x7faf5c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf620fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf5c0d0350 0x7faf5c14f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf620fc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c0ceb70 con 0x7faf5c0d0350 2024-05-14T01:24:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf620fc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c159e90 con 0x7faf5c06f370 2024-05-14T01:24:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf620fc640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faf5c06e360 con 0x7faf5c0720c0 2024-05-14T01:24:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf5bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf5c0d0350 0x7faf5c14f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf5bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf5c0d0350 0x7faf5c14f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59364/0 (socket says 172.21.15.154:59364) 2024-05-14T01:24:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf5bfff640 1 -- 172.21.15.154:0/2936616326 learned_addr learned my addr 172.21.15.154:0/2936616326 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf5affd640 1 --2- 172.21.15.154:0/2936616326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf5c0720c0 0x7faf5c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf5b7fe640 1 --2- 172.21.15.154:0/2936616326 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf5c06f370 0x7faf5c0b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf5bfff640 1 -- 172.21.15.154:0/2936616326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf5c0720c0 msgr2=0x7faf5c0b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:03.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf5bfff640 1 --2- 172.21.15.154:0/2936616326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf5c0720c0 0x7faf5c0b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf5bfff640 1 -- 172.21.15.154:0/2936616326 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf5c06f370 msgr2=0x7faf5c0b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:03.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf5bfff640 1 --2- 172.21.15.154:0/2936616326 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf5c06f370 0x7faf5c0b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf5bfff640 1 -- 172.21.15.154:0/2936616326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5c14d650 con 0x7faf5c0d0350 2024-05-14T01:24:03.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf5affd640 1 --2- 172.21.15.154:0/2936616326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf5c0720c0 0x7faf5c0b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:03.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf5bfff640 1 --2- 172.21.15.154:0/2936616326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf5c0d0350 0x7faf5c14f340 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faf5400c730 tx=0x7faf5400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:03.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf43fff640 1 -- 172.21.15.154:0/2936616326 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54003b80 con 0x7faf5c0d0350 2024-05-14T01:24:03.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf43fff640 1 -- 172.21.15.154:0/2936616326 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf54003d20 con 0x7faf5c0d0350 2024-05-14T01:24:03.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf620fc640 1 -- 172.21.15.154:0/2936616326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5c14d930 con 0x7faf5c0d0350 2024-05-14T01:24:03.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf43fff640 1 -- 172.21.15.154:0/2936616326 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54005310 con 0x7faf5c0d0350 2024-05-14T01:24:03.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf620fc640 1 -- 172.21.15.154:0/2936616326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf5c0b41f0 con 0x7faf5c0d0350 2024-05-14T01:24:03.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf620fc640 1 -- 172.21.15.154:0/2936616326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf5c068360 con 0x7faf5c0d0350 2024-05-14T01:24:03.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf43fff640 1 -- 172.21.15.154:0/2936616326 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf540056c0 con 0x7faf5c0d0350 2024-05-14T01:24:03.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf43fff640 1 --2- 172.21.15.154:0/2936616326 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7faf480678c0 0x7faf48069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:03.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf43fff640 1 -- 172.21.15.154:0/2936616326 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faf54085d10 con 0x7faf5c0d0350 2024-05-14T01:24:03.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf5b7fe640 1 --2- 172.21.15.154:0/2936616326 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7faf480678c0 0x7faf48069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:03.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.757+0000 7faf5b7fe640 1 --2- 172.21.15.154:0/2936616326 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7faf480678c0 0x7faf48069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009630 tx=0x7faf4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:03.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.761+0000 7faf43fff640 1 -- 172.21.15.154:0/2936616326 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7faf54056850 con 0x7faf5c0d0350 2024-05-14T01:24:03.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.921+0000 7faf620fc640 1 -- 172.21.15.154:0/2936616326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faf5c159620 con 0x7faf5c0d0350 2024-05-14T01:24:03.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.921+0000 7faf43fff640 1 -- 172.21.15.154:0/2936616326 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7faf54056150 con 0x7faf5c0d0350 2024-05-14T01:24:03.909 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:24:03.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.925+0000 7faf620fc640 1 -- 172.21.15.154:0/2936616326 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7faf480678c0 msgr2=0x7faf48069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:03.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.925+0000 7faf620fc640 1 --2- 172.21.15.154:0/2936616326 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7faf480678c0 0x7faf48069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009630 tx=0x7faf4c008040 comp rx=0 tx=0).stop 2024-05-14T01:24:03.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.925+0000 7faf620fc640 1 -- 172.21.15.154:0/2936616326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf5c0d0350 msgr2=0x7faf5c14f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:03.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.925+0000 7faf620fc640 1 --2- 172.21.15.154:0/2936616326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf5c0d0350 0x7faf5c14f340 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faf5400c730 tx=0x7faf5400cbf0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.925+0000 7faf620fc640 1 -- 172.21.15.154:0/2936616326 shutdown_connections 2024-05-14T01:24:03.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.925+0000 7faf620fc640 1 --2- 172.21.15.154:0/2936616326 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7faf480678c0 0x7faf48069d80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.925+0000 7faf620fc640 1 --2- 172.21.15.154:0/2936616326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf5c0d0350 0x7faf5c14f340 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.925+0000 7faf620fc640 1 --2- 172.21.15.154:0/2936616326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf5c0720c0 0x7faf5c0b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.925+0000 7faf620fc640 1 --2- 172.21.15.154:0/2936616326 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf5c06f370 0x7faf5c0b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:03.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.925+0000 7faf620fc640 1 -- 172.21.15.154:0/2936616326 >> 172.21.15.154:0/2936616326 conn(0x7faf5c0b21b0 msgr2=0x7faf5c06d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:03.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.925+0000 7faf620fc640 1 -- 172.21.15.154:0/2936616326 shutdown_connections 2024-05-14T01:24:03.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:03.925+0000 7faf620fc640 1 -- 172.21.15.154:0/2936616326 wait complete. 2024-05-14T01:24:03.926 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:24:03.927 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T01:24:03.970 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:24:04.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.097+0000 7f88da454640 1 Processor -- start 2024-05-14T01:24:04.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.097+0000 7f88da454640 1 -- start start 2024-05-14T01:24:04.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88da454640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f88d40cf610 0x7f88d415fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88da454640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88d4071840 con 0x7f88d41458d0 2024-05-14T01:24:04.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88da454640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88d4071b20 con 0x7f88d415ff80 2024-05-14T01:24:04.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88da454640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f88d4071e00 con 0x7f88d40cf610 2024-05-14T01:24:04.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d3fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f88d41458d0 0x7f88d4071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54240/0 (socket says 172.21.15.154:54240) 2024-05-14T01:24:04.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d3fff640 1 -- 172.21.15.154:0/3528192643 learned_addr learned my addr 172.21.15.154:0/3528192643 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:04.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d2ffd640 1 -- 172.21.15.154:0/3528192643 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 350652914 0 0) 0x7f88d4071840 con 0x7f88d41458d0 2024-05-14T01:24:04.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d2ffd640 1 -- 172.21.15.154:0/3528192643 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88bc003530 con 0x7f88d41458d0 2024-05-14T01:24:04.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d37fe640 1 --2- 172.21.15.154:0/3528192643 >> v2:172.21.15.176:3300/0 conn(0x7f88d40cf610 0x7f88d415fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d2ffd640 1 -- 172.21.15.154:0/3528192643 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 224480159 0 0) 0x7f88bc003530 con 0x7f88d41458d0 2024-05-14T01:24:04.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d2ffd640 1 -- 172.21.15.154:0/3528192643 >> v2:172.21.15.176:3300/0 conn(0x7f88d40cf610 msgr2=0x7f88d415fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:04.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d2ffd640 1 --2- 172.21.15.154:0/3528192643 >> v2:172.21.15.176:3300/0 conn(0x7f88d40cf610 0x7f88d415fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d2ffd640 1 -- 172.21.15.154:0/3528192643 >> v1:172.21.15.176:6789/0 conn(0x7f88d415ff80 legacy=0x7f88d406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:04.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d2ffd640 1 -- 172.21.15.154:0/3528192643 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d40720e0 con 0x7f88d41458d0 2024-05-14T01:24:04.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d2ffd640 1 -- 172.21.15.154:0/3528192643 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f88c4001680 con 0x7f88d41458d0 2024-05-14T01:24:04.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d2ffd640 1 -- 172.21.15.154:0/3528192643 >> v1:172.21.15.154:6789/0 conn(0x7f88d41458d0 legacy=0x7f88d4071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:04.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d2ffd640 1 --2- 172.21.15.154:0/3528192643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88bc0039c0 0x7f88bc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d2ffd640 1 --2- 172.21.15.154:0/3528192643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88bc004810 0x7f88bc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d2ffd640 1 --2- 172.21.15.154:0/3528192643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88bc0051d0 0x7f88bc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d2ffd640 1 -- 172.21.15.154:0/3528192643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f88d4071e00 con 0x7f88bc004810 2024-05-14T01:24:04.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d2ffd640 1 -- 172.21.15.154:0/3528192643 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f88bc00c070 con 0x7f88bc0051d0 2024-05-14T01:24:04.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d2ffd640 1 -- 172.21.15.154:0/3528192643 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f88bc00c270 con 0x7f88bc0039c0 2024-05-14T01:24:04.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d37fe640 1 --2- 172.21.15.154:0/3528192643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88bc004810 0x7f88bc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d3fff640 1 --2- 172.21.15.154:0/3528192643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88bc0039c0 0x7f88bc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d89f1640 1 --2- 172.21.15.154:0/3528192643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88bc0051d0 0x7f88bc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d37fe640 1 -- 172.21.15.154:0/3528192643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88bc0039c0 msgr2=0x7f88bc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:04.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d37fe640 1 --2- 172.21.15.154:0/3528192643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88bc0039c0 0x7f88bc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d37fe640 1 -- 172.21.15.154:0/3528192643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88bc0051d0 msgr2=0x7f88bc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:04.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d37fe640 1 --2- 172.21.15.154:0/3528192643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88bc0051d0 0x7f88bc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d37fe640 1 -- 172.21.15.154:0/3528192643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88bc003530 con 0x7f88bc004810 2024-05-14T01:24:04.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d89f1640 1 -- 172.21.15.154:0/3528192643 reap_dead start 2024-05-14T01:24:04.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.101+0000 7f88d37fe640 1 --2- 172.21.15.154:0/3528192643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88bc004810 0x7f88bc004c90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009ae0 tx=0x7f88c801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9facae63852a043d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:04.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88d2ffd640 1 -- 172.21.15.154:0/3528192643 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c80b2070 con 0x7f88bc004810 2024-05-14T01:24:04.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88d2ffd640 1 -- 172.21.15.154:0/3528192643 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c80a5550 con 0x7f88bc004810 2024-05-14T01:24:04.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88d2ffd640 1 -- 172.21.15.154:0/3528192643 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c80096b0 con 0x7f88bc004810 2024-05-14T01:24:04.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88da454640 1 -- 172.21.15.154:0/3528192643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88bc004810 msgr2=0x7f88bc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:04.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88da454640 1 --2- 172.21.15.154:0/3528192643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88bc004810 0x7f88bc004c90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009ae0 tx=0x7f88c801ca70 comp rx=0 tx=0).stop 2024-05-14T01:24:04.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88da454640 1 -- 172.21.15.154:0/3528192643 shutdown_connections 2024-05-14T01:24:04.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88da454640 1 --2- 172.21.15.154:0/3528192643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88bc004810 0x7f88bc004c90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88da454640 1 -- 172.21.15.154:0/3528192643 >> 172.21.15.154:0/3528192643 conn(0x7f88d40b1770 msgr2=0x7f88d40b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:04.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88da454640 1 -- 172.21.15.154:0/3528192643 shutdown_connections 2024-05-14T01:24:04.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88da454640 1 -- 172.21.15.154:0/3528192643 wait complete. 2024-05-14T01:24:04.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88da454640 1 Processor -- start 2024-05-14T01:24:04.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88da454640 1 -- start start 2024-05-14T01:24:04.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88da454640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88bc004810 0x7f88d4157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88da454640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88d4144130 0x7f88d4136250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88da454640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88d4136790 0x7f88d4135300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88da454640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f88d4072a60 con 0x7f88d4136790 2024-05-14T01:24:04.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88da454640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f88d40728e0 con 0x7f88d4144130 2024-05-14T01:24:04.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88da454640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f88d415fa40 con 0x7f88bc004810 2024-05-14T01:24:04.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88d89f1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88d4136790 0x7f88d4135300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88d89f1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88d4136790 0x7f88d4135300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59388/0 (socket says 172.21.15.154:59388) 2024-05-14T01:24:04.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88d89f1640 1 -- 172.21.15.154:0/2798638674 learned_addr learned my addr 172.21.15.154:0/2798638674 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:04.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88d3fff640 1 --2- 172.21.15.154:0/2798638674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88bc004810 0x7f88d4157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88d37fe640 1 --2- 172.21.15.154:0/2798638674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88d4144130 0x7f88d4136250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88d89f1640 1 -- 172.21.15.154:0/2798638674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88bc004810 msgr2=0x7f88d4157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:04.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88d89f1640 1 --2- 172.21.15.154:0/2798638674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88bc004810 0x7f88d4157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88d89f1640 1 -- 172.21.15.154:0/2798638674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88d4144130 msgr2=0x7f88d4136250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:04.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88d89f1640 1 --2- 172.21.15.154:0/2798638674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88d4144130 0x7f88d4136250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88d89f1640 1 -- 172.21.15.154:0/2798638674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d41445b0 con 0x7f88d4136790 2024-05-14T01:24:04.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88d89f1640 1 --2- 172.21.15.154:0/2798638674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88d4136790 0x7f88d4135300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00e3e0 tx=0x7f88cc00e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:04.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88d0ff9640 1 -- 172.21.15.154:0/2798638674 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc019070 con 0x7f88d4136790 2024-05-14T01:24:04.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88d0ff9640 1 -- 172.21.15.154:0/2798638674 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88cc006d70 con 0x7f88d4136790 2024-05-14T01:24:04.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88da454640 1 -- 172.21.15.154:0/2798638674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d4134260 con 0x7f88d4136790 2024-05-14T01:24:04.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88d0ff9640 1 -- 172.21.15.154:0/2798638674 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc003bc0 con 0x7f88d4136790 2024-05-14T01:24:04.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.105+0000 7f88da454640 1 -- 172.21.15.154:0/2798638674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d4134820 con 0x7f88d4136790 2024-05-14T01:24:04.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.109+0000 7f88da454640 1 -- 172.21.15.154:0/2798638674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d4075470 con 0x7f88d4136790 2024-05-14T01:24:04.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.109+0000 7f88d0ff9640 1 -- 172.21.15.154:0/2798638674 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f88cc005070 con 0x7f88d4136790 2024-05-14T01:24:04.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.109+0000 7f88d0ff9640 1 --2- 172.21.15.154:0/2798638674 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f88c00678f0 0x7f88c0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.109+0000 7f88d3fff640 1 --2- 172.21.15.154:0/2798638674 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f88c00678f0 0x7f88c0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.109+0000 7f88d0ff9640 1 -- 172.21.15.154:0/2798638674 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f88cc085160 con 0x7f88d4136790 2024-05-14T01:24:04.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.109+0000 7f88d3fff640 1 --2- 172.21.15.154:0/2798638674 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f88c00678f0 0x7f88c0069db0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f88c4005440 tx=0x7f88c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:04.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.113+0000 7f88d0ff9640 1 -- 172.21.15.154:0/2798638674 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f88cc055c00 con 0x7f88d4136790 2024-05-14T01:24:04.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.261+0000 7f88da454640 1 -- 172.21.15.154:0/2798638674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f88d4070e40 con 0x7f88d4136790 2024-05-14T01:24:04.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.261+0000 7f88d0ff9640 1 -- 172.21.15.154:0/2798638674 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f88cc055500 con 0x7f88d4136790 2024-05-14T01:24:04.248 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-05-14T01:24:04.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.265+0000 7f88da454640 1 -- 172.21.15.154:0/2798638674 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f88c00678f0 msgr2=0x7f88c0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:04.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.265+0000 7f88da454640 1 --2- 172.21.15.154:0/2798638674 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f88c00678f0 0x7f88c0069db0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f88c4005440 tx=0x7f88c4009040 comp rx=0 tx=0).stop 2024-05-14T01:24:04.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.265+0000 7f88da454640 1 -- 172.21.15.154:0/2798638674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88d4136790 msgr2=0x7f88d4135300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:04.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.265+0000 7f88da454640 1 --2- 172.21.15.154:0/2798638674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88d4136790 0x7f88d4135300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00e3e0 tx=0x7f88cc00e8a0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.265+0000 7f88da454640 1 -- 172.21.15.154:0/2798638674 shutdown_connections 2024-05-14T01:24:04.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.265+0000 7f88da454640 1 --2- 172.21.15.154:0/2798638674 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f88c00678f0 0x7f88c0069db0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.265+0000 7f88da454640 1 --2- 172.21.15.154:0/2798638674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88d4136790 0x7f88d4135300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.265+0000 7f88da454640 1 --2- 172.21.15.154:0/2798638674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88d4144130 0x7f88d4136250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.265+0000 7f88da454640 1 --2- 172.21.15.154:0/2798638674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88bc004810 0x7f88d4157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.265+0000 7f88da454640 1 -- 172.21.15.154:0/2798638674 >> 172.21.15.154:0/2798638674 conn(0x7f88d40b1770 msgr2=0x7f88d40af5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:04.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.265+0000 7f88da454640 1 -- 172.21.15.154:0/2798638674 shutdown_connections 2024-05-14T01:24:04.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.265+0000 7f88da454640 1 -- 172.21.15.154:0/2798638674 wait complete. 2024-05-14T01:24:04.265 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T01:24:04.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.441+0000 7fcd4d2ab640 1 Processor -- start 2024-05-14T01:24:04.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.441+0000 7fcd4d2ab640 1 -- start start 2024-05-14T01:24:04.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.441+0000 7fcd4d2ab640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd481458d0 0x7fcd480cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.441+0000 7fcd4d2ab640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd48071060 0x7fcd4815fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.441+0000 7fcd4d2ab640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd48071840 con 0x7fcd4815ff80 2024-05-14T01:24:04.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.441+0000 7fcd4d2ab640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fcd4806de50 con 0x7fcd48071060 2024-05-14T01:24:04.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.441+0000 7fcd4d2ab640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcd48071b20 con 0x7fcd481458d0 2024-05-14T01:24:04.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.441+0000 7fcd467fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd48071060 0x7fcd4815fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.441+0000 7fcd467fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd48071060 0x7fcd4815fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59404/0 (socket says 172.21.15.154:59404) 2024-05-14T01:24:04.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.441+0000 7fcd467fc640 1 -- 172.21.15.154:0/1840330820 learned_addr learned my addr 172.21.15.154:0/1840330820 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:04.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.441+0000 7fcd46ffd640 1 --2- 172.21.15.154:0/1840330820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd481458d0 0x7fcd480cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.441+0000 7fcd467fc640 1 -- 172.21.15.154:0/1840330820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd481458d0 msgr2=0x7fcd480cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:04.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.441+0000 7fcd467fc640 1 --2- 172.21.15.154:0/1840330820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd481458d0 0x7fcd480cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.441+0000 7fcd467fc640 1 -- 172.21.15.154:0/1840330820 >> v1:172.21.15.154:6789/0 conn(0x7fcd4815ff80 legacy=0x7fcd480ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:04.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.441+0000 7fcd467fc640 1 -- 172.21.15.154:0/1840330820 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd48071e00 con 0x7fcd48071060 2024-05-14T01:24:04.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.441+0000 7fcd45ffb640 1 -- 172.21.15.154:0/1840330820 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2786230948 0 0) 0x7fcd48071840 con 0x7fcd4815ff80 2024-05-14T01:24:04.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd467fc640 1 --2- 172.21.15.154:0/1840330820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd48071060 0x7fcd4815fa40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009870 tx=0x7fcd3801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccd2dd1b1c4d59f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:04.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd45ffb640 1 -- 172.21.15.154:0/1840330820 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd380b2070 con 0x7fcd48071060 2024-05-14T01:24:04.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd45ffb640 1 -- 172.21.15.154:0/1840330820 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd380a9070 con 0x7fcd48071060 2024-05-14T01:24:04.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd45ffb640 1 -- 172.21.15.154:0/1840330820 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd380ad880 con 0x7fcd48071060 2024-05-14T01:24:04.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd4d2ab640 1 -- 172.21.15.154:0/1840330820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd48071060 msgr2=0x7fcd4815fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:04.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd4d2ab640 1 --2- 172.21.15.154:0/1840330820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd48071060 0x7fcd4815fa40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009870 tx=0x7fcd3801c560 comp rx=0 tx=0).stop 2024-05-14T01:24:04.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd4d2ab640 1 -- 172.21.15.154:0/1840330820 shutdown_connections 2024-05-14T01:24:04.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd4d2ab640 1 --2- 172.21.15.154:0/1840330820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd48071060 0x7fcd4815fa40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd4d2ab640 1 --2- 172.21.15.154:0/1840330820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd481458d0 0x7fcd480cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd4d2ab640 1 -- 172.21.15.154:0/1840330820 >> 172.21.15.154:0/1840330820 conn(0x7fcd480b1770 msgr2=0x7fcd480b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:04.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd4d2ab640 1 -- 172.21.15.154:0/1840330820 shutdown_connections 2024-05-14T01:24:04.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd4d2ab640 1 -- 172.21.15.154:0/1840330820 wait complete. 2024-05-14T01:24:04.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd4d2ab640 1 Processor -- start 2024-05-14T01:24:04.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd4d2ab640 1 -- start start 2024-05-14T01:24:04.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd4d2ab640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd48071060 0x7fcd48152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd4d2ab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd481458d0 0x7fcd4815e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd4d2ab640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd4815ff80 0x7fcd4815c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd4d2ab640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd48072a60 con 0x7fcd481458d0 2024-05-14T01:24:04.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd4d2ab640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcd480728e0 con 0x7fcd48071060 2024-05-14T01:24:04.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd4d2ab640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcd48168de0 con 0x7fcd4815ff80 2024-05-14T01:24:04.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd467fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd481458d0 0x7fcd4815e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd467fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd481458d0 0x7fcd4815e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59408/0 (socket says 172.21.15.154:59408) 2024-05-14T01:24:04.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd467fc640 1 -- 172.21.15.154:0/1364718294 learned_addr learned my addr 172.21.15.154:0/1364718294 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:04.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd477fe640 1 --2- 172.21.15.154:0/1364718294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd4815ff80 0x7fcd4815c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd46ffd640 1 --2- 172.21.15.154:0/1364718294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd48071060 0x7fcd48152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd467fc640 1 -- 172.21.15.154:0/1364718294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd4815ff80 msgr2=0x7fcd4815c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:04.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd467fc640 1 --2- 172.21.15.154:0/1364718294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd4815ff80 0x7fcd4815c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd467fc640 1 -- 172.21.15.154:0/1364718294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd48071060 msgr2=0x7fcd48152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:04.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd467fc640 1 --2- 172.21.15.154:0/1364718294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd48071060 0x7fcd48152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd467fc640 1 -- 172.21.15.154:0/1364718294 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4815ce70 con 0x7fcd481458d0 2024-05-14T01:24:04.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd46ffd640 1 --2- 172.21.15.154:0/1364718294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd48071060 0x7fcd48152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:04.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd467fc640 1 --2- 172.21.15.154:0/1364718294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd481458d0 0x7fcd4815e250 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcd380b0040 tx=0x7fcd38019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:04.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd2f7fe640 1 -- 172.21.15.154:0/1364718294 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd380bb070 con 0x7fcd481458d0 2024-05-14T01:24:04.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd2f7fe640 1 -- 172.21.15.154:0/1364718294 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd380addf0 con 0x7fcd481458d0 2024-05-14T01:24:04.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd4d2ab640 1 -- 172.21.15.154:0/1364718294 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4815d150 con 0x7fcd481458d0 2024-05-14T01:24:04.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd2f7fe640 1 -- 172.21.15.154:0/1364718294 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd380b2040 con 0x7fcd481458d0 2024-05-14T01:24:04.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.445+0000 7fcd4d2ab640 1 -- 172.21.15.154:0/1364718294 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd481f8970 con 0x7fcd481458d0 2024-05-14T01:24:04.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.449+0000 7fcd4d2ab640 1 -- 172.21.15.154:0/1364718294 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd48075470 con 0x7fcd481458d0 2024-05-14T01:24:04.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.449+0000 7fcd2f7fe640 1 -- 172.21.15.154:0/1364718294 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcd380be070 con 0x7fcd481458d0 2024-05-14T01:24:04.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.449+0000 7fcd2f7fe640 1 --2- 172.21.15.154:0/1364718294 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fcd340678c0 0x7fcd34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.449+0000 7fcd2f7fe640 1 -- 172.21.15.154:0/1364718294 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcd3811ec90 con 0x7fcd481458d0 2024-05-14T01:24:04.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.449+0000 7fcd46ffd640 1 --2- 172.21.15.154:0/1364718294 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fcd340678c0 0x7fcd34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.449+0000 7fcd46ffd640 1 --2- 172.21.15.154:0/1364718294 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fcd340678c0 0x7fcd34069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcd48142d80 tx=0x7fcd3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:04.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.453+0000 7fcd2f7fe640 1 -- 172.21.15.154:0/1364718294 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fcd38016150 con 0x7fcd481458d0 2024-05-14T01:24:04.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.601+0000 7fcd4d2ab640 1 -- 172.21.15.154:0/1364718294 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcd48070e40 con 0x7fcd481458d0 2024-05-14T01:24:04.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.601+0000 7fcd2f7fe640 1 -- 172.21.15.154:0/1364718294 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fcd380ef860 con 0x7fcd481458d0 2024-05-14T01:24:04.586 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-05-14T01:24:04.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.601+0000 7fcd4d2ab640 1 -- 172.21.15.154:0/1364718294 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fcd340678c0 msgr2=0x7fcd34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:04.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.601+0000 7fcd4d2ab640 1 --2- 172.21.15.154:0/1364718294 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fcd340678c0 0x7fcd34069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcd48142d80 tx=0x7fcd3c008040 comp rx=0 tx=0).stop 2024-05-14T01:24:04.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.601+0000 7fcd4d2ab640 1 -- 172.21.15.154:0/1364718294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd481458d0 msgr2=0x7fcd4815e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:04.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.601+0000 7fcd4d2ab640 1 --2- 172.21.15.154:0/1364718294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd481458d0 0x7fcd4815e250 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcd380b0040 tx=0x7fcd38019300 comp rx=0 tx=0).stop 2024-05-14T01:24:04.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.601+0000 7fcd4d2ab640 1 -- 172.21.15.154:0/1364718294 shutdown_connections 2024-05-14T01:24:04.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.601+0000 7fcd4d2ab640 1 --2- 172.21.15.154:0/1364718294 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fcd340678c0 0x7fcd34069d80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.601+0000 7fcd4d2ab640 1 --2- 172.21.15.154:0/1364718294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd4815ff80 0x7fcd4815c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.601+0000 7fcd4d2ab640 1 --2- 172.21.15.154:0/1364718294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd481458d0 0x7fcd4815e250 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.601+0000 7fcd4d2ab640 1 --2- 172.21.15.154:0/1364718294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd48071060 0x7fcd48152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.601+0000 7fcd4d2ab640 1 -- 172.21.15.154:0/1364718294 >> 172.21.15.154:0/1364718294 conn(0x7fcd480b1770 msgr2=0x7fcd480cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:04.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.605+0000 7fcd4d2ab640 1 -- 172.21.15.154:0/1364718294 shutdown_connections 2024-05-14T01:24:04.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.605+0000 7fcd4d2ab640 1 -- 172.21.15.154:0/1364718294 wait complete. 2024-05-14T01:24:04.621 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-05-14T01:24:04.621 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:04.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.749+0000 7f1d95481640 1 Processor -- start 2024-05-14T01:24:04.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.749+0000 7f1d95481640 1 -- start start 2024-05-14T01:24:04.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.749+0000 7f1d95481640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1d9013ede0 0x7f1d901415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.749+0000 7f1d95481640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1d90141b30 0x7f1d900ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.749+0000 7f1d95481640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d900cf100 con 0x7f1d900ce880 2024-05-14T01:24:04.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.749+0000 7f1d95481640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1d90141f90 con 0x7f1d90141b30 2024-05-14T01:24:04.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.749+0000 7f1d95481640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1d9006cff0 con 0x7f1d9013ede0 2024-05-14T01:24:04.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.749+0000 7f1d8e7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1d90141b30 0x7f1d900ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.749+0000 7f1d8e7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1d90141b30 0x7f1d900ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59414/0 (socket says 172.21.15.154:59414) 2024-05-14T01:24:04.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.749+0000 7f1d8e7fc640 1 -- 172.21.15.154:0/2059081161 learned_addr learned my addr 172.21.15.154:0/2059081161 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:04.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.749+0000 7f1d8effd640 1 --2- 172.21.15.154:0/2059081161 >> v2:172.21.15.176:3300/0 conn(0x7f1d9013ede0 0x7f1d901415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.749+0000 7f1d8e7fc640 1 -- 172.21.15.154:0/2059081161 >> v2:172.21.15.176:3300/0 conn(0x7f1d9013ede0 msgr2=0x7f1d901415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:04.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.749+0000 7f1d8e7fc640 1 --2- 172.21.15.154:0/2059081161 >> v2:172.21.15.176:3300/0 conn(0x7f1d9013ede0 0x7f1d901415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.749+0000 7f1d8e7fc640 1 -- 172.21.15.154:0/2059081161 >> v1:172.21.15.176:6789/0 conn(0x7f1d900ce880 legacy=0x7f1d9015fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:04.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.749+0000 7f1d8e7fc640 1 -- 172.21.15.154:0/2059081161 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d900cf3e0 con 0x7f1d90141b30 2024-05-14T01:24:04.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.749+0000 7f1d8e7fc640 1 --2- 172.21.15.154:0/2059081161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d90141b30 0x7f1d900ce340 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009e50 tx=0x7f1d8401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f96203f940b30c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:04.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d8dffb640 1 -- 172.21.15.154:0/2059081161 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d840a5820 con 0x7f1d90141b30 2024-05-14T01:24:04.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d8dffb640 1 -- 172.21.15.154:0/2059081161 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d840a59c0 con 0x7f1d90141b30 2024-05-14T01:24:04.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d8dffb640 1 -- 172.21.15.154:0/2059081161 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d840a5d90 con 0x7f1d90141b30 2024-05-14T01:24:04.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d95481640 1 -- 172.21.15.154:0/2059081161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d90141b30 msgr2=0x7f1d900ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:04.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d95481640 1 --2- 172.21.15.154:0/2059081161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d90141b30 0x7f1d900ce340 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009e50 tx=0x7f1d8401c980 comp rx=0 tx=0).stop 2024-05-14T01:24:04.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d95481640 1 -- 172.21.15.154:0/2059081161 shutdown_connections 2024-05-14T01:24:04.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d95481640 1 --2- 172.21.15.154:0/2059081161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d90141b30 0x7f1d900ce340 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d95481640 1 --2- 172.21.15.154:0/2059081161 >> v2:172.21.15.176:3300/0 conn(0x7f1d9013ede0 0x7f1d901415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d95481640 1 -- 172.21.15.154:0/2059081161 >> 172.21.15.154:0/2059081161 conn(0x7f1d900b1850 msgr2=0x7f1d900b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:04.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d95481640 1 -- 172.21.15.154:0/2059081161 shutdown_connections 2024-05-14T01:24:04.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d95481640 1 -- 172.21.15.154:0/2059081161 wait complete. 2024-05-14T01:24:04.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d95481640 1 Processor -- start 2024-05-14T01:24:04.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d95481640 1 -- start start 2024-05-14T01:24:04.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d95481640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d900ce880 0x7f1d90138a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d95481640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d9013ede0 0x7f1d901f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d95481640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d90141b30 0x7f1d901f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d95481640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d900cee90 con 0x7f1d900ce880 2024-05-14T01:24:04.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d95481640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1d900ced10 con 0x7f1d90141b30 2024-05-14T01:24:04.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d95481640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1d90168da0 con 0x7f1d9013ede0 2024-05-14T01:24:04.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d8effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d900ce880 0x7f1d90138a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d8effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d900ce880 0x7f1d90138a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59424/0 (socket says 172.21.15.154:59424) 2024-05-14T01:24:04.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d8effd640 1 -- 172.21.15.154:0/3231218958 learned_addr learned my addr 172.21.15.154:0/3231218958 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:04.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d8e7fc640 1 --2- 172.21.15.154:0/3231218958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d9013ede0 0x7f1d901f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d8f7fe640 1 --2- 172.21.15.154:0/3231218958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d90141b30 0x7f1d901f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d8effd640 1 -- 172.21.15.154:0/3231218958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d9013ede0 msgr2=0x7f1d901f77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:04.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d8effd640 1 --2- 172.21.15.154:0/3231218958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d9013ede0 0x7f1d901f77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d8effd640 1 -- 172.21.15.154:0/3231218958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d90141b30 msgr2=0x7f1d901f7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:04.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d8effd640 1 --2- 172.21.15.154:0/3231218958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d90141b30 0x7f1d901f7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d8effd640 1 -- 172.21.15.154:0/3231218958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d90138fa0 con 0x7f1d900ce880 2024-05-14T01:24:04.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d8e7fc640 1 --2- 172.21.15.154:0/3231218958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d9013ede0 0x7f1d901f77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:04.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d8effd640 1 --2- 172.21.15.154:0/3231218958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d900ce880 0x7f1d90138a60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800d800 tx=0x7f1d8800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:04.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d777fe640 1 -- 172.21.15.154:0/3231218958 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8800b6c0 con 0x7f1d900ce880 2024-05-14T01:24:04.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d777fe640 1 -- 172.21.15.154:0/3231218958 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d88019070 con 0x7f1d900ce880 2024-05-14T01:24:04.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d95481640 1 -- 172.21.15.154:0/3231218958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d901f83a0 con 0x7f1d900ce880 2024-05-14T01:24:04.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d777fe640 1 -- 172.21.15.154:0/3231218958 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8800bae0 con 0x7f1d900ce880 2024-05-14T01:24:04.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.753+0000 7f1d95481640 1 -- 172.21.15.154:0/3231218958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d900b2a70 con 0x7f1d900ce880 2024-05-14T01:24:04.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.757+0000 7f1d95481640 1 -- 172.21.15.154:0/3231218958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d90075470 con 0x7f1d900ce880 2024-05-14T01:24:04.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.757+0000 7f1d777fe640 1 -- 172.21.15.154:0/3231218958 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d8800bc80 con 0x7f1d900ce880 2024-05-14T01:24:04.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.757+0000 7f1d777fe640 1 --2- 172.21.15.154:0/3231218958 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1d7c0678c0 0x7f1d7c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:04.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.757+0000 7f1d777fe640 1 -- 172.21.15.154:0/3231218958 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1d88086170 con 0x7f1d900ce880 2024-05-14T01:24:04.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.757+0000 7f1d8e7fc640 1 --2- 172.21.15.154:0/3231218958 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1d7c0678c0 0x7f1d7c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:04.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.757+0000 7f1d8e7fc640 1 --2- 172.21.15.154:0/3231218958 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1d7c0678c0 0x7f1d7c069d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1d840ae000 tx=0x7f1d840a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:04.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.761+0000 7f1d777fe640 1 -- 172.21.15.154:0/3231218958 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1d88056d40 con 0x7f1d900ce880 2024-05-14T01:24:04.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.913+0000 7f1d95481640 1 -- 172.21.15.154:0/3231218958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d90153310 con 0x7f1d900ce880 2024-05-14T01:24:04.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.917+0000 7f1d777fe640 1 -- 172.21.15.154:0/3231218958 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f1d88056640 con 0x7f1d900ce880 2024-05-14T01:24:04.902 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:04.902 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:36.232271+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:04.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.917+0000 7f1d95481640 1 -- 172.21.15.154:0/3231218958 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1d7c0678c0 msgr2=0x7f1d7c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:04.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.917+0000 7f1d95481640 1 --2- 172.21.15.154:0/3231218958 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1d7c0678c0 0x7f1d7c069d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1d840ae000 tx=0x7f1d840a7070 comp rx=0 tx=0).stop 2024-05-14T01:24:04.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.917+0000 7f1d95481640 1 -- 172.21.15.154:0/3231218958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d900ce880 msgr2=0x7f1d90138a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:04.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.917+0000 7f1d95481640 1 --2- 172.21.15.154:0/3231218958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d900ce880 0x7f1d90138a60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800d800 tx=0x7f1d8800dcc0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.917+0000 7f1d95481640 1 -- 172.21.15.154:0/3231218958 shutdown_connections 2024-05-14T01:24:04.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.917+0000 7f1d95481640 1 --2- 172.21.15.154:0/3231218958 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1d7c0678c0 0x7f1d7c069d80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.917+0000 7f1d95481640 1 --2- 172.21.15.154:0/3231218958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d90141b30 0x7f1d901f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.917+0000 7f1d95481640 1 --2- 172.21.15.154:0/3231218958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d9013ede0 0x7f1d901f77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.917+0000 7f1d95481640 1 --2- 172.21.15.154:0/3231218958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d900ce880 0x7f1d90138a60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:04.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.917+0000 7f1d95481640 1 -- 172.21.15.154:0/3231218958 >> 172.21.15.154:0/3231218958 conn(0x7f1d900b1850 msgr2=0x7f1d9013dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:04.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.917+0000 7f1d95481640 1 -- 172.21.15.154:0/3231218958 shutdown_connections 2024-05-14T01:24:04.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:04.917+0000 7f1d95481640 1 -- 172.21.15.154:0/3231218958 wait complete. 2024-05-14T01:24:04.920 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T01:23:33.083538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T01:23:33.556058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:24:04.920 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:24:05.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.053+0000 7f12bccd3640 1 Processor -- start 2024-05-14T01:24:05.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.053+0000 7f12bccd3640 1 -- start start 2024-05-14T01:24:05.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.053+0000 7f12bccd3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b80d0f70 0x7f12b80d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.053+0000 7f12bccd3640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f12b8162a60 0x7f12b80d2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.053+0000 7f12bccd3640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12b815e910 con 0x7f12b815e530 2024-05-14T01:24:05.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.053+0000 7f12bccd3640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f12b80cec20 con 0x7f12b8162a60 2024-05-14T01:24:05.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.053+0000 7f12bccd3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f12b80cef00 con 0x7f12b80d0f70 2024-05-14T01:24:05.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.053+0000 7f12b5d9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b80d0f70 0x7f12b80d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.053+0000 7f12b6d9d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f12b8162a60 0x7f12b80d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.053+0000 7f12b5d9b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b80d0f70 0x7f12b80d2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:35362/0 (socket says 172.21.15.154:35362) 2024-05-14T01:24:05.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.053+0000 7f12b5d9b640 1 -- 172.21.15.154:0/1001933267 learned_addr learned my addr 172.21.15.154:0/1001933267 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:05.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.053+0000 7f12b6d9d640 1 -- 172.21.15.154:0/1001933267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b80d0f70 msgr2=0x7f12b80d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:05.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.053+0000 7f12b6d9d640 1 --2- 172.21.15.154:0/1001933267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b80d0f70 0x7f12b80d2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.053+0000 7f12b6d9d640 1 -- 172.21.15.154:0/1001933267 >> v1:172.21.15.176:6789/0 conn(0x7f12b815e530 legacy=0x7f12b80d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.053+0000 7f12b6d9d640 1 -- 172.21.15.154:0/1001933267 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b80cf1e0 con 0x7f12b8162a60 2024-05-14T01:24:05.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12b6d9d640 1 --2- 172.21.15.154:0/1001933267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12b8162a60 0x7f12b80d2970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009d90 tx=0x7f12b001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc4f64750f5df8d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:05.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12b559a640 1 -- 172.21.15.154:0/1001933267 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b00b2070 con 0x7f12b8162a60 2024-05-14T01:24:05.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12b559a640 1 -- 172.21.15.154:0/1001933267 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b00a5940 con 0x7f12b8162a60 2024-05-14T01:24:05.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12b559a640 1 -- 172.21.15.154:0/1001933267 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b00a5d10 con 0x7f12b8162a60 2024-05-14T01:24:05.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12bccd3640 1 -- 172.21.15.154:0/1001933267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12b8162a60 msgr2=0x7f12b80d2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12bccd3640 1 --2- 172.21.15.154:0/1001933267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12b8162a60 0x7f12b80d2970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009d90 tx=0x7f12b001c970 comp rx=0 tx=0).stop 2024-05-14T01:24:05.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12bccd3640 1 -- 172.21.15.154:0/1001933267 shutdown_connections 2024-05-14T01:24:05.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12bccd3640 1 --2- 172.21.15.154:0/1001933267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12b8162a60 0x7f12b80d2970 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12bccd3640 1 --2- 172.21.15.154:0/1001933267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b80d0f70 0x7f12b80d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12bccd3640 1 -- 172.21.15.154:0/1001933267 >> 172.21.15.154:0/1001933267 conn(0x7f12b80b5b80 msgr2=0x7f12b80b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:05.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12bccd3640 1 -- 172.21.15.154:0/1001933267 shutdown_connections 2024-05-14T01:24:05.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12bccd3640 1 -- 172.21.15.154:0/1001933267 wait complete. 2024-05-14T01:24:05.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12bccd3640 1 Processor -- start 2024-05-14T01:24:05.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12bccd3640 1 -- start start 2024-05-14T01:24:05.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12bccd3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12b80d0f70 0x7f12b80cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12bccd3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b815e530 0x7f12b80ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12bccd3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12b8162a60 0x7f12b80cd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12bccd3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f12b80d3440 con 0x7f12b8162a60 2024-05-14T01:24:05.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12bccd3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f12b80d32c0 con 0x7f12b80d0f70 2024-05-14T01:24:05.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12bccd3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f12b816bba0 con 0x7f12b815e530 2024-05-14T01:24:05.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12b6d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12b8162a60 0x7f12b80cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12b6d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12b8162a60 0x7f12b80cd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59432/0 (socket says 172.21.15.154:59432) 2024-05-14T01:24:05.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12b6d9d640 1 -- 172.21.15.154:0/866009204 learned_addr learned my addr 172.21.15.154:0/866009204 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:05.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12b5d9b640 1 --2- 172.21.15.154:0/866009204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b815e530 0x7f12b80ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12b659c640 1 --2- 172.21.15.154:0/866009204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12b80d0f70 0x7f12b80cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12b6d9d640 1 -- 172.21.15.154:0/866009204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b815e530 msgr2=0x7f12b80ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12b6d9d640 1 --2- 172.21.15.154:0/866009204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b815e530 0x7f12b80ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12b6d9d640 1 -- 172.21.15.154:0/866009204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12b80d0f70 msgr2=0x7f12b80cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.057+0000 7f12b6d9d640 1 --2- 172.21.15.154:0/866009204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12b80d0f70 0x7f12b80cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.061+0000 7f12b6d9d640 1 -- 172.21.15.154:0/866009204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b80cb7f0 con 0x7f12b8162a60 2024-05-14T01:24:05.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.061+0000 7f12b6d9d640 1 --2- 172.21.15.154:0/866009204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12b8162a60 0x7f12b80cd190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f12b00b0040 tx=0x7f12b0019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:05.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.061+0000 7f12aeffd640 1 -- 172.21.15.154:0/866009204 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b00b2050 con 0x7f12b8162a60 2024-05-14T01:24:05.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.061+0000 7f12aeffd640 1 -- 172.21.15.154:0/866009204 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b00be070 con 0x7f12b8162a60 2024-05-14T01:24:05.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.061+0000 7f12bccd3640 1 -- 172.21.15.154:0/866009204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b80cab70 con 0x7f12b8162a60 2024-05-14T01:24:05.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.061+0000 7f12aeffd640 1 -- 172.21.15.154:0/866009204 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b00ada90 con 0x7f12b8162a60 2024-05-14T01:24:05.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.061+0000 7f12bccd3640 1 -- 172.21.15.154:0/866009204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b80ce1e0 con 0x7f12b8162a60 2024-05-14T01:24:05.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.061+0000 7f12bccd3640 1 -- 172.21.15.154:0/866009204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12b8075470 con 0x7f12b8162a60 2024-05-14T01:24:05.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.061+0000 7f12aeffd640 1 -- 172.21.15.154:0/866009204 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f12b00adc30 con 0x7f12b8162a60 2024-05-14T01:24:05.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.061+0000 7f12aeffd640 1 --2- 172.21.15.154:0/866009204 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f12980678c0 0x7f1298069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.061+0000 7f12aeffd640 1 -- 172.21.15.154:0/866009204 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f12b0120eb0 con 0x7f12b8162a60 2024-05-14T01:24:05.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.061+0000 7f12b659c640 1 --2- 172.21.15.154:0/866009204 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f12980678c0 0x7f1298069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.061+0000 7f12b659c640 1 --2- 172.21.15.154:0/866009204 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f12980678c0 0x7f1298069d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f12a8001650 tx=0x7f12a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:05.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.065+0000 7f12aeffd640 1 -- 172.21.15.154:0/866009204 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f12b80cb7f0 con 0x7f12b8162a60 2024-05-14T01:24:05.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.217+0000 7f12bccd3640 1 -- 172.21.15.154:0/866009204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f12b8067d40 con 0x7f12b8162a60 2024-05-14T01:24:05.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.217+0000 7f12aeffd640 1 -- 172.21.15.154:0/866009204 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f12b0016560 con 0x7f12b8162a60 2024-05-14T01:24:05.202 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:24:05.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.217+0000 7f12bccd3640 1 -- 172.21.15.154:0/866009204 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f12980678c0 msgr2=0x7f1298069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.217+0000 7f12bccd3640 1 --2- 172.21.15.154:0/866009204 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f12980678c0 0x7f1298069d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f12a8001650 tx=0x7f12a8009040 comp rx=0 tx=0).stop 2024-05-14T01:24:05.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.217+0000 7f12bccd3640 1 -- 172.21.15.154:0/866009204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12b8162a60 msgr2=0x7f12b80cd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.217+0000 7f12bccd3640 1 --2- 172.21.15.154:0/866009204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12b8162a60 0x7f12b80cd190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f12b00b0040 tx=0x7f12b0019710 comp rx=0 tx=0).stop 2024-05-14T01:24:05.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.217+0000 7f12bccd3640 1 -- 172.21.15.154:0/866009204 shutdown_connections 2024-05-14T01:24:05.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.217+0000 7f12bccd3640 1 --2- 172.21.15.154:0/866009204 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f12980678c0 0x7f1298069d80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.217+0000 7f12bccd3640 1 --2- 172.21.15.154:0/866009204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12b8162a60 0x7f12b80cd190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.217+0000 7f12bccd3640 1 --2- 172.21.15.154:0/866009204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b815e530 0x7f12b80ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.217+0000 7f12bccd3640 1 --2- 172.21.15.154:0/866009204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12b80d0f70 0x7f12b80cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.217+0000 7f12bccd3640 1 -- 172.21.15.154:0/866009204 >> 172.21.15.154:0/866009204 conn(0x7f12b80b5b80 msgr2=0x7f12b80d4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:05.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.217+0000 7f12bccd3640 1 -- 172.21.15.154:0/866009204 shutdown_connections 2024-05-14T01:24:05.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.217+0000 7f12bccd3640 1 -- 172.21.15.154:0/866009204 wait complete. 2024-05-14T01:24:05.219 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T01:24:05.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.345+0000 7f911414f640 1 Processor -- start 2024-05-14T01:24:05.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.345+0000 7f911414f640 1 -- start start 2024-05-14T01:24:05.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.345+0000 7f911414f640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f910c0d0f70 0x7f910c0d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.345+0000 7f911414f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910c162a60 0x7f910c0d2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.345+0000 7f911414f640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f910c15e910 con 0x7f910c15e530 2024-05-14T01:24:05.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.345+0000 7f911414f640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f910c0cec20 con 0x7f910c0d0f70 2024-05-14T01:24:05.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.345+0000 7f911414f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f910c0cef00 con 0x7f910c162a60 2024-05-14T01:24:05.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.345+0000 7f91116ea640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f910c0d0f70 0x7f910c0d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.345+0000 7f91126ec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910c162a60 0x7f910c0d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.345+0000 7f9111eeb640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f910c15e530 0x7f910c0d0860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:45512/0 (socket says 172.21.15.154:45512) 2024-05-14T01:24:05.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.345+0000 7f9111eeb640 1 -- 172.21.15.154:0/1125350517 learned_addr learned my addr 172.21.15.154:0/1125350517 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:05.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.345+0000 7f91126ec640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910c162a60 0x7f910c0d2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:35374/0 (socket says 172.21.15.154:35374) 2024-05-14T01:24:05.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.349+0000 7f91116ea640 1 -- 172.21.15.154:0/1125350517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910c162a60 msgr2=0x7f910c0d2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:05.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.349+0000 7f91116ea640 1 --2- 172.21.15.154:0/1125350517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910c162a60 0x7f910c0d2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.349+0000 7f91116ea640 1 -- 172.21.15.154:0/1125350517 >> v1:172.21.15.176:6789/0 conn(0x7f910c15e530 legacy=0x7f910c0d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.349+0000 7f91116ea640 1 -- 172.21.15.154:0/1125350517 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910c0cf1e0 con 0x7f910c0d0f70 2024-05-14T01:24:05.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.349+0000 7f91126ec640 1 --2- 172.21.15.154:0/1125350517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910c162a60 0x7f910c0d2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:24:05.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.349+0000 7f91116ea640 1 --2- 172.21.15.154:0/1125350517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f910c0d0f70 0x7f910c0d2430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9100009d90 tx=0x7f910001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68765d6d44077be7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:05.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.349+0000 7f9110ee9640 1 -- 172.21.15.154:0/1125350517 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91000b2070 con 0x7f910c0d0f70 2024-05-14T01:24:05.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.349+0000 7f9110ee9640 1 -- 172.21.15.154:0/1125350517 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91000a5940 con 0x7f910c0d0f70 2024-05-14T01:24:05.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.349+0000 7f9110ee9640 1 -- 172.21.15.154:0/1125350517 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91000a5d10 con 0x7f910c0d0f70 2024-05-14T01:24:05.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.349+0000 7f911414f640 1 -- 172.21.15.154:0/1125350517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f910c0d0f70 msgr2=0x7f910c0d2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.349+0000 7f911414f640 1 --2- 172.21.15.154:0/1125350517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f910c0d0f70 0x7f910c0d2430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9100009d90 tx=0x7f910001c970 comp rx=0 tx=0).stop 2024-05-14T01:24:05.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.349+0000 7f911414f640 1 -- 172.21.15.154:0/1125350517 shutdown_connections 2024-05-14T01:24:05.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.349+0000 7f911414f640 1 --2- 172.21.15.154:0/1125350517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910c162a60 0x7f910c0d2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.349+0000 7f911414f640 1 --2- 172.21.15.154:0/1125350517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f910c0d0f70 0x7f910c0d2430 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.349+0000 7f911414f640 1 -- 172.21.15.154:0/1125350517 >> 172.21.15.154:0/1125350517 conn(0x7f910c0b5b80 msgr2=0x7f910c0b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:05.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.349+0000 7f911414f640 1 -- 172.21.15.154:0/1125350517 shutdown_connections 2024-05-14T01:24:05.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.349+0000 7f911414f640 1 -- 172.21.15.154:0/1125350517 wait complete. 2024-05-14T01:24:05.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f911414f640 1 Processor -- start 2024-05-14T01:24:05.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f911414f640 1 -- start start 2024-05-14T01:24:05.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f911414f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f910c0d0f70 0x7f910c1559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f911414f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f910c15e530 0x7f910c153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f911414f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910c162a60 0x7f910c160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f911414f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f910c0d32c0 con 0x7f910c15e530 2024-05-14T01:24:05.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f911414f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f910c0d3440 con 0x7f910c0d0f70 2024-05-14T01:24:05.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f911414f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f910c16bba0 con 0x7f910c162a60 2024-05-14T01:24:05.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f91116ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f910c15e530 0x7f910c153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f91116ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f910c15e530 0x7f910c153d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59440/0 (socket says 172.21.15.154:59440) 2024-05-14T01:24:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f91116ea640 1 -- 172.21.15.154:0/958852064 learned_addr learned my addr 172.21.15.154:0/958852064 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f9111eeb640 1 --2- 172.21.15.154:0/958852064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f910c0d0f70 0x7f910c1559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f91126ec640 1 --2- 172.21.15.154:0/958852064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910c162a60 0x7f910c160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f91116ea640 1 -- 172.21.15.154:0/958852064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910c162a60 msgr2=0x7f910c160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f91116ea640 1 --2- 172.21.15.154:0/958852064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910c162a60 0x7f910c160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f91116ea640 1 -- 172.21.15.154:0/958852064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f910c0d0f70 msgr2=0x7f910c1559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f91116ea640 1 --2- 172.21.15.154:0/958852064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f910c0d0f70 0x7f910c1559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f91116ea640 1 -- 172.21.15.154:0/958852064 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910c0c9fd0 con 0x7f910c15e530 2024-05-14T01:24:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f91126ec640 1 --2- 172.21.15.154:0/958852064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910c162a60 0x7f910c160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f91116ea640 1 --2- 172.21.15.154:0/958852064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f910c15e530 0x7f910c153d50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f910001a5a0 tx=0x7f9100019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f910a7fc640 1 -- 172.21.15.154:0/958852064 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91000bb020 con 0x7f910c15e530 2024-05-14T01:24:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f910a7fc640 1 -- 172.21.15.154:0/958852064 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91000ad640 con 0x7f910c15e530 2024-05-14T01:24:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f911414f640 1 -- 172.21.15.154:0/958852064 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f910c0ca2b0 con 0x7f910c15e530 2024-05-14T01:24:05.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f910a7fc640 1 -- 172.21.15.154:0/958852064 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91000b2040 con 0x7f910c15e530 2024-05-14T01:24:05.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f911414f640 1 -- 172.21.15.154:0/958852064 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f910c15b7f0 con 0x7f910c15e530 2024-05-14T01:24:05.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f911414f640 1 -- 172.21.15.154:0/958852064 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f910c075470 con 0x7f910c15e530 2024-05-14T01:24:05.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.353+0000 7f910a7fc640 1 -- 172.21.15.154:0/958852064 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f91000be020 con 0x7f910c15e530 2024-05-14T01:24:05.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.357+0000 7f910a7fc640 1 --2- 172.21.15.154:0/958852064 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f90f80678c0 0x7f90f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.357+0000 7f910a7fc640 1 -- 172.21.15.154:0/958852064 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f91001201f0 con 0x7f910c15e530 2024-05-14T01:24:05.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.357+0000 7f9111eeb640 1 --2- 172.21.15.154:0/958852064 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f90f80678c0 0x7f90f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.357+0000 7f9111eeb640 1 --2- 172.21.15.154:0/958852064 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f90f80678c0 0x7f90f8069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f90fc000f70 tx=0x7f90fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:05.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.361+0000 7f910a7fc640 1 -- 172.21.15.154:0/958852064 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f9100016560 con 0x7f910c15e530 2024-05-14T01:24:05.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.509+0000 7f911414f640 1 -- 172.21.15.154:0/958852064 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f910c0d1fe0 con 0x7f910c15e530 2024-05-14T01:24:05.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.509+0000 7f910a7fc640 1 -- 172.21.15.154:0/958852064 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f91000f0dc0 con 0x7f910c15e530 2024-05-14T01:24:05.495 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-05-14T01:24:05.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.513+0000 7f911414f640 1 -- 172.21.15.154:0/958852064 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f90f80678c0 msgr2=0x7f90f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.513+0000 7f911414f640 1 --2- 172.21.15.154:0/958852064 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f90f80678c0 0x7f90f8069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f90fc000f70 tx=0x7f90fc009040 comp rx=0 tx=0).stop 2024-05-14T01:24:05.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.513+0000 7f911414f640 1 -- 172.21.15.154:0/958852064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f910c15e530 msgr2=0x7f910c153d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.513+0000 7f911414f640 1 --2- 172.21.15.154:0/958852064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f910c15e530 0x7f910c153d50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f910001a5a0 tx=0x7f9100019710 comp rx=0 tx=0).stop 2024-05-14T01:24:05.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.513+0000 7f911414f640 1 -- 172.21.15.154:0/958852064 shutdown_connections 2024-05-14T01:24:05.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.513+0000 7f911414f640 1 --2- 172.21.15.154:0/958852064 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f90f80678c0 0x7f90f8069d80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.513+0000 7f911414f640 1 --2- 172.21.15.154:0/958852064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f910c162a60 0x7f910c160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.513+0000 7f911414f640 1 --2- 172.21.15.154:0/958852064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f910c15e530 0x7f910c153d50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.513+0000 7f911414f640 1 --2- 172.21.15.154:0/958852064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f910c0d0f70 0x7f910c1559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.513+0000 7f911414f640 1 -- 172.21.15.154:0/958852064 >> 172.21.15.154:0/958852064 conn(0x7f910c0b5b80 msgr2=0x7f910c0d3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:05.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.513+0000 7f911414f640 1 -- 172.21.15.154:0/958852064 shutdown_connections 2024-05-14T01:24:05.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.513+0000 7f911414f640 1 -- 172.21.15.154:0/958852064 wait complete. 2024-05-14T01:24:05.513 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T01:24:05.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faffbe85640 1 Processor -- start 2024-05-14T01:24:05.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faffbe85640 1 -- start start 2024-05-14T01:24:05.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faffbe85640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faff4158920 0x7faff4072c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faffbe85640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff4072410 con 0x7faff4071f80 2024-05-14T01:24:05.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faffbe85640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff40b3bb0 con 0x7faff4162370 2024-05-14T01:24:05.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faffbe85640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7faff4071af0 con 0x7faff4158920 2024-05-14T01:24:05.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff9420640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7faff4071f80 0x7faff4161c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54262/0 (socket says 172.21.15.154:54262) 2024-05-14T01:24:05.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff9420640 1 -- 172.21.15.154:0/373171027 learned_addr learned my addr 172.21.15.154:0/373171027 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:05.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff9c21640 1 --2- 172.21.15.154:0/373171027 >> v2:172.21.15.176:3300/0 conn(0x7faff4158920 0x7faff4072c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff8c1f640 1 -- 172.21.15.154:0/373171027 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1796490234 0 0) 0x7fafe4001120 con 0x7faff4071f80 2024-05-14T01:24:05.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff8c1f640 1 -- 172.21.15.154:0/373171027 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafe0003530 con 0x7faff4071f80 2024-05-14T01:24:05.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff8c1f640 1 -- 172.21.15.154:0/373171027 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 607443941 0 0) 0x7fafe0003530 con 0x7faff4071f80 2024-05-14T01:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff8c1f640 1 -- 172.21.15.154:0/373171027 >> v2:172.21.15.176:3300/0 conn(0x7faff4158920 msgr2=0x7faff4072c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff8c1f640 1 --2- 172.21.15.154:0/373171027 >> v2:172.21.15.176:3300/0 conn(0x7faff4158920 0x7faff4072c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff8c1f640 1 -- 172.21.15.154:0/373171027 >> v1:172.21.15.176:6789/0 conn(0x7faff4162370 legacy=0x7faff40ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff8c1f640 1 -- 172.21.15.154:0/373171027 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff40711c0 con 0x7faff4071f80 2024-05-14T01:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff8c1f640 1 -- 172.21.15.154:0/373171027 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fafe4001850 con 0x7faff4071f80 2024-05-14T01:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff8c1f640 1 -- 172.21.15.154:0/373171027 >> v1:172.21.15.154:6789/0 conn(0x7faff4071f80 legacy=0x7faff4161c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff8c1f640 1 --2- 172.21.15.154:0/373171027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafe00039c0 0x7fafe0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff8c1f640 1 --2- 172.21.15.154:0/373171027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe0004810 0x7fafe0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff8c1f640 1 --2- 172.21.15.154:0/373171027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafe00051d0 0x7fafe000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff8c1f640 1 -- 172.21.15.154:0/373171027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faff4071af0 con 0x7fafe00039c0 2024-05-14T01:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff8c1f640 1 -- 172.21.15.154:0/373171027 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fafe000c070 con 0x7fafe0004810 2024-05-14T01:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff8c1f640 1 -- 172.21.15.154:0/373171027 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fafe000c270 con 0x7fafe00051d0 2024-05-14T01:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff9c21640 1 --2- 172.21.15.154:0/373171027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafe00039c0 0x7fafe0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff9c21640 1 -- 172.21.15.154:0/373171027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafe00051d0 msgr2=0x7fafe000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff9420640 1 --2- 172.21.15.154:0/373171027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe0004810 0x7fafe0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faffa422640 1 --2- 172.21.15.154:0/373171027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafe00051d0 0x7fafe000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff9c21640 1 --2- 172.21.15.154:0/373171027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafe00051d0 0x7fafe000b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff9c21640 1 -- 172.21.15.154:0/373171027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe0004810 msgr2=0x7fafe0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:05.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff9c21640 1 --2- 172.21.15.154:0/373171027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe0004810 0x7fafe0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff9c21640 1 -- 172.21.15.154:0/373171027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe0003530 con 0x7fafe00039c0 2024-05-14T01:24:05.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faff9420640 1 --2- 172.21.15.154:0/373171027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafe0004810 0x7fafe0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:05.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.649+0000 7faffa422640 1 -- 172.21.15.154:0/373171027 reap_dead start 2024-05-14T01:24:05.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faff9c21640 1 --2- 172.21.15.154:0/373171027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafe00039c0 0x7fafe0003de0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faff0009ae0 tx=0x7faff001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b2f9af478257af server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:05.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faff8c1f640 1 -- 172.21.15.154:0/373171027 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff00096b0 con 0x7fafe00039c0 2024-05-14T01:24:05.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faff8c1f640 1 -- 172.21.15.154:0/373171027 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff00a6500 con 0x7fafe00039c0 2024-05-14T01:24:05.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faff8c1f640 1 -- 172.21.15.154:0/373171027 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff00a68f0 con 0x7fafe00039c0 2024-05-14T01:24:05.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faffbe85640 1 -- 172.21.15.154:0/373171027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafe00039c0 msgr2=0x7fafe0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faffbe85640 1 --2- 172.21.15.154:0/373171027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafe00039c0 0x7fafe0003de0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faff0009ae0 tx=0x7faff001ca40 comp rx=0 tx=0).stop 2024-05-14T01:24:05.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faffbe85640 1 -- 172.21.15.154:0/373171027 shutdown_connections 2024-05-14T01:24:05.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faffbe85640 1 --2- 172.21.15.154:0/373171027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafe00039c0 0x7fafe0003de0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faffbe85640 1 -- 172.21.15.154:0/373171027 >> 172.21.15.154:0/373171027 conn(0x7faff40b1770 msgr2=0x7faff40b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:05.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faffbe85640 1 -- 172.21.15.154:0/373171027 shutdown_connections 2024-05-14T01:24:05.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faffbe85640 1 -- 172.21.15.154:0/373171027 wait complete. 2024-05-14T01:24:05.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faffbe85640 1 Processor -- start 2024-05-14T01:24:05.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faffbe85640 1 -- start start 2024-05-14T01:24:05.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faffbe85640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafe00039c0 0x7faff41466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faffbe85640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faff4151960 0x7faff40ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faffbe85640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faff4154840 0x7faff4154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faffbe85640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faff40ae090 con 0x7fafe00039c0 2024-05-14T01:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faffbe85640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faff40b3890 con 0x7faff4154840 2024-05-14T01:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faffbe85640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faff40ae210 con 0x7faff4151960 2024-05-14T01:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faff9c21640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafe00039c0 0x7faff41466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faff9c21640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafe00039c0 0x7faff41466e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59452/0 (socket says 172.21.15.154:59452) 2024-05-14T01:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faff9c21640 1 -- 172.21.15.154:0/3390824723 learned_addr learned my addr 172.21.15.154:0/3390824723 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faff9c21640 1 -- 172.21.15.154:0/3390824723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faff4151960 msgr2=0x7faff40ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faff9c21640 1 --2- 172.21.15.154:0/3390824723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faff4151960 0x7faff40ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faff9c21640 1 -- 172.21.15.154:0/3390824723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faff4154840 msgr2=0x7faff4154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faff9c21640 1 --2- 172.21.15.154:0/3390824723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faff4154840 0x7faff4154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.653+0000 7faff9c21640 1 -- 172.21.15.154:0/3390824723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff40cd8f0 con 0x7fafe00039c0 2024-05-14T01:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.657+0000 7faff9c21640 1 --2- 172.21.15.154:0/3390824723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafe00039c0 0x7faff41466e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faff001c870 tx=0x7faff00197e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.657+0000 7fafea7fc640 1 -- 172.21.15.154:0/3390824723 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff000f080 con 0x7fafe00039c0 2024-05-14T01:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.657+0000 7fafea7fc640 1 -- 172.21.15.154:0/3390824723 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff00be070 con 0x7fafe00039c0 2024-05-14T01:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.657+0000 7faffbe85640 1 -- 172.21.15.154:0/3390824723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff40cdbd0 con 0x7fafe00039c0 2024-05-14T01:24:05.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.657+0000 7fafea7fc640 1 -- 172.21.15.154:0/3390824723 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff00a68b0 con 0x7fafe00039c0 2024-05-14T01:24:05.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.657+0000 7faffbe85640 1 -- 172.21.15.154:0/3390824723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff40cd4c0 con 0x7fafe00039c0 2024-05-14T01:24:05.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.657+0000 7faffbe85640 1 -- 172.21.15.154:0/3390824723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faff4075470 con 0x7fafe00039c0 2024-05-14T01:24:05.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.657+0000 7fafea7fc640 1 -- 172.21.15.154:0/3390824723 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faff00a6a50 con 0x7fafe00039c0 2024-05-14T01:24:05.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.657+0000 7fafea7fc640 1 --2- 172.21.15.154:0/3390824723 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fafd80678f0 0x7fafd8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.657+0000 7faff9420640 1 --2- 172.21.15.154:0/3390824723 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fafd80678f0 0x7fafd8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.657+0000 7fafea7fc640 1 -- 172.21.15.154:0/3390824723 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faff01202c0 con 0x7fafe00039c0 2024-05-14T01:24:05.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.657+0000 7faff9420640 1 --2- 172.21.15.154:0/3390824723 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fafd80678f0 0x7fafd8069db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fafe4000fe0 tx=0x7fafe4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:05.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.661+0000 7fafea7fc640 1 -- 172.21.15.154:0/3390824723 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7faff0016780 con 0x7fafe00039c0 2024-05-14T01:24:05.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.821+0000 7faffbe85640 1 -- 172.21.15.154:0/3390824723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7faff40cf8d0 con 0x7fafe00039c0 2024-05-14T01:24:05.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.821+0000 7fafea7fc640 1 -- 172.21.15.154:0/3390824723 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7faff00f0e90 con 0x7fafe00039c0 2024-05-14T01:24:05.808 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-05-14T01:24:05.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.825+0000 7faffbe85640 1 -- 172.21.15.154:0/3390824723 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fafd80678f0 msgr2=0x7fafd8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.825+0000 7faffbe85640 1 --2- 172.21.15.154:0/3390824723 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fafd80678f0 0x7fafd8069db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fafe4000fe0 tx=0x7fafe4009040 comp rx=0 tx=0).stop 2024-05-14T01:24:05.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.825+0000 7faffbe85640 1 -- 172.21.15.154:0/3390824723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafe00039c0 msgr2=0x7faff41466e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.825+0000 7faffbe85640 1 --2- 172.21.15.154:0/3390824723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafe00039c0 0x7faff41466e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faff001c870 tx=0x7faff00197e0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.825+0000 7faffbe85640 1 -- 172.21.15.154:0/3390824723 shutdown_connections 2024-05-14T01:24:05.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.825+0000 7faffbe85640 1 --2- 172.21.15.154:0/3390824723 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fafd80678f0 0x7fafd8069db0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.825+0000 7faffbe85640 1 --2- 172.21.15.154:0/3390824723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faff4154840 0x7faff4154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.825+0000 7faffbe85640 1 --2- 172.21.15.154:0/3390824723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faff4151960 0x7faff40ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.825+0000 7faffbe85640 1 --2- 172.21.15.154:0/3390824723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafe00039c0 0x7faff41466e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.825+0000 7faffbe85640 1 -- 172.21.15.154:0/3390824723 >> 172.21.15.154:0/3390824723 conn(0x7faff40b1770 msgr2=0x7faff40b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:05.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.825+0000 7faffbe85640 1 -- 172.21.15.154:0/3390824723 shutdown_connections 2024-05-14T01:24:05.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.825+0000 7faffbe85640 1 -- 172.21.15.154:0/3390824723 wait complete. 2024-05-14T01:24:05.828 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-05-14T01:24:05.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.957+0000 7f026ca10640 1 Processor -- start 2024-05-14T01:24:05.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.957+0000 7f026ca10640 1 -- start start 2024-05-14T01:24:05.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f026ca10640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02680cf520 0x7f02680d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f026ca10640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f026815e4e0 0x7f02680b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f026ca10640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02680d29f0 con 0x7f026815e100 2024-05-14T01:24:05.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f026ca10640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f02680d2cd0 con 0x7f02680cf520 2024-05-14T01:24:05.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f026ca10640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f02680d2fb0 con 0x7f026815e4e0 2024-05-14T01:24:05.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f0265d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02680cf520 0x7f02680d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f026659c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f026815e100 0x7f02680cee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54274/0 (socket says 172.21.15.154:54274) 2024-05-14T01:24:05.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f026659c640 1 -- 172.21.15.154:0/1878346814 learned_addr learned my addr 172.21.15.154:0/1878346814 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:05.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f0265d9b640 1 -- 172.21.15.154:0/1878346814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f026815e4e0 msgr2=0x7f02680b9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:05.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f0266d9d640 1 --2- 172.21.15.154:0/1878346814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f026815e4e0 0x7f02680b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f0265d9b640 1 --2- 172.21.15.154:0/1878346814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f026815e4e0 0x7f02680b9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f026559a640 1 -- 172.21.15.154:0/1878346814 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1913284271 0 0) 0x7f02680d29f0 con 0x7f026815e100 2024-05-14T01:24:05.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f0265d9b640 1 -- 172.21.15.154:0/1878346814 >> v1:172.21.15.154:6789/0 conn(0x7f026815e100 legacy=0x7f02680cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f0265d9b640 1 -- 172.21.15.154:0/1878346814 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02680d3290 con 0x7f02680cf520 2024-05-14T01:24:05.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f0266d9d640 1 --2- 172.21.15.154:0/1878346814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f026815e4e0 0x7f02680b9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:05.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f0265d9b640 1 --2- 172.21.15.154:0/1878346814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02680cf520 0x7f02680d22f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f025c0097c0 tx=0x7f025c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e08ef93e12eaf4d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:05.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f026559a640 1 -- 172.21.15.154:0/1878346814 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c0b5070 con 0x7f02680cf520 2024-05-14T01:24:05.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f026559a640 1 -- 172.21.15.154:0/1878346814 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f025c0a8990 con 0x7f02680cf520 2024-05-14T01:24:05.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f026559a640 1 -- 172.21.15.154:0/1878346814 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c0a8d60 con 0x7f02680cf520 2024-05-14T01:24:05.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f026ca10640 1 -- 172.21.15.154:0/1878346814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02680cf520 msgr2=0x7f02680d22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f026ca10640 1 --2- 172.21.15.154:0/1878346814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02680cf520 0x7f02680d22f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f025c0097c0 tx=0x7f025c01ec90 comp rx=0 tx=0).stop 2024-05-14T01:24:05.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.961+0000 7f026ca10640 1 -- 172.21.15.154:0/1878346814 shutdown_connections 2024-05-14T01:24:05.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f026ca10640 1 --2- 172.21.15.154:0/1878346814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f026815e4e0 0x7f02680b9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f026ca10640 1 --2- 172.21.15.154:0/1878346814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02680cf520 0x7f02680d22f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f026ca10640 1 -- 172.21.15.154:0/1878346814 >> 172.21.15.154:0/1878346814 conn(0x7f02680b5b50 msgr2=0x7f02680b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:05.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f026ca10640 1 -- 172.21.15.154:0/1878346814 shutdown_connections 2024-05-14T01:24:05.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f026ca10640 1 -- 172.21.15.154:0/1878346814 wait complete. 2024-05-14T01:24:05.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f026ca10640 1 Processor -- start 2024-05-14T01:24:05.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f026ca10640 1 -- start start 2024-05-14T01:24:05.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f026ca10640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02680cf520 0x7f02680cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f026ca10640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026815e100 0x7f026814a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f026ca10640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f026815e4e0 0x7f02680ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f026ca10640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02680d3c10 con 0x7f026815e100 2024-05-14T01:24:05.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f026ca10640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f02680d3a90 con 0x7f02680cf520 2024-05-14T01:24:05.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f026ca10640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f02680cd9d0 con 0x7f026815e4e0 2024-05-14T01:24:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f0265d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026815e100 0x7f026814a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f0265d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026815e100 0x7f026814a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59474/0 (socket says 172.21.15.154:59474) 2024-05-14T01:24:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f0265d9b640 1 -- 172.21.15.154:0/65349931 learned_addr learned my addr 172.21.15.154:0/65349931 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f0265d9b640 1 -- 172.21.15.154:0/65349931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f026815e4e0 msgr2=0x7f02680ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f0265d9b640 1 --2- 172.21.15.154:0/65349931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f026815e4e0 0x7f02680ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f0265d9b640 1 -- 172.21.15.154:0/65349931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02680cf520 msgr2=0x7f02680cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f0265d9b640 1 --2- 172.21.15.154:0/65349931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02680cf520 0x7f02680cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f0265d9b640 1 -- 172.21.15.154:0/65349931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02680cdcb0 con 0x7f026815e100 2024-05-14T01:24:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f0265d9b640 1 --2- 172.21.15.154:0/65349931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026815e100 0x7f026814a2e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f025c01c8c0 tx=0x7f025c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f0256ffd640 1 -- 172.21.15.154:0/65349931 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c0b5040 con 0x7f026815e100 2024-05-14T01:24:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f0256ffd640 1 -- 172.21.15.154:0/65349931 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f025c0bf070 con 0x7f026815e100 2024-05-14T01:24:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f026ca10640 1 -- 172.21.15.154:0/65349931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02680cdf90 con 0x7f026815e100 2024-05-14T01:24:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f0256ffd640 1 -- 172.21.15.154:0/65349931 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c0b0b60 con 0x7f026815e100 2024-05-14T01:24:05.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f026ca10640 1 -- 172.21.15.154:0/65349931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02680ca970 con 0x7f026815e100 2024-05-14T01:24:05.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.965+0000 7f026ca10640 1 -- 172.21.15.154:0/65349931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0268075470 con 0x7f026815e100 2024-05-14T01:24:05.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.969+0000 7f0256ffd640 1 -- 172.21.15.154:0/65349931 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f025c0b0d00 con 0x7f026815e100 2024-05-14T01:24:05.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.969+0000 7f0256ffd640 1 --2- 172.21.15.154:0/65349931 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f02480678f0 0x7f0248069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:05.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.969+0000 7f0256ffd640 1 -- 172.21.15.154:0/65349931 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f025c123280 con 0x7f026815e100 2024-05-14T01:24:05.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.969+0000 7f026659c640 1 --2- 172.21.15.154:0/65349931 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f02480678f0 0x7f0248069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:05.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.969+0000 7f026659c640 1 --2- 172.21.15.154:0/65349931 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f02480678f0 0x7f0248069db0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f02580011f0 tx=0x7f0258007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:05.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:05.973+0000 7f0256ffd640 1 -- 172.21.15.154:0/65349931 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f025c0187f0 con 0x7f026815e100 2024-05-14T01:24:06.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.177+0000 7f026ca10640 1 -- 172.21.15.154:0/65349931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7f026815c3d0 con 0x7f026815e100 2024-05-14T01:24:06.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.405+0000 7f0256ffd640 1 -- 172.21.15.154:0/65349931 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v51) ==== 147+0+0 (secure 0 0 0) 0x7f025c0af3a0 con 0x7f026815e100 2024-05-14T01:24:06.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.409+0000 7f026ca10640 1 -- 172.21.15.154:0/65349931 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f02480678f0 msgr2=0x7f0248069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:06.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.409+0000 7f026ca10640 1 --2- 172.21.15.154:0/65349931 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f02480678f0 0x7f0248069db0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f02580011f0 tx=0x7f0258007930 comp rx=0 tx=0).stop 2024-05-14T01:24:06.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.409+0000 7f026ca10640 1 -- 172.21.15.154:0/65349931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026815e100 msgr2=0x7f026814a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:06.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.409+0000 7f026ca10640 1 --2- 172.21.15.154:0/65349931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026815e100 0x7f026814a2e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f025c01c8c0 tx=0x7f025c01ba30 comp rx=0 tx=0).stop 2024-05-14T01:24:06.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.409+0000 7f026ca10640 1 -- 172.21.15.154:0/65349931 shutdown_connections 2024-05-14T01:24:06.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.409+0000 7f026ca10640 1 --2- 172.21.15.154:0/65349931 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f02480678f0 0x7f0248069db0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:06.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.409+0000 7f026ca10640 1 --2- 172.21.15.154:0/65349931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f026815e4e0 0x7f02680ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:06.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.409+0000 7f026ca10640 1 --2- 172.21.15.154:0/65349931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026815e100 0x7f026814a2e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:06.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.409+0000 7f026ca10640 1 --2- 172.21.15.154:0/65349931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02680cf520 0x7f02680cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:06.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.409+0000 7f026ca10640 1 -- 172.21.15.154:0/65349931 >> 172.21.15.154:0/65349931 conn(0x7f02680b5b50 msgr2=0x7f0268159680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:06.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.409+0000 7f026ca10640 1 -- 172.21.15.154:0/65349931 shutdown_connections 2024-05-14T01:24:06.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.409+0000 7f026ca10640 1 -- 172.21.15.154:0/65349931 wait complete. 2024-05-14T01:24:06.412 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-14T01:24:06.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d0d04e640 1 Processor -- start 2024-05-14T01:24:06.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d0d04e640 1 -- start start 2024-05-14T01:24:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d0d04e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2d0815e530 0x7f2d080d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d0d04e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d080b3590 0x7f2d080d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d0d04e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d080d3440 con 0x7f2d08162a60 2024-05-14T01:24:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d0d04e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2d0815e910 con 0x7f2d0815e530 2024-05-14T01:24:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d0d04e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2d080cec20 con 0x7f2d080b3590 2024-05-14T01:24:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d0659c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2d08162a60 0x7f2d080718a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54286/0 (socket says 172.21.15.154:54286) 2024-05-14T01:24:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d0659c640 1 -- 172.21.15.154:0/3398756161 learned_addr learned my addr 172.21.15.154:0/3398756161 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d05d9b640 1 -- 172.21.15.154:0/3398756161 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3995852686 0 0) 0x7f2d080d3440 con 0x7f2d08162a60 2024-05-14T01:24:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d05d9b640 1 -- 172.21.15.154:0/3398756161 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cf0003530 con 0x7f2d08162a60 2024-05-14T01:24:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d0759e640 1 --2- 172.21.15.154:0/3398756161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d080b3590 0x7f2d080d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d06d9d640 1 --2- 172.21.15.154:0/3398756161 >> v2:172.21.15.176:3300/0 conn(0x7f2d0815e530 0x7f2d080d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d05d9b640 1 -- 172.21.15.154:0/3398756161 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3024099076 0 0) 0x7f2cf0003530 con 0x7f2d08162a60 2024-05-14T01:24:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d05d9b640 1 -- 172.21.15.154:0/3398756161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d080b3590 msgr2=0x7f2d080d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:06.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d05d9b640 1 --2- 172.21.15.154:0/3398756161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d080b3590 0x7f2d080d0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:06.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d05d9b640 1 -- 172.21.15.154:0/3398756161 >> v2:172.21.15.176:3300/0 conn(0x7f2d0815e530 msgr2=0x7f2d080d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:06.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d05d9b640 1 --2- 172.21.15.154:0/3398756161 >> v2:172.21.15.176:3300/0 conn(0x7f2d0815e530 0x7f2d080d0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:06.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d05d9b640 1 -- 172.21.15.154:0/3398756161 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d080cef00 con 0x7f2d08162a60 2024-05-14T01:24:06.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d05d9b640 1 -- 172.21.15.154:0/3398756161 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f2cfc001680 con 0x7f2d08162a60 2024-05-14T01:24:06.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d06d9d640 1 --2- 172.21.15.154:0/3398756161 >> v2:172.21.15.176:3300/0 conn(0x7f2d0815e530 0x7f2d080d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:06.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d05d9b640 1 -- 172.21.15.154:0/3398756161 >> v1:172.21.15.154:6789/0 conn(0x7f2d08162a60 legacy=0x7f2d080718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:06.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d05d9b640 1 --2- 172.21.15.154:0/3398756161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cf00039c0 0x7f2cf0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:06.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d05d9b640 1 --2- 172.21.15.154:0/3398756161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cf0004810 0x7f2cf0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:06.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d05d9b640 1 --2- 172.21.15.154:0/3398756161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d080b3590 0x7f2cf00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:06.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d05d9b640 1 -- 172.21.15.154:0/3398756161 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0815e910 con 0x7f2cf00039c0 2024-05-14T01:24:06.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d05d9b640 1 -- 172.21.15.154:0/3398756161 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2d080cec20 con 0x7f2cf0004810 2024-05-14T01:24:06.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d05d9b640 1 -- 172.21.15.154:0/3398756161 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2cf000ba20 con 0x7f2d080b3590 2024-05-14T01:24:06.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d06d9d640 1 --2- 172.21.15.154:0/3398756161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cf00039c0 0x7f2cf0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:06.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d0759e640 1 --2- 172.21.15.154:0/3398756161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d080b3590 0x7f2cf00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:06.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d0659c640 1 --2- 172.21.15.154:0/3398756161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cf0004810 0x7f2cf0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:06.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d06d9d640 1 -- 172.21.15.154:0/3398756161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d080b3590 msgr2=0x7f2cf00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:06.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d06d9d640 1 --2- 172.21.15.154:0/3398756161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d080b3590 0x7f2cf00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:06.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d06d9d640 1 -- 172.21.15.154:0/3398756161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cf0004810 msgr2=0x7f2cf0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:06.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d06d9d640 1 --2- 172.21.15.154:0/3398756161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cf0004810 0x7f2cf0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:06.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d06d9d640 1 -- 172.21.15.154:0/3398756161 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf0003530 con 0x7f2cf00039c0 2024-05-14T01:24:06.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.553+0000 7f2d0659c640 1 --2- 172.21.15.154:0/3398756161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cf0004810 0x7f2cf0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:06.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.557+0000 7f2d06d9d640 1 --2- 172.21.15.154:0/3398756161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cf00039c0 0x7f2cf0003de0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80098d0 tx=0x7f2cf801c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79684702747c9300 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:06.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.557+0000 7f2d05d9b640 1 -- 172.21.15.154:0/3398756161 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800f040 con 0x7f2cf00039c0 2024-05-14T01:24:06.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.557+0000 7f2d05d9b640 1 -- 172.21.15.154:0/3398756161 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cf80af070 con 0x7f2cf00039c0 2024-05-14T01:24:06.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.557+0000 7f2d05d9b640 1 -- 172.21.15.154:0/3398756161 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80aa7f0 con 0x7f2cf00039c0 2024-05-14T01:24:06.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.557+0000 7f2d0d04e640 1 -- 172.21.15.154:0/3398756161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cf00039c0 msgr2=0x7f2cf0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:06.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.557+0000 7f2d0d04e640 1 --2- 172.21.15.154:0/3398756161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cf00039c0 0x7f2cf0003de0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80098d0 tx=0x7f2cf801c650 comp rx=0 tx=0).stop 2024-05-14T01:24:06.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.557+0000 7f2d0759e640 1 -- 172.21.15.154:0/3398756161 reap_dead start 2024-05-14T01:24:06.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.557+0000 7f2d0d04e640 1 -- 172.21.15.154:0/3398756161 shutdown_connections 2024-05-14T01:24:06.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.557+0000 7f2d0d04e640 1 -- 172.21.15.154:0/3398756161 >> 172.21.15.154:0/3398756161 conn(0x7f2d080b5b80 msgr2=0x7f2d080b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:06.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.557+0000 7f2d0d04e640 1 -- 172.21.15.154:0/3398756161 shutdown_connections 2024-05-14T01:24:06.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.557+0000 7f2d0d04e640 1 -- 172.21.15.154:0/3398756161 wait complete. 2024-05-14T01:24:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.557+0000 7f2d0d04e640 1 Processor -- start 2024-05-14T01:24:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.557+0000 7f2d0d04e640 1 -- start start 2024-05-14T01:24:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0d04e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cf00039c0 0x7f2d080c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0d04e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d080c7f10 0x7f2d080cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0d04e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d080cdc90 0x7f2d081562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0d04e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2d080cf9e0 con 0x7f2d080cdc90 2024-05-14T01:24:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0d04e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2d080b2d10 con 0x7f2cf00039c0 2024-05-14T01:24:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0d04e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2d080cfb60 con 0x7f2d080c7f10 2024-05-14T01:24:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0759e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d080cdc90 0x7f2d081562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0759e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d080cdc90 0x7f2d081562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59494/0 (socket says 172.21.15.154:59494) 2024-05-14T01:24:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0759e640 1 -- 172.21.15.154:0/3925478266 learned_addr learned my addr 172.21.15.154:0/3925478266 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d06d9d640 1 --2- 172.21.15.154:0/3925478266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cf00039c0 0x7f2d080c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0659c640 1 --2- 172.21.15.154:0/3925478266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d080c7f10 0x7f2d080cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0759e640 1 -- 172.21.15.154:0/3925478266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d080c7f10 msgr2=0x7f2d080cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0759e640 1 --2- 172.21.15.154:0/3925478266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d080c7f10 0x7f2d080cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0759e640 1 -- 172.21.15.154:0/3925478266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cf00039c0 msgr2=0x7f2d080c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0759e640 1 --2- 172.21.15.154:0/3925478266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cf00039c0 0x7f2d080c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0759e640 1 -- 172.21.15.154:0/3925478266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0815ef00 con 0x7f2d080cdc90 2024-05-14T01:24:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0759e640 1 --2- 172.21.15.154:0/3925478266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d080cdc90 0x7f2d081562d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2d00007c80 tx=0x7f2d000115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2cef7fe640 1 -- 172.21.15.154:0/3925478266 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00011e40 con 0x7f2d080cdc90 2024-05-14T01:24:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2cef7fe640 1 -- 172.21.15.154:0/3925478266 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0001b070 con 0x7f2d080cdc90 2024-05-14T01:24:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0d04e640 1 -- 172.21.15.154:0/3925478266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d0815f1e0 con 0x7f2d080cdc90 2024-05-14T01:24:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2cef7fe640 1 -- 172.21.15.154:0/3925478266 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d000039a0 con 0x7f2d080cdc90 2024-05-14T01:24:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0d04e640 1 -- 172.21.15.154:0/3925478266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d0815f7a0 con 0x7f2d080cdc90 2024-05-14T01:24:06.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d0d04e640 1 -- 172.21.15.154:0/3925478266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d08075470 con 0x7f2d080cdc90 2024-05-14T01:24:06.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2cef7fe640 1 -- 172.21.15.154:0/3925478266 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2d00003b40 con 0x7f2d080cdc90 2024-05-14T01:24:06.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2cef7fe640 1 --2- 172.21.15.154:0/3925478266 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2cf40678f0 0x7f2cf4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:06.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2cef7fe640 1 -- 172.21.15.154:0/3925478266 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2d00086520 con 0x7f2d080cdc90 2024-05-14T01:24:06.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d06d9d640 1 --2- 172.21.15.154:0/3925478266 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2cf40678f0 0x7f2cf4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:06.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.561+0000 7f2d06d9d640 1 --2- 172.21.15.154:0/3925478266 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2cf40678f0 0x7f2cf4069db0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80ae000 tx=0x7f2cf80046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:06.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.565+0000 7f2cef7fe640 1 -- 172.21.15.154:0/3925478266 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f2d00025020 con 0x7f2d080cdc90 2024-05-14T01:24:06.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.725+0000 7f2d0d04e640 1 -- 172.21.15.154:0/3925478266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2d0815dac0 con 0x7f2d080cdc90 2024-05-14T01:24:06.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.733+0000 7f2cef7fe640 1 -- 172.21.15.154:0/3925478266 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f2d00056fd0 con 0x7f2d080cdc90 2024-05-14T01:24:06.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.733+0000 7f2d0d04e640 1 -- 172.21.15.154:0/3925478266 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2cf40678f0 msgr2=0x7f2cf4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:06.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.733+0000 7f2d0d04e640 1 --2- 172.21.15.154:0/3925478266 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2cf40678f0 0x7f2cf4069db0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80ae000 tx=0x7f2cf80046d0 comp rx=0 tx=0).stop 2024-05-14T01:24:06.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.733+0000 7f2d0d04e640 1 -- 172.21.15.154:0/3925478266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d080cdc90 msgr2=0x7f2d081562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:06.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.733+0000 7f2d0d04e640 1 --2- 172.21.15.154:0/3925478266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d080cdc90 0x7f2d081562d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2d00007c80 tx=0x7f2d000115a0 comp rx=0 tx=0).stop 2024-05-14T01:24:06.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.737+0000 7f2d0d04e640 1 -- 172.21.15.154:0/3925478266 shutdown_connections 2024-05-14T01:24:06.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.737+0000 7f2d0d04e640 1 --2- 172.21.15.154:0/3925478266 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2cf40678f0 0x7f2cf4069db0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:06.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.737+0000 7f2d0d04e640 1 --2- 172.21.15.154:0/3925478266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d080cdc90 0x7f2d081562d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:06.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.737+0000 7f2d0d04e640 1 --2- 172.21.15.154:0/3925478266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d080c7f10 0x7f2d080cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:06.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.737+0000 7f2d0d04e640 1 --2- 172.21.15.154:0/3925478266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cf00039c0 0x7f2d080c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:06.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.737+0000 7f2d0d04e640 1 -- 172.21.15.154:0/3925478266 >> 172.21.15.154:0/3925478266 conn(0x7f2d080b5b80 msgr2=0x7f2d080718a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:06.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.737+0000 7f2d0d04e640 1 -- 172.21.15.154:0/3925478266 shutdown_connections 2024-05-14T01:24:06.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:06.737+0000 7f2d0d04e640 1 -- 172.21.15.154:0/3925478266 wait complete. 2024-05-14T01:24:06.738 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-14T01:24:06.738 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-14T01:24:06.794 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-14T01:24:06.841 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-14T01:24:06.842 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:24:06.842 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T01:24:06.847 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:24:06.847 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T01:24:06.893 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:07.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.073+0000 7fe2c70f4640 1 Processor -- start 2024-05-14T01:24:07.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.073+0000 7fe2c70f4640 1 -- start start 2024-05-14T01:24:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.077+0000 7fe2c70f4640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe2c006db80 0x7fe2c00cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.077+0000 7fe2c70f4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2c015bb60 0x7fe2c015bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.077+0000 7fe2c70f4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2c00b2ec0 con 0x7fe2c01513c0 2024-05-14T01:24:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.077+0000 7fe2c70f4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe2c00cf9d0 con 0x7fe2c015bb60 2024-05-14T01:24:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.077+0000 7fe2c70f4640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe2c00b3ad0 con 0x7fe2c006db80 2024-05-14T01:24:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.077+0000 7fe2c5691640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2c015bb60 0x7fe2c015bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.077+0000 7fe2c5691640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2c015bb60 0x7fe2c015bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59502/0 (socket says 172.21.15.154:59502) 2024-05-14T01:24:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.077+0000 7fe2c4e90640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe2c01513c0 0x7fe2c006d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54296/0 (socket says 172.21.15.154:54296) 2024-05-14T01:24:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.077+0000 7fe2c5691640 1 -- 172.21.15.154:0/696719496 learned_addr learned my addr 172.21.15.154:0/696719496 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.077+0000 7fe2bffff640 1 --2- 172.21.15.154:0/696719496 >> v2:172.21.15.176:3300/0 conn(0x7fe2c006db80 0x7fe2c00cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.077+0000 7fe2c5691640 1 -- 172.21.15.154:0/696719496 >> v2:172.21.15.176:3300/0 conn(0x7fe2c006db80 msgr2=0x7fe2c00cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.077+0000 7fe2c5691640 1 --2- 172.21.15.154:0/696719496 >> v2:172.21.15.176:3300/0 conn(0x7fe2c006db80 0x7fe2c00cf490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.077+0000 7fe2c5691640 1 -- 172.21.15.154:0/696719496 >> v1:172.21.15.154:6789/0 conn(0x7fe2c01513c0 legacy=0x7fe2c006d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:07.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.077+0000 7fe2c5691640 1 -- 172.21.15.154:0/696719496 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c00b31a0 con 0x7fe2c015bb60 2024-05-14T01:24:07.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.077+0000 7fe2c5691640 1 --2- 172.21.15.154:0/696719496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2c015bb60 0x7fe2c015bf80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00d0ce0 tx=0x7fe2b801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61df04ab69dc8710 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:07.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.077+0000 7fe2bf7fe640 1 -- 172.21.15.154:0/696719496 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b80a56f0 con 0x7fe2c015bb60 2024-05-14T01:24:07.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.077+0000 7fe2bf7fe640 1 -- 172.21.15.154:0/696719496 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b80a5890 con 0x7fe2c015bb60 2024-05-14T01:24:07.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.077+0000 7fe2bf7fe640 1 -- 172.21.15.154:0/696719496 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b80a5c60 con 0x7fe2c015bb60 2024-05-14T01:24:07.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c70f4640 1 -- 172.21.15.154:0/696719496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2c015bb60 msgr2=0x7fe2c015bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:07.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c70f4640 1 --2- 172.21.15.154:0/696719496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2c015bb60 0x7fe2c015bf80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00d0ce0 tx=0x7fe2b801c9c0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c70f4640 1 -- 172.21.15.154:0/696719496 shutdown_connections 2024-05-14T01:24:07.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c70f4640 1 --2- 172.21.15.154:0/696719496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2c015bb60 0x7fe2c015bf80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c70f4640 1 --2- 172.21.15.154:0/696719496 >> v2:172.21.15.176:3300/0 conn(0x7fe2c006db80 0x7fe2c00cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c70f4640 1 -- 172.21.15.154:0/696719496 >> 172.21.15.154:0/696719496 conn(0x7fe2c00b1850 msgr2=0x7fe2c00b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:07.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c70f4640 1 -- 172.21.15.154:0/696719496 shutdown_connections 2024-05-14T01:24:07.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c70f4640 1 -- 172.21.15.154:0/696719496 wait complete. 2024-05-14T01:24:07.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c70f4640 1 Processor -- start 2024-05-14T01:24:07.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c70f4640 1 -- start start 2024-05-14T01:24:07.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c70f4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2c006db80 0x7fe2c0159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c70f4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2c01513c0 0x7fe2c0159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c70f4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2c015bb60 0x7fe2c014e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c70f4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c006e990 con 0x7fe2c015bb60 2024-05-14T01:24:07.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c70f4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c006e810 con 0x7fe2c01513c0 2024-05-14T01:24:07.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c70f4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c00b3f40 con 0x7fe2c006db80 2024-05-14T01:24:07.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c5691640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2c015bb60 0x7fe2c014e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c5691640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2c015bb60 0x7fe2c014e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59518/0 (socket says 172.21.15.154:59518) 2024-05-14T01:24:07.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c5691640 1 -- 172.21.15.154:0/3074706910 learned_addr learned my addr 172.21.15.154:0/3074706910 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:07.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2bffff640 1 --2- 172.21.15.154:0/3074706910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2c01513c0 0x7fe2c0159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c4e90640 1 --2- 172.21.15.154:0/3074706910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2c006db80 0x7fe2c0159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c5691640 1 -- 172.21.15.154:0/3074706910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2c006db80 msgr2=0x7fe2c0159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:07.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c5691640 1 --2- 172.21.15.154:0/3074706910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2c006db80 0x7fe2c0159740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c5691640 1 -- 172.21.15.154:0/3074706910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2c01513c0 msgr2=0x7fe2c0159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:07.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c5691640 1 --2- 172.21.15.154:0/3074706910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2c01513c0 0x7fe2c0159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c5691640 1 -- 172.21.15.154:0/3074706910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c0167920 con 0x7fe2c015bb60 2024-05-14T01:24:07.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2bffff640 1 --2- 172.21.15.154:0/3074706910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2c01513c0 0x7fe2c0159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:07.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c5691640 1 --2- 172.21.15.154:0/3074706910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2c015bb60 0x7fe2c014e9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80195d0 tx=0x7fe2b8019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:07.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2bd7fa640 1 -- 172.21.15.154:0/3074706910 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b80bc020 con 0x7fe2c015bb60 2024-05-14T01:24:07.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2bd7fa640 1 -- 172.21.15.154:0/3074706910 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b80b8690 con 0x7fe2c015bb60 2024-05-14T01:24:07.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c70f4640 1 -- 172.21.15.154:0/3074706910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c0167c00 con 0x7fe2c015bb60 2024-05-14T01:24:07.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2bd7fa640 1 -- 172.21.15.154:0/3074706910 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b80b8a80 con 0x7fe2c015bb60 2024-05-14T01:24:07.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.081+0000 7fe2c70f4640 1 -- 172.21.15.154:0/3074706910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c01681c0 con 0x7fe2c015bb60 2024-05-14T01:24:07.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.085+0000 7fe2c70f4640 1 -- 172.21.15.154:0/3074706910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c0075470 con 0x7fe2c015bb60 2024-05-14T01:24:07.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.085+0000 7fe2bd7fa640 1 -- 172.21.15.154:0/3074706910 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe2b80bf020 con 0x7fe2c015bb60 2024-05-14T01:24:07.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.085+0000 7fe2bd7fa640 1 --2- 172.21.15.154:0/3074706910 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe2a40678c0 0x7fe2a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.085+0000 7fe2bd7fa640 1 -- 172.21.15.154:0/3074706910 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe2b8120cb0 con 0x7fe2c015bb60 2024-05-14T01:24:07.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.085+0000 7fe2c4e90640 1 --2- 172.21.15.154:0/3074706910 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe2a40678c0 0x7fe2a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.085+0000 7fe2c4e90640 1 --2- 172.21.15.154:0/3074706910 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe2a40678c0 0x7fe2a4069d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4000f70 tx=0x7fe2b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:07.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.089+0000 7fe2bd7fa640 1 -- 172.21.15.154:0/3074706910 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fe2b80c6030 con 0x7fe2c015bb60 2024-05-14T01:24:07.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.253+0000 7fe2c70f4640 1 -- 172.21.15.154:0/3074706910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2c0158370 con 0x7fe2c015bb60 2024-05-14T01:24:07.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.257+0000 7fe2bd7fa640 1 -- 172.21.15.154:0/3074706910 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7fe2b80165e0 con 0x7fe2c015bb60 2024-05-14T01:24:07.242 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:07.243 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:36.232271+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:07.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.257+0000 7fe2c70f4640 1 -- 172.21.15.154:0/3074706910 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe2a40678c0 msgr2=0x7fe2a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:07.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.257+0000 7fe2c70f4640 1 --2- 172.21.15.154:0/3074706910 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe2a40678c0 0x7fe2a4069d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4000f70 tx=0x7fe2b4009040 comp rx=0 tx=0).stop 2024-05-14T01:24:07.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.257+0000 7fe2c70f4640 1 -- 172.21.15.154:0/3074706910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2c015bb60 msgr2=0x7fe2c014e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:07.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.257+0000 7fe2c70f4640 1 --2- 172.21.15.154:0/3074706910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2c015bb60 0x7fe2c014e9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80195d0 tx=0x7fe2b8019760 comp rx=0 tx=0).stop 2024-05-14T01:24:07.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.257+0000 7fe2c70f4640 1 -- 172.21.15.154:0/3074706910 shutdown_connections 2024-05-14T01:24:07.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.257+0000 7fe2c70f4640 1 --2- 172.21.15.154:0/3074706910 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe2a40678c0 0x7fe2a4069d80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.257+0000 7fe2c70f4640 1 --2- 172.21.15.154:0/3074706910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2c015bb60 0x7fe2c014e9c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.257+0000 7fe2c70f4640 1 --2- 172.21.15.154:0/3074706910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2c01513c0 0x7fe2c0159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.257+0000 7fe2c70f4640 1 --2- 172.21.15.154:0/3074706910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2c006db80 0x7fe2c0159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.257+0000 7fe2c70f4640 1 -- 172.21.15.154:0/3074706910 >> 172.21.15.154:0/3074706910 conn(0x7fe2c00b1850 msgr2=0x7fe2c00b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:07.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.257+0000 7fe2c70f4640 1 -- 172.21.15.154:0/3074706910 shutdown_connections 2024-05-14T01:24:07.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.257+0000 7fe2c70f4640 1 -- 172.21.15.154:0/3074706910 wait complete. 2024-05-14T01:24:07.262 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T01:23:33.083538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T01:23:33.556058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:24:07.263 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:24:07.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.393+0000 7f953ebe3640 1 Processor -- start 2024-05-14T01:24:07.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.393+0000 7f953ebe3640 1 -- start start 2024-05-14T01:24:07.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f953ebe3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95380cf610 0x7f953815fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f953ebe3640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f953815ff80 0x7f953806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f953ebe3640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9538071840 con 0x7f95381458d0 2024-05-14T01:24:07.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f953ebe3640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9538071b20 con 0x7f953815ff80 2024-05-14T01:24:07.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f953ebe3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9538071e00 con 0x7f95380cf610 2024-05-14T01:24:07.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f953c97f640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f95381458d0 0x7f9538071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54484/0 (socket says 172.21.15.154:54484) 2024-05-14T01:24:07.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f953c97f640 1 -- 172.21.15.154:0/3604153713 learned_addr learned my addr 172.21.15.154:0/3604153713 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:07.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f953d180640 1 --2- 172.21.15.154:0/3604153713 >> v2:172.21.15.176:3300/0 conn(0x7f953815ff80 0x7f953806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f9537fff640 1 --2- 172.21.15.154:0/3604153713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95380cf610 0x7f953815fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f95377fe640 1 -- 172.21.15.154:0/3604153713 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 392883629 0 0) 0x7f9538071840 con 0x7f95381458d0 2024-05-14T01:24:07.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f95377fe640 1 -- 172.21.15.154:0/3604153713 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9520003530 con 0x7f95381458d0 2024-05-14T01:24:07.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f95377fe640 1 -- 172.21.15.154:0/3604153713 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3997163806 0 0) 0x7f9520003530 con 0x7f95381458d0 2024-05-14T01:24:07.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f95377fe640 1 -- 172.21.15.154:0/3604153713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95380cf610 msgr2=0x7f953815fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:07.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f95377fe640 1 --2- 172.21.15.154:0/3604153713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95380cf610 0x7f953815fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f95377fe640 1 -- 172.21.15.154:0/3604153713 >> v2:172.21.15.176:3300/0 conn(0x7f953815ff80 msgr2=0x7f953806ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:07.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f95377fe640 1 --2- 172.21.15.154:0/3604153713 >> v2:172.21.15.176:3300/0 conn(0x7f953815ff80 0x7f953806ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f95377fe640 1 -- 172.21.15.154:0/3604153713 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95380720e0 con 0x7f95381458d0 2024-05-14T01:24:07.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f95377fe640 1 -- 172.21.15.154:0/3604153713 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f952c001a00 con 0x7f95381458d0 2024-05-14T01:24:07.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f95377fe640 1 -- 172.21.15.154:0/3604153713 >> v1:172.21.15.154:6789/0 conn(0x7f95381458d0 legacy=0x7f9538071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f95377fe640 1 --2- 172.21.15.154:0/3604153713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95200039c0 0x7f9520003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f95377fe640 1 --2- 172.21.15.154:0/3604153713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9520004810 0x7f9520004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f95377fe640 1 --2- 172.21.15.154:0/3604153713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95380cf610 0x7f95200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f95377fe640 1 -- 172.21.15.154:0/3604153713 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9538071b20 con 0x7f9520004810 2024-05-14T01:24:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f95377fe640 1 -- 172.21.15.154:0/3604153713 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9538071e00 con 0x7f95200039c0 2024-05-14T01:24:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f95377fe640 1 -- 172.21.15.154:0/3604153713 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f952000b9d0 con 0x7f95380cf610 2024-05-14T01:24:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f9537fff640 1 --2- 172.21.15.154:0/3604153713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9520004810 0x7f9520004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f953d180640 1 --2- 172.21.15.154:0/3604153713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95380cf610 0x7f95200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f9537fff640 1 -- 172.21.15.154:0/3604153713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95380cf610 msgr2=0x7f95200051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f953c97f640 1 --2- 172.21.15.154:0/3604153713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95200039c0 0x7f9520003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f9537fff640 1 --2- 172.21.15.154:0/3604153713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95380cf610 0x7f95200051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f9537fff640 1 -- 172.21.15.154:0/3604153713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95200039c0 msgr2=0x7f9520003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f9537fff640 1 --2- 172.21.15.154:0/3604153713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95200039c0 0x7f9520003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f9537fff640 1 -- 172.21.15.154:0/3604153713 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9520003530 con 0x7f9520004810 2024-05-14T01:24:07.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f953d180640 1 --2- 172.21.15.154:0/3604153713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95380cf610 0x7f95200051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:07.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.397+0000 7f953c97f640 1 --2- 172.21.15.154:0/3604153713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95200039c0 0x7f9520003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:07.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f9537fff640 1 --2- 172.21.15.154:0/3604153713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9520004810 0x7f9520004c90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9528009ac0 tx=0x7f952801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d15b03541721884 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:07.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f95377fe640 1 -- 172.21.15.154:0/3604153713 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95280b2070 con 0x7f9520004810 2024-05-14T01:24:07.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f95377fe640 1 -- 172.21.15.154:0/3604153713 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95280a5560 con 0x7f9520004810 2024-05-14T01:24:07.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f95377fe640 1 -- 172.21.15.154:0/3604153713 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9528009690 con 0x7f9520004810 2024-05-14T01:24:07.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953ebe3640 1 -- 172.21.15.154:0/3604153713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9520004810 msgr2=0x7f9520004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:07.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953ebe3640 1 --2- 172.21.15.154:0/3604153713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9520004810 0x7f9520004c90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9528009ac0 tx=0x7f952801ca50 comp rx=0 tx=0).stop 2024-05-14T01:24:07.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953d180640 1 -- 172.21.15.154:0/3604153713 reap_dead start 2024-05-14T01:24:07.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953ebe3640 1 -- 172.21.15.154:0/3604153713 shutdown_connections 2024-05-14T01:24:07.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953ebe3640 1 -- 172.21.15.154:0/3604153713 >> 172.21.15.154:0/3604153713 conn(0x7f95380b1770 msgr2=0x7f95380b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:07.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953ebe3640 1 -- 172.21.15.154:0/3604153713 shutdown_connections 2024-05-14T01:24:07.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953ebe3640 1 -- 172.21.15.154:0/3604153713 wait complete. 2024-05-14T01:24:07.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953ebe3640 1 Processor -- start 2024-05-14T01:24:07.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953ebe3640 1 -- start start 2024-05-14T01:24:07.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953ebe3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9520004810 0x7f953814d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953ebe3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95381435d0 0x7f95381e5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953ebe3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9538144b70 0x7f95380ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953ebe3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9538072a60 con 0x7f9538144b70 2024-05-14T01:24:07.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953ebe3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f95380728e0 con 0x7f95381435d0 2024-05-14T01:24:07.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953ebe3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f953815fa40 con 0x7f9520004810 2024-05-14T01:24:07.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953d180640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9538144b70 0x7f95380ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953d180640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9538144b70 0x7f95380ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59152/0 (socket says 172.21.15.154:59152) 2024-05-14T01:24:07.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953d180640 1 -- 172.21.15.154:0/3904743182 learned_addr learned my addr 172.21.15.154:0/3904743182 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:07.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f9537fff640 1 --2- 172.21.15.154:0/3904743182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95381435d0 0x7f95381e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.401+0000 7f953c97f640 1 --2- 172.21.15.154:0/3904743182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9520004810 0x7f953814d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.405+0000 7f953d180640 1 -- 172.21.15.154:0/3904743182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9520004810 msgr2=0x7f953814d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:07.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.405+0000 7f953d180640 1 --2- 172.21.15.154:0/3904743182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9520004810 0x7f953814d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.405+0000 7f953d180640 1 -- 172.21.15.154:0/3904743182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95381435d0 msgr2=0x7f95381e5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:07.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.405+0000 7f953d180640 1 --2- 172.21.15.154:0/3904743182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95381435d0 0x7f95381e5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.405+0000 7f953d180640 1 -- 172.21.15.154:0/3904743182 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9538143ad0 con 0x7f9538144b70 2024-05-14T01:24:07.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.405+0000 7f953c97f640 1 --2- 172.21.15.154:0/3904743182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9520004810 0x7f953814d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:07.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.405+0000 7f953d180640 1 --2- 172.21.15.154:0/3904743182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9538144b70 0x7f95380ce240 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9538160360 tx=0x7f9530010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:07.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.405+0000 7f95357fa640 1 -- 172.21.15.154:0/3904743182 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953000f040 con 0x7f9538144b70 2024-05-14T01:24:07.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.405+0000 7f95357fa640 1 -- 172.21.15.154:0/3904743182 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f953001c070 con 0x7f9538144b70 2024-05-14T01:24:07.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.405+0000 7f953ebe3640 1 -- 172.21.15.154:0/3904743182 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9538143db0 con 0x7f9538144b70 2024-05-14T01:24:07.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.405+0000 7f95357fa640 1 -- 172.21.15.154:0/3904743182 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953000ea40 con 0x7f9538144b70 2024-05-14T01:24:07.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.405+0000 7f953ebe3640 1 -- 172.21.15.154:0/3904743182 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9538144370 con 0x7f9538144b70 2024-05-14T01:24:07.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.405+0000 7f953ebe3640 1 -- 172.21.15.154:0/3904743182 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9538075470 con 0x7f9538144b70 2024-05-14T01:24:07.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.405+0000 7f95357fa640 1 -- 172.21.15.154:0/3904743182 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f953000ebe0 con 0x7f9538144b70 2024-05-14T01:24:07.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.405+0000 7f95357fa640 1 --2- 172.21.15.154:0/3904743182 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f95240678f0 0x7f9524069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.405+0000 7f953c97f640 1 --2- 172.21.15.154:0/3904743182 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f95240678f0 0x7f9524069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.405+0000 7f95357fa640 1 -- 172.21.15.154:0/3904743182 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9530085a20 con 0x7f9538144b70 2024-05-14T01:24:07.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.405+0000 7f953c97f640 1 --2- 172.21.15.154:0/3904743182 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f95240678f0 0x7f9524069db0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f952c001bb0 tx=0x7f952c0017c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:07.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.409+0000 7f95357fa640 1 -- 172.21.15.154:0/3904743182 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f9530056560 con 0x7f9538144b70 2024-05-14T01:24:07.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.573+0000 7f953ebe3640 1 -- 172.21.15.154:0/3904743182 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f95380cee80 con 0x7f9538144b70 2024-05-14T01:24:07.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.573+0000 7f95357fa640 1 -- 172.21.15.154:0/3904743182 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f9530055e60 con 0x7f9538144b70 2024-05-14T01:24:07.558 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:24:07.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.573+0000 7f953ebe3640 1 -- 172.21.15.154:0/3904743182 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f95240678f0 msgr2=0x7f9524069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:07.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.573+0000 7f953ebe3640 1 --2- 172.21.15.154:0/3904743182 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f95240678f0 0x7f9524069db0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f952c001bb0 tx=0x7f952c0017c0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.573+0000 7f953ebe3640 1 -- 172.21.15.154:0/3904743182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9538144b70 msgr2=0x7f95380ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:07.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.573+0000 7f953ebe3640 1 --2- 172.21.15.154:0/3904743182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9538144b70 0x7f95380ce240 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9538160360 tx=0x7f9530010c20 comp rx=0 tx=0).stop 2024-05-14T01:24:07.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.573+0000 7f953ebe3640 1 -- 172.21.15.154:0/3904743182 shutdown_connections 2024-05-14T01:24:07.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.573+0000 7f953ebe3640 1 --2- 172.21.15.154:0/3904743182 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f95240678f0 0x7f9524069db0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.573+0000 7f953ebe3640 1 --2- 172.21.15.154:0/3904743182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9538144b70 0x7f95380ce240 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.573+0000 7f953ebe3640 1 --2- 172.21.15.154:0/3904743182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95381435d0 0x7f95381e5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.573+0000 7f953ebe3640 1 --2- 172.21.15.154:0/3904743182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9520004810 0x7f953814d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.573+0000 7f953ebe3640 1 -- 172.21.15.154:0/3904743182 >> 172.21.15.154:0/3904743182 conn(0x7f95380b1770 msgr2=0x7f9538071060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:07.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.573+0000 7f953ebe3640 1 -- 172.21.15.154:0/3904743182 shutdown_connections 2024-05-14T01:24:07.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.573+0000 7f953ebe3640 1 -- 172.21.15.154:0/3904743182 wait complete. 2024-05-14T01:24:07.577 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T01:24:07.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.713+0000 7fe55da5e640 1 Processor -- start 2024-05-14T01:24:07.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.713+0000 7fe55da5e640 1 -- start start 2024-05-14T01:24:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.713+0000 7fe55da5e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5580d0210 0x7fe5580d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.713+0000 7fe55da5e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe5580cd390 0x7fe5580cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.713+0000 7fe55da5e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5580ce760 0x7fe5580cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.713+0000 7fe55da5e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe5580cdd50 con 0x7fe5580ce760 2024-05-14T01:24:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.713+0000 7fe55da5e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe5580d1e10 con 0x7fe5580cd390 2024-05-14T01:24:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.713+0000 7fe55da5e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe5580b1be0 con 0x7fe5580d0210 2024-05-14T01:24:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.713+0000 7fe5577fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5580ce760 0x7fe5580cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.713+0000 7fe5577fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5580ce760 0x7fe5580cebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59160/0 (socket says 172.21.15.154:59160) 2024-05-14T01:24:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.713+0000 7fe5577fe640 1 -- 172.21.15.154:0/3251362946 learned_addr learned my addr 172.21.15.154:0/3251362946 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.713+0000 7fe5567fc640 1 --2- 172.21.15.154:0/3251362946 >> v2:172.21.15.176:3300/0 conn(0x7fe5580cd390 0x7fe5580cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.713+0000 7fe556ffd640 1 --2- 172.21.15.154:0/3251362946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5580d0210 0x7fe5580d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.713+0000 7fe5577fe640 1 -- 172.21.15.154:0/3251362946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5580d0210 msgr2=0x7fe5580d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.713+0000 7fe5577fe640 1 --2- 172.21.15.154:0/3251362946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5580d0210 0x7fe5580d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.713+0000 7fe5577fe640 1 -- 172.21.15.154:0/3251362946 >> v2:172.21.15.176:3300/0 conn(0x7fe5580cd390 msgr2=0x7fe5580cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.713+0000 7fe5577fe640 1 --2- 172.21.15.154:0/3251362946 >> v2:172.21.15.176:3300/0 conn(0x7fe5580cd390 0x7fe5580cd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.713+0000 7fe5577fe640 1 -- 172.21.15.154:0/3251362946 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5580d0b30 con 0x7fe5580ce760 2024-05-14T01:24:07.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe5577fe640 1 --2- 172.21.15.154:0/3251362946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5580ce760 0x7fe5580cebf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe5580b4960 tx=0x7fe54801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d198dbedd12be4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:07.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe555ffb640 1 -- 172.21.15.154:0/3251362946 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5480ab620 con 0x7fe5580ce760 2024-05-14T01:24:07.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe555ffb640 1 -- 172.21.15.154:0/3251362946 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5480b0070 con 0x7fe5580ce760 2024-05-14T01:24:07.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe555ffb640 1 -- 172.21.15.154:0/3251362946 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5480ab9e0 con 0x7fe5580ce760 2024-05-14T01:24:07.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe55da5e640 1 -- 172.21.15.154:0/3251362946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5580ce760 msgr2=0x7fe5580cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:07.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe55da5e640 1 --2- 172.21.15.154:0/3251362946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5580ce760 0x7fe5580cebf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe5580b4960 tx=0x7fe54801c460 comp rx=0 tx=0).stop 2024-05-14T01:24:07.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe55da5e640 1 -- 172.21.15.154:0/3251362946 shutdown_connections 2024-05-14T01:24:07.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe55da5e640 1 --2- 172.21.15.154:0/3251362946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5580ce760 0x7fe5580cebf0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe55da5e640 1 --2- 172.21.15.154:0/3251362946 >> v2:172.21.15.176:3300/0 conn(0x7fe5580cd390 0x7fe5580cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe55da5e640 1 --2- 172.21.15.154:0/3251362946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5580d0210 0x7fe5580d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe55da5e640 1 -- 172.21.15.154:0/3251362946 >> 172.21.15.154:0/3251362946 conn(0x7fe55809aa10 msgr2=0x7fe55809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:07.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe55da5e640 1 -- 172.21.15.154:0/3251362946 shutdown_connections 2024-05-14T01:24:07.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe55da5e640 1 -- 172.21.15.154:0/3251362946 wait complete. 2024-05-14T01:24:07.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe55da5e640 1 Processor -- start 2024-05-14T01:24:07.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe55da5e640 1 -- start start 2024-05-14T01:24:07.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe55da5e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5580cd390 0x7fe558164b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe55da5e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5580ce760 0x7fe558165510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe55da5e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5580d0210 0x7fe558156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe55da5e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe55815c2a0 con 0x7fe5580d0210 2024-05-14T01:24:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe55da5e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe5580b1870 con 0x7fe5580ce760 2024-05-14T01:24:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe55da5e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe55815c420 con 0x7fe5580cd390 2024-05-14T01:24:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe5577fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5580d0210 0x7fe558156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe5577fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5580d0210 0x7fe558156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59162/0 (socket says 172.21.15.154:59162) 2024-05-14T01:24:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.717+0000 7fe5577fe640 1 -- 172.21.15.154:0/2782359850 learned_addr learned my addr 172.21.15.154:0/2782359850 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.721+0000 7fe556ffd640 1 --2- 172.21.15.154:0/2782359850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5580cd390 0x7fe558164b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.721+0000 7fe5577fe640 1 -- 172.21.15.154:0/2782359850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5580cd390 msgr2=0x7fe558164b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.721+0000 7fe5577fe640 1 --2- 172.21.15.154:0/2782359850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5580cd390 0x7fe558164b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.721+0000 7fe5577fe640 1 -- 172.21.15.154:0/2782359850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5580ce760 msgr2=0x7fe558165510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.721+0000 7fe5577fe640 1 --2- 172.21.15.154:0/2782359850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5580ce760 0x7fe558165510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.721+0000 7fe5577fe640 1 -- 172.21.15.154:0/2782359850 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe558165ef0 con 0x7fe5580d0210 2024-05-14T01:24:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.721+0000 7fe5577fe640 1 --2- 172.21.15.154:0/2782359850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5580d0210 0x7fe558156110 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe54801cd00 tx=0x7fe54801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.721+0000 7fe54ffff640 1 -- 172.21.15.154:0/2782359850 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5480abd20 con 0x7fe5580d0210 2024-05-14T01:24:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.721+0000 7fe54ffff640 1 -- 172.21.15.154:0/2782359850 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5480be3f0 con 0x7fe5580d0210 2024-05-14T01:24:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.721+0000 7fe55da5e640 1 -- 172.21.15.154:0/2782359850 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe558163d50 con 0x7fe5580d0210 2024-05-14T01:24:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.721+0000 7fe54ffff640 1 -- 172.21.15.154:0/2782359850 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5480be7e0 con 0x7fe5580d0210 2024-05-14T01:24:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.721+0000 7fe55da5e640 1 -- 172.21.15.154:0/2782359850 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe558164310 con 0x7fe5580d0210 2024-05-14T01:24:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.721+0000 7fe55da5e640 1 -- 172.21.15.154:0/2782359850 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe558068360 con 0x7fe5580d0210 2024-05-14T01:24:07.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.721+0000 7fe54ffff640 1 -- 172.21.15.154:0/2782359850 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe5480b43f0 con 0x7fe5580d0210 2024-05-14T01:24:07.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.721+0000 7fe54ffff640 1 --2- 172.21.15.154:0/2782359850 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe5380678c0 0x7fe538069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:07.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.721+0000 7fe54ffff640 1 -- 172.21.15.154:0/2782359850 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe548120050 con 0x7fe5580d0210 2024-05-14T01:24:07.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.721+0000 7fe556ffd640 1 --2- 172.21.15.154:0/2782359850 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe5380678c0 0x7fe538069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:07.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.721+0000 7fe556ffd640 1 --2- 172.21.15.154:0/2782359850 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe5380678c0 0x7fe538069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe558157450 tx=0x7fe55000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:07.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.725+0000 7fe54ffff640 1 -- 172.21.15.154:0/2782359850 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fe5480c4060 con 0x7fe5580d0210 2024-05-14T01:24:07.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.885+0000 7fe55da5e640 1 -- 172.21.15.154:0/2782359850 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe5580c4fe0 con 0x7fe5580d0210 2024-05-14T01:24:07.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.885+0000 7fe54ffff640 1 -- 172.21.15.154:0/2782359850 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fe548016110 con 0x7fe5580d0210 2024-05-14T01:24:07.871 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-05-14T01:24:07.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.885+0000 7fe55da5e640 1 -- 172.21.15.154:0/2782359850 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe5380678c0 msgr2=0x7fe538069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:07.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.885+0000 7fe55da5e640 1 --2- 172.21.15.154:0/2782359850 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe5380678c0 0x7fe538069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe558157450 tx=0x7fe55000b040 comp rx=0 tx=0).stop 2024-05-14T01:24:07.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.885+0000 7fe55da5e640 1 -- 172.21.15.154:0/2782359850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5580d0210 msgr2=0x7fe558156110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:07.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.885+0000 7fe55da5e640 1 --2- 172.21.15.154:0/2782359850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5580d0210 0x7fe558156110 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe54801cd00 tx=0x7fe54801aca0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.889+0000 7fe55da5e640 1 -- 172.21.15.154:0/2782359850 shutdown_connections 2024-05-14T01:24:07.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.889+0000 7fe55da5e640 1 --2- 172.21.15.154:0/2782359850 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe5380678c0 0x7fe538069d80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.889+0000 7fe55da5e640 1 --2- 172.21.15.154:0/2782359850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5580d0210 0x7fe558156110 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.889+0000 7fe55da5e640 1 --2- 172.21.15.154:0/2782359850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5580ce760 0x7fe558165510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.889+0000 7fe55da5e640 1 --2- 172.21.15.154:0/2782359850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5580cd390 0x7fe558164b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:07.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.889+0000 7fe55da5e640 1 -- 172.21.15.154:0/2782359850 >> 172.21.15.154:0/2782359850 conn(0x7fe55809aa10 msgr2=0x7fe558070600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:07.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.889+0000 7fe55da5e640 1 -- 172.21.15.154:0/2782359850 shutdown_connections 2024-05-14T01:24:07.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:07.889+0000 7fe55da5e640 1 -- 172.21.15.154:0/2782359850 wait complete. 2024-05-14T01:24:07.890 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T01:24:08.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.021+0000 7f85fe37e640 1 Processor -- start 2024-05-14T01:24:08.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.021+0000 7f85fe37e640 1 -- start start 2024-05-14T01:24:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fe37e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f85f8071ef0 0x7f85f80722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fe37e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85f80cf1b0 0x7f85f80b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fe37e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f8072810 con 0x7f85f80ced50 2024-05-14T01:24:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fe37e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f85f80ce8c0 con 0x7f85f80cf1b0 2024-05-14T01:24:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fe37e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f85f80cdcb0 con 0x7f85f8071ef0 2024-05-14T01:24:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85f77fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f85f80ced50 0x7f85f80cd160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54486/0 (socket says 172.21.15.154:54486) 2024-05-14T01:24:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85f77fe640 1 -- 172.21.15.154:0/175539810 learned_addr learned my addr 172.21.15.154:0/175539810 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fc91b640 1 --2- 172.21.15.154:0/175539810 >> v2:172.21.15.154:3300/0 conn(0x7f85f80cf1b0 0x7f85f80b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85f7fff640 1 --2- 172.21.15.154:0/175539810 >> v2:172.21.15.176:3300/0 conn(0x7f85f8071ef0 0x7f85f80722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fc91b640 1 -- 172.21.15.154:0/175539810 >> v2:172.21.15.176:3300/0 conn(0x7f85f8071ef0 msgr2=0x7f85f80722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fc91b640 1 --2- 172.21.15.154:0/175539810 >> v2:172.21.15.176:3300/0 conn(0x7f85f8071ef0 0x7f85f80722d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fc91b640 1 -- 172.21.15.154:0/175539810 >> v1:172.21.15.154:6789/0 conn(0x7f85f80ced50 legacy=0x7f85f80cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fc91b640 1 -- 172.21.15.154:0/175539810 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f80cdf90 con 0x7f85f80cf1b0 2024-05-14T01:24:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85f6ffd640 1 -- 172.21.15.154:0/175539810 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 657105777 0 0) 0x7f85f8072810 con 0x7f85f80ced50 2024-05-14T01:24:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85f7fff640 1 --2- 172.21.15.154:0/175539810 >> v2:172.21.15.176:3300/0 conn(0x7f85f8071ef0 0x7f85f80722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:08.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fc91b640 1 --2- 172.21.15.154:0/175539810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85f80cf1b0 0x7f85f80b2a70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f85f8073a40 tx=0x7f85f001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82d2ca21ae93b0f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:08.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85f6ffd640 1 -- 172.21.15.154:0/175539810 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f00b2070 con 0x7f85f80cf1b0 2024-05-14T01:24:08.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85f6ffd640 1 -- 172.21.15.154:0/175539810 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85f00a58d0 con 0x7f85f80cf1b0 2024-05-14T01:24:08.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85f6ffd640 1 -- 172.21.15.154:0/175539810 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f00a5ca0 con 0x7f85f80cf1b0 2024-05-14T01:24:08.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fe37e640 1 -- 172.21.15.154:0/175539810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85f80cf1b0 msgr2=0x7f85f80b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fe37e640 1 --2- 172.21.15.154:0/175539810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85f80cf1b0 0x7f85f80b2a70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f85f8073a40 tx=0x7f85f001c900 comp rx=0 tx=0).stop 2024-05-14T01:24:08.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fe37e640 1 -- 172.21.15.154:0/175539810 shutdown_connections 2024-05-14T01:24:08.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fe37e640 1 --2- 172.21.15.154:0/175539810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85f80cf1b0 0x7f85f80b2a70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fe37e640 1 --2- 172.21.15.154:0/175539810 >> v2:172.21.15.176:3300/0 conn(0x7f85f8071ef0 0x7f85f80722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fe37e640 1 -- 172.21.15.154:0/175539810 >> 172.21.15.154:0/175539810 conn(0x7f85f80b1770 msgr2=0x7f85f80b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:08.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fe37e640 1 -- 172.21.15.154:0/175539810 shutdown_connections 2024-05-14T01:24:08.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.025+0000 7f85fe37e640 1 -- 172.21.15.154:0/175539810 wait complete. 2024-05-14T01:24:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fe37e640 1 Processor -- start 2024-05-14T01:24:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fe37e640 1 -- start start 2024-05-14T01:24:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fe37e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85f8071ef0 0x7f85f8158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fe37e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85f80ced50 0x7f85f8141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fe37e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85f80cf1b0 0x7f85f8158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fe37e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f85f806eb10 con 0x7f85f80cf1b0 2024-05-14T01:24:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fe37e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f85f806e990 con 0x7f85f8071ef0 2024-05-14T01:24:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fe37e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f85f80cd870 con 0x7f85f80ced50 2024-05-14T01:24:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fc91b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85f80cf1b0 0x7f85f8158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fc91b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85f80cf1b0 0x7f85f8158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59178/0 (socket says 172.21.15.154:59178) 2024-05-14T01:24:08.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fc91b640 1 -- 172.21.15.154:0/390614982 learned_addr learned my addr 172.21.15.154:0/390614982 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:08.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85f7fff640 1 --2- 172.21.15.154:0/390614982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85f8071ef0 0x7f85f8158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fc91b640 1 -- 172.21.15.154:0/390614982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85f80ced50 msgr2=0x7f85f8141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fc91b640 1 --2- 172.21.15.154:0/390614982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85f80ced50 0x7f85f8141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fc91b640 1 -- 172.21.15.154:0/390614982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85f8071ef0 msgr2=0x7f85f8158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fc91b640 1 --2- 172.21.15.154:0/390614982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85f8071ef0 0x7f85f8158940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fc91b640 1 -- 172.21.15.154:0/390614982 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f8140460 con 0x7f85f80cf1b0 2024-05-14T01:24:08.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fc91b640 1 --2- 172.21.15.154:0/390614982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85f80cf1b0 0x7f85f8158090 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f85f0019510 tx=0x7f85f00196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:08.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85f4ff9640 1 -- 172.21.15.154:0/390614982 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f00b2050 con 0x7f85f80cf1b0 2024-05-14T01:24:08.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85f4ff9640 1 -- 172.21.15.154:0/390614982 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85f00be070 con 0x7f85f80cf1b0 2024-05-14T01:24:08.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fe37e640 1 -- 172.21.15.154:0/390614982 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f8140740 con 0x7f85f80cf1b0 2024-05-14T01:24:08.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85f4ff9640 1 -- 172.21.15.154:0/390614982 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f00ada70 con 0x7f85f80cf1b0 2024-05-14T01:24:08.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fe37e640 1 -- 172.21.15.154:0/390614982 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f8140d00 con 0x7f85f80cf1b0 2024-05-14T01:24:08.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.029+0000 7f85fe37e640 1 -- 172.21.15.154:0/390614982 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f8075470 con 0x7f85f80cf1b0 2024-05-14T01:24:08.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.033+0000 7f85f4ff9640 1 -- 172.21.15.154:0/390614982 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f85f00adc10 con 0x7f85f80cf1b0 2024-05-14T01:24:08.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.033+0000 7f85f4ff9640 1 --2- 172.21.15.154:0/390614982 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f85e40678c0 0x7f85e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.033+0000 7f85f4ff9640 1 -- 172.21.15.154:0/390614982 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f85f0120f80 con 0x7f85f80cf1b0 2024-05-14T01:24:08.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.033+0000 7f85f7fff640 1 --2- 172.21.15.154:0/390614982 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f85e40678c0 0x7f85e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.033+0000 7f85f7fff640 1 --2- 172.21.15.154:0/390614982 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f85e40678c0 0x7f85e4069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f85e8006fd0 tx=0x7f85e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:08.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.037+0000 7f85f4ff9640 1 -- 172.21.15.154:0/390614982 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f85f0016520 con 0x7f85f80cf1b0 2024-05-14T01:24:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.185+0000 7f85fe37e640 1 -- 172.21.15.154:0/390614982 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f85f806d0f0 con 0x7f85f80cf1b0 2024-05-14T01:24:08.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.185+0000 7f85f4ff9640 1 -- 172.21.15.154:0/390614982 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f85f00ab340 con 0x7f85f80cf1b0 2024-05-14T01:24:08.171 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-05-14T01:24:08.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.185+0000 7f85fe37e640 1 -- 172.21.15.154:0/390614982 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f85e40678c0 msgr2=0x7f85e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.185+0000 7f85fe37e640 1 --2- 172.21.15.154:0/390614982 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f85e40678c0 0x7f85e4069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f85e8006fd0 tx=0x7f85e8008040 comp rx=0 tx=0).stop 2024-05-14T01:24:08.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.185+0000 7f85fe37e640 1 -- 172.21.15.154:0/390614982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85f80cf1b0 msgr2=0x7f85f8158090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.185+0000 7f85fe37e640 1 --2- 172.21.15.154:0/390614982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85f80cf1b0 0x7f85f8158090 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f85f0019510 tx=0x7f85f00196a0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.185+0000 7f85fe37e640 1 -- 172.21.15.154:0/390614982 shutdown_connections 2024-05-14T01:24:08.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.185+0000 7f85fe37e640 1 --2- 172.21.15.154:0/390614982 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f85e40678c0 0x7f85e4069d80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.185+0000 7f85fe37e640 1 --2- 172.21.15.154:0/390614982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85f80cf1b0 0x7f85f8158090 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.185+0000 7f85fe37e640 1 --2- 172.21.15.154:0/390614982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85f80ced50 0x7f85f8141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.185+0000 7f85fe37e640 1 --2- 172.21.15.154:0/390614982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85f8071ef0 0x7f85f8158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.185+0000 7f85fe37e640 1 -- 172.21.15.154:0/390614982 >> 172.21.15.154:0/390614982 conn(0x7f85f80b1770 msgr2=0x7f85f815a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:08.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.189+0000 7f85fe37e640 1 -- 172.21.15.154:0/390614982 shutdown_connections 2024-05-14T01:24:08.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.189+0000 7f85fe37e640 1 -- 172.21.15.154:0/390614982 wait complete. 2024-05-14T01:24:08.189 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T01:24:08.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc2a0b5e640 1 Processor -- start 2024-05-14T01:24:08.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc2a0b5e640 1 -- start start 2024-05-14T01:24:08.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc2a0b5e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc29c144760 0x7fc29c06e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc2a0b5e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc29c144b40 con 0x7fc29c0b3530 2024-05-14T01:24:08.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc2a0b5e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc29c0b3a40 con 0x7fc29c15bae0 2024-05-14T01:24:08.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc2a0b5e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc29c0b4650 con 0x7fc29c144760 2024-05-14T01:24:08.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc299d9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc29c0b3530 0x7fc29c15b3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54494/0 (socket says 172.21.15.154:54494) 2024-05-14T01:24:08.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc299d9b640 1 -- 172.21.15.154:0/168123157 learned_addr learned my addr 172.21.15.154:0/168123157 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:08.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29a59c640 1 --2- 172.21.15.154:0/168123157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc29c144760 0x7fc29c06e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29959a640 1 -- 172.21.15.154:0/168123157 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1966290663 0 0) 0x7fc29c144b40 con 0x7fc29c0b3530 2024-05-14T01:24:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29959a640 1 -- 172.21.15.154:0/168123157 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc284005740 con 0x7fc29c0b3530 2024-05-14T01:24:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29959a640 1 -- 172.21.15.154:0/168123157 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 95608995 0 0) 0x7fc29c0b3a40 con 0x7fc29c15bae0 2024-05-14T01:24:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29959a640 1 -- 172.21.15.154:0/168123157 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc29c144b40 con 0x7fc29c15bae0 2024-05-14T01:24:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29959a640 1 -- 172.21.15.154:0/168123157 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2614299953 0 0) 0x7fc284005740 con 0x7fc29c0b3530 2024-05-14T01:24:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29959a640 1 -- 172.21.15.154:0/168123157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc29c144760 msgr2=0x7fc29c06e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29959a640 1 --2- 172.21.15.154:0/168123157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc29c144760 0x7fc29c06e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29959a640 1 -- 172.21.15.154:0/168123157 >> v1:172.21.15.176:6789/0 conn(0x7fc29c15bae0 legacy=0x7fc29c15c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29959a640 1 -- 172.21.15.154:0/168123157 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29c0b3d20 con 0x7fc29c0b3530 2024-05-14T01:24:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29959a640 1 -- 172.21.15.154:0/168123157 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fc290001680 con 0x7fc29c0b3530 2024-05-14T01:24:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29959a640 1 -- 172.21.15.154:0/168123157 >> v1:172.21.15.154:6789/0 conn(0x7fc29c0b3530 legacy=0x7fc29c15b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29959a640 1 --2- 172.21.15.154:0/168123157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc284005d90 0x7fc284006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29959a640 1 --2- 172.21.15.154:0/168123157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc29c144760 0x7fc284006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29959a640 1 --2- 172.21.15.154:0/168123157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc284006f60 0x7fc2840073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29959a640 1 -- 172.21.15.154:0/168123157 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c0b4650 con 0x7fc284006f60 2024-05-14T01:24:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29959a640 1 -- 172.21.15.154:0/168123157 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc28400dc90 con 0x7fc284005d90 2024-05-14T01:24:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29959a640 1 -- 172.21.15.154:0/168123157 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc28400de40 con 0x7fc29c144760 2024-05-14T01:24:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29ad9d640 1 --2- 172.21.15.154:0/168123157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc284006f60 0x7fc2840073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29a59c640 1 --2- 172.21.15.154:0/168123157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc284005d90 0x7fc284006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc299d9b640 1 --2- 172.21.15.154:0/168123157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc29c144760 0x7fc284006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29ad9d640 1 -- 172.21.15.154:0/168123157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc29c144760 msgr2=0x7fc284006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29ad9d640 1 --2- 172.21.15.154:0/168123157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc29c144760 0x7fc284006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29ad9d640 1 -- 172.21.15.154:0/168123157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc284005d90 msgr2=0x7fc284006190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29ad9d640 1 --2- 172.21.15.154:0/168123157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc284005d90 0x7fc284006190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29ad9d640 1 -- 172.21.15.154:0/168123157 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc284005740 con 0x7fc284006f60 2024-05-14T01:24:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.325+0000 7fc29a59c640 1 --2- 172.21.15.154:0/168123157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc284005d90 0x7fc284006190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc29ad9d640 1 --2- 172.21.15.154:0/168123157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc284006f60 0x7fc2840073e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc294001fd0 tx=0x7fc29401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a47f73cec84d1b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc29959a640 1 -- 172.21.15.154:0/168123157 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc294001c20 con 0x7fc284006f60 2024-05-14T01:24:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc29959a640 1 -- 172.21.15.154:0/168123157 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc294003ba0 con 0x7fc284006f60 2024-05-14T01:24:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc29959a640 1 -- 172.21.15.154:0/168123157 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2940050d0 con 0x7fc284006f60 2024-05-14T01:24:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc2a0b5e640 1 -- 172.21.15.154:0/168123157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc284006f60 msgr2=0x7fc2840073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc2a0b5e640 1 --2- 172.21.15.154:0/168123157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc284006f60 0x7fc2840073e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc294001fd0 tx=0x7fc29401c900 comp rx=0 tx=0).stop 2024-05-14T01:24:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc29ad9d640 1 -- 172.21.15.154:0/168123157 reap_dead start 2024-05-14T01:24:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc2a0b5e640 1 -- 172.21.15.154:0/168123157 shutdown_connections 2024-05-14T01:24:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc2a0b5e640 1 -- 172.21.15.154:0/168123157 >> 172.21.15.154:0/168123157 conn(0x7fc29c0b1850 msgr2=0x7fc29c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc2a0b5e640 1 -- 172.21.15.154:0/168123157 shutdown_connections 2024-05-14T01:24:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc2a0b5e640 1 -- 172.21.15.154:0/168123157 wait complete. 2024-05-14T01:24:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc2a0b5e640 1 Processor -- start 2024-05-14T01:24:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc2a0b5e640 1 -- start start 2024-05-14T01:24:08.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc2a0b5e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc29c13d6d0 0x7fc29c1f3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc2a0b5e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc29c1e5000 0x7fc29c15cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc2a0b5e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc29c15d2e0 0x7fc29c14afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc2a0b5e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c06e680 con 0x7fc29c15d2e0 2024-05-14T01:24:08.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc2a0b5e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c0b42e0 con 0x7fc29c13d6d0 2024-05-14T01:24:08.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc2a0b5e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc29c06e800 con 0x7fc29c1e5000 2024-05-14T01:24:08.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.329+0000 7fc29ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc29c15d2e0 0x7fc29c14afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc29ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc29c15d2e0 0x7fc29c14afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59200/0 (socket says 172.21.15.154:59200) 2024-05-14T01:24:08.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc29ad9d640 1 -- 172.21.15.154:0/2986209096 learned_addr learned my addr 172.21.15.154:0/2986209096 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:08.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc29a59c640 1 --2- 172.21.15.154:0/2986209096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc29c13d6d0 0x7fc29c1f3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc299d9b640 1 --2- 172.21.15.154:0/2986209096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc29c1e5000 0x7fc29c15cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc29ad9d640 1 -- 172.21.15.154:0/2986209096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc29c1e5000 msgr2=0x7fc29c15cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc29ad9d640 1 --2- 172.21.15.154:0/2986209096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc29c1e5000 0x7fc29c15cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc29ad9d640 1 -- 172.21.15.154:0/2986209096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc29c13d6d0 msgr2=0x7fc29c1f3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc29ad9d640 1 --2- 172.21.15.154:0/2986209096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc29c13d6d0 0x7fc29c1f3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc29ad9d640 1 -- 172.21.15.154:0/2986209096 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29c1f4500 con 0x7fc29c15d2e0 2024-05-14T01:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc299d9b640 1 --2- 172.21.15.154:0/2986209096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc29c1e5000 0x7fc29c15cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc29a59c640 1 --2- 172.21.15.154:0/2986209096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc29c13d6d0 0x7fc29c1f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc29ad9d640 1 --2- 172.21.15.154:0/2986209096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc29c15d2e0 0x7fc29c14afb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc294001fd0 tx=0x7fc284007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc28affd640 1 -- 172.21.15.154:0/2986209096 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc294001c00 con 0x7fc29c15d2e0 2024-05-14T01:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc28affd640 1 -- 172.21.15.154:0/2986209096 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc294006b60 con 0x7fc29c15d2e0 2024-05-14T01:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc2a0b5e640 1 -- 172.21.15.154:0/2986209096 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc29c1e3f60 con 0x7fc29c15d2e0 2024-05-14T01:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc28affd640 1 -- 172.21.15.154:0/2986209096 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2940050d0 con 0x7fc29c15d2e0 2024-05-14T01:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc2a0b5e640 1 -- 172.21.15.154:0/2986209096 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc29c1e4520 con 0x7fc29c15d2e0 2024-05-14T01:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc2a0b5e640 1 -- 172.21.15.154:0/2986209096 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc29c075470 con 0x7fc29c15d2e0 2024-05-14T01:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc28affd640 1 -- 172.21.15.154:0/2986209096 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc294005270 con 0x7fc29c15d2e0 2024-05-14T01:24:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc28affd640 1 --2- 172.21.15.154:0/2986209096 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc27c0678f0 0x7fc27c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc28affd640 1 -- 172.21.15.154:0/2986209096 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc29411f6f0 con 0x7fc29c15d2e0 2024-05-14T01:24:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc29a59c640 1 --2- 172.21.15.154:0/2986209096 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc27c0678f0 0x7fc27c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.333+0000 7fc29a59c640 1 --2- 172.21.15.154:0/2986209096 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc27c0678f0 0x7fc27c069db0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0c5e80 tx=0x7fc28c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:08.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.337+0000 7fc28affd640 1 -- 172.21.15.154:0/2986209096 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fc294016610 con 0x7fc29c15d2e0 2024-05-14T01:24:08.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.513+0000 7fc2a0b5e640 1 -- 172.21.15.154:0/2986209096 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc29c15c220 con 0x7fc29c15d2e0 2024-05-14T01:24:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.513+0000 7fc28affd640 1 -- 172.21.15.154:0/2986209096 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fc2940f0310 con 0x7fc29c15d2e0 2024-05-14T01:24:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-05-14T01:24:08.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.513+0000 7fc2a0b5e640 1 -- 172.21.15.154:0/2986209096 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc27c0678f0 msgr2=0x7fc27c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.513+0000 7fc2a0b5e640 1 --2- 172.21.15.154:0/2986209096 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc27c0678f0 0x7fc27c069db0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0c5e80 tx=0x7fc28c008040 comp rx=0 tx=0).stop 2024-05-14T01:24:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.513+0000 7fc2a0b5e640 1 -- 172.21.15.154:0/2986209096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc29c15d2e0 msgr2=0x7fc29c14afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.513+0000 7fc2a0b5e640 1 --2- 172.21.15.154:0/2986209096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc29c15d2e0 0x7fc29c14afb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc294001fd0 tx=0x7fc284007a50 comp rx=0 tx=0).stop 2024-05-14T01:24:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.517+0000 7fc2a0b5e640 1 -- 172.21.15.154:0/2986209096 shutdown_connections 2024-05-14T01:24:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.517+0000 7fc2a0b5e640 1 --2- 172.21.15.154:0/2986209096 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc27c0678f0 0x7fc27c069db0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.517+0000 7fc2a0b5e640 1 --2- 172.21.15.154:0/2986209096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc29c15d2e0 0x7fc29c14afb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.517+0000 7fc2a0b5e640 1 --2- 172.21.15.154:0/2986209096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc29c1e5000 0x7fc29c15cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.517+0000 7fc2a0b5e640 1 --2- 172.21.15.154:0/2986209096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc29c13d6d0 0x7fc29c1f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.517+0000 7fc2a0b5e640 1 -- 172.21.15.154:0/2986209096 >> 172.21.15.154:0/2986209096 conn(0x7fc29c0b1850 msgr2=0x7fc29c15c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.517+0000 7fc2a0b5e640 1 -- 172.21.15.154:0/2986209096 shutdown_connections 2024-05-14T01:24:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.517+0000 7fc2a0b5e640 1 -- 172.21.15.154:0/2986209096 wait complete. 2024-05-14T01:24:08.518 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:24:08.518 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T01:24:08.524 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:08.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.693+0000 7fa6a2f4d640 1 Processor -- start 2024-05-14T01:24:08.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.693+0000 7fa6a2f4d640 1 -- start start 2024-05-14T01:24:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa6a2f4d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa69c06e490 0x7fa69c0cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa6a2f4d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69c0cf100 con 0x7fa69c13ede0 2024-05-14T01:24:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa6a2f4d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69c0cf3e0 con 0x7fa69c141d00 2024-05-14T01:24:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa6a2f4d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa69c06cff0 con 0x7fa69c06e490 2024-05-14T01:24:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa6a0ce9640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa69c13ede0 0x7fa69c1415f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54496/0 (socket says 172.21.15.154:54496) 2024-05-14T01:24:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa6a0ce9640 1 -- 172.21.15.154:0/928039388 learned_addr learned my addr 172.21.15.154:0/928039388 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa69b7fe640 1 -- 172.21.15.154:0/928039388 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212015597 0 0) 0x7fa69c0cf100 con 0x7fa69c13ede0 2024-05-14T01:24:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa69b7fe640 1 -- 172.21.15.154:0/928039388 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa684003530 con 0x7fa69c13ede0 2024-05-14T01:24:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa6a14ea640 1 --2- 172.21.15.154:0/928039388 >> v2:172.21.15.176:3300/0 conn(0x7fa69c06e490 0x7fa69c0cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa69b7fe640 1 -- 172.21.15.154:0/928039388 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3933401561 0 0) 0x7fa684003530 con 0x7fa69c13ede0 2024-05-14T01:24:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa69b7fe640 1 -- 172.21.15.154:0/928039388 >> v2:172.21.15.176:3300/0 conn(0x7fa69c06e490 msgr2=0x7fa69c0cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa69b7fe640 1 --2- 172.21.15.154:0/928039388 >> v2:172.21.15.176:3300/0 conn(0x7fa69c06e490 0x7fa69c0cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa69b7fe640 1 -- 172.21.15.154:0/928039388 >> v1:172.21.15.176:6789/0 conn(0x7fa69c141d00 legacy=0x7fa69c0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa69b7fe640 1 -- 172.21.15.154:0/928039388 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69c06cc80 con 0x7fa69c13ede0 2024-05-14T01:24:08.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa69b7fe640 1 -- 172.21.15.154:0/928039388 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fa68c001680 con 0x7fa69c13ede0 2024-05-14T01:24:08.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa69b7fe640 1 -- 172.21.15.154:0/928039388 >> v1:172.21.15.154:6789/0 conn(0x7fa69c13ede0 legacy=0x7fa69c1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa69b7fe640 1 --2- 172.21.15.154:0/928039388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6840039f0 0x7fa684003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa69b7fe640 1 --2- 172.21.15.154:0/928039388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa684004810 0x7fa684004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa69b7fe640 1 --2- 172.21.15.154:0/928039388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa684005220 0x7fa68400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa69b7fe640 1 -- 172.21.15.154:0/928039388 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c06cff0 con 0x7fa684005220 2024-05-14T01:24:08.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa69b7fe640 1 -- 172.21.15.154:0/928039388 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa68400c150 con 0x7fa684004810 2024-05-14T01:24:08.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa69b7fe640 1 -- 172.21.15.154:0/928039388 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa68400c350 con 0x7fa6840039f0 2024-05-14T01:24:08.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa6a14ea640 1 --2- 172.21.15.154:0/928039388 >> v2:172.21.15.176:3300/0 conn(0x7fa69c06e490 0x7fa69c0cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:08.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa6a14ea640 1 --2- 172.21.15.154:0/928039388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa684005220 0x7fa68400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa69bfff640 1 --2- 172.21.15.154:0/928039388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa684004810 0x7fa684004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa6a0ce9640 1 --2- 172.21.15.154:0/928039388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6840039f0 0x7fa684003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa6a14ea640 1 -- 172.21.15.154:0/928039388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6840039f0 msgr2=0x7fa684003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:08.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa6a14ea640 1 --2- 172.21.15.154:0/928039388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6840039f0 0x7fa684003e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa6a14ea640 1 -- 172.21.15.154:0/928039388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa684004810 msgr2=0x7fa684004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:08.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa6a14ea640 1 --2- 172.21.15.154:0/928039388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa684004810 0x7fa684004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.697+0000 7fa6a14ea640 1 -- 172.21.15.154:0/928039388 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa684003530 con 0x7fa684005220 2024-05-14T01:24:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a14ea640 1 -- 172.21.15.154:0/928039388 reap_dead start 2024-05-14T01:24:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a14ea640 1 --2- 172.21.15.154:0/928039388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa684005220 0x7fa68400b9d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa6940073b0 tx=0x7fa69401cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda2db47074c7d6a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa69b7fe640 1 -- 172.21.15.154:0/928039388 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694009c70 con 0x7fa684005220 2024-05-14T01:24:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa69b7fe640 1 -- 172.21.15.154:0/928039388 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6940a5e40 con 0x7fa684005220 2024-05-14T01:24:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa69b7fe640 1 -- 172.21.15.154:0/928039388 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6940ad680 con 0x7fa684005220 2024-05-14T01:24:08.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a2f4d640 1 -- 172.21.15.154:0/928039388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa684005220 msgr2=0x7fa68400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a2f4d640 1 --2- 172.21.15.154:0/928039388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa684005220 0x7fa68400b9d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa6940073b0 tx=0x7fa69401cf20 comp rx=0 tx=0).stop 2024-05-14T01:24:08.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a2f4d640 1 -- 172.21.15.154:0/928039388 shutdown_connections 2024-05-14T01:24:08.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a2f4d640 1 --2- 172.21.15.154:0/928039388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa684005220 0x7fa68400b9d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a2f4d640 1 -- 172.21.15.154:0/928039388 >> 172.21.15.154:0/928039388 conn(0x7fa69c0b1850 msgr2=0x7fa69c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:08.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a2f4d640 1 -- 172.21.15.154:0/928039388 shutdown_connections 2024-05-14T01:24:08.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a2f4d640 1 -- 172.21.15.154:0/928039388 wait complete. 2024-05-14T01:24:08.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a2f4d640 1 Processor -- start 2024-05-14T01:24:08.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a2f4d640 1 -- start start 2024-05-14T01:24:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a2f4d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa684005220 0x7fa69c1f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a2f4d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa69c142120 0x7fa69c1386f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a2f4d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa69c142580 0x7fa69c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a2f4d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c1415f0 con 0x7fa684005220 2024-05-14T01:24:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a2f4d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c13f1c0 con 0x7fa69c142580 2024-05-14T01:24:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a2f4d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa69c141770 con 0x7fa69c142120 2024-05-14T01:24:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a0ce9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa684005220 0x7fa69c1f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a0ce9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa684005220 0x7fa69c1f4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59210/0 (socket says 172.21.15.154:59210) 2024-05-14T01:24:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a0ce9640 1 -- 172.21.15.154:0/4249813354 learned_addr learned my addr 172.21.15.154:0/4249813354 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a14ea640 1 --2- 172.21.15.154:0/4249813354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa69c142580 0x7fa69c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a0ce9640 1 -- 172.21.15.154:0/4249813354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa69c142120 msgr2=0x7fa69c1386f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a0ce9640 1 --2- 172.21.15.154:0/4249813354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa69c142120 0x7fa69c1386f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a0ce9640 1 -- 172.21.15.154:0/4249813354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa69c142580 msgr2=0x7fa69c138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a0ce9640 1 --2- 172.21.15.154:0/4249813354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa69c142580 0x7fa69c138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a0ce9640 1 -- 172.21.15.154:0/4249813354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69c142b00 con 0x7fa684005220 2024-05-14T01:24:08.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a0ce9640 1 --2- 172.21.15.154:0/4249813354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa684005220 0x7fa69c1f4270 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00d7a0 tx=0x7fa68c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:08.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6997fa640 1 -- 172.21.15.154:0/4249813354 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c019070 con 0x7fa684005220 2024-05-14T01:24:08.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6997fa640 1 -- 172.21.15.154:0/4249813354 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa68c0072d0 con 0x7fa684005220 2024-05-14T01:24:08.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a2f4d640 1 -- 172.21.15.154:0/4249813354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa69c144540 con 0x7fa684005220 2024-05-14T01:24:08.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6997fa640 1 -- 172.21.15.154:0/4249813354 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c0047f0 con 0x7fa684005220 2024-05-14T01:24:08.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.701+0000 7fa6a2f4d640 1 -- 172.21.15.154:0/4249813354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa69c144b00 con 0x7fa684005220 2024-05-14T01:24:08.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.705+0000 7fa6a2f4d640 1 -- 172.21.15.154:0/4249813354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa69c075470 con 0x7fa684005220 2024-05-14T01:24:08.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.705+0000 7fa6997fa640 1 -- 172.21.15.154:0/4249813354 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa68c004990 con 0x7fa684005220 2024-05-14T01:24:08.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.705+0000 7fa6997fa640 1 --2- 172.21.15.154:0/4249813354 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa6880678f0 0x7fa688069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.705+0000 7fa6997fa640 1 -- 172.21.15.154:0/4249813354 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa68c085570 con 0x7fa684005220 2024-05-14T01:24:08.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.705+0000 7fa69bfff640 1 --2- 172.21.15.154:0/4249813354 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa6880678f0 0x7fa688069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.705+0000 7fa69bfff640 1 --2- 172.21.15.154:0/4249813354 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa6880678f0 0x7fa688069db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa69c159ec0 tx=0x7fa690009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:08.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.709+0000 7fa6997fa640 1 -- 172.21.15.154:0/4249813354 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fa68c056020 con 0x7fa684005220 2024-05-14T01:24:08.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.861+0000 7fa6a2f4d640 1 -- 172.21.15.154:0/4249813354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa69c06f180 con 0x7fa684005220 2024-05-14T01:24:08.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.861+0000 7fa6997fa640 1 -- 172.21.15.154:0/4249813354 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7fa68c055920 con 0x7fa684005220 2024-05-14T01:24:08.849 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:08.850 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:36.232271+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:08.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.865+0000 7fa6a2f4d640 1 -- 172.21.15.154:0/4249813354 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa6880678f0 msgr2=0x7fa688069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.865+0000 7fa6a2f4d640 1 --2- 172.21.15.154:0/4249813354 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa6880678f0 0x7fa688069db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa69c159ec0 tx=0x7fa690009040 comp rx=0 tx=0).stop 2024-05-14T01:24:08.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.865+0000 7fa6a2f4d640 1 -- 172.21.15.154:0/4249813354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa684005220 msgr2=0x7fa69c1f4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.865+0000 7fa6a2f4d640 1 --2- 172.21.15.154:0/4249813354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa684005220 0x7fa69c1f4270 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00d7a0 tx=0x7fa68c00dc60 comp rx=0 tx=0).stop 2024-05-14T01:24:08.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.865+0000 7fa6a2f4d640 1 -- 172.21.15.154:0/4249813354 shutdown_connections 2024-05-14T01:24:08.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.865+0000 7fa6a2f4d640 1 --2- 172.21.15.154:0/4249813354 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa6880678f0 0x7fa688069db0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.865+0000 7fa6a2f4d640 1 --2- 172.21.15.154:0/4249813354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa69c142580 0x7fa69c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.865+0000 7fa6a2f4d640 1 --2- 172.21.15.154:0/4249813354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa69c142120 0x7fa69c1386f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.865+0000 7fa6a2f4d640 1 --2- 172.21.15.154:0/4249813354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa684005220 0x7fa69c1f4270 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.865+0000 7fa6a2f4d640 1 -- 172.21.15.154:0/4249813354 >> 172.21.15.154:0/4249813354 conn(0x7fa69c0b1850 msgr2=0x7fa69c0ce300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:08.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.865+0000 7fa6a2f4d640 1 -- 172.21.15.154:0/4249813354 shutdown_connections 2024-05-14T01:24:08.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:08.865+0000 7fa6a2f4d640 1 -- 172.21.15.154:0/4249813354 wait complete. 2024-05-14T01:24:08.867 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T01:23:33.083538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T01:23:33.556058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:24:08.867 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:24:08.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.005+0000 7f7a4d472640 1 Processor -- start 2024-05-14T01:24:08.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.005+0000 7f7a4d472640 1 -- start start 2024-05-14T01:24:08.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.005+0000 7f7a4d472640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a4815c1d0 0x7f7a480cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.005+0000 7f7a4d472640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7a480d1d60 0x7f7a480d21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.005+0000 7f7a4d472640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a480af730 con 0x7f7a480aeae0 2024-05-14T01:24:08.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.005+0000 7f7a4d472640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7a480d05c0 con 0x7f7a480d1d60 2024-05-14T01:24:08.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.005+0000 7f7a4d472640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7a480d2700 con 0x7f7a4815c1d0 2024-05-14T01:24:08.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.005+0000 7f7a467fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7a480d1d60 0x7f7a480d21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.005+0000 7f7a467fc640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7a480d1d60 0x7f7a480d21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:40702/0 (socket says 172.21.15.154:40702) 2024-05-14T01:24:08.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.005+0000 7f7a467fc640 1 -- 172.21.15.154:0/1110941340 learned_addr learned my addr 172.21.15.154:0/1110941340 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:08.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.005+0000 7f7a46ffd640 1 --2- 172.21.15.154:0/1110941340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a4815c1d0 0x7f7a480cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.005+0000 7f7a467fc640 1 -- 172.21.15.154:0/1110941340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a4815c1d0 msgr2=0x7f7a480cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:08.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.005+0000 7f7a467fc640 1 --2- 172.21.15.154:0/1110941340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a4815c1d0 0x7f7a480cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.005+0000 7f7a467fc640 1 -- 172.21.15.154:0/1110941340 >> v1:172.21.15.176:6789/0 conn(0x7f7a480aeae0 legacy=0x7f7a480aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.005+0000 7f7a467fc640 1 -- 172.21.15.154:0/1110941340 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a480afa10 con 0x7f7a480d1d60 2024-05-14T01:24:08.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.005+0000 7f7a45ffb640 1 -- 172.21.15.154:0/1110941340 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2539395905 0 0) 0x7f7a480af730 con 0x7f7a480aeae0 2024-05-14T01:24:08.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a467fc640 1 --2- 172.21.15.154:0/1110941340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a480d1d60 0x7f7a480d21c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7a30009870 tx=0x7f7a3001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2bb5077a455c147 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:08.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a45ffb640 1 -- 172.21.15.154:0/1110941340 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a300b0070 con 0x7f7a480d1d60 2024-05-14T01:24:08.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a45ffb640 1 -- 172.21.15.154:0/1110941340 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a300ab600 con 0x7f7a480d1d60 2024-05-14T01:24:08.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a45ffb640 1 -- 172.21.15.154:0/1110941340 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a300ab9d0 con 0x7f7a480d1d60 2024-05-14T01:24:08.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a4d472640 1 -- 172.21.15.154:0/1110941340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a480d1d60 msgr2=0x7f7a480d21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a4d472640 1 --2- 172.21.15.154:0/1110941340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a480d1d60 0x7f7a480d21c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7a30009870 tx=0x7f7a3001c4d0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a4d472640 1 -- 172.21.15.154:0/1110941340 shutdown_connections 2024-05-14T01:24:08.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a4d472640 1 --2- 172.21.15.154:0/1110941340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a480d1d60 0x7f7a480d21c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a4d472640 1 --2- 172.21.15.154:0/1110941340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a4815c1d0 0x7f7a480cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a4d472640 1 -- 172.21.15.154:0/1110941340 >> 172.21.15.154:0/1110941340 conn(0x7f7a4809aa10 msgr2=0x7f7a4809adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:08.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a4d472640 1 -- 172.21.15.154:0/1110941340 shutdown_connections 2024-05-14T01:24:08.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a4d472640 1 -- 172.21.15.154:0/1110941340 wait complete. 2024-05-14T01:24:08.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a4d472640 1 Processor -- start 2024-05-14T01:24:08.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a4d472640 1 -- start start 2024-05-14T01:24:08.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a4d472640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a480aeae0 0x7f7a480cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a4d472640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a480d1d60 0x7f7a480ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a4d472640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a4815c1d0 0x7f7a48154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:08.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a4d472640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7a480b1350 con 0x7f7a480d1d60 2024-05-14T01:24:08.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a4d472640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7a480b11d0 con 0x7f7a480aeae0 2024-05-14T01:24:08.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a4d472640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7a480b14d0 con 0x7f7a4815c1d0 2024-05-14T01:24:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a467fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a480d1d60 0x7f7a480ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.009+0000 7f7a467fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a480d1d60 0x7f7a480ca060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59214/0 (socket says 172.21.15.154:59214) 2024-05-14T01:24:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a467fc640 1 -- 172.21.15.154:0/703543071 learned_addr learned my addr 172.21.15.154:0/703543071 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a46ffd640 1 --2- 172.21.15.154:0/703543071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a480aeae0 0x7f7a480cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a477fe640 1 --2- 172.21.15.154:0/703543071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a4815c1d0 0x7f7a48154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a467fc640 1 -- 172.21.15.154:0/703543071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a4815c1d0 msgr2=0x7f7a48154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a467fc640 1 --2- 172.21.15.154:0/703543071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a4815c1d0 0x7f7a48154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a467fc640 1 -- 172.21.15.154:0/703543071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a480aeae0 msgr2=0x7f7a480cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a467fc640 1 --2- 172.21.15.154:0/703543071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a480aeae0 0x7f7a480cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a467fc640 1 -- 172.21.15.154:0/703543071 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a480ca8b0 con 0x7f7a480d1d60 2024-05-14T01:24:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a467fc640 1 --2- 172.21.15.154:0/703543071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a480d1d60 0x7f7a480ca060 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7a3001ab80 tx=0x7f7a3001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a3f7fe640 1 -- 172.21.15.154:0/703543071 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a300bd070 con 0x7f7a480d1d60 2024-05-14T01:24:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a3f7fe640 1 -- 172.21.15.154:0/703543071 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a30004030 con 0x7f7a480d1d60 2024-05-14T01:24:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a4d472640 1 -- 172.21.15.154:0/703543071 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a480cab90 con 0x7f7a480d1d60 2024-05-14T01:24:09.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a3f7fe640 1 -- 172.21.15.154:0/703543071 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a300b0040 con 0x7f7a480d1d60 2024-05-14T01:24:09.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a4d472640 1 -- 172.21.15.154:0/703543071 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a480cb150 con 0x7f7a480d1d60 2024-05-14T01:24:09.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a4d472640 1 -- 172.21.15.154:0/703543071 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a48075470 con 0x7f7a480d1d60 2024-05-14T01:24:09.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a3f7fe640 1 -- 172.21.15.154:0/703543071 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a300b3070 con 0x7f7a480d1d60 2024-05-14T01:24:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a3f7fe640 1 --2- 172.21.15.154:0/703543071 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7a280678f0 0x7f7a28069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a3f7fe640 1 -- 172.21.15.154:0/703543071 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7a3011f170 con 0x7f7a480d1d60 2024-05-14T01:24:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a46ffd640 1 --2- 172.21.15.154:0/703543071 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7a280678f0 0x7f7a28069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.013+0000 7f7a46ffd640 1 --2- 172.21.15.154:0/703543071 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7a280678f0 0x7f7a28069db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7a400073f0 tx=0x7f7a4000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:09.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.017+0000 7f7a3f7fe640 1 -- 172.21.15.154:0/703543071 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f7a30016150 con 0x7f7a480d1d60 2024-05-14T01:24:09.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.165+0000 7f7a4d472640 1 -- 172.21.15.154:0/703543071 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7a48070310 con 0x7f7a480d1d60 2024-05-14T01:24:09.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.165+0000 7f7a3f7fe640 1 -- 172.21.15.154:0/703543071 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f7a300ef5e0 con 0x7f7a480d1d60 2024-05-14T01:24:09.153 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:24:09.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.169+0000 7f7a4d472640 1 -- 172.21.15.154:0/703543071 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7a280678f0 msgr2=0x7f7a28069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.169+0000 7f7a4d472640 1 --2- 172.21.15.154:0/703543071 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7a280678f0 0x7f7a28069db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7a400073f0 tx=0x7f7a4000b040 comp rx=0 tx=0).stop 2024-05-14T01:24:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.169+0000 7f7a4d472640 1 -- 172.21.15.154:0/703543071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a480d1d60 msgr2=0x7f7a480ca060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.169+0000 7f7a4d472640 1 --2- 172.21.15.154:0/703543071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a480d1d60 0x7f7a480ca060 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7a3001ab80 tx=0x7f7a3001ad10 comp rx=0 tx=0).stop 2024-05-14T01:24:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.169+0000 7f7a4d472640 1 -- 172.21.15.154:0/703543071 shutdown_connections 2024-05-14T01:24:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.169+0000 7f7a4d472640 1 --2- 172.21.15.154:0/703543071 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7a280678f0 0x7f7a28069db0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.169+0000 7f7a4d472640 1 --2- 172.21.15.154:0/703543071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a4815c1d0 0x7f7a48154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.169+0000 7f7a4d472640 1 --2- 172.21.15.154:0/703543071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a480d1d60 0x7f7a480ca060 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.169+0000 7f7a4d472640 1 --2- 172.21.15.154:0/703543071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a480aeae0 0x7f7a480cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.169+0000 7f7a4d472640 1 -- 172.21.15.154:0/703543071 >> 172.21.15.154:0/703543071 conn(0x7f7a4809aa10 msgr2=0x7f7a4806f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.169+0000 7f7a4d472640 1 -- 172.21.15.154:0/703543071 shutdown_connections 2024-05-14T01:24:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.169+0000 7f7a4d472640 1 -- 172.21.15.154:0/703543071 wait complete. 2024-05-14T01:24:09.171 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T01:24:09.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b5e7b2640 1 Processor -- start 2024-05-14T01:24:09.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b5e7b2640 1 -- start start 2024-05-14T01:24:09.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b5e7b2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b580d0f70 0x7f2b580d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b5e7b2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b5815e910 con 0x7f2b58162a60 2024-05-14T01:24:09.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b5e7b2640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b580cec20 con 0x7f2b5815e530 2024-05-14T01:24:09.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b5e7b2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2b580cef00 con 0x7f2b580d0f70 2024-05-14T01:24:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b5cd4f640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2b58162a60 0x7f2b580d2970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54500/0 (socket says 172.21.15.154:54500) 2024-05-14T01:24:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b5cd4f640 1 -- 172.21.15.154:0/2288698944 learned_addr learned my addr 172.21.15.154:0/2288698944 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b4ffff640 1 --2- 172.21.15.154:0/2288698944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b580d0f70 0x7f2b580d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b577fe640 1 -- 172.21.15.154:0/2288698944 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 488118079 0 0) 0x7f2b5815e910 con 0x7f2b58162a60 2024-05-14T01:24:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b577fe640 1 -- 172.21.15.154:0/2288698944 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b44003530 con 0x7f2b58162a60 2024-05-14T01:24:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b577fe640 1 -- 172.21.15.154:0/2288698944 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2269704347 0 0) 0x7f2b44003530 con 0x7f2b58162a60 2024-05-14T01:24:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b577fe640 1 -- 172.21.15.154:0/2288698944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b580d0f70 msgr2=0x7f2b580d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b577fe640 1 --2- 172.21.15.154:0/2288698944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b580d0f70 0x7f2b580d2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b577fe640 1 -- 172.21.15.154:0/2288698944 >> v1:172.21.15.176:6789/0 conn(0x7f2b5815e530 legacy=0x7f2b580d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b577fe640 1 -- 172.21.15.154:0/2288698944 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b580cf1e0 con 0x7f2b58162a60 2024-05-14T01:24:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b577fe640 1 -- 172.21.15.154:0/2288698944 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f2b50001a00 con 0x7f2b58162a60 2024-05-14T01:24:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b577fe640 1 -- 172.21.15.154:0/2288698944 >> v1:172.21.15.154:6789/0 conn(0x7f2b58162a60 legacy=0x7f2b580d2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b577fe640 1 --2- 172.21.15.154:0/2288698944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b440039f0 0x7f2b44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b577fe640 1 --2- 172.21.15.154:0/2288698944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b580d0f70 0x7f2b44004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b577fe640 1 --2- 172.21.15.154:0/2288698944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b44004d50 0x7f2b440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b577fe640 1 -- 172.21.15.154:0/2288698944 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2b580cef00 con 0x7f2b440039f0 2024-05-14T01:24:09.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b577fe640 1 -- 172.21.15.154:0/2288698944 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4400ba00 con 0x7f2b44004d50 2024-05-14T01:24:09.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b577fe640 1 -- 172.21.15.154:0/2288698944 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2b4400bc00 con 0x7f2b580d0f70 2024-05-14T01:24:09.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b57fff640 1 --2- 172.21.15.154:0/2288698944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b440039f0 0x7f2b44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b5cd4f640 1 --2- 172.21.15.154:0/2288698944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b44004d50 0x7f2b440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b57fff640 1 -- 172.21.15.154:0/2288698944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b580d0f70 msgr2=0x7f2b44004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:09.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b4ffff640 1 --2- 172.21.15.154:0/2288698944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b580d0f70 0x7f2b44004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b57fff640 1 --2- 172.21.15.154:0/2288698944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b580d0f70 0x7f2b44004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b57fff640 1 -- 172.21.15.154:0/2288698944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b44004d50 msgr2=0x7f2b440051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:09.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b57fff640 1 --2- 172.21.15.154:0/2288698944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b44004d50 0x7f2b440051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b57fff640 1 -- 172.21.15.154:0/2288698944 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b44003530 con 0x7f2b440039f0 2024-05-14T01:24:09.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.305+0000 7f2b5cd4f640 1 --2- 172.21.15.154:0/2288698944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b44004d50 0x7f2b440051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:09.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b57fff640 1 --2- 172.21.15.154:0/2288698944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b440039f0 0x7f2b44003dd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2b48001860 tx=0x7f2b4801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa298dbc739d51a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:09.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b577fe640 1 -- 172.21.15.154:0/2288698944 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b480b0070 con 0x7f2b440039f0 2024-05-14T01:24:09.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b577fe640 1 -- 172.21.15.154:0/2288698944 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b480ab600 con 0x7f2b440039f0 2024-05-14T01:24:09.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b577fe640 1 -- 172.21.15.154:0/2288698944 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b48001460 con 0x7f2b440039f0 2024-05-14T01:24:09.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b5e7b2640 1 -- 172.21.15.154:0/2288698944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b440039f0 msgr2=0x7f2b44003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b5e7b2640 1 --2- 172.21.15.154:0/2288698944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b440039f0 0x7f2b44003dd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2b48001860 tx=0x7f2b4801c460 comp rx=0 tx=0).stop 2024-05-14T01:24:09.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b5cd4f640 1 -- 172.21.15.154:0/2288698944 reap_dead start 2024-05-14T01:24:09.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b5e7b2640 1 -- 172.21.15.154:0/2288698944 shutdown_connections 2024-05-14T01:24:09.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b5e7b2640 1 -- 172.21.15.154:0/2288698944 >> 172.21.15.154:0/2288698944 conn(0x7f2b580b5b80 msgr2=0x7f2b580b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:09.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b5e7b2640 1 -- 172.21.15.154:0/2288698944 shutdown_connections 2024-05-14T01:24:09.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b5e7b2640 1 -- 172.21.15.154:0/2288698944 wait complete. 2024-05-14T01:24:09.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b5e7b2640 1 Processor -- start 2024-05-14T01:24:09.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b5e7b2640 1 -- start start 2024-05-14T01:24:09.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b5e7b2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b440039f0 0x7f2b58157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b5e7b2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b58159370 0x7f2b58159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b5e7b2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b580b8e40 0x7f2b580c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b5e7b2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2b580d3200 con 0x7f2b580b8e40 2024-05-14T01:24:09.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b5e7b2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2b580d3080 con 0x7f2b440039f0 2024-05-14T01:24:09.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b5e7b2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2b580d3380 con 0x7f2b58159370 2024-05-14T01:24:09.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b5cd4f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b580b8e40 0x7f2b580c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b5cd4f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b580b8e40 0x7f2b580c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59234/0 (socket says 172.21.15.154:59234) 2024-05-14T01:24:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.309+0000 7f2b5cd4f640 1 -- 172.21.15.154:0/3601101949 learned_addr learned my addr 172.21.15.154:0/3601101949 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b57fff640 1 --2- 172.21.15.154:0/3601101949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b440039f0 0x7f2b58157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b4ffff640 1 --2- 172.21.15.154:0/3601101949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b58159370 0x7f2b58159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b5cd4f640 1 -- 172.21.15.154:0/3601101949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b58159370 msgr2=0x7f2b58159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b5cd4f640 1 --2- 172.21.15.154:0/3601101949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b58159370 0x7f2b58159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b5cd4f640 1 -- 172.21.15.154:0/3601101949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b440039f0 msgr2=0x7f2b58157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b5cd4f640 1 --2- 172.21.15.154:0/3601101949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b440039f0 0x7f2b58157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b5cd4f640 1 -- 172.21.15.154:0/3601101949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b580b8080 con 0x7f2b580b8e40 2024-05-14T01:24:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b57fff640 1 --2- 172.21.15.154:0/3601101949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b440039f0 0x7f2b58157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b5cd4f640 1 --2- 172.21.15.154:0/3601101949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b580b8e40 0x7f2b580c82c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2b500012f0 tx=0x7f2b5000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b557fa640 1 -- 172.21.15.154:0/3601101949 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5000bb20 con 0x7f2b580b8e40 2024-05-14T01:24:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b557fa640 1 -- 172.21.15.154:0/3601101949 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b5000bcc0 con 0x7f2b580b8e40 2024-05-14T01:24:09.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b557fa640 1 -- 172.21.15.154:0/3601101949 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b50007270 con 0x7f2b580b8e40 2024-05-14T01:24:09.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b5e7b2640 1 -- 172.21.15.154:0/3601101949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b580b8360 con 0x7f2b580b8e40 2024-05-14T01:24:09.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b5e7b2640 1 -- 172.21.15.154:0/3601101949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b580b8920 con 0x7f2b580b8e40 2024-05-14T01:24:09.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b5e7b2640 1 -- 172.21.15.154:0/3601101949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b58075470 con 0x7f2b580b8e40 2024-05-14T01:24:09.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b557fa640 1 -- 172.21.15.154:0/3601101949 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2b5001b020 con 0x7f2b580b8e40 2024-05-14T01:24:09.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b557fa640 1 --2- 172.21.15.154:0/3601101949 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2b380678f0 0x7f2b38069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b557fa640 1 -- 172.21.15.154:0/3601101949 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2b50085f50 con 0x7f2b580b8e40 2024-05-14T01:24:09.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b57fff640 1 --2- 172.21.15.154:0/3601101949 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2b380678f0 0x7f2b38069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.313+0000 7f2b57fff640 1 --2- 172.21.15.154:0/3601101949 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2b380678f0 0x7f2b38069db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2b480ad000 tx=0x7f2b480a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:09.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.317+0000 7f2b557fa640 1 -- 172.21.15.154:0/3601101949 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f2b50056a90 con 0x7f2b580b8e40 2024-05-14T01:24:09.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.469+0000 7f2b5e7b2640 1 -- 172.21.15.154:0/3601101949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2b580d1fe0 con 0x7f2b580b8e40 2024-05-14T01:24:09.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.469+0000 7f2b557fa640 1 -- 172.21.15.154:0/3601101949 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f2b50056390 con 0x7f2b580b8e40 2024-05-14T01:24:09.455 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-05-14T01:24:09.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.469+0000 7f2b5e7b2640 1 -- 172.21.15.154:0/3601101949 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2b380678f0 msgr2=0x7f2b38069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.469+0000 7f2b5e7b2640 1 --2- 172.21.15.154:0/3601101949 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2b380678f0 0x7f2b38069db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2b480ad000 tx=0x7f2b480a6000 comp rx=0 tx=0).stop 2024-05-14T01:24:09.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.469+0000 7f2b5e7b2640 1 -- 172.21.15.154:0/3601101949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b580b8e40 msgr2=0x7f2b580c82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.469+0000 7f2b5e7b2640 1 --2- 172.21.15.154:0/3601101949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b580b8e40 0x7f2b580c82c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2b500012f0 tx=0x7f2b5000b4a0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.469+0000 7f2b5e7b2640 1 -- 172.21.15.154:0/3601101949 shutdown_connections 2024-05-14T01:24:09.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.469+0000 7f2b5e7b2640 1 --2- 172.21.15.154:0/3601101949 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2b380678f0 0x7f2b38069db0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.469+0000 7f2b5e7b2640 1 --2- 172.21.15.154:0/3601101949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b580b8e40 0x7f2b580c82c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.469+0000 7f2b5e7b2640 1 --2- 172.21.15.154:0/3601101949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b58159370 0x7f2b58159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.469+0000 7f2b5e7b2640 1 --2- 172.21.15.154:0/3601101949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b440039f0 0x7f2b58157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.469+0000 7f2b5e7b2640 1 -- 172.21.15.154:0/3601101949 >> 172.21.15.154:0/3601101949 conn(0x7f2b580b5b80 msgr2=0x7f2b58163680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:09.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.469+0000 7f2b5e7b2640 1 -- 172.21.15.154:0/3601101949 shutdown_connections 2024-05-14T01:24:09.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.469+0000 7f2b5e7b2640 1 -- 172.21.15.154:0/3601101949 wait complete. 2024-05-14T01:24:09.472 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T01:24:09.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2b6859640 1 Processor -- start 2024-05-14T01:24:09.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2b6859640 1 -- start start 2024-05-14T01:24:09.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2b6859640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb2b015bfe0 0x7fb2b00d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2b6859640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b00cc770 con 0x7fb2b00d2410 2024-05-14T01:24:09.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2b6859640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b00af1e0 con 0x7fb2b00aea00 2024-05-14T01:24:09.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2b6859640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb2b00af4c0 con 0x7fb2b015bfe0 2024-05-14T01:24:09.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2b4df6640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb2b00d2410 0x7fb2b00b0280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54508/0 (socket says 172.21.15.154:54508) 2024-05-14T01:24:09.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2b4df6640 1 -- 172.21.15.154:0/1992419842 learned_addr learned my addr 172.21.15.154:0/1992419842 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:09.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2affff640 1 --2- 172.21.15.154:0/1992419842 >> v2:172.21.15.176:3300/0 conn(0x7fb2b015bfe0 0x7fb2b00d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2aeffd640 1 -- 172.21.15.154:0/1992419842 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370876717 0 0) 0x7fb2a80014a0 con 0x7fb2b00d2410 2024-05-14T01:24:09.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2aeffd640 1 -- 172.21.15.154:0/1992419842 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb298003530 con 0x7fb2b00d2410 2024-05-14T01:24:09.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2aeffd640 1 -- 172.21.15.154:0/1992419842 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2666835716 0 0) 0x7fb298003530 con 0x7fb2b00d2410 2024-05-14T01:24:09.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2aeffd640 1 -- 172.21.15.154:0/1992419842 >> v2:172.21.15.176:3300/0 conn(0x7fb2b015bfe0 msgr2=0x7fb2b00d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:09.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2aeffd640 1 --2- 172.21.15.154:0/1992419842 >> v2:172.21.15.176:3300/0 conn(0x7fb2b015bfe0 0x7fb2b00d0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2aeffd640 1 -- 172.21.15.154:0/1992419842 >> v1:172.21.15.176:6789/0 conn(0x7fb2b00aea00 legacy=0x7fb2b00d1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2aeffd640 1 -- 172.21.15.154:0/1992419842 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b00af7a0 con 0x7fb2b00d2410 2024-05-14T01:24:09.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2aeffd640 1 -- 172.21.15.154:0/1992419842 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fb2a8001bd0 con 0x7fb2b00d2410 2024-05-14T01:24:09.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2aeffd640 1 -- 172.21.15.154:0/1992419842 >> v1:172.21.15.154:6789/0 conn(0x7fb2b00d2410 legacy=0x7fb2b00b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2aeffd640 1 --2- 172.21.15.154:0/1992419842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2980039c0 0x7fb298003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2aeffd640 1 --2- 172.21.15.154:0/1992419842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb298004810 0x7fb298004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2aeffd640 1 --2- 172.21.15.154:0/1992419842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2980051d0 0x7fb29800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2aeffd640 1 -- 172.21.15.154:0/1992419842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b00af4c0 con 0x7fb2980051d0 2024-05-14T01:24:09.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2aeffd640 1 -- 172.21.15.154:0/1992419842 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb29800c170 con 0x7fb2980039c0 2024-05-14T01:24:09.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2aeffd640 1 -- 172.21.15.154:0/1992419842 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb29800c370 con 0x7fb298004810 2024-05-14T01:24:09.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2b4df6640 1 --2- 172.21.15.154:0/1992419842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2980051d0 0x7fb29800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2affff640 1 --2- 172.21.15.154:0/1992419842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2980039c0 0x7fb298003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2af7fe640 1 --2- 172.21.15.154:0/1992419842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb298004810 0x7fb298004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2b4df6640 1 -- 172.21.15.154:0/1992419842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb298004810 msgr2=0x7fb298004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:09.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2b4df6640 1 --2- 172.21.15.154:0/1992419842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb298004810 0x7fb298004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2b4df6640 1 -- 172.21.15.154:0/1992419842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2980039c0 msgr2=0x7fb298003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:09.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2b4df6640 1 --2- 172.21.15.154:0/1992419842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2980039c0 0x7fb298003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.601+0000 7fb2b4df6640 1 -- 172.21.15.154:0/1992419842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb298003530 con 0x7fb2980051d0 2024-05-14T01:24:09.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2b4df6640 1 -- 172.21.15.154:0/1992419842 reap_dead start 2024-05-14T01:24:09.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2b4df6640 1 --2- 172.21.15.154:0/1992419842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2980051d0 0x7fb29800b9d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800aa30 tx=0x7fb2a801fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de50a90b09d5345b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:09.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2aeffd640 1 -- 172.21.15.154:0/1992419842 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800a650 con 0x7fb2980051d0 2024-05-14T01:24:09.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2aeffd640 1 -- 172.21.15.154:0/1992419842 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a80aa510 con 0x7fb2980051d0 2024-05-14T01:24:09.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2aeffd640 1 -- 172.21.15.154:0/1992419842 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a80aa920 con 0x7fb2980051d0 2024-05-14T01:24:09.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2b6859640 1 -- 172.21.15.154:0/1992419842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2980051d0 msgr2=0x7fb29800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2b6859640 1 --2- 172.21.15.154:0/1992419842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2980051d0 0x7fb29800b9d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800aa30 tx=0x7fb2a801fae0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2b6859640 1 -- 172.21.15.154:0/1992419842 shutdown_connections 2024-05-14T01:24:09.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2b6859640 1 --2- 172.21.15.154:0/1992419842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2980051d0 0x7fb29800b9d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2b6859640 1 -- 172.21.15.154:0/1992419842 >> 172.21.15.154:0/1992419842 conn(0x7fb2b009aa10 msgr2=0x7fb2b009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:09.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2b6859640 1 -- 172.21.15.154:0/1992419842 shutdown_connections 2024-05-14T01:24:09.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2b6859640 1 -- 172.21.15.154:0/1992419842 wait complete. 2024-05-14T01:24:09.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2b6859640 1 Processor -- start 2024-05-14T01:24:09.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2b6859640 1 -- start start 2024-05-14T01:24:09.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2b6859640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2980051d0 0x7fb2b0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2b6859640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2b0155550 0x7fb2b006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2b6859640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2b0159390 0x7fb2b0159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2b6859640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b015c540 con 0x7fb2b0155550 2024-05-14T01:24:09.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2b6859640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b015c3c0 con 0x7fb2b0159390 2024-05-14T01:24:09.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2b6859640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b00aeeb0 con 0x7fb2980051d0 2024-05-14T01:24:09.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2af7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2b0155550 0x7fb2b006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2af7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2b0155550 0x7fb2b006bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59246/0 (socket says 172.21.15.154:59246) 2024-05-14T01:24:09.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2af7fe640 1 -- 172.21.15.154:0/2375404626 learned_addr learned my addr 172.21.15.154:0/2375404626 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:09.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2affff640 1 --2- 172.21.15.154:0/2375404626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2980051d0 0x7fb2b0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.605+0000 7fb2b4df6640 1 --2- 172.21.15.154:0/2375404626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2b0159390 0x7fb2b0159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.609+0000 7fb2af7fe640 1 -- 172.21.15.154:0/2375404626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2980051d0 msgr2=0x7fb2b0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.609+0000 7fb2af7fe640 1 --2- 172.21.15.154:0/2375404626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2980051d0 0x7fb2b0156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.609+0000 7fb2af7fe640 1 -- 172.21.15.154:0/2375404626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2b0159390 msgr2=0x7fb2b0159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.609+0000 7fb2af7fe640 1 --2- 172.21.15.154:0/2375404626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2b0159390 0x7fb2b0159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.609+0000 7fb2af7fe640 1 -- 172.21.15.154:0/2375404626 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b01559d0 con 0x7fb2b0155550 2024-05-14T01:24:09.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.609+0000 7fb2af7fe640 1 --2- 172.21.15.154:0/2375404626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2b0155550 0x7fb2b006bc90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400d4f0 tx=0x7fb2a400d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:09.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.609+0000 7fb2acff9640 1 -- 172.21.15.154:0/2375404626 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4005480 con 0x7fb2b0155550 2024-05-14T01:24:09.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.609+0000 7fb2acff9640 1 -- 172.21.15.154:0/2375404626 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a4017070 con 0x7fb2b0155550 2024-05-14T01:24:09.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.609+0000 7fb2acff9640 1 -- 172.21.15.154:0/2375404626 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4003820 con 0x7fb2b0155550 2024-05-14T01:24:09.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.609+0000 7fb2b6859640 1 -- 172.21.15.154:0/2375404626 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b0158530 con 0x7fb2b0155550 2024-05-14T01:24:09.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.609+0000 7fb2b6859640 1 -- 172.21.15.154:0/2375404626 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b0157770 con 0x7fb2b0155550 2024-05-14T01:24:09.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.609+0000 7fb2b6859640 1 -- 172.21.15.154:0/2375404626 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2b0068360 con 0x7fb2b0155550 2024-05-14T01:24:09.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.609+0000 7fb2acff9640 1 -- 172.21.15.154:0/2375404626 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb2a40039c0 con 0x7fb2b0155550 2024-05-14T01:24:09.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.609+0000 7fb2acff9640 1 --2- 172.21.15.154:0/2375404626 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb29c0678f0 0x7fb29c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.609+0000 7fb2acff9640 1 -- 172.21.15.154:0/2375404626 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb2a4085a50 con 0x7fb2b0155550 2024-05-14T01:24:09.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.609+0000 7fb2affff640 1 --2- 172.21.15.154:0/2375404626 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb29c0678f0 0x7fb29c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.609+0000 7fb2affff640 1 --2- 172.21.15.154:0/2375404626 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb29c0678f0 0x7fb29c069db0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb2a00099b0 tx=0x7fb2a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:09.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.613+0000 7fb2acff9640 1 -- 172.21.15.154:0/2375404626 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb2b01559d0 con 0x7fb2b0155550 2024-05-14T01:24:09.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.761+0000 7fb2b6859640 1 -- 172.21.15.154:0/2375404626 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb2b00cfef0 con 0x7fb2b0155550 2024-05-14T01:24:09.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.761+0000 7fb2acff9640 1 -- 172.21.15.154:0/2375404626 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fb2a4056590 con 0x7fb2b0155550 2024-05-14T01:24:09.747 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-05-14T01:24:09.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.761+0000 7fb2b6859640 1 -- 172.21.15.154:0/2375404626 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb29c0678f0 msgr2=0x7fb29c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.761+0000 7fb2b6859640 1 --2- 172.21.15.154:0/2375404626 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb29c0678f0 0x7fb29c069db0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb2a00099b0 tx=0x7fb2a0008040 comp rx=0 tx=0).stop 2024-05-14T01:24:09.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.761+0000 7fb2b6859640 1 -- 172.21.15.154:0/2375404626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2b0155550 msgr2=0x7fb2b006bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.761+0000 7fb2b6859640 1 --2- 172.21.15.154:0/2375404626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2b0155550 0x7fb2b006bc90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400d4f0 tx=0x7fb2a400d9b0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.761+0000 7fb2b6859640 1 -- 172.21.15.154:0/2375404626 shutdown_connections 2024-05-14T01:24:09.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.761+0000 7fb2b6859640 1 --2- 172.21.15.154:0/2375404626 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb29c0678f0 0x7fb29c069db0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.761+0000 7fb2b6859640 1 --2- 172.21.15.154:0/2375404626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2b0159390 0x7fb2b0159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.761+0000 7fb2b6859640 1 --2- 172.21.15.154:0/2375404626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2b0155550 0x7fb2b006bc90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.761+0000 7fb2b6859640 1 --2- 172.21.15.154:0/2375404626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2980051d0 0x7fb2b0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.761+0000 7fb2b6859640 1 -- 172.21.15.154:0/2375404626 >> 172.21.15.154:0/2375404626 conn(0x7fb2b009aa10 msgr2=0x7fb2b00ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:09.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.765+0000 7fb2b6859640 1 -- 172.21.15.154:0/2375404626 shutdown_connections 2024-05-14T01:24:09.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.765+0000 7fb2b6859640 1 -- 172.21.15.154:0/2375404626 wait complete. 2024-05-14T01:24:09.765 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T01:24:09.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01feddd640 1 Processor -- start 2024-05-14T01:24:09.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01feddd640 1 -- start start 2024-05-14T01:24:09.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01feddd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01f815bf30 0x7f01f80b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01feddd640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f01f815c310 0x7f01f80d1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01feddd640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01f80b30b0 con 0x7f01f80d08e0 2024-05-14T01:24:09.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01feddd640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f01f80b3390 con 0x7f01f815c310 2024-05-14T01:24:09.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01feddd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f01f80b3670 con 0x7f01f815bf30 2024-05-14T01:24:09.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01fd37a640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f01f80d08e0 0x7f01f815fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54514/0 (socket says 172.21.15.154:54514) 2024-05-14T01:24:09.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01fd37a640 1 -- 172.21.15.154:0/2131088235 learned_addr learned my addr 172.21.15.154:0/2131088235 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01fcb79640 1 --2- 172.21.15.154:0/2131088235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01f815bf30 0x7f01f80b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01f7fff640 1 --2- 172.21.15.154:0/2131088235 >> v2:172.21.15.176:3300/0 conn(0x7f01f815c310 0x7f01f80d1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01f77fe640 1 -- 172.21.15.154:0/2131088235 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3356229298 0 0) 0x7f01f80b30b0 con 0x7f01f80d08e0 2024-05-14T01:24:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01f77fe640 1 -- 172.21.15.154:0/2131088235 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01e0003530 con 0x7f01f80d08e0 2024-05-14T01:24:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01f77fe640 1 -- 172.21.15.154:0/2131088235 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 349925463 0 0) 0x7f01e0003530 con 0x7f01f80d08e0 2024-05-14T01:24:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01f77fe640 1 -- 172.21.15.154:0/2131088235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01f815bf30 msgr2=0x7f01f80b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01f77fe640 1 --2- 172.21.15.154:0/2131088235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01f815bf30 0x7f01f80b27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01f77fe640 1 -- 172.21.15.154:0/2131088235 >> v2:172.21.15.176:3300/0 conn(0x7f01f815c310 msgr2=0x7f01f80d1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01f77fe640 1 --2- 172.21.15.154:0/2131088235 >> v2:172.21.15.176:3300/0 conn(0x7f01f815c310 0x7f01f80d1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01f77fe640 1 -- 172.21.15.154:0/2131088235 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f80aec10 con 0x7f01f80d08e0 2024-05-14T01:24:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01f77fe640 1 -- 172.21.15.154:0/2131088235 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f01f0001a00 con 0x7f01f80d08e0 2024-05-14T01:24:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01f77fe640 1 -- 172.21.15.154:0/2131088235 >> v1:172.21.15.154:6789/0 conn(0x7f01f80d08e0 legacy=0x7f01f815fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01f77fe640 1 --2- 172.21.15.154:0/2131088235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01e00039c0 0x7f01e0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01f77fe640 1 --2- 172.21.15.154:0/2131088235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01e0004810 0x7f01e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01f77fe640 1 --2- 172.21.15.154:0/2131088235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01f815bf30 0x7f01e00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01f77fe640 1 -- 172.21.15.154:0/2131088235 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f01f80b3390 con 0x7f01e00039c0 2024-05-14T01:24:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01f77fe640 1 -- 172.21.15.154:0/2131088235 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f01f80b3670 con 0x7f01e0004810 2024-05-14T01:24:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01f77fe640 1 -- 172.21.15.154:0/2131088235 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f01e000b9d0 con 0x7f01f815bf30 2024-05-14T01:24:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01fcb79640 1 --2- 172.21.15.154:0/2131088235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01e00039c0 0x7f01e0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01fd37a640 1 --2- 172.21.15.154:0/2131088235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01f815bf30 0x7f01e00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01f7fff640 1 --2- 172.21.15.154:0/2131088235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01e0004810 0x7f01e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01fcb79640 1 -- 172.21.15.154:0/2131088235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01f815bf30 msgr2=0x7f01e00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01fcb79640 1 --2- 172.21.15.154:0/2131088235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01f815bf30 0x7f01e00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01fcb79640 1 -- 172.21.15.154:0/2131088235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01e0004810 msgr2=0x7f01e0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01fcb79640 1 --2- 172.21.15.154:0/2131088235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01e0004810 0x7f01e0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.901+0000 7f01fcb79640 1 -- 172.21.15.154:0/2131088235 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e0003530 con 0x7f01e00039c0 2024-05-14T01:24:09.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.905+0000 7f01fcb79640 1 --2- 172.21.15.154:0/2131088235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01e00039c0 0x7f01e0003de0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009ae0 tx=0x7f01e801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148cd28980718efa server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:09.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.905+0000 7f01f77fe640 1 -- 172.21.15.154:0/2131088235 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e80096b0 con 0x7f01e00039c0 2024-05-14T01:24:09.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.905+0000 7f01f77fe640 1 -- 172.21.15.154:0/2131088235 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e80a6480 con 0x7f01e00039c0 2024-05-14T01:24:09.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.905+0000 7f01f77fe640 1 -- 172.21.15.154:0/2131088235 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e80a6870 con 0x7f01e00039c0 2024-05-14T01:24:09.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.905+0000 7f01feddd640 1 -- 172.21.15.154:0/2131088235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01e00039c0 msgr2=0x7f01e0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.905+0000 7f01feddd640 1 --2- 172.21.15.154:0/2131088235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01e00039c0 0x7f01e0003de0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009ae0 tx=0x7f01e801ca70 comp rx=0 tx=0).stop 2024-05-14T01:24:09.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.905+0000 7f01fd37a640 1 -- 172.21.15.154:0/2131088235 reap_dead start 2024-05-14T01:24:09.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.905+0000 7f01feddd640 1 -- 172.21.15.154:0/2131088235 shutdown_connections 2024-05-14T01:24:09.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.905+0000 7f01feddd640 1 -- 172.21.15.154:0/2131088235 >> 172.21.15.154:0/2131088235 conn(0x7f01f809aa10 msgr2=0x7f01f809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:09.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.905+0000 7f01feddd640 1 -- 172.21.15.154:0/2131088235 shutdown_connections 2024-05-14T01:24:09.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.905+0000 7f01feddd640 1 -- 172.21.15.154:0/2131088235 wait complete. 2024-05-14T01:24:09.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.905+0000 7f01feddd640 1 Processor -- start 2024-05-14T01:24:09.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.905+0000 7f01feddd640 1 -- start start 2024-05-14T01:24:09.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01feddd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01f8150100 0x7f01f80cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01feddd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01f80cad20 0x7f01f806f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01feddd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f806f680 0x7f01f80c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01feddd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f01f80d21d0 con 0x7f01f806f680 2024-05-14T01:24:09.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01feddd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f01f80b0670 con 0x7f01f8150100 2024-05-14T01:24:09.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01feddd640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f01f80d2350 con 0x7f01f80cad20 2024-05-14T01:24:09.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01fd37a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f806f680 0x7f01f80c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01fd37a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f806f680 0x7f01f80c8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59272/0 (socket says 172.21.15.154:59272) 2024-05-14T01:24:09.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01fd37a640 1 -- 172.21.15.154:0/2408534221 learned_addr learned my addr 172.21.15.154:0/2408534221 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:09.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01fcb79640 1 --2- 172.21.15.154:0/2408534221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01f8150100 0x7f01f80cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01f7fff640 1 --2- 172.21.15.154:0/2408534221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01f80cad20 0x7f01f806f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01fd37a640 1 -- 172.21.15.154:0/2408534221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01f80cad20 msgr2=0x7f01f806f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01fd37a640 1 --2- 172.21.15.154:0/2408534221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01f80cad20 0x7f01f806f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01fd37a640 1 -- 172.21.15.154:0/2408534221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01f8150100 msgr2=0x7f01f80cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:09.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01fd37a640 1 --2- 172.21.15.154:0/2408534221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01f8150100 0x7f01f80cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:09.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01fd37a640 1 -- 172.21.15.154:0/2408534221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f8150e50 con 0x7f01f806f680 2024-05-14T01:24:09.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01fd37a640 1 --2- 172.21.15.154:0/2408534221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f806f680 0x7f01f80c8e90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f01f8073570 tx=0x7f01f0011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:09.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01f57fa640 1 -- 172.21.15.154:0/2408534221 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0010040 con 0x7f01f806f680 2024-05-14T01:24:09.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01f57fa640 1 -- 172.21.15.154:0/2408534221 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f001a070 con 0x7f01f806f680 2024-05-14T01:24:09.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01f57fa640 1 -- 172.21.15.154:0/2408534221 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0011ea0 con 0x7f01f806f680 2024-05-14T01:24:09.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01feddd640 1 -- 172.21.15.154:0/2408534221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f80ccd30 con 0x7f01f806f680 2024-05-14T01:24:09.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01feddd640 1 -- 172.21.15.154:0/2408534221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f80cd2f0 con 0x7f01f806f680 2024-05-14T01:24:09.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01feddd640 1 -- 172.21.15.154:0/2408534221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f8068360 con 0x7f01f806f680 2024-05-14T01:24:09.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01f57fa640 1 -- 172.21.15.154:0/2408534221 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f01f000fb40 con 0x7f01f806f680 2024-05-14T01:24:09.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01f57fa640 1 --2- 172.21.15.154:0/2408534221 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f01e40678f0 0x7f01e4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:09.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01f57fa640 1 -- 172.21.15.154:0/2408534221 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f01f00889e0 con 0x7f01f806f680 2024-05-14T01:24:09.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01fcb79640 1 --2- 172.21.15.154:0/2408534221 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f01e40678f0 0x7f01e4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:09.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.909+0000 7f01fcb79640 1 --2- 172.21.15.154:0/2408534221 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f01e40678f0 0x7f01e4069db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f01e80ad000 tx=0x7f01e80b2040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:09.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:09.913+0000 7f01f57fa640 1 -- 172.21.15.154:0/2408534221 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f01f0059520 con 0x7f01f806f680 2024-05-14T01:24:10.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.073+0000 7f01feddd640 1 -- 172.21.15.154:0/2408534221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f01f80d0de0 con 0x7f01f806f680 2024-05-14T01:24:10.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.073+0000 7f01f57fa640 1 -- 172.21.15.154:0/2408534221 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f01f0058e20 con 0x7f01f806f680 2024-05-14T01:24:10.061 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-05-14T01:24:10.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.077+0000 7f01feddd640 1 -- 172.21.15.154:0/2408534221 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f01e40678f0 msgr2=0x7f01e4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.077+0000 7f01feddd640 1 --2- 172.21.15.154:0/2408534221 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f01e40678f0 0x7f01e4069db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f01e80ad000 tx=0x7f01e80b2040 comp rx=0 tx=0).stop 2024-05-14T01:24:10.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.077+0000 7f01feddd640 1 -- 172.21.15.154:0/2408534221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f806f680 msgr2=0x7f01f80c8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.077+0000 7f01feddd640 1 --2- 172.21.15.154:0/2408534221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f806f680 0x7f01f80c8e90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f01f8073570 tx=0x7f01f0011b60 comp rx=0 tx=0).stop 2024-05-14T01:24:10.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.077+0000 7f01feddd640 1 -- 172.21.15.154:0/2408534221 shutdown_connections 2024-05-14T01:24:10.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.077+0000 7f01feddd640 1 --2- 172.21.15.154:0/2408534221 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f01e40678f0 0x7f01e4069db0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.077+0000 7f01feddd640 1 --2- 172.21.15.154:0/2408534221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f806f680 0x7f01f80c8e90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.077+0000 7f01feddd640 1 --2- 172.21.15.154:0/2408534221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01f80cad20 0x7f01f806f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.077+0000 7f01feddd640 1 --2- 172.21.15.154:0/2408534221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01f8150100 0x7f01f80cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.077+0000 7f01feddd640 1 -- 172.21.15.154:0/2408534221 >> 172.21.15.154:0/2408534221 conn(0x7f01f809aa10 msgr2=0x7f01f80c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:10.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.077+0000 7f01feddd640 1 -- 172.21.15.154:0/2408534221 shutdown_connections 2024-05-14T01:24:10.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.077+0000 7f01feddd640 1 -- 172.21.15.154:0/2408534221 wait complete. 2024-05-14T01:24:10.079 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi154.front.sepia.ceph.com... 2024-05-14T01:24:10.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:10.079 DEBUG:teuthology.orchestra.run.smithi154:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-14T01:24:10.098 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T01:24:10.098 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-05-14T01:24:10.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:10.098 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-14T01:24:10.150 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:24:10.150 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T01:24:10.156 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:24:10.156 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T01:24:10.205 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:10.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.333+0000 7f37be02d640 1 Processor -- start 2024-05-14T01:24:10.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.333+0000 7f37be02d640 1 -- start start 2024-05-14T01:24:10.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.333+0000 7f37be02d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f37b815e4e0 0x7f37b80d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.333+0000 7f37be02d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b80d29f0 con 0x7f37b815e100 2024-05-14T01:24:10.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.333+0000 7f37be02d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b80d2cd0 con 0x7f37b80cf520 2024-05-14T01:24:10.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.333+0000 7f37be02d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f37b80d2fb0 con 0x7f37b815e4e0 2024-05-14T01:24:10.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.333+0000 7f37b77fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f37b815e100 0x7f37b80cee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54518/0 (socket says 172.21.15.154:54518) 2024-05-14T01:24:10.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.333+0000 7f37b77fe640 1 -- 172.21.15.154:0/2032831604 learned_addr learned my addr 172.21.15.154:0/2032831604 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:10.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.333+0000 7f37b67fc640 1 -- 172.21.15.154:0/2032831604 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3221740524 0 0) 0x7f37b80d29f0 con 0x7f37b815e100 2024-05-14T01:24:10.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.333+0000 7f37b67fc640 1 -- 172.21.15.154:0/2032831604 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37a4003530 con 0x7f37b815e100 2024-05-14T01:24:10.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.333+0000 7f37b7fff640 1 --2- 172.21.15.154:0/2032831604 >> v2:172.21.15.176:3300/0 conn(0x7f37b815e4e0 0x7f37b80d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:10.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.333+0000 7f37b67fc640 1 -- 172.21.15.154:0/2032831604 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2482157009 0 0) 0x7f37a4003530 con 0x7f37b815e100 2024-05-14T01:24:10.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.333+0000 7f37b67fc640 1 -- 172.21.15.154:0/2032831604 >> v2:172.21.15.176:3300/0 conn(0x7f37b815e4e0 msgr2=0x7f37b80d22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:10.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.333+0000 7f37b67fc640 1 --2- 172.21.15.154:0/2032831604 >> v2:172.21.15.176:3300/0 conn(0x7f37b815e4e0 0x7f37b80d22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b67fc640 1 -- 172.21.15.154:0/2032831604 >> v1:172.21.15.176:6789/0 conn(0x7f37b80cf520 legacy=0x7f37b80b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b67fc640 1 -- 172.21.15.154:0/2032831604 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b80d3290 con 0x7f37b815e100 2024-05-14T01:24:10.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b67fc640 1 -- 172.21.15.154:0/2032831604 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f37a8001a00 con 0x7f37b815e100 2024-05-14T01:24:10.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b67fc640 1 -- 172.21.15.154:0/2032831604 >> v1:172.21.15.154:6789/0 conn(0x7f37b815e100 legacy=0x7f37b80cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b67fc640 1 --2- 172.21.15.154:0/2032831604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37a40039c0 0x7f37a4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b67fc640 1 --2- 172.21.15.154:0/2032831604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37a4004810 0x7f37a4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b67fc640 1 --2- 172.21.15.154:0/2032831604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37a40051d0 0x7f37a400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b67fc640 1 -- 172.21.15.154:0/2032831604 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37b80d2fb0 con 0x7f37a40039c0 2024-05-14T01:24:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b67fc640 1 -- 172.21.15.154:0/2032831604 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f37a400c080 con 0x7f37a40051d0 2024-05-14T01:24:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b67fc640 1 -- 172.21.15.154:0/2032831604 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f37a400c280 con 0x7f37a4004810 2024-05-14T01:24:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b77fe640 1 --2- 172.21.15.154:0/2032831604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37a40039c0 0x7f37a4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b7fff640 1 --2- 172.21.15.154:0/2032831604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37a40051d0 0x7f37a400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b6ffd640 1 --2- 172.21.15.154:0/2032831604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37a4004810 0x7f37a4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b77fe640 1 -- 172.21.15.154:0/2032831604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37a4004810 msgr2=0x7f37a4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b77fe640 1 --2- 172.21.15.154:0/2032831604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37a4004810 0x7f37a4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b77fe640 1 -- 172.21.15.154:0/2032831604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37a40051d0 msgr2=0x7f37a400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b77fe640 1 --2- 172.21.15.154:0/2032831604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37a40051d0 0x7f37a400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b77fe640 1 -- 172.21.15.154:0/2032831604 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a4003530 con 0x7f37a40039c0 2024-05-14T01:24:10.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b7fff640 1 --2- 172.21.15.154:0/2032831604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37a40051d0 0x7f37a400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:10.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b6ffd640 1 --2- 172.21.15.154:0/2032831604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37a4004810 0x7f37a4004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:10.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b7fff640 1 -- 172.21.15.154:0/2032831604 reap_dead start 2024-05-14T01:24:10.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b77fe640 1 --2- 172.21.15.154:0/2032831604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37a40039c0 0x7f37a4003de0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f37a800a840 tx=0x7f37a801fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26826e00dffeb871 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b67fc640 1 -- 172.21.15.154:0/2032831604 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a800a460 con 0x7f37a40039c0 2024-05-14T01:24:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b67fc640 1 -- 172.21.15.154:0/2032831604 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a80aa6d0 con 0x7f37a40039c0 2024-05-14T01:24:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37b67fc640 1 -- 172.21.15.154:0/2032831604 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a80aaac0 con 0x7f37a40039c0 2024-05-14T01:24:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37be02d640 1 -- 172.21.15.154:0/2032831604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37a40039c0 msgr2=0x7f37a4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37be02d640 1 --2- 172.21.15.154:0/2032831604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37a40039c0 0x7f37a4003de0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f37a800a840 tx=0x7f37a801fa80 comp rx=0 tx=0).stop 2024-05-14T01:24:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37be02d640 1 -- 172.21.15.154:0/2032831604 shutdown_connections 2024-05-14T01:24:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37be02d640 1 --2- 172.21.15.154:0/2032831604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37a40039c0 0x7f37a4003de0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37be02d640 1 -- 172.21.15.154:0/2032831604 >> 172.21.15.154:0/2032831604 conn(0x7f37b80b5b50 msgr2=0x7f37b80b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37be02d640 1 -- 172.21.15.154:0/2032831604 shutdown_connections 2024-05-14T01:24:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.337+0000 7f37be02d640 1 -- 172.21.15.154:0/2032831604 wait complete. 2024-05-14T01:24:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37be02d640 1 Processor -- start 2024-05-14T01:24:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37be02d640 1 -- start start 2024-05-14T01:24:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37be02d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37a40039c0 0x7f37b81f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37be02d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37b815e920 0x7f37b8157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37be02d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b815ee70 0x7f37b8159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37be02d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37b80d3c10 con 0x7f37b815ee70 2024-05-14T01:24:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37be02d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f37b80d3a90 con 0x7f37b815e920 2024-05-14T01:24:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37be02d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f37b815b2a0 con 0x7f37a40039c0 2024-05-14T01:24:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37b7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b815ee70 0x7f37b8159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37b7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b815ee70 0x7f37b8159300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59296/0 (socket says 172.21.15.154:59296) 2024-05-14T01:24:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37b7fff640 1 -- 172.21.15.154:0/1283026029 learned_addr learned my addr 172.21.15.154:0/1283026029 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37b77fe640 1 --2- 172.21.15.154:0/1283026029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37a40039c0 0x7f37b81f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37b6ffd640 1 --2- 172.21.15.154:0/1283026029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37b815e920 0x7f37b8157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37b7fff640 1 -- 172.21.15.154:0/1283026029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37a40039c0 msgr2=0x7f37b81f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37b7fff640 1 --2- 172.21.15.154:0/1283026029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37a40039c0 0x7f37b81f3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37b7fff640 1 -- 172.21.15.154:0/1283026029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37b815e920 msgr2=0x7f37b8157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37b7fff640 1 --2- 172.21.15.154:0/1283026029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37b815e920 0x7f37b8157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37b7fff640 1 -- 172.21.15.154:0/1283026029 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b8157bd0 con 0x7f37b815ee70 2024-05-14T01:24:10.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37b6ffd640 1 --2- 172.21.15.154:0/1283026029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37b815e920 0x7f37b8157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:10.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37b7fff640 1 --2- 172.21.15.154:0/1283026029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b815ee70 0x7f37b8159300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f37b815e8f0 tx=0x7f37b0011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:10.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37affff640 1 -- 172.21.15.154:0/1283026029 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b0004440 con 0x7f37b815ee70 2024-05-14T01:24:10.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37affff640 1 -- 172.21.15.154:0/1283026029 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b001b070 con 0x7f37b815ee70 2024-05-14T01:24:10.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37affff640 1 -- 172.21.15.154:0/1283026029 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b0003860 con 0x7f37b815ee70 2024-05-14T01:24:10.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37be02d640 1 -- 172.21.15.154:0/1283026029 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b815b4f0 con 0x7f37b815ee70 2024-05-14T01:24:10.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37be02d640 1 -- 172.21.15.154:0/1283026029 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b80cc300 con 0x7f37b815ee70 2024-05-14T01:24:10.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37be02d640 1 -- 172.21.15.154:0/1283026029 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b815ba10 con 0x7f37b815ee70 2024-05-14T01:24:10.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37affff640 1 -- 172.21.15.154:0/1283026029 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f37b0003a00 con 0x7f37b815ee70 2024-05-14T01:24:10.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37affff640 1 --2- 172.21.15.154:0/1283026029 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f37980678c0 0x7f3798069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37affff640 1 -- 172.21.15.154:0/1283026029 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f37b0085f60 con 0x7f37b815ee70 2024-05-14T01:24:10.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.341+0000 7f37b77fe640 1 --2- 172.21.15.154:0/1283026029 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f37980678c0 0x7f3798069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:10.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.345+0000 7f37b77fe640 1 --2- 172.21.15.154:0/1283026029 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f37980678c0 0x7f3798069d80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f37a80b1000 tx=0x7f37b80d2bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:10.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.349+0000 7f37affff640 1 -- 172.21.15.154:0/1283026029 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f37b0056a10 con 0x7f37b815ee70 2024-05-14T01:24:10.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.497+0000 7f37be02d640 1 -- 172.21.15.154:0/1283026029 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37b8075470 con 0x7f37b815ee70 2024-05-14T01:24:10.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.501+0000 7f37affff640 1 -- 172.21.15.154:0/1283026029 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f37b0056310 con 0x7f37b815ee70 2024-05-14T01:24:10.487 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:10.487 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:36.232271+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:10.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.501+0000 7f37be02d640 1 -- 172.21.15.154:0/1283026029 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f37980678c0 msgr2=0x7f3798069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.501+0000 7f37be02d640 1 --2- 172.21.15.154:0/1283026029 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f37980678c0 0x7f3798069d80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f37a80b1000 tx=0x7f37b80d2bc0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.501+0000 7f37be02d640 1 -- 172.21.15.154:0/1283026029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b815ee70 msgr2=0x7f37b8159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.501+0000 7f37be02d640 1 --2- 172.21.15.154:0/1283026029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b815ee70 0x7f37b8159300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f37b815e8f0 tx=0x7f37b0011920 comp rx=0 tx=0).stop 2024-05-14T01:24:10.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.501+0000 7f37be02d640 1 -- 172.21.15.154:0/1283026029 shutdown_connections 2024-05-14T01:24:10.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.501+0000 7f37be02d640 1 --2- 172.21.15.154:0/1283026029 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f37980678c0 0x7f3798069d80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.501+0000 7f37be02d640 1 --2- 172.21.15.154:0/1283026029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b815ee70 0x7f37b8159300 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.501+0000 7f37be02d640 1 --2- 172.21.15.154:0/1283026029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37b815e920 0x7f37b8157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.501+0000 7f37be02d640 1 --2- 172.21.15.154:0/1283026029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37a40039c0 0x7f37b81f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.501+0000 7f37be02d640 1 -- 172.21.15.154:0/1283026029 >> 172.21.15.154:0/1283026029 conn(0x7f37b80b5b50 msgr2=0x7f37b80b8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:10.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.501+0000 7f37be02d640 1 -- 172.21.15.154:0/1283026029 shutdown_connections 2024-05-14T01:24:10.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.501+0000 7f37be02d640 1 -- 172.21.15.154:0/1283026029 wait complete. 2024-05-14T01:24:10.505 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T01:23:33.083538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T01:23:33.556058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:24:10.505 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:24:10.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.641+0000 7ff3c9c2a640 1 Processor -- start 2024-05-14T01:24:10.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.641+0000 7ff3c9c2a640 1 -- start start 2024-05-14T01:24:10.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.641+0000 7ff3c9c2a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff3c406d710 0x7ff3c406daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.641+0000 7ff3c9c2a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3c406f1b0 0x7ff3c406e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.641+0000 7ff3c9c2a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c415d280 con 0x7ff3c40716b0 2024-05-14T01:24:10.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.641+0000 7ff3c9c2a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c406e570 con 0x7ff3c406d710 2024-05-14T01:24:10.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.641+0000 7ff3c9c2a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c40cd0e0 con 0x7ff3c406f1b0 2024-05-14T01:24:10.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.641+0000 7ff3c37fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff3c406d710 0x7ff3c406daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:10.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.641+0000 7ff3c3fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff3c40716b0 0x7ff3c4071b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54526/0 (socket says 172.21.15.154:54526) 2024-05-14T01:24:10.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.641+0000 7ff3c3fff640 1 -- 172.21.15.154:0/1350259313 learned_addr learned my addr 172.21.15.154:0/1350259313 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:10.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.641+0000 7ff3c37fe640 1 -- 172.21.15.154:0/1350259313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3c406f1b0 msgr2=0x7ff3c406e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:10.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.641+0000 7ff3c2ffd640 1 --2- 172.21.15.154:0/1350259313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3c406f1b0 0x7ff3c406e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:10.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.641+0000 7ff3c27fc640 1 -- 172.21.15.154:0/1350259313 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656126487 0 0) 0x7ff3c415d280 con 0x7ff3c40716b0 2024-05-14T01:24:10.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.641+0000 7ff3c37fe640 1 --2- 172.21.15.154:0/1350259313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3c406f1b0 0x7ff3c406e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.641+0000 7ff3c37fe640 1 -- 172.21.15.154:0/1350259313 >> v1:172.21.15.154:6789/0 conn(0x7ff3c40716b0 legacy=0x7ff3c4071b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.641+0000 7ff3c37fe640 1 -- 172.21.15.154:0/1350259313 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c40cd3c0 con 0x7ff3c406d710 2024-05-14T01:24:10.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c37fe640 1 --2- 172.21.15.154:0/1350259313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c406d710 0x7ff3c406daf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009d90 tx=0x7ff3bc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19e6e17ea24de52 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:10.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c27fc640 1 -- 172.21.15.154:0/1350259313 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc0b2070 con 0x7ff3c406d710 2024-05-14T01:24:10.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c27fc640 1 -- 172.21.15.154:0/1350259313 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3bc0a5830 con 0x7ff3c406d710 2024-05-14T01:24:10.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c27fc640 1 -- 172.21.15.154:0/1350259313 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc0a5c00 con 0x7ff3c406d710 2024-05-14T01:24:10.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c9c2a640 1 -- 172.21.15.154:0/1350259313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c406d710 msgr2=0x7ff3c406daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c9c2a640 1 --2- 172.21.15.154:0/1350259313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c406d710 0x7ff3c406daf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009d90 tx=0x7ff3bc01c970 comp rx=0 tx=0).stop 2024-05-14T01:24:10.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c9c2a640 1 -- 172.21.15.154:0/1350259313 shutdown_connections 2024-05-14T01:24:10.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c9c2a640 1 --2- 172.21.15.154:0/1350259313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3c406f1b0 0x7ff3c406e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c9c2a640 1 --2- 172.21.15.154:0/1350259313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c406d710 0x7ff3c406daf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c9c2a640 1 -- 172.21.15.154:0/1350259313 >> 172.21.15.154:0/1350259313 conn(0x7ff3c40b21b0 msgr2=0x7ff3c40b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:10.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c9c2a640 1 -- 172.21.15.154:0/1350259313 shutdown_connections 2024-05-14T01:24:10.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c9c2a640 1 -- 172.21.15.154:0/1350259313 wait complete. 2024-05-14T01:24:10.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c9c2a640 1 Processor -- start 2024-05-14T01:24:10.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c9c2a640 1 -- start start 2024-05-14T01:24:10.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c9c2a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3c406d710 0x7ff3c41562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c9c2a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3c406f1b0 0x7ff3c40ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c9c2a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c40716b0 0x7ff3c40ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c9c2a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c41692e0 con 0x7ff3c40716b0 2024-05-14T01:24:10.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c9c2a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c4159f30 con 0x7ff3c406d710 2024-05-14T01:24:10.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c9c2a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c4169460 con 0x7ff3c406f1b0 2024-05-14T01:24:10.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c40716b0 0x7ff3c40ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:10.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c40716b0 0x7ff3c40ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59308/0 (socket says 172.21.15.154:59308) 2024-05-14T01:24:10.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c3fff640 1 -- 172.21.15.154:0/2055081653 learned_addr learned my addr 172.21.15.154:0/2055081653 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:10.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c3fff640 1 -- 172.21.15.154:0/2055081653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3c406f1b0 msgr2=0x7ff3c40ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c3fff640 1 --2- 172.21.15.154:0/2055081653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3c406f1b0 0x7ff3c40ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c3fff640 1 -- 172.21.15.154:0/2055081653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3c406d710 msgr2=0x7ff3c41562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c3fff640 1 --2- 172.21.15.154:0/2055081653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3c406d710 0x7ff3c41562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.645+0000 7ff3c3fff640 1 -- 172.21.15.154:0/2055081653 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c40aa310 con 0x7ff3c40716b0 2024-05-14T01:24:10.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.649+0000 7ff3c3fff640 1 --2- 172.21.15.154:0/2055081653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c40716b0 0x7ff3c40ae8e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400c480 tx=0x7ff3b400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:10.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.649+0000 7ff3bbfff640 1 -- 172.21.15.154:0/2055081653 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4018070 con 0x7ff3c40716b0 2024-05-14T01:24:10.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.649+0000 7ff3bbfff640 1 -- 172.21.15.154:0/2055081653 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b40074e0 con 0x7ff3c40716b0 2024-05-14T01:24:10.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.649+0000 7ff3bbfff640 1 -- 172.21.15.154:0/2055081653 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4004a30 con 0x7ff3c40716b0 2024-05-14T01:24:10.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.649+0000 7ff3c9c2a640 1 -- 172.21.15.154:0/2055081653 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c40aa5f0 con 0x7ff3c40716b0 2024-05-14T01:24:10.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.649+0000 7ff3c9c2a640 1 -- 172.21.15.154:0/2055081653 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c40aabb0 con 0x7ff3c40716b0 2024-05-14T01:24:10.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.649+0000 7ff3c9c2a640 1 -- 172.21.15.154:0/2055081653 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c40aadf0 con 0x7ff3c40716b0 2024-05-14T01:24:10.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.649+0000 7ff3bbfff640 1 -- 172.21.15.154:0/2055081653 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff3b4004bd0 con 0x7ff3c40716b0 2024-05-14T01:24:10.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.649+0000 7ff3bbfff640 1 --2- 172.21.15.154:0/2055081653 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff3a40678c0 0x7ff3a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.649+0000 7ff3bbfff640 1 -- 172.21.15.154:0/2055081653 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff3b4084f40 con 0x7ff3c40716b0 2024-05-14T01:24:10.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.649+0000 7ff3c37fe640 1 --2- 172.21.15.154:0/2055081653 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff3a40678c0 0x7ff3a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:10.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.649+0000 7ff3c37fe640 1 --2- 172.21.15.154:0/2055081653 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff3a40678c0 0x7ff3a4069d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc0af000 tx=0x7ff3bc004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:10.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.653+0000 7ff3bbfff640 1 -- 172.21.15.154:0/2055081653 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7ff3b4055b10 con 0x7ff3c40716b0 2024-05-14T01:24:10.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.801+0000 7ff3c9c2a640 1 -- 172.21.15.154:0/2055081653 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff3c40b08d0 con 0x7ff3c40716b0 2024-05-14T01:24:10.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.801+0000 7ff3bbfff640 1 -- 172.21.15.154:0/2055081653 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7ff3b4055410 con 0x7ff3c40716b0 2024-05-14T01:24:10.789 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:24:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.805+0000 7ff3c9c2a640 1 -- 172.21.15.154:0/2055081653 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff3a40678c0 msgr2=0x7ff3a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.805+0000 7ff3c9c2a640 1 --2- 172.21.15.154:0/2055081653 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff3a40678c0 0x7ff3a4069d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc0af000 tx=0x7ff3bc004ac0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.805+0000 7ff3c9c2a640 1 -- 172.21.15.154:0/2055081653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c40716b0 msgr2=0x7ff3c40ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.805+0000 7ff3c9c2a640 1 --2- 172.21.15.154:0/2055081653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c40716b0 0x7ff3c40ae8e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400c480 tx=0x7ff3b400c940 comp rx=0 tx=0).stop 2024-05-14T01:24:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.805+0000 7ff3c9c2a640 1 -- 172.21.15.154:0/2055081653 shutdown_connections 2024-05-14T01:24:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.805+0000 7ff3c9c2a640 1 --2- 172.21.15.154:0/2055081653 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff3a40678c0 0x7ff3a4069d80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.805+0000 7ff3c9c2a640 1 --2- 172.21.15.154:0/2055081653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c40716b0 0x7ff3c40ae8e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.805+0000 7ff3c9c2a640 1 --2- 172.21.15.154:0/2055081653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3c406f1b0 0x7ff3c40ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.805+0000 7ff3c9c2a640 1 --2- 172.21.15.154:0/2055081653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3c406d710 0x7ff3c41562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.805+0000 7ff3c9c2a640 1 -- 172.21.15.154:0/2055081653 >> 172.21.15.154:0/2055081653 conn(0x7ff3c40b21b0 msgr2=0x7ff3c4071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.805+0000 7ff3c9c2a640 1 -- 172.21.15.154:0/2055081653 shutdown_connections 2024-05-14T01:24:10.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.805+0000 7ff3c9c2a640 1 -- 172.21.15.154:0/2055081653 wait complete. 2024-05-14T01:24:10.806 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T01:24:10.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.937+0000 7f2752011640 1 Processor -- start 2024-05-14T01:24:10.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.937+0000 7f2752011640 1 -- start start 2024-05-14T01:24:10.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.937+0000 7f2752011640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f274c162a60 0x7f274c0d2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.937+0000 7f2752011640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f274c15e910 con 0x7f274c15e530 2024-05-14T01:24:10.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.937+0000 7f2752011640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f274c0cec20 con 0x7f274c0d0f70 2024-05-14T01:24:10.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.937+0000 7f2752011640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f274c0cef00 con 0x7f274c162a60 2024-05-14T01:24:10.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.937+0000 7f274bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f274c162a60 0x7f274c0d2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:10.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.937+0000 7f274b7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f274c15e530 0x7f274c0d0860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54536/0 (socket says 172.21.15.154:54536) 2024-05-14T01:24:10.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.937+0000 7f274bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f274c162a60 0x7f274c0d2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59316/0 (socket says 172.21.15.154:59316) 2024-05-14T01:24:10.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.937+0000 7f274b7fe640 1 -- 172.21.15.154:0/1124527113 learned_addr learned my addr 172.21.15.154:0/1124527113 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:10.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.937+0000 7f274bfff640 1 -- 172.21.15.154:0/1124527113 >> v1:172.21.15.176:6789/0 conn(0x7f274c0d0f70 legacy=0x7f274c0d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:10.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.937+0000 7f274bfff640 1 -- 172.21.15.154:0/1124527113 >> v1:172.21.15.154:6789/0 conn(0x7f274c15e530 legacy=0x7f274c0d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.937+0000 7f274a7fc640 1 -- 172.21.15.154:0/1124527113 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364154015 0 0) 0x7f274c15e910 con 0x7f274c15e530 2024-05-14T01:24:10.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.937+0000 7f274bfff640 1 -- 172.21.15.154:0/1124527113 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f274c0cf1e0 con 0x7f274c162a60 2024-05-14T01:24:10.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.941+0000 7f274bfff640 1 --2- 172.21.15.154:0/1124527113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f274c162a60 0x7f274c0d2b40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2744009d90 tx=0x7f274401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb1b08002b1f8e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:10.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.941+0000 7f274a7fc640 1 -- 172.21.15.154:0/1124527113 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27440b2070 con 0x7f274c162a60 2024-05-14T01:24:10.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.941+0000 7f274a7fc640 1 -- 172.21.15.154:0/1124527113 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27440a5900 con 0x7f274c162a60 2024-05-14T01:24:10.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.941+0000 7f274a7fc640 1 -- 172.21.15.154:0/1124527113 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27440a5cd0 con 0x7f274c162a60 2024-05-14T01:24:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.941+0000 7f2752011640 1 -- 172.21.15.154:0/1124527113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f274c162a60 msgr2=0x7f274c0d2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.941+0000 7f2752011640 1 --2- 172.21.15.154:0/1124527113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f274c162a60 0x7f274c0d2b40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2744009d90 tx=0x7f274401c930 comp rx=0 tx=0).stop 2024-05-14T01:24:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.941+0000 7f2752011640 1 -- 172.21.15.154:0/1124527113 shutdown_connections 2024-05-14T01:24:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.941+0000 7f2752011640 1 --2- 172.21.15.154:0/1124527113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f274c162a60 0x7f274c0d2b40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.941+0000 7f2752011640 1 -- 172.21.15.154:0/1124527113 >> 172.21.15.154:0/1124527113 conn(0x7f274c0b5b80 msgr2=0x7f274c0b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.941+0000 7f2752011640 1 -- 172.21.15.154:0/1124527113 shutdown_connections 2024-05-14T01:24:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.941+0000 7f2752011640 1 -- 172.21.15.154:0/1124527113 wait complete. 2024-05-14T01:24:10.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.941+0000 7f2752011640 1 Processor -- start 2024-05-14T01:24:10.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.941+0000 7f2752011640 1 -- start start 2024-05-14T01:24:10.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f2752011640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f274c0d0f70 0x7f274c1550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f2752011640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f274c15e530 0x7f274c15bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f2752011640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f274c162a60 0x7f274c156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f2752011640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f274c16cbb0 con 0x7f274c15e530 2024-05-14T01:24:10.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f2752011640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f274c0d3490 con 0x7f274c0d0f70 2024-05-14T01:24:10.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f2752011640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f274c16cd30 con 0x7f274c162a60 2024-05-14T01:24:10.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f274affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f274c15e530 0x7f274c15bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:10.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f274affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f274c15e530 0x7f274c15bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59322/0 (socket says 172.21.15.154:59322) 2024-05-14T01:24:10.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f274affd640 1 -- 172.21.15.154:0/2627998148 learned_addr learned my addr 172.21.15.154:0/2627998148 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:10.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f274affd640 1 -- 172.21.15.154:0/2627998148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f274c162a60 msgr2=0x7f274c156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f274b7fe640 1 --2- 172.21.15.154:0/2627998148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f274c0d0f70 0x7f274c1550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:10.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f274bfff640 1 --2- 172.21.15.154:0/2627998148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f274c162a60 0x7f274c156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:10.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f274affd640 1 --2- 172.21.15.154:0/2627998148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f274c162a60 0x7f274c156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f274affd640 1 -- 172.21.15.154:0/2627998148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f274c0d0f70 msgr2=0x7f274c1550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:10.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f274affd640 1 --2- 172.21.15.154:0/2627998148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f274c0d0f70 0x7f274c1550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:10.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f274affd640 1 -- 172.21.15.154:0/2627998148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f274c15c800 con 0x7f274c15e530 2024-05-14T01:24:10.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f274b7fe640 1 --2- 172.21.15.154:0/2627998148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f274c0d0f70 0x7f274c1550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:10.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f274affd640 1 --2- 172.21.15.154:0/2627998148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f274c15e530 0x7f274c15bdd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f274000c410 tx=0x7f274000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:10.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f2733fff640 1 -- 172.21.15.154:0/2627998148 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740011790 con 0x7f274c15e530 2024-05-14T01:24:10.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f2733fff640 1 -- 172.21.15.154:0/2627998148 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2740017070 con 0x7f274c15e530 2024-05-14T01:24:10.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f2733fff640 1 -- 172.21.15.154:0/2627998148 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740011b70 con 0x7f274c15e530 2024-05-14T01:24:10.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f2752011640 1 -- 172.21.15.154:0/2627998148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f274c156e20 con 0x7f274c15e530 2024-05-14T01:24:10.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f2752011640 1 -- 172.21.15.154:0/2627998148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f274c1573e0 con 0x7f274c15e530 2024-05-14T01:24:10.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f2752011640 1 -- 172.21.15.154:0/2627998148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f274c075470 con 0x7f274c15e530 2024-05-14T01:24:10.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f2733fff640 1 -- 172.21.15.154:0/2627998148 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2740011d10 con 0x7f274c15e530 2024-05-14T01:24:10.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f2733fff640 1 --2- 172.21.15.154:0/2627998148 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f27380678c0 0x7f2738069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:10.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f2733fff640 1 -- 172.21.15.154:0/2627998148 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f27400858d0 con 0x7f274c15e530 2024-05-14T01:24:10.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f274b7fe640 1 --2- 172.21.15.154:0/2627998148 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f27380678c0 0x7f2738069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:10.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.945+0000 7f274b7fe640 1 --2- 172.21.15.154:0/2627998148 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f27380678c0 0x7f2738069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f273c000f70 tx=0x7f273c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:10.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:10.949+0000 7f2733fff640 1 -- 172.21.15.154:0/2627998148 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f2740021020 con 0x7f274c15e530 2024-05-14T01:24:11.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.105+0000 7f2752011640 1 -- 172.21.15.154:0/2627998148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f274c0c79a0 con 0x7f274c15e530 2024-05-14T01:24:11.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.109+0000 7f2733fff640 1 -- 172.21.15.154:0/2627998148 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f2740056410 con 0x7f274c15e530 2024-05-14T01:24:11.094 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-05-14T01:24:11.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.109+0000 7f2752011640 1 -- 172.21.15.154:0/2627998148 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f27380678c0 msgr2=0x7f2738069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.109+0000 7f2752011640 1 --2- 172.21.15.154:0/2627998148 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f27380678c0 0x7f2738069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f273c000f70 tx=0x7f273c009040 comp rx=0 tx=0).stop 2024-05-14T01:24:11.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.109+0000 7f2752011640 1 -- 172.21.15.154:0/2627998148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f274c15e530 msgr2=0x7f274c15bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.109+0000 7f2752011640 1 --2- 172.21.15.154:0/2627998148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f274c15e530 0x7f274c15bdd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f274000c410 tx=0x7f274000c8d0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.109+0000 7f2752011640 1 -- 172.21.15.154:0/2627998148 shutdown_connections 2024-05-14T01:24:11.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.109+0000 7f2752011640 1 --2- 172.21.15.154:0/2627998148 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f27380678c0 0x7f2738069d80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.109+0000 7f2752011640 1 --2- 172.21.15.154:0/2627998148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f274c162a60 0x7f274c156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.109+0000 7f2752011640 1 --2- 172.21.15.154:0/2627998148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f274c15e530 0x7f274c15bdd0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.109+0000 7f2752011640 1 --2- 172.21.15.154:0/2627998148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f274c0d0f70 0x7f274c1550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.109+0000 7f2752011640 1 -- 172.21.15.154:0/2627998148 >> 172.21.15.154:0/2627998148 conn(0x7f274c0b5b80 msgr2=0x7f274c0b7600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:11.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.109+0000 7f2752011640 1 -- 172.21.15.154:0/2627998148 shutdown_connections 2024-05-14T01:24:11.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.109+0000 7f2752011640 1 -- 172.21.15.154:0/2627998148 wait complete. 2024-05-14T01:24:11.112 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T01:24:11.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.237+0000 7f6f4016a640 1 Processor -- start 2024-05-14T01:24:11.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.237+0000 7f6f4016a640 1 -- start start 2024-05-14T01:24:11.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.237+0000 7f6f4016a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f380d02a0 0x7f6f380d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:11.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.237+0000 7f6f4016a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6f38143840 0x7f6f38143ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:11.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.237+0000 7f6f4016a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f380b3fa0 con 0x7f6f38143460 2024-05-14T01:24:11.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.237+0000 7f6f4016a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6f380d0c40 con 0x7f6f38143840 2024-05-14T01:24:11.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.237+0000 7f6f4016a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6f38161cb0 con 0x7f6f380d02a0 2024-05-14T01:24:11.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.237+0000 7f6f3d705640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f380d02a0 0x7f6f380d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:11.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.237+0000 7f6f3e707640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6f38143840 0x7f6f38143ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:11.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.237+0000 7f6f3e707640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6f38143840 0x7f6f38143ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:40832/0 (socket says 172.21.15.154:40832) 2024-05-14T01:24:11.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.237+0000 7f6f3df06640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f6f38143460 0x7f6f380b34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:43980/0 (socket says 172.21.15.154:43980) 2024-05-14T01:24:11.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.237+0000 7f6f3e707640 1 -- 172.21.15.154:0/2743510573 learned_addr learned my addr 172.21.15.154:0/2743510573 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:11.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.237+0000 7f6f3e707640 1 -- 172.21.15.154:0/2743510573 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f380d02a0 msgr2=0x7f6f380d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:11.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.237+0000 7f6f3e707640 1 --2- 172.21.15.154:0/2743510573 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f380d02a0 0x7f6f380d0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.237+0000 7f6f3e707640 1 -- 172.21.15.154:0/2743510573 >> v1:172.21.15.176:6789/0 conn(0x7f6f38143460 legacy=0x7f6f380b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.237+0000 7f6f3e707640 1 -- 172.21.15.154:0/2743510573 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f38161f00 con 0x7f6f38143840 2024-05-14T01:24:11.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.241+0000 7f6f3e707640 1 --2- 172.21.15.154:0/2743510573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f38143840 0x7f6f38143ca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6f30009e50 tx=0x7f6f3001c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f80b10c95ce4dbb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.241+0000 7f6f3cf04640 1 -- 172.21.15.154:0/2743510573 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f300a5770 con 0x7f6f38143840 2024-05-14T01:24:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.241+0000 7f6f3cf04640 1 -- 172.21.15.154:0/2743510573 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f300a5910 con 0x7f6f38143840 2024-05-14T01:24:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.241+0000 7f6f3cf04640 1 -- 172.21.15.154:0/2743510573 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f300a5ce0 con 0x7f6f38143840 2024-05-14T01:24:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.241+0000 7f6f4016a640 1 -- 172.21.15.154:0/2743510573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f38143840 msgr2=0x7f6f38143ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.241+0000 7f6f4016a640 1 --2- 172.21.15.154:0/2743510573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f38143840 0x7f6f38143ca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6f30009e50 tx=0x7f6f3001c9a0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.241+0000 7f6f4016a640 1 -- 172.21.15.154:0/2743510573 shutdown_connections 2024-05-14T01:24:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.241+0000 7f6f4016a640 1 --2- 172.21.15.154:0/2743510573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f38143840 0x7f6f38143ca0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.241+0000 7f6f4016a640 1 --2- 172.21.15.154:0/2743510573 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f380d02a0 0x7f6f380d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.241+0000 7f6f4016a640 1 -- 172.21.15.154:0/2743510573 >> 172.21.15.154:0/2743510573 conn(0x7f6f380b21b0 msgr2=0x7f6f380b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.241+0000 7f6f4016a640 1 -- 172.21.15.154:0/2743510573 shutdown_connections 2024-05-14T01:24:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.241+0000 7f6f4016a640 1 -- 172.21.15.154:0/2743510573 wait complete. 2024-05-14T01:24:11.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f4016a640 1 Processor -- start 2024-05-14T01:24:11.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f4016a640 1 -- start start 2024-05-14T01:24:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f4016a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f380d02a0 0x7f6f3812af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f4016a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f38143460 0x7f6f38158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f4016a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f38143840 0x7f6f38158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f4016a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6f38162b40 con 0x7f6f38143460 2024-05-14T01:24:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f4016a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6f381629c0 con 0x7f6f380d02a0 2024-05-14T01:24:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f4016a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6f3816b050 con 0x7f6f38143840 2024-05-14T01:24:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f3d705640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f38143460 0x7f6f38158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f3d705640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f38143460 0x7f6f38158670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59330/0 (socket says 172.21.15.154:59330) 2024-05-14T01:24:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f3d705640 1 -- 172.21.15.154:0/1935080347 learned_addr learned my addr 172.21.15.154:0/1935080347 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f3df06640 1 --2- 172.21.15.154:0/1935080347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f380d02a0 0x7f6f3812af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f3e707640 1 --2- 172.21.15.154:0/1935080347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f38143840 0x7f6f38158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f3d705640 1 -- 172.21.15.154:0/1935080347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f38143840 msgr2=0x7f6f38158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f3d705640 1 --2- 172.21.15.154:0/1935080347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f38143840 0x7f6f38158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f3d705640 1 -- 172.21.15.154:0/1935080347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f380d02a0 msgr2=0x7f6f3812af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f3d705640 1 --2- 172.21.15.154:0/1935080347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f380d02a0 0x7f6f3812af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f3d705640 1 -- 172.21.15.154:0/1935080347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f3812b4c0 con 0x7f6f38143460 2024-05-14T01:24:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f3e707640 1 --2- 172.21.15.154:0/1935080347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f38143840 0x7f6f38158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f3d705640 1 --2- 172.21.15.154:0/1935080347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f38143460 0x7f6f38158670 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6f2800e870 tx=0x7f6f2800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f2e7fc640 1 -- 172.21.15.154:0/1935080347 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f28017070 con 0x7f6f38143460 2024-05-14T01:24:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f2e7fc640 1 -- 172.21.15.154:0/1935080347 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f2800c940 con 0x7f6f38143460 2024-05-14T01:24:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f4016a640 1 -- 172.21.15.154:0/1935080347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f380ae600 con 0x7f6f38143460 2024-05-14T01:24:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f2e7fc640 1 -- 172.21.15.154:0/1935080347 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2800ccf0 con 0x7f6f38143460 2024-05-14T01:24:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f4016a640 1 -- 172.21.15.154:0/1935080347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f380aebc0 con 0x7f6f38143460 2024-05-14T01:24:11.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f4016a640 1 -- 172.21.15.154:0/1935080347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f38068360 con 0x7f6f38143460 2024-05-14T01:24:11.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.245+0000 7f6f2e7fc640 1 -- 172.21.15.154:0/1935080347 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6f2801a070 con 0x7f6f38143460 2024-05-14T01:24:11.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.249+0000 7f6f2e7fc640 1 --2- 172.21.15.154:0/1935080347 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6f1c0678c0 0x7f6f1c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:11.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.249+0000 7f6f2e7fc640 1 -- 172.21.15.154:0/1935080347 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6f28085c90 con 0x7f6f38143460 2024-05-14T01:24:11.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.249+0000 7f6f3df06640 1 --2- 172.21.15.154:0/1935080347 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6f1c0678c0 0x7f6f1c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:11.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.249+0000 7f6f3df06640 1 --2- 172.21.15.154:0/1935080347 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6f1c0678c0 0x7f6f1c069d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6f34000f70 tx=0x7f6f34007cf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:11.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.253+0000 7f6f2e7fc640 1 -- 172.21.15.154:0/1935080347 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f6f280566b0 con 0x7f6f38143460 2024-05-14T01:24:11.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.413+0000 7f6f4016a640 1 -- 172.21.15.154:0/1935080347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6f38142510 con 0x7f6f38143460 2024-05-14T01:24:11.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.413+0000 7f6f2e7fc640 1 -- 172.21.15.154:0/1935080347 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f6f28055fb0 con 0x7f6f38143460 2024-05-14T01:24:11.400 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-05-14T01:24:11.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.417+0000 7f6f4016a640 1 -- 172.21.15.154:0/1935080347 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6f1c0678c0 msgr2=0x7f6f1c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.417+0000 7f6f4016a640 1 --2- 172.21.15.154:0/1935080347 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6f1c0678c0 0x7f6f1c069d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6f34000f70 tx=0x7f6f34007cf0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.417+0000 7f6f4016a640 1 -- 172.21.15.154:0/1935080347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f38143460 msgr2=0x7f6f38158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.417+0000 7f6f4016a640 1 --2- 172.21.15.154:0/1935080347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f38143460 0x7f6f38158670 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6f2800e870 tx=0x7f6f2800ec70 comp rx=0 tx=0).stop 2024-05-14T01:24:11.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.417+0000 7f6f4016a640 1 -- 172.21.15.154:0/1935080347 shutdown_connections 2024-05-14T01:24:11.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.417+0000 7f6f4016a640 1 --2- 172.21.15.154:0/1935080347 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6f1c0678c0 0x7f6f1c069d80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.417+0000 7f6f4016a640 1 --2- 172.21.15.154:0/1935080347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f38143840 0x7f6f38158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.417+0000 7f6f4016a640 1 --2- 172.21.15.154:0/1935080347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f38143460 0x7f6f38158670 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.417+0000 7f6f4016a640 1 --2- 172.21.15.154:0/1935080347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f380d02a0 0x7f6f3812af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.417+0000 7f6f4016a640 1 -- 172.21.15.154:0/1935080347 >> 172.21.15.154:0/1935080347 conn(0x7f6f380b21b0 msgr2=0x7f6f3815e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:11.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.417+0000 7f6f4016a640 1 -- 172.21.15.154:0/1935080347 shutdown_connections 2024-05-14T01:24:11.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.417+0000 7f6f4016a640 1 -- 172.21.15.154:0/1935080347 wait complete. 2024-05-14T01:24:11.419 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T01:24:11.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.557+0000 7fa02b52d640 1 Processor -- start 2024-05-14T01:24:11.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.557+0000 7fa02b52d640 1 -- start start 2024-05-14T01:24:11.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.557+0000 7fa02b52d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa024144760 0x7fa02406e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:11.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.557+0000 7fa02b52d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa024144b40 con 0x7fa0240b3530 2024-05-14T01:24:11.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.557+0000 7fa02b52d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0240b3a40 con 0x7fa02415bae0 2024-05-14T01:24:11.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.557+0000 7fa02b52d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa0240b4650 con 0x7fa024144760 2024-05-14T01:24:11.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.557+0000 7fa028ac8640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa0240b3530 0x7fa02415b3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54546/0 (socket says 172.21.15.154:54546) 2024-05-14T01:24:11.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.557+0000 7fa028ac8640 1 -- 172.21.15.154:0/324192876 learned_addr learned my addr 172.21.15.154:0/324192876 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:11.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.557+0000 7fa0292c9640 1 --2- 172.21.15.154:0/324192876 >> v2:172.21.15.154:3300/0 conn(0x7fa024144760 0x7fa02406e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:11.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.557+0000 7fa023fff640 1 -- 172.21.15.154:0/324192876 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396285187 0 0) 0x7fa024144b40 con 0x7fa0240b3530 2024-05-14T01:24:11.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.557+0000 7fa023fff640 1 -- 172.21.15.154:0/324192876 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa00c003530 con 0x7fa0240b3530 2024-05-14T01:24:11.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.557+0000 7fa0292c9640 1 -- 172.21.15.154:0/324192876 >> v1:172.21.15.176:6789/0 conn(0x7fa02415bae0 legacy=0x7fa02415c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.557+0000 7fa0292c9640 1 -- 172.21.15.154:0/324192876 >> v1:172.21.15.154:6789/0 conn(0x7fa0240b3530 legacy=0x7fa02415b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.557+0000 7fa0292c9640 1 -- 172.21.15.154:0/324192876 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0240b3d20 con 0x7fa024144760 2024-05-14T01:24:11.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.561+0000 7fa0292c9640 1 --2- 172.21.15.154:0/324192876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa024144760 0x7fa02406e680 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa014009d90 tx=0x7fa01401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ac821a2874fc60 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:11.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.561+0000 7fa023fff640 1 -- 172.21.15.154:0/324192876 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0140b2070 con 0x7fa024144760 2024-05-14T01:24:11.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.561+0000 7fa023fff640 1 -- 172.21.15.154:0/324192876 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0140a5a00 con 0x7fa024144760 2024-05-14T01:24:11.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.561+0000 7fa023fff640 1 -- 172.21.15.154:0/324192876 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0140a5dd0 con 0x7fa024144760 2024-05-14T01:24:11.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.561+0000 7fa02b52d640 1 -- 172.21.15.154:0/324192876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa024144760 msgr2=0x7fa02406e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.561+0000 7fa02b52d640 1 --2- 172.21.15.154:0/324192876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa024144760 0x7fa02406e680 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa014009d90 tx=0x7fa01401c940 comp rx=0 tx=0).stop 2024-05-14T01:24:11.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.561+0000 7fa02b52d640 1 -- 172.21.15.154:0/324192876 shutdown_connections 2024-05-14T01:24:11.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.561+0000 7fa02b52d640 1 --2- 172.21.15.154:0/324192876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa024144760 0x7fa02406e680 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.561+0000 7fa02b52d640 1 -- 172.21.15.154:0/324192876 >> 172.21.15.154:0/324192876 conn(0x7fa0240b1850 msgr2=0x7fa0240b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:11.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.561+0000 7fa02b52d640 1 -- 172.21.15.154:0/324192876 shutdown_connections 2024-05-14T01:24:11.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.561+0000 7fa02b52d640 1 -- 172.21.15.154:0/324192876 wait complete. 2024-05-14T01:24:11.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.561+0000 7fa02b52d640 1 Processor -- start 2024-05-14T01:24:11.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.561+0000 7fa02b52d640 1 -- start start 2024-05-14T01:24:11.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa02b52d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0240b3530 0x7fa0240cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:11.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa02b52d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa024144760 0x7fa0240ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:11.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa02b52d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa02415bae0 0x7fa0240ce730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:11.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa02b52d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa02415d680 con 0x7fa024144760 2024-05-14T01:24:11.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa02b52d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa02415d500 con 0x7fa02415bae0 2024-05-14T01:24:11.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa02b52d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa02415d800 con 0x7fa0240b3530 2024-05-14T01:24:11.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa028ac8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa024144760 0x7fa0240ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:11.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa028ac8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa024144760 0x7fa0240ce1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59350/0 (socket says 172.21.15.154:59350) 2024-05-14T01:24:11.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa028ac8640 1 -- 172.21.15.154:0/2077177691 learned_addr learned my addr 172.21.15.154:0/2077177691 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:11.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa0292c9640 1 --2- 172.21.15.154:0/2077177691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0240b3530 0x7fa0240cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:11.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa029aca640 1 --2- 172.21.15.154:0/2077177691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa02415bae0 0x7fa0240ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:11.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa028ac8640 1 -- 172.21.15.154:0/2077177691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0240b3530 msgr2=0x7fa0240cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa028ac8640 1 --2- 172.21.15.154:0/2077177691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0240b3530 0x7fa0240cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa028ac8640 1 -- 172.21.15.154:0/2077177691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa02415bae0 msgr2=0x7fa0240ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa028ac8640 1 --2- 172.21.15.154:0/2077177691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa02415bae0 0x7fa0240ce730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa028ac8640 1 -- 172.21.15.154:0/2077177691 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa024157a40 con 0x7fa024144760 2024-05-14T01:24:11.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa0292c9640 1 --2- 172.21.15.154:0/2077177691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0240b3530 0x7fa0240cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:11.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa029aca640 1 --2- 172.21.15.154:0/2077177691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa02415bae0 0x7fa0240ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:11.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa028ac8640 1 --2- 172.21.15.154:0/2077177691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa024144760 0x7fa0240ce1f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa01800c420 tx=0x7fa01800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:11.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa021ffb640 1 -- 172.21.15.154:0/2077177691 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa018017070 con 0x7fa024144760 2024-05-14T01:24:11.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa021ffb640 1 -- 172.21.15.154:0/2077177691 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa018005cf0 con 0x7fa024144760 2024-05-14T01:24:11.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa02b52d640 1 -- 172.21.15.154:0/2077177691 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0241f82f0 con 0x7fa024144760 2024-05-14T01:24:11.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa021ffb640 1 -- 172.21.15.154:0/2077177691 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0180072d0 con 0x7fa024144760 2024-05-14T01:24:11.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa02b52d640 1 -- 172.21.15.154:0/2077177691 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa024157f90 con 0x7fa024144760 2024-05-14T01:24:11.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa02b52d640 1 -- 172.21.15.154:0/2077177691 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa024075470 con 0x7fa024144760 2024-05-14T01:24:11.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa021ffb640 1 -- 172.21.15.154:0/2077177691 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa01801a070 con 0x7fa024144760 2024-05-14T01:24:11.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa021ffb640 1 --2- 172.21.15.154:0/2077177691 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa0100678c0 0x7fa010069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:11.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa0292c9640 1 --2- 172.21.15.154:0/2077177691 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa0100678c0 0x7fa010069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:11.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa021ffb640 1 -- 172.21.15.154:0/2077177691 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa018084f90 con 0x7fa024144760 2024-05-14T01:24:11.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.565+0000 7fa0292c9640 1 --2- 172.21.15.154:0/2077177691 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa0100678c0 0x7fa010069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa0140af000 tx=0x7fa0140a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:11.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.569+0000 7fa021ffb640 1 -- 172.21.15.154:0/2077177691 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fa0180554b0 con 0x7fa024144760 2024-05-14T01:24:11.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.741+0000 7fa02b52d640 1 -- 172.21.15.154:0/2077177691 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa02406d250 con 0x7fa024144760 2024-05-14T01:24:11.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.745+0000 7fa021ffb640 1 -- 172.21.15.154:0/2077177691 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fa0180597b0 con 0x7fa024144760 2024-05-14T01:24:11.730 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-05-14T01:24:11.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.745+0000 7fa02b52d640 1 -- 172.21.15.154:0/2077177691 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa0100678c0 msgr2=0x7fa010069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.745+0000 7fa02b52d640 1 --2- 172.21.15.154:0/2077177691 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa0100678c0 0x7fa010069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa0140af000 tx=0x7fa0140a7070 comp rx=0 tx=0).stop 2024-05-14T01:24:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.745+0000 7fa02b52d640 1 -- 172.21.15.154:0/2077177691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa024144760 msgr2=0x7fa0240ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.745+0000 7fa02b52d640 1 --2- 172.21.15.154:0/2077177691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa024144760 0x7fa0240ce1f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa01800c420 tx=0x7fa01800c8e0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.745+0000 7fa02b52d640 1 -- 172.21.15.154:0/2077177691 shutdown_connections 2024-05-14T01:24:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.745+0000 7fa02b52d640 1 --2- 172.21.15.154:0/2077177691 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa0100678c0 0x7fa010069d80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.745+0000 7fa02b52d640 1 --2- 172.21.15.154:0/2077177691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa02415bae0 0x7fa0240ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.745+0000 7fa02b52d640 1 --2- 172.21.15.154:0/2077177691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa024144760 0x7fa0240ce1f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.745+0000 7fa02b52d640 1 --2- 172.21.15.154:0/2077177691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0240b3530 0x7fa0240cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.749+0000 7fa02b52d640 1 -- 172.21.15.154:0/2077177691 >> 172.21.15.154:0/2077177691 conn(0x7fa0240b1850 msgr2=0x7fa02406d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.749+0000 7fa02b52d640 1 -- 172.21.15.154:0/2077177691 shutdown_connections 2024-05-14T01:24:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.749+0000 7fa02b52d640 1 -- 172.21.15.154:0/2077177691 wait complete. 2024-05-14T01:24:11.750 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:24:11.750 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T01:24:11.757 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:11.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.881+0000 7f50cee6d640 1 Processor -- start 2024-05-14T01:24:11.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.881+0000 7f50cee6d640 1 -- start start 2024-05-14T01:24:11.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.881+0000 7f50cee6d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f50c815e200 0x7f50c806ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:11.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.881+0000 7f50cee6d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50c80b50f0 0x7f50c806c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:11.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.881+0000 7f50cee6d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50c80b4050 con 0x7f50c80b5550 2024-05-14T01:24:11.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.881+0000 7f50cee6d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f50c815e5e0 con 0x7f50c815e200 2024-05-14T01:24:11.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.881+0000 7f50cee6d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f50c80b4330 con 0x7f50c80b50f0 2024-05-14T01:24:11.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.885+0000 7f50c7fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50c80b50f0 0x7f50c806c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:11.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.885+0000 7f50ccc09640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f50c815e200 0x7f50c806ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:11.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.885+0000 7f50c7fff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50c80b50f0 0x7f50c806c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:49474/0 (socket says 172.21.15.154:49474) 2024-05-14T01:24:11.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.885+0000 7f50cd40a640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f50c80b5550 0x7f50c806dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:43994/0 (socket says 172.21.15.154:43994) 2024-05-14T01:24:11.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.885+0000 7f50c7fff640 1 -- 172.21.15.154:0/2972612280 learned_addr learned my addr 172.21.15.154:0/2972612280 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:11.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.885+0000 7f50c7fff640 1 -- 172.21.15.154:0/2972612280 >> v2:172.21.15.176:3300/0 conn(0x7f50c815e200 msgr2=0x7f50c806ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:11.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.885+0000 7f50c7fff640 1 --2- 172.21.15.154:0/2972612280 >> v2:172.21.15.176:3300/0 conn(0x7f50c815e200 0x7f50c806ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.885+0000 7f50c7fff640 1 -- 172.21.15.154:0/2972612280 >> v1:172.21.15.176:6789/0 conn(0x7f50c80b5550 legacy=0x7f50c806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.885+0000 7f50c7fff640 1 -- 172.21.15.154:0/2972612280 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c80b4610 con 0x7f50c80b50f0 2024-05-14T01:24:11.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.885+0000 7f50c7fff640 1 --2- 172.21.15.154:0/2972612280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50c80b50f0 0x7f50c806c290 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f50b4009870 tx=0x7f50b401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fc8bebfc9a4bbf0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:11.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.885+0000 7f50c77fe640 1 -- 172.21.15.154:0/2972612280 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b40ab650 con 0x7f50c80b50f0 2024-05-14T01:24:11.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.885+0000 7f50c77fe640 1 -- 172.21.15.154:0/2972612280 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b40b0070 con 0x7f50c80b50f0 2024-05-14T01:24:11.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.885+0000 7f50c77fe640 1 -- 172.21.15.154:0/2972612280 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b40aba10 con 0x7f50c80b50f0 2024-05-14T01:24:11.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cee6d640 1 -- 172.21.15.154:0/2972612280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50c80b50f0 msgr2=0x7f50c806c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cee6d640 1 --2- 172.21.15.154:0/2972612280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50c80b50f0 0x7f50c806c290 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f50b4009870 tx=0x7f50b401c560 comp rx=0 tx=0).stop 2024-05-14T01:24:11.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cee6d640 1 -- 172.21.15.154:0/2972612280 shutdown_connections 2024-05-14T01:24:11.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cee6d640 1 --2- 172.21.15.154:0/2972612280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50c80b50f0 0x7f50c806c290 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cee6d640 1 --2- 172.21.15.154:0/2972612280 >> v2:172.21.15.176:3300/0 conn(0x7f50c815e200 0x7f50c806ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cee6d640 1 -- 172.21.15.154:0/2972612280 >> 172.21.15.154:0/2972612280 conn(0x7f50c8071fc0 msgr2=0x7f50c80723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:11.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cee6d640 1 -- 172.21.15.154:0/2972612280 shutdown_connections 2024-05-14T01:24:11.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cee6d640 1 -- 172.21.15.154:0/2972612280 wait complete. 2024-05-14T01:24:11.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cee6d640 1 Processor -- start 2024-05-14T01:24:11.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cee6d640 1 -- start start 2024-05-14T01:24:11.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cee6d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50c80b50f0 0x7f50c80b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:11.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cee6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50c80b5550 0x7f50c8153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:11.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cee6d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50c815e200 0x7f50c8153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:11.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cee6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f50c8070780 con 0x7f50c80b5550 2024-05-14T01:24:11.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cee6d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f50c806cbe0 con 0x7f50c815e200 2024-05-14T01:24:11.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cee6d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f50c8070900 con 0x7f50c80b50f0 2024-05-14T01:24:11.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50c7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50c80b5550 0x7f50c8153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:11.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50c7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50c80b5550 0x7f50c8153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59366/0 (socket says 172.21.15.154:59366) 2024-05-14T01:24:11.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50c7fff640 1 -- 172.21.15.154:0/2269203867 learned_addr learned my addr 172.21.15.154:0/2269203867 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:11.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50ccc09640 1 --2- 172.21.15.154:0/2269203867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50c80b50f0 0x7f50c80b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:11.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cd40a640 1 --2- 172.21.15.154:0/2269203867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50c815e200 0x7f50c8153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:11.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50c7fff640 1 -- 172.21.15.154:0/2269203867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50c80b50f0 msgr2=0x7f50c80b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50c7fff640 1 --2- 172.21.15.154:0/2269203867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50c80b50f0 0x7f50c80b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50c7fff640 1 -- 172.21.15.154:0/2269203867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50c815e200 msgr2=0x7f50c8153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:11.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50c7fff640 1 --2- 172.21.15.154:0/2269203867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50c815e200 0x7f50c8153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:11.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50c7fff640 1 -- 172.21.15.154:0/2269203867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c8154360 con 0x7f50c80b5550 2024-05-14T01:24:11.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50c7fff640 1 --2- 172.21.15.154:0/2269203867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50c80b5550 0x7f50c8153550 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f50b401ac10 tx=0x7f50b401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:11.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50c57fa640 1 -- 172.21.15.154:0/2269203867 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b40be5f0 con 0x7f50c80b5550 2024-05-14T01:24:11.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50c57fa640 1 -- 172.21.15.154:0/2269203867 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b40be7b0 con 0x7f50c80b5550 2024-05-14T01:24:11.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cee6d640 1 -- 172.21.15.154:0/2269203867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c8154640 con 0x7f50c80b5550 2024-05-14T01:24:11.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50c57fa640 1 -- 172.21.15.154:0/2269203867 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b40beba0 con 0x7f50c80b5550 2024-05-14T01:24:11.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.889+0000 7f50cee6d640 1 -- 172.21.15.154:0/2269203867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c8154c00 con 0x7f50c80b5550 2024-05-14T01:24:11.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.893+0000 7f50cee6d640 1 -- 172.21.15.154:0/2269203867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c8075470 con 0x7f50c80b5550 2024-05-14T01:24:11.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.893+0000 7f50c57fa640 1 -- 172.21.15.154:0/2269203867 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f50b40b43f0 con 0x7f50c80b5550 2024-05-14T01:24:11.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.893+0000 7f50c57fa640 1 --2- 172.21.15.154:0/2269203867 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f50ac0678c0 0x7f50ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:11.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.893+0000 7f50c57fa640 1 -- 172.21.15.154:0/2269203867 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f50b41203f0 con 0x7f50c80b5550 2024-05-14T01:24:11.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.893+0000 7f50ccc09640 1 --2- 172.21.15.154:0/2269203867 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f50ac0678c0 0x7f50ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:11.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.893+0000 7f50ccc09640 1 --2- 172.21.15.154:0/2269203867 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f50ac0678c0 0x7f50ac069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009a50 tx=0x7f50bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:11.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:11.897+0000 7f50c57fa640 1 -- 172.21.15.154:0/2269203867 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f50b4016150 con 0x7f50c80b5550 2024-05-14T01:24:12.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.045+0000 7f50cee6d640 1 -- 172.21.15.154:0/2269203867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50c8156510 con 0x7f50c80b5550 2024-05-14T01:24:12.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.049+0000 7f50c57fa640 1 -- 172.21.15.154:0/2269203867 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f50b40f7080 con 0x7f50c80b5550 2024-05-14T01:24:12.034 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:12.034 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:36.232271+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:12.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.049+0000 7f50cee6d640 1 -- 172.21.15.154:0/2269203867 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f50ac0678c0 msgr2=0x7f50ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.049+0000 7f50cee6d640 1 --2- 172.21.15.154:0/2269203867 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f50ac0678c0 0x7f50ac069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009a50 tx=0x7f50bc008040 comp rx=0 tx=0).stop 2024-05-14T01:24:12.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.049+0000 7f50cee6d640 1 -- 172.21.15.154:0/2269203867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50c80b5550 msgr2=0x7f50c8153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.049+0000 7f50cee6d640 1 --2- 172.21.15.154:0/2269203867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50c80b5550 0x7f50c8153550 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f50b401ac10 tx=0x7f50b401ada0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.049+0000 7f50cee6d640 1 -- 172.21.15.154:0/2269203867 shutdown_connections 2024-05-14T01:24:12.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.049+0000 7f50cee6d640 1 --2- 172.21.15.154:0/2269203867 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f50ac0678c0 0x7f50ac069d80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.049+0000 7f50cee6d640 1 --2- 172.21.15.154:0/2269203867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50c815e200 0x7f50c8153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.049+0000 7f50cee6d640 1 --2- 172.21.15.154:0/2269203867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50c80b5550 0x7f50c8153550 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.049+0000 7f50cee6d640 1 --2- 172.21.15.154:0/2269203867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50c80b50f0 0x7f50c80b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.049+0000 7f50cee6d640 1 -- 172.21.15.154:0/2269203867 >> 172.21.15.154:0/2269203867 conn(0x7f50c8071fc0 msgr2=0x7f50c806dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:12.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.049+0000 7f50cee6d640 1 -- 172.21.15.154:0/2269203867 shutdown_connections 2024-05-14T01:24:12.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.049+0000 7f50cee6d640 1 -- 172.21.15.154:0/2269203867 wait complete. 2024-05-14T01:24:12.052 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T01:23:33.083538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T01:23:33.556058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:24:12.052 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:24:12.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.189+0000 7f687623e640 1 Processor -- start 2024-05-14T01:24:12.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.189+0000 7f687623e640 1 -- start start 2024-05-14T01:24:12.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.189+0000 7f687623e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6870158920 0x7f6870072c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.189+0000 7f687623e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6870071f80 0x7f68700b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.189+0000 7f687623e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68700723e0 con 0x7f6870161c60 2024-05-14T01:24:12.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.189+0000 7f687623e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6870071af0 con 0x7f6870071f80 2024-05-14T01:24:12.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.189+0000 7f687623e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f68700b3bb0 con 0x7f6870158920 2024-05-14T01:24:12.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.189+0000 7f686f7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6870158920 0x7f6870072c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.189+0000 7f6867fff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6870071f80 0x7f68700b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.189+0000 7f686ffff640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f6870161c60 0x7f68700ad880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:44008/0 (socket says 172.21.15.154:44008) 2024-05-14T01:24:12.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.189+0000 7f686ffff640 1 -- 172.21.15.154:0/309036325 learned_addr learned my addr 172.21.15.154:0/309036325 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:12.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.189+0000 7f6867fff640 1 -- 172.21.15.154:0/309036325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6870158920 msgr2=0x7f6870072c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:12.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.189+0000 7f6867fff640 1 --2- 172.21.15.154:0/309036325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6870158920 0x7f6870072c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.189+0000 7f6867fff640 1 -- 172.21.15.154:0/309036325 >> v1:172.21.15.176:6789/0 conn(0x7f6870161c60 legacy=0x7f68700ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.189+0000 7f6867fff640 1 -- 172.21.15.154:0/309036325 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68700711c0 con 0x7f6870071f80 2024-05-14T01:24:12.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.193+0000 7f6867fff640 1 --2- 172.21.15.154:0/309036325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6870071f80 0x7f68700b3480 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f68580097c0 tx=0x7f685801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4bb3bd00dbd80b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:12.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.193+0000 7f686effd640 1 -- 172.21.15.154:0/309036325 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68580b1070 con 0x7f6870071f80 2024-05-14T01:24:12.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.193+0000 7f686effd640 1 -- 172.21.15.154:0/309036325 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68580ac410 con 0x7f6870071f80 2024-05-14T01:24:12.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.193+0000 7f686effd640 1 -- 172.21.15.154:0/309036325 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68580ac7e0 con 0x7f6870071f80 2024-05-14T01:24:12.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.193+0000 7f687623e640 1 -- 172.21.15.154:0/309036325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6870071f80 msgr2=0x7f68700b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.193+0000 7f687623e640 1 --2- 172.21.15.154:0/309036325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6870071f80 0x7f68700b3480 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f68580097c0 tx=0x7f685801c4a0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.193+0000 7f687623e640 1 -- 172.21.15.154:0/309036325 shutdown_connections 2024-05-14T01:24:12.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.193+0000 7f687623e640 1 --2- 172.21.15.154:0/309036325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6870071f80 0x7f68700b3480 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.193+0000 7f687623e640 1 --2- 172.21.15.154:0/309036325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6870158920 0x7f6870072c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.193+0000 7f687623e640 1 -- 172.21.15.154:0/309036325 >> 172.21.15.154:0/309036325 conn(0x7f68700b1770 msgr2=0x7f68700b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:12.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.193+0000 7f687623e640 1 -- 172.21.15.154:0/309036325 shutdown_connections 2024-05-14T01:24:12.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.193+0000 7f687623e640 1 -- 172.21.15.154:0/309036325 wait complete. 2024-05-14T01:24:12.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.193+0000 7f687623e640 1 Processor -- start 2024-05-14T01:24:12.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.193+0000 7f687623e640 1 -- start start 2024-05-14T01:24:12.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f687623e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6870071f80 0x7f68701576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f687623e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6870161c60 0x7f6870152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f687623e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6870152dd0 0x7f687014e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f687623e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f68700ae520 con 0x7f6870152dd0 2024-05-14T01:24:12.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f687623e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f68700ae3a0 con 0x7f6870161c60 2024-05-14T01:24:12.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f687623e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f687016b810 con 0x7f6870071f80 2024-05-14T01:24:12.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f686ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6870152dd0 0x7f687014e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f686ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6870152dd0 0x7f687014e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59370/0 (socket says 172.21.15.154:59370) 2024-05-14T01:24:12.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f686ffff640 1 -- 172.21.15.154:0/2884327145 learned_addr learned my addr 172.21.15.154:0/2884327145 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:12.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f6867fff640 1 --2- 172.21.15.154:0/2884327145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6870161c60 0x7f6870152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f686f7fe640 1 --2- 172.21.15.154:0/2884327145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6870071f80 0x7f68701576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f686ffff640 1 -- 172.21.15.154:0/2884327145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6870071f80 msgr2=0x7f68701576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f686ffff640 1 --2- 172.21.15.154:0/2884327145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6870071f80 0x7f68701576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f686ffff640 1 -- 172.21.15.154:0/2884327145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6870161c60 msgr2=0x7f6870152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f686ffff640 1 --2- 172.21.15.154:0/2884327145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6870161c60 0x7f6870152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f686ffff640 1 -- 172.21.15.154:0/2884327145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6870155e20 con 0x7f6870152dd0 2024-05-14T01:24:12.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f686ffff640 1 --2- 172.21.15.154:0/2884327145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6870152dd0 0x7f687014e510 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f686800ca80 tx=0x7f686800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:12.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f686cff9640 1 -- 172.21.15.154:0/2884327145 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6868017070 con 0x7f6870152dd0 2024-05-14T01:24:12.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f686cff9640 1 -- 172.21.15.154:0/2884327145 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f686800ac30 con 0x7f6870152dd0 2024-05-14T01:24:12.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f686cff9640 1 -- 172.21.15.154:0/2884327145 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6868012600 con 0x7f6870152dd0 2024-05-14T01:24:12.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f687623e640 1 -- 172.21.15.154:0/2884327145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6870153260 con 0x7f6870152dd0 2024-05-14T01:24:12.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f687623e640 1 -- 172.21.15.154:0/2884327145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6870156ef0 con 0x7f6870152dd0 2024-05-14T01:24:12.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f687623e640 1 -- 172.21.15.154:0/2884327145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6870075470 con 0x7f6870152dd0 2024-05-14T01:24:12.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f686cff9640 1 -- 172.21.15.154:0/2884327145 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f686801a070 con 0x7f6870152dd0 2024-05-14T01:24:12.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f686cff9640 1 --2- 172.21.15.154:0/2884327145 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f68500678f0 0x7f6850069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f686cff9640 1 -- 172.21.15.154:0/2884327145 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6868085800 con 0x7f6870152dd0 2024-05-14T01:24:12.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f686f7fe640 1 --2- 172.21.15.154:0/2884327145 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f68500678f0 0x7f6850069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.197+0000 7f686f7fe640 1 --2- 172.21.15.154:0/2884327145 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f68500678f0 0x7f6850069db0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6860009a30 tx=0x7f6860008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:12.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.201+0000 7f686cff9640 1 -- 172.21.15.154:0/2884327145 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f686800ae20 con 0x7f6870152dd0 2024-05-14T01:24:12.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.361+0000 7f687623e640 1 -- 172.21.15.154:0/2884327145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f68700d0090 con 0x7f6870152dd0 2024-05-14T01:24:12.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.361+0000 7f686cff9640 1 -- 172.21.15.154:0/2884327145 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f6868055cf0 con 0x7f6870152dd0 2024-05-14T01:24:12.347 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:24:12.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.361+0000 7f687623e640 1 -- 172.21.15.154:0/2884327145 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f68500678f0 msgr2=0x7f6850069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.361+0000 7f687623e640 1 --2- 172.21.15.154:0/2884327145 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f68500678f0 0x7f6850069db0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6860009a30 tx=0x7f6860008040 comp rx=0 tx=0).stop 2024-05-14T01:24:12.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.361+0000 7f687623e640 1 -- 172.21.15.154:0/2884327145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6870152dd0 msgr2=0x7f687014e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.361+0000 7f687623e640 1 --2- 172.21.15.154:0/2884327145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6870152dd0 0x7f687014e510 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f686800ca80 tx=0x7f686800cf40 comp rx=0 tx=0).stop 2024-05-14T01:24:12.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.361+0000 7f687623e640 1 -- 172.21.15.154:0/2884327145 shutdown_connections 2024-05-14T01:24:12.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.361+0000 7f687623e640 1 --2- 172.21.15.154:0/2884327145 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f68500678f0 0x7f6850069db0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.361+0000 7f687623e640 1 --2- 172.21.15.154:0/2884327145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6870152dd0 0x7f687014e510 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.361+0000 7f687623e640 1 --2- 172.21.15.154:0/2884327145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6870161c60 0x7f6870152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.361+0000 7f687623e640 1 --2- 172.21.15.154:0/2884327145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6870071f80 0x7f68701576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.361+0000 7f687623e640 1 -- 172.21.15.154:0/2884327145 >> 172.21.15.154:0/2884327145 conn(0x7f68700b1770 msgr2=0x7f687015ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:12.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.361+0000 7f687623e640 1 -- 172.21.15.154:0/2884327145 shutdown_connections 2024-05-14T01:24:12.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.361+0000 7f687623e640 1 -- 172.21.15.154:0/2884327145 wait complete. 2024-05-14T01:24:12.365 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T01:24:12.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fd2113640 1 Processor -- start 2024-05-14T01:24:12.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fd2113640 1 -- start start 2024-05-14T01:24:12.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fd2113640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc06fad0 0x7f7fcc0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fd2113640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7fcc0b0250 0x7f7fcc1625c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fd2113640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fcc06feb0 con 0x7f7fcc074280 2024-05-14T01:24:12.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fd2113640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7fcc0d0a50 con 0x7f7fcc0b0250 2024-05-14T01:24:12.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fd2113640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7fcc0d01f0 con 0x7f7fcc06fad0 2024-05-14T01:24:12.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fcbfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7fcc074280 0x7f7fcc06b280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54554/0 (socket says 172.21.15.154:54554) 2024-05-14T01:24:12.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fcbfff640 1 -- 172.21.15.154:0/2461738751 learned_addr learned my addr 172.21.15.154:0/2461738751 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:12.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fcaffd640 1 --2- 172.21.15.154:0/2461738751 >> v2:172.21.15.176:3300/0 conn(0x7f7fcc0b0250 0x7f7fcc1625c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fcb7fe640 1 --2- 172.21.15.154:0/2461738751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc06fad0 0x7f7fcc0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fca7fc640 1 -- 172.21.15.154:0/2461738751 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 263625321 0 0) 0x7f7fcc06feb0 con 0x7f7fcc074280 2024-05-14T01:24:12.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fca7fc640 1 -- 172.21.15.154:0/2461738751 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fb4003530 con 0x7f7fcc074280 2024-05-14T01:24:12.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fca7fc640 1 -- 172.21.15.154:0/2461738751 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3258036810 0 0) 0x7f7fb4003530 con 0x7f7fcc074280 2024-05-14T01:24:12.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fca7fc640 1 -- 172.21.15.154:0/2461738751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc06fad0 msgr2=0x7f7fcc0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fca7fc640 1 --2- 172.21.15.154:0/2461738751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc06fad0 0x7f7fcc0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fca7fc640 1 -- 172.21.15.154:0/2461738751 >> v2:172.21.15.176:3300/0 conn(0x7f7fcc0b0250 msgr2=0x7f7fcc1625c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fca7fc640 1 --2- 172.21.15.154:0/2461738751 >> v2:172.21.15.176:3300/0 conn(0x7f7fcc0b0250 0x7f7fcc1625c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fca7fc640 1 -- 172.21.15.154:0/2461738751 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fcc161e00 con 0x7f7fcc074280 2024-05-14T01:24:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fca7fc640 1 -- 172.21.15.154:0/2461738751 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f7fc4001a00 con 0x7f7fcc074280 2024-05-14T01:24:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fca7fc640 1 -- 172.21.15.154:0/2461738751 >> v1:172.21.15.154:6789/0 conn(0x7f7fcc074280 legacy=0x7f7fcc06b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fca7fc640 1 --2- 172.21.15.154:0/2461738751 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb40039c0 0x7f7fb4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fca7fc640 1 --2- 172.21.15.154:0/2461738751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fb4004810 0x7f7fb4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fca7fc640 1 --2- 172.21.15.154:0/2461738751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc06fad0 0x7f7fb40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fca7fc640 1 -- 172.21.15.154:0/2461738751 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc0d0a50 con 0x7f7fb4004810 2024-05-14T01:24:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fca7fc640 1 -- 172.21.15.154:0/2461738751 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc0d01f0 con 0x7f7fb40039c0 2024-05-14T01:24:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fca7fc640 1 -- 172.21.15.154:0/2461738751 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb400b9d0 con 0x7f7fcc06fad0 2024-05-14T01:24:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fcaffd640 1 --2- 172.21.15.154:0/2461738751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fb4004810 0x7f7fb4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fcb7fe640 1 --2- 172.21.15.154:0/2461738751 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb40039c0 0x7f7fb4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fcbfff640 1 --2- 172.21.15.154:0/2461738751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc06fad0 0x7f7fb40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fcaffd640 1 -- 172.21.15.154:0/2461738751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc06fad0 msgr2=0x7f7fb40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:12.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fcaffd640 1 --2- 172.21.15.154:0/2461738751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc06fad0 0x7f7fb40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fcaffd640 1 -- 172.21.15.154:0/2461738751 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb40039c0 msgr2=0x7f7fb4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:12.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fcaffd640 1 --2- 172.21.15.154:0/2461738751 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb40039c0 0x7f7fb4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fcaffd640 1 -- 172.21.15.154:0/2461738751 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb4003530 con 0x7f7fb4004810 2024-05-14T01:24:12.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.501+0000 7f7fcbfff640 1 --2- 172.21.15.154:0/2461738751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc06fad0 0x7f7fb40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:12.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.505+0000 7f7fcaffd640 1 --2- 172.21.15.154:0/2461738751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fb4004810 0x7f7fb4004c90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009ae0 tx=0x7f7fc001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70050abaf6270b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:12.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.505+0000 7f7fca7fc640 1 -- 172.21.15.154:0/2461738751 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00b2070 con 0x7f7fb4004810 2024-05-14T01:24:12.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.505+0000 7f7fca7fc640 1 -- 172.21.15.154:0/2461738751 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc00a55c0 con 0x7f7fb4004810 2024-05-14T01:24:12.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.505+0000 7f7fca7fc640 1 -- 172.21.15.154:0/2461738751 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00096b0 con 0x7f7fb4004810 2024-05-14T01:24:12.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.505+0000 7f7fd2113640 1 -- 172.21.15.154:0/2461738751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fb4004810 msgr2=0x7f7fb4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.505+0000 7f7fd2113640 1 --2- 172.21.15.154:0/2461738751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fb4004810 0x7f7fb4004c90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009ae0 tx=0x7f7fc001cab0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.505+0000 7f7fcbfff640 1 -- 172.21.15.154:0/2461738751 reap_dead start 2024-05-14T01:24:12.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.505+0000 7f7fd2113640 1 -- 172.21.15.154:0/2461738751 shutdown_connections 2024-05-14T01:24:12.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.505+0000 7f7fd2113640 1 -- 172.21.15.154:0/2461738751 >> 172.21.15.154:0/2461738751 conn(0x7f7fcc0cd6f0 msgr2=0x7f7fcc0cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:12.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.505+0000 7f7fd2113640 1 -- 172.21.15.154:0/2461738751 shutdown_connections 2024-05-14T01:24:12.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.505+0000 7f7fd2113640 1 -- 172.21.15.154:0/2461738751 wait complete. 2024-05-14T01:24:12.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.505+0000 7f7fd2113640 1 Processor -- start 2024-05-14T01:24:12.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.505+0000 7f7fd2113640 1 -- start start 2024-05-14T01:24:12.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fd2113640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb4004810 0x7f7fcc15c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fd2113640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fcc0c7d40 0x7f7fcc0c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fd2113640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc151eb0 0x7f7fcc152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fd2113640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc1620a0 con 0x7f7fcc0c7d40 2024-05-14T01:24:12.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fd2113640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc0d0770 con 0x7f7fb4004810 2024-05-14T01:24:12.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fd2113640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7fcc162b00 con 0x7f7fcc151eb0 2024-05-14T01:24:12.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fcaffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fcc0c7d40 0x7f7fcc0c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fcaffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fcc0c7d40 0x7f7fcc0c9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59384/0 (socket says 172.21.15.154:59384) 2024-05-14T01:24:12.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fcaffd640 1 -- 172.21.15.154:0/3383836684 learned_addr learned my addr 172.21.15.154:0/3383836684 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:12.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fcb7fe640 1 --2- 172.21.15.154:0/3383836684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb4004810 0x7f7fcc15c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fcaffd640 1 -- 172.21.15.154:0/3383836684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc151eb0 msgr2=0x7f7fcc152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fcbfff640 1 --2- 172.21.15.154:0/3383836684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc151eb0 0x7f7fcc152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fcaffd640 1 --2- 172.21.15.154:0/3383836684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc151eb0 0x7f7fcc152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fcaffd640 1 -- 172.21.15.154:0/3383836684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb4004810 msgr2=0x7f7fcc15c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fcaffd640 1 --2- 172.21.15.154:0/3383836684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb4004810 0x7f7fcc15c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fcaffd640 1 -- 172.21.15.154:0/3383836684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fcc0ccd00 con 0x7f7fcc0c7d40 2024-05-14T01:24:12.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fcaffd640 1 --2- 172.21.15.154:0/3383836684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fcc0c7d40 0x7f7fcc0c9b80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00b0040 tx=0x7f7fb4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:12.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fb3fff640 1 -- 172.21.15.154:0/3383836684 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00bc030 con 0x7f7fcc0c7d40 2024-05-14T01:24:12.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fb3fff640 1 -- 172.21.15.154:0/3383836684 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc0004020 con 0x7f7fcc0c7d40 2024-05-14T01:24:12.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fd2113640 1 -- 172.21.15.154:0/3383836684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fcc0c83d0 con 0x7f7fcc0c7d40 2024-05-14T01:24:12.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fb3fff640 1 -- 172.21.15.154:0/3383836684 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00b2040 con 0x7f7fcc0c7d40 2024-05-14T01:24:12.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fd2113640 1 -- 172.21.15.154:0/3383836684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fcc0c8990 con 0x7f7fcc0c7d40 2024-05-14T01:24:12.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fd2113640 1 -- 172.21.15.154:0/3383836684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fcc067cd0 con 0x7f7fcc0c7d40 2024-05-14T01:24:12.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fb3fff640 1 -- 172.21.15.154:0/3383836684 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7fc00bf070 con 0x7f7fcc0c7d40 2024-05-14T01:24:12.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fb3fff640 1 --2- 172.21.15.154:0/3383836684 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7fb80678c0 0x7f7fb8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fcb7fe640 1 --2- 172.21.15.154:0/3383836684 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7fb80678c0 0x7f7fb8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.509+0000 7f7fb3fff640 1 -- 172.21.15.154:0/3383836684 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7fc0120b40 con 0x7f7fcc0c7d40 2024-05-14T01:24:12.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.513+0000 7f7fcb7fe640 1 --2- 172.21.15.154:0/3383836684 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7fb80678c0 0x7f7fb8069d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0ce140 tx=0x7f7fbc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:12.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.513+0000 7f7fb3fff640 1 -- 172.21.15.154:0/3383836684 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f7fc00167c0 con 0x7f7fcc0c7d40 2024-05-14T01:24:12.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.661+0000 7f7fd2113640 1 -- 172.21.15.154:0/3383836684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7fcc068360 con 0x7f7fcc0c7d40 2024-05-14T01:24:12.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.661+0000 7f7fb3fff640 1 -- 172.21.15.154:0/3383836684 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f7fc00f16f0 con 0x7f7fcc0c7d40 2024-05-14T01:24:12.648 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-05-14T01:24:12.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.665+0000 7f7fd2113640 1 -- 172.21.15.154:0/3383836684 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7fb80678c0 msgr2=0x7f7fb8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.665+0000 7f7fd2113640 1 --2- 172.21.15.154:0/3383836684 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7fb80678c0 0x7f7fb8069d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0ce140 tx=0x7f7fbc008040 comp rx=0 tx=0).stop 2024-05-14T01:24:12.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.665+0000 7f7fd2113640 1 -- 172.21.15.154:0/3383836684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fcc0c7d40 msgr2=0x7f7fcc0c9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.665+0000 7f7fd2113640 1 --2- 172.21.15.154:0/3383836684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fcc0c7d40 0x7f7fcc0c9b80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00b0040 tx=0x7f7fb4005840 comp rx=0 tx=0).stop 2024-05-14T01:24:12.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.665+0000 7f7fd2113640 1 -- 172.21.15.154:0/3383836684 shutdown_connections 2024-05-14T01:24:12.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.665+0000 7f7fd2113640 1 --2- 172.21.15.154:0/3383836684 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7fb80678c0 0x7f7fb8069d80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.665+0000 7f7fd2113640 1 --2- 172.21.15.154:0/3383836684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fcc151eb0 0x7f7fcc152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.665+0000 7f7fd2113640 1 --2- 172.21.15.154:0/3383836684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fcc0c7d40 0x7f7fcc0c9b80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.665+0000 7f7fd2113640 1 --2- 172.21.15.154:0/3383836684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb4004810 0x7f7fcc15c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.665+0000 7f7fd2113640 1 -- 172.21.15.154:0/3383836684 >> 172.21.15.154:0/3383836684 conn(0x7f7fcc0cd6f0 msgr2=0x7f7fcc0b1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:12.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.665+0000 7f7fd2113640 1 -- 172.21.15.154:0/3383836684 shutdown_connections 2024-05-14T01:24:12.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.665+0000 7f7fd2113640 1 -- 172.21.15.154:0/3383836684 wait complete. 2024-05-14T01:24:12.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T01:24:12.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.797+0000 7f3c59161640 1 Processor -- start 2024-05-14T01:24:12.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.797+0000 7f3c59161640 1 -- start start 2024-05-14T01:24:12.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.801+0000 7f3c59161640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c540cf610 0x7f3c5415fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.801+0000 7f3c59161640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3c5415ff80 0x7f3c5406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.801+0000 7f3c59161640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c54071840 con 0x7f3c541458d0 2024-05-14T01:24:12.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.801+0000 7f3c59161640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3c54071b20 con 0x7f3c5415ff80 2024-05-14T01:24:12.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.801+0000 7f3c59161640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3c54071e00 con 0x7f3c540cf610 2024-05-14T01:24:12.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.801+0000 7f3c5259c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c540cf610 0x7f3c5415fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.801+0000 7f3c5359e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3c5415ff80 0x7f3c5406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.801+0000 7f3c52d9d640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f3c541458d0 0x7f3c54071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:44014/0 (socket says 172.21.15.154:44014) 2024-05-14T01:24:12.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.801+0000 7f3c52d9d640 1 -- 172.21.15.154:0/689844683 learned_addr learned my addr 172.21.15.154:0/689844683 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:12.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.801+0000 7f3c5259c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c540cf610 0x7f3c5415fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:49518/0 (socket says 172.21.15.154:49518) 2024-05-14T01:24:12.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.801+0000 7f3c5259c640 1 -- 172.21.15.154:0/689844683 >> v2:172.21.15.176:3300/0 conn(0x7f3c5415ff80 msgr2=0x7f3c5406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:12.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.801+0000 7f3c5259c640 1 --2- 172.21.15.154:0/689844683 >> v2:172.21.15.176:3300/0 conn(0x7f3c5415ff80 0x7f3c5406ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.801+0000 7f3c5259c640 1 -- 172.21.15.154:0/689844683 >> v1:172.21.15.176:6789/0 conn(0x7f3c541458d0 legacy=0x7f3c54071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.801+0000 7f3c5259c640 1 -- 172.21.15.154:0/689844683 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c540720e0 con 0x7f3c540cf610 2024-05-14T01:24:12.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c5259c640 1 --2- 172.21.15.154:0/689844683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c540cf610 0x7f3c5415fa40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3c480097c0 tx=0x7f3c4801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b95340fe2c55d05b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:12.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c51d9b640 1 -- 172.21.15.154:0/689844683 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c480b0070 con 0x7f3c540cf610 2024-05-14T01:24:12.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c51d9b640 1 -- 172.21.15.154:0/689844683 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c480ab600 con 0x7f3c540cf610 2024-05-14T01:24:12.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c51d9b640 1 -- 172.21.15.154:0/689844683 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c480ab9d0 con 0x7f3c540cf610 2024-05-14T01:24:12.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c59161640 1 -- 172.21.15.154:0/689844683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c540cf610 msgr2=0x7f3c5415fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c59161640 1 --2- 172.21.15.154:0/689844683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c540cf610 0x7f3c5415fa40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3c480097c0 tx=0x7f3c4801c4a0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c59161640 1 -- 172.21.15.154:0/689844683 shutdown_connections 2024-05-14T01:24:12.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c59161640 1 --2- 172.21.15.154:0/689844683 >> v2:172.21.15.176:3300/0 conn(0x7f3c5415ff80 0x7f3c5406ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c59161640 1 --2- 172.21.15.154:0/689844683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c540cf610 0x7f3c5415fa40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c59161640 1 -- 172.21.15.154:0/689844683 >> 172.21.15.154:0/689844683 conn(0x7f3c540b1770 msgr2=0x7f3c540b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:12.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c59161640 1 -- 172.21.15.154:0/689844683 shutdown_connections 2024-05-14T01:24:12.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c59161640 1 -- 172.21.15.154:0/689844683 wait complete. 2024-05-14T01:24:12.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c59161640 1 Processor -- start 2024-05-14T01:24:12.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c59161640 1 -- start start 2024-05-14T01:24:12.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c59161640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c540cf610 0x7f3c541417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c59161640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c541458d0 0x7f3c54157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c59161640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c5415ff80 0x7f3c54144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c59161640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c54168de0 con 0x7f3c540cf610 2024-05-14T01:24:12.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c59161640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5406dde0 con 0x7f3c5415ff80 2024-05-14T01:24:12.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.805+0000 7f3c59161640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3c54168f60 con 0x7f3c541458d0 2024-05-14T01:24:12.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c52d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c540cf610 0x7f3c541417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c52d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c540cf610 0x7f3c541417a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59386/0 (socket says 172.21.15.154:59386) 2024-05-14T01:24:12.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c52d9d640 1 -- 172.21.15.154:0/396680925 learned_addr learned my addr 172.21.15.154:0/396680925 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:12.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c5259c640 1 --2- 172.21.15.154:0/396680925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c541458d0 0x7f3c54157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c5359e640 1 --2- 172.21.15.154:0/396680925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c5415ff80 0x7f3c54144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c52d9d640 1 -- 172.21.15.154:0/396680925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c541458d0 msgr2=0x7f3c54157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c52d9d640 1 --2- 172.21.15.154:0/396680925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c541458d0 0x7f3c54157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c52d9d640 1 -- 172.21.15.154:0/396680925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c5415ff80 msgr2=0x7f3c54144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c52d9d640 1 --2- 172.21.15.154:0/396680925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c5415ff80 0x7f3c54144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c52d9d640 1 -- 172.21.15.154:0/396680925 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c54141580 con 0x7f3c540cf610 2024-05-14T01:24:12.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c52d9d640 1 --2- 172.21.15.154:0/396680925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c540cf610 0x7f3c541417a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400c370 tx=0x7f3c4400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:12.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c3b7fe640 1 -- 172.21.15.154:0/396680925 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c44017070 con 0x7f3c540cf610 2024-05-14T01:24:12.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c3b7fe640 1 -- 172.21.15.154:0/396680925 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c44005cf0 con 0x7f3c540cf610 2024-05-14T01:24:12.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c59161640 1 -- 172.21.15.154:0/396680925 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c54157710 con 0x7f3c540cf610 2024-05-14T01:24:12.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c3b7fe640 1 -- 172.21.15.154:0/396680925 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c440072f0 con 0x7f3c540cf610 2024-05-14T01:24:12.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c59161640 1 -- 172.21.15.154:0/396680925 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c54157cd0 con 0x7f3c540cf610 2024-05-14T01:24:12.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c59161640 1 -- 172.21.15.154:0/396680925 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c54157f10 con 0x7f3c540cf610 2024-05-14T01:24:12.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c3b7fe640 1 -- 172.21.15.154:0/396680925 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3c4401a070 con 0x7f3c540cf610 2024-05-14T01:24:12.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c3b7fe640 1 --2- 172.21.15.154:0/396680925 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f3c400678c0 0x7f3c40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:12.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c3b7fe640 1 -- 172.21.15.154:0/396680925 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3c44084f80 con 0x7f3c540cf610 2024-05-14T01:24:12.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c5259c640 1 --2- 172.21.15.154:0/396680925 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f3c400678c0 0x7f3c40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:12.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.809+0000 7f3c5259c640 1 --2- 172.21.15.154:0/396680925 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f3c400678c0 0x7f3c40069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3c480ad000 tx=0x7f3c48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:12.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.813+0000 7f3c3b7fe640 1 -- 172.21.15.154:0/396680925 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f3c54141580 con 0x7f3c540cf610 2024-05-14T01:24:12.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.969+0000 7f3c59161640 1 -- 172.21.15.154:0/396680925 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3c54075470 con 0x7f3c540cf610 2024-05-14T01:24:12.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.969+0000 7f3c3b7fe640 1 -- 172.21.15.154:0/396680925 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f3c44055b50 con 0x7f3c540cf610 2024-05-14T01:24:12.955 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-05-14T01:24:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.969+0000 7f3c59161640 1 -- 172.21.15.154:0/396680925 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f3c400678c0 msgr2=0x7f3c40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.969+0000 7f3c59161640 1 --2- 172.21.15.154:0/396680925 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f3c400678c0 0x7f3c40069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3c480ad000 tx=0x7f3c48008040 comp rx=0 tx=0).stop 2024-05-14T01:24:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.969+0000 7f3c59161640 1 -- 172.21.15.154:0/396680925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c540cf610 msgr2=0x7f3c541417a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.969+0000 7f3c59161640 1 --2- 172.21.15.154:0/396680925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c540cf610 0x7f3c541417a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400c370 tx=0x7f3c4400c830 comp rx=0 tx=0).stop 2024-05-14T01:24:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.969+0000 7f3c59161640 1 -- 172.21.15.154:0/396680925 shutdown_connections 2024-05-14T01:24:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.969+0000 7f3c59161640 1 --2- 172.21.15.154:0/396680925 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f3c400678c0 0x7f3c40069d80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.969+0000 7f3c59161640 1 --2- 172.21.15.154:0/396680925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c5415ff80 0x7f3c54144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.969+0000 7f3c59161640 1 --2- 172.21.15.154:0/396680925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c541458d0 0x7f3c54157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.969+0000 7f3c59161640 1 --2- 172.21.15.154:0/396680925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c540cf610 0x7f3c541417a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:12.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.969+0000 7f3c59161640 1 -- 172.21.15.154:0/396680925 >> 172.21.15.154:0/396680925 conn(0x7f3c540b1770 msgr2=0x7f3c540af5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:12.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.969+0000 7f3c59161640 1 -- 172.21.15.154:0/396680925 shutdown_connections 2024-05-14T01:24:12.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:12.969+0000 7f3c59161640 1 -- 172.21.15.154:0/396680925 wait complete. 2024-05-14T01:24:12.973 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T01:24:13.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.097+0000 7f1daa463640 1 Processor -- start 2024-05-14T01:24:13.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.097+0000 7f1daa463640 1 -- start start 2024-05-14T01:24:13.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.097+0000 7f1daa463640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1da40adf60 0x7f1da40b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:13.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.097+0000 7f1daa463640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1da406c290 0x7f1da406c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:13.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.097+0000 7f1daa463640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1da40ae660 con 0x7f1da4158940 2024-05-14T01:24:13.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.097+0000 7f1daa463640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1da406cc20 con 0x7f1da40adf60 2024-05-14T01:24:13.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.097+0000 7f1daa463640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1da40ae410 con 0x7f1da406c290 2024-05-14T01:24:13.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.097+0000 7f1da8a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1da406c290 0x7f1da406c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:13.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.097+0000 7f1da37fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1da40adf60 0x7f1da40b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:13.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.097+0000 7f1da3fff640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f1da4158940 0x7f1da415f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:44018/0 (socket says 172.21.15.154:44018) 2024-05-14T01:24:13.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.097+0000 7f1da3fff640 1 -- 172.21.15.154:0/2409394311 learned_addr learned my addr 172.21.15.154:0/2409394311 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:13.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.097+0000 7f1da8a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1da406c290 0x7f1da406c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:49530/0 (socket says 172.21.15.154:49530) 2024-05-14T01:24:13.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.097+0000 7f1da37fe640 1 -- 172.21.15.154:0/2409394311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1da406c290 msgr2=0x7f1da406c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:13.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.097+0000 7f1da37fe640 1 --2- 172.21.15.154:0/2409394311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1da406c290 0x7f1da406c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.097+0000 7f1da37fe640 1 -- 172.21.15.154:0/2409394311 >> v1:172.21.15.176:6789/0 conn(0x7f1da4158940 legacy=0x7f1da415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:13.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.097+0000 7f1da37fe640 1 -- 172.21.15.154:0/2409394311 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da40ae940 con 0x7f1da40adf60 2024-05-14T01:24:13.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.097+0000 7f1da8a00640 1 --2- 172.21.15.154:0/2409394311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1da406c290 0x7f1da406c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:24:13.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.101+0000 7f1da37fe640 1 --2- 172.21.15.154:0/2409394311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1da40adf60 0x7f1da40b3ec0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009d90 tx=0x7f1d9401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11372603b2651ad2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:13.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.101+0000 7f1da2ffd640 1 -- 172.21.15.154:0/2409394311 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d940b2070 con 0x7f1da40adf60 2024-05-14T01:24:13.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.101+0000 7f1da2ffd640 1 -- 172.21.15.154:0/2409394311 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d940a57a0 con 0x7f1da40adf60 2024-05-14T01:24:13.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.101+0000 7f1da2ffd640 1 -- 172.21.15.154:0/2409394311 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d940a5b70 con 0x7f1da40adf60 2024-05-14T01:24:13.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.101+0000 7f1daa463640 1 -- 172.21.15.154:0/2409394311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1da40adf60 msgr2=0x7f1da40b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:13.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.101+0000 7f1daa463640 1 --2- 172.21.15.154:0/2409394311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1da40adf60 0x7f1da40b3ec0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009d90 tx=0x7f1d9401c8e0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.101+0000 7f1daa463640 1 -- 172.21.15.154:0/2409394311 shutdown_connections 2024-05-14T01:24:13.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.101+0000 7f1daa463640 1 --2- 172.21.15.154:0/2409394311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1da406c290 0x7f1da406c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.101+0000 7f1daa463640 1 --2- 172.21.15.154:0/2409394311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1da40adf60 0x7f1da40b3ec0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.101+0000 7f1daa463640 1 -- 172.21.15.154:0/2409394311 >> 172.21.15.154:0/2409394311 conn(0x7f1da4072000 msgr2=0x7f1da4072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:13.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.101+0000 7f1daa463640 1 -- 172.21.15.154:0/2409394311 shutdown_connections 2024-05-14T01:24:13.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.101+0000 7f1daa463640 1 -- 172.21.15.154:0/2409394311 wait complete. 2024-05-14T01:24:13.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1daa463640 1 Processor -- start 2024-05-14T01:24:13.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1daa463640 1 -- start start 2024-05-14T01:24:13.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1daa463640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da406c290 0x7f1da41f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:13.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1daa463640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1da40adf60 0x7f1da40ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:13.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1daa463640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1da4158940 0x7f1da414f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:13.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1daa463640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1da40b51a0 con 0x7f1da406c290 2024-05-14T01:24:13.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1daa463640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1da40b5020 con 0x7f1da4158940 2024-05-14T01:24:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1daa463640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1da415e6a0 con 0x7f1da40adf60 2024-05-14T01:24:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1da3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da406c290 0x7f1da41f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1da3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da406c290 0x7f1da41f7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59390/0 (socket says 172.21.15.154:59390) 2024-05-14T01:24:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1da3fff640 1 -- 172.21.15.154:0/2812699291 learned_addr learned my addr 172.21.15.154:0/2812699291 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1da37fe640 1 --2- 172.21.15.154:0/2812699291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1da40adf60 0x7f1da40ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1da8a00640 1 --2- 172.21.15.154:0/2812699291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1da4158940 0x7f1da414f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1da3fff640 1 -- 172.21.15.154:0/2812699291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1da40adf60 msgr2=0x7f1da40ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1da3fff640 1 --2- 172.21.15.154:0/2812699291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1da40adf60 0x7f1da40ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1da3fff640 1 -- 172.21.15.154:0/2812699291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1da4158940 msgr2=0x7f1da414f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1da3fff640 1 --2- 172.21.15.154:0/2812699291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1da4158940 0x7f1da414f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1da3fff640 1 -- 172.21.15.154:0/2812699291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da40cd790 con 0x7f1da406c290 2024-05-14T01:24:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1da3fff640 1 --2- 172.21.15.154:0/2812699291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da406c290 0x7f1da41f7e60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00c420 tx=0x7f1d8c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1da0ff9640 1 -- 172.21.15.154:0/2812699291 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c017070 con 0x7f1da406c290 2024-05-14T01:24:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1da0ff9640 1 -- 172.21.15.154:0/2812699291 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d8c005cf0 con 0x7f1da406c290 2024-05-14T01:24:13.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1da0ff9640 1 -- 172.21.15.154:0/2812699291 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0072f0 con 0x7f1da406c290 2024-05-14T01:24:13.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1daa463640 1 -- 172.21.15.154:0/2812699291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da40cda30 con 0x7f1da406c290 2024-05-14T01:24:13.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1daa463640 1 -- 172.21.15.154:0/2812699291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da40cdff0 con 0x7f1da406c290 2024-05-14T01:24:13.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.105+0000 7f1daa463640 1 -- 172.21.15.154:0/2812699291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da4068360 con 0x7f1da406c290 2024-05-14T01:24:13.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.109+0000 7f1da0ff9640 1 -- 172.21.15.154:0/2812699291 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d8c01a070 con 0x7f1da406c290 2024-05-14T01:24:13.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.109+0000 7f1da0ff9640 1 --2- 172.21.15.154:0/2812699291 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1d840678c0 0x7f1d84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:13.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.109+0000 7f1da37fe640 1 --2- 172.21.15.154:0/2812699291 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1d840678c0 0x7f1d84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:13.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.109+0000 7f1da0ff9640 1 -- 172.21.15.154:0/2812699291 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1d8c084fb0 con 0x7f1da406c290 2024-05-14T01:24:13.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.109+0000 7f1da37fe640 1 --2- 172.21.15.154:0/2812699291 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1d840678c0 0x7f1d84069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1d940af000 tx=0x7f1d940a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:13.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.113+0000 7f1da0ff9640 1 -- 172.21.15.154:0/2812699291 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1d8c055b80 con 0x7f1da406c290 2024-05-14T01:24:13.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.273+0000 7f1daa463640 1 -- 172.21.15.154:0/2812699291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1da40b4190 con 0x7f1da406c290 2024-05-14T01:24:13.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.273+0000 7f1da0ff9640 1 -- 172.21.15.154:0/2812699291 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f1d8c055480 con 0x7f1da406c290 2024-05-14T01:24:13.258 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-05-14T01:24:13.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.273+0000 7f1daa463640 1 -- 172.21.15.154:0/2812699291 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1d840678c0 msgr2=0x7f1d84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:13.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.273+0000 7f1daa463640 1 --2- 172.21.15.154:0/2812699291 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1d840678c0 0x7f1d84069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1d940af000 tx=0x7f1d940a7070 comp rx=0 tx=0).stop 2024-05-14T01:24:13.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.273+0000 7f1daa463640 1 -- 172.21.15.154:0/2812699291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da406c290 msgr2=0x7f1da41f7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:13.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.273+0000 7f1daa463640 1 --2- 172.21.15.154:0/2812699291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da406c290 0x7f1da41f7e60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00c420 tx=0x7f1d8c00c8e0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.273+0000 7f1daa463640 1 -- 172.21.15.154:0/2812699291 shutdown_connections 2024-05-14T01:24:13.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.273+0000 7f1daa463640 1 --2- 172.21.15.154:0/2812699291 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1d840678c0 0x7f1d84069d80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.273+0000 7f1daa463640 1 --2- 172.21.15.154:0/2812699291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1da4158940 0x7f1da414f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.273+0000 7f1daa463640 1 --2- 172.21.15.154:0/2812699291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1da40adf60 0x7f1da40ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.273+0000 7f1daa463640 1 --2- 172.21.15.154:0/2812699291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da406c290 0x7f1da41f7e60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.273+0000 7f1daa463640 1 -- 172.21.15.154:0/2812699291 >> 172.21.15.154:0/2812699291 conn(0x7f1da4072000 msgr2=0x7f1da40b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:13.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.273+0000 7f1daa463640 1 -- 172.21.15.154:0/2812699291 shutdown_connections 2024-05-14T01:24:13.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.273+0000 7f1daa463640 1 -- 172.21.15.154:0/2812699291 wait complete. 2024-05-14T01:24:13.276 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi176.front.sepia.ceph.com... 2024-05-14T01:24:13.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:13.276 DEBUG:teuthology.orchestra.run.smithi176:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-05-14T01:24:13.316 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T01:24:13.316 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-05-14T01:24:13.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:13.316 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-14T01:24:13.368 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:24:13.368 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T01:24:13.374 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:24:13.374 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T01:24:13.423 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:13.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.601+0000 7f4a374a8640 1 Processor -- start 2024-05-14T01:24:13.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.601+0000 7f4a374a8640 1 -- start start 2024-05-14T01:24:13.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a374a8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4a3015bae0 0x7f4a30165d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:13.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a374a8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a30144b40 con 0x7f4a30144760 2024-05-14T01:24:13.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a374a8640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a300b3a40 con 0x7f4a300b3530 2024-05-14T01:24:13.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a374a8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4a3006ed90 con 0x7f4a3015bae0 2024-05-14T01:24:13.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a35244640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4a30144760 0x7f4a3006e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54560/0 (socket says 172.21.15.154:54560) 2024-05-14T01:24:13.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a35244640 1 -- 172.21.15.154:0/3458983934 learned_addr learned my addr 172.21.15.154:0/3458983934 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:13.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a35a45640 1 --2- 172.21.15.154:0/3458983934 >> v2:172.21.15.154:3300/0 conn(0x7f4a3015bae0 0x7f4a30165d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:13.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a27fff640 1 -- 172.21.15.154:0/3458983934 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3295385728 0 0) 0x7f4a30144b40 con 0x7f4a30144760 2024-05-14T01:24:13.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a27fff640 1 -- 172.21.15.154:0/3458983934 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a1c003530 con 0x7f4a30144760 2024-05-14T01:24:13.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a35a45640 1 -- 172.21.15.154:0/3458983934 >> v1:172.21.15.176:6789/0 conn(0x7f4a300b3530 legacy=0x7f4a3015b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:13.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a35a45640 1 -- 172.21.15.154:0/3458983934 >> v1:172.21.15.154:6789/0 conn(0x7f4a30144760 legacy=0x7f4a3006e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:13.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a35a45640 1 -- 172.21.15.154:0/3458983934 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a300b3d20 con 0x7f4a3015bae0 2024-05-14T01:24:13.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a35a45640 1 --2- 172.21.15.154:0/3458983934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a3015bae0 0x7f4a30165d10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c009d90 tx=0x7f4a2c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4666def2fe06e08 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:13.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a27fff640 1 -- 172.21.15.154:0/3458983934 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0b2070 con 0x7f4a3015bae0 2024-05-14T01:24:13.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a27fff640 1 -- 172.21.15.154:0/3458983934 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a2c0a5940 con 0x7f4a3015bae0 2024-05-14T01:24:13.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a27fff640 1 -- 172.21.15.154:0/3458983934 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0a5d10 con 0x7f4a3015bae0 2024-05-14T01:24:13.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a374a8640 1 -- 172.21.15.154:0/3458983934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a3015bae0 msgr2=0x7f4a30165d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:13.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a374a8640 1 --2- 172.21.15.154:0/3458983934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a3015bae0 0x7f4a30165d10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c009d90 tx=0x7f4a2c01c970 comp rx=0 tx=0).stop 2024-05-14T01:24:13.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a374a8640 1 -- 172.21.15.154:0/3458983934 shutdown_connections 2024-05-14T01:24:13.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a374a8640 1 --2- 172.21.15.154:0/3458983934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a3015bae0 0x7f4a30165d10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a374a8640 1 -- 172.21.15.154:0/3458983934 >> 172.21.15.154:0/3458983934 conn(0x7f4a300b1850 msgr2=0x7f4a300b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:13.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a374a8640 1 -- 172.21.15.154:0/3458983934 shutdown_connections 2024-05-14T01:24:13.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.605+0000 7f4a374a8640 1 -- 172.21.15.154:0/3458983934 wait complete. 2024-05-14T01:24:13.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a374a8640 1 Processor -- start 2024-05-14T01:24:13.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a374a8640 1 -- start start 2024-05-14T01:24:13.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a374a8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a300b3530 0x7f4a301f8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:13.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a374a8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a30144760 0x7f4a300727a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:13.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a374a8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a3015bae0 0x7f4a30072ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:13.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a374a8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4a30168e00 con 0x7f4a3015bae0 2024-05-14T01:24:13.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a374a8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4a30168c80 con 0x7f4a300b3530 2024-05-14T01:24:13.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a374a8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a30168f80 con 0x7f4a30144760 2024-05-14T01:24:13.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a35a45640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a3015bae0 0x7f4a30072ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:13.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a35a45640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a3015bae0 0x7f4a30072ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59406/0 (socket says 172.21.15.154:59406) 2024-05-14T01:24:13.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a35a45640 1 -- 172.21.15.154:0/824379503 learned_addr learned my addr 172.21.15.154:0/824379503 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:13.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a35244640 1 --2- 172.21.15.154:0/824379503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a300b3530 0x7f4a301f8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:13.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a34a43640 1 --2- 172.21.15.154:0/824379503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a30144760 0x7f4a300727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:13.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a35a45640 1 -- 172.21.15.154:0/824379503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a30144760 msgr2=0x7f4a300727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:13.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a35a45640 1 --2- 172.21.15.154:0/824379503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a30144760 0x7f4a300727a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a35a45640 1 -- 172.21.15.154:0/824379503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a300b3530 msgr2=0x7f4a301f8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:13.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a35a45640 1 --2- 172.21.15.154:0/824379503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a300b3530 0x7f4a301f8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a35a45640 1 -- 172.21.15.154:0/824379503 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3015ab60 con 0x7f4a3015bae0 2024-05-14T01:24:13.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a35a45640 1 --2- 172.21.15.154:0/824379503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a3015bae0 0x7f4a30072ce0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c01a5a0 tx=0x7f4a2c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:13.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a25ffb640 1 -- 172.21.15.154:0/824379503 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0bd020 con 0x7f4a3015bae0 2024-05-14T01:24:13.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a25ffb640 1 -- 172.21.15.154:0/824379503 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a2c0b8670 con 0x7f4a3015bae0 2024-05-14T01:24:13.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a374a8640 1 -- 172.21.15.154:0/824379503 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a3013f9a0 con 0x7f4a3015bae0 2024-05-14T01:24:13.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a25ffb640 1 -- 172.21.15.154:0/824379503 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0b2040 con 0x7f4a3015bae0 2024-05-14T01:24:13.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a374a8640 1 -- 172.21.15.154:0/824379503 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a3013ff60 con 0x7f4a3015bae0 2024-05-14T01:24:13.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.609+0000 7f4a374a8640 1 -- 172.21.15.154:0/824379503 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a30067850 con 0x7f4a3015bae0 2024-05-14T01:24:13.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.613+0000 7f4a25ffb640 1 -- 172.21.15.154:0/824379503 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4a2c0c0020 con 0x7f4a3015bae0 2024-05-14T01:24:13.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.613+0000 7f4a25ffb640 1 --2- 172.21.15.154:0/824379503 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4a140678c0 0x7f4a14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:13.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.613+0000 7f4a35244640 1 --2- 172.21.15.154:0/824379503 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4a140678c0 0x7f4a14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:13.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.613+0000 7f4a25ffb640 1 -- 172.21.15.154:0/824379503 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4a2c120b50 con 0x7f4a3015bae0 2024-05-14T01:24:13.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.613+0000 7f4a35244640 1 --2- 172.21.15.154:0/824379503 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4a140678c0 0x7f4a14069d80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4a28005890 tx=0x7f4a28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:13.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.617+0000 7f4a25ffb640 1 -- 172.21.15.154:0/824379503 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f4a2c0c7030 con 0x7f4a3015bae0 2024-05-14T01:24:13.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.765+0000 7f4a374a8640 1 -- 172.21.15.154:0/824379503 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a3015c220 con 0x7f4a3015bae0 2024-05-14T01:24:13.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.769+0000 7f4a25ffb640 1 -- 172.21.15.154:0/824379503 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f4a2c10f070 con 0x7f4a3015bae0 2024-05-14T01:24:13.755 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:13.755 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:36.232271+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.769+0000 7f4a374a8640 1 -- 172.21.15.154:0/824379503 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4a140678c0 msgr2=0x7f4a14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.769+0000 7f4a374a8640 1 --2- 172.21.15.154:0/824379503 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4a140678c0 0x7f4a14069d80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4a28005890 tx=0x7f4a28009040 comp rx=0 tx=0).stop 2024-05-14T01:24:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.769+0000 7f4a374a8640 1 -- 172.21.15.154:0/824379503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a3015bae0 msgr2=0x7f4a30072ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.769+0000 7f4a374a8640 1 --2- 172.21.15.154:0/824379503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a3015bae0 0x7f4a30072ce0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c01a5a0 tx=0x7f4a2c019710 comp rx=0 tx=0).stop 2024-05-14T01:24:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.769+0000 7f4a374a8640 1 -- 172.21.15.154:0/824379503 shutdown_connections 2024-05-14T01:24:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.769+0000 7f4a374a8640 1 --2- 172.21.15.154:0/824379503 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4a140678c0 0x7f4a14069d80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.769+0000 7f4a374a8640 1 --2- 172.21.15.154:0/824379503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a3015bae0 0x7f4a30072ce0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.769+0000 7f4a374a8640 1 --2- 172.21.15.154:0/824379503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a30144760 0x7f4a300727a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.769+0000 7f4a374a8640 1 --2- 172.21.15.154:0/824379503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a300b3530 0x7f4a301f8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.769+0000 7f4a374a8640 1 -- 172.21.15.154:0/824379503 >> 172.21.15.154:0/824379503 conn(0x7f4a300b1850 msgr2=0x7f4a300b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.769+0000 7f4a374a8640 1 -- 172.21.15.154:0/824379503 shutdown_connections 2024-05-14T01:24:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.769+0000 7f4a374a8640 1 -- 172.21.15.154:0/824379503 wait complete. 2024-05-14T01:24:13.774 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T01:23:33.083538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T01:23:33.556058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:24:13.774 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:24:13.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.905+0000 7fc0ad134640 1 Processor -- start 2024-05-14T01:24:13.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.905+0000 7fc0ad134640 1 -- start start 2024-05-14T01:24:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0ad134640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc0a81458d0 0x7fc0a80cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0ad134640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc0a8160150 0x7fc0a806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0ad134640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a8071840 con 0x7fc0a8071060 2024-05-14T01:24:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0ad134640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc0a8071b20 con 0x7fc0a8160150 2024-05-14T01:24:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0ad134640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc0a8071e00 con 0x7fc0a81458d0 2024-05-14T01:24:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0a659c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc0a8071060 0x7fc0a815fa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54566/0 (socket says 172.21.15.154:54566) 2024-05-14T01:24:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0a659c640 1 -- 172.21.15.154:0/1279486154 learned_addr learned my addr 172.21.15.154:0/1279486154 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0a759e640 1 --2- 172.21.15.154:0/1279486154 >> v2:172.21.15.154:3300/0 conn(0x7fc0a8160150 0x7fc0a806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0a6d9d640 1 --2- 172.21.15.154:0/1279486154 >> v2:172.21.15.176:3300/0 conn(0x7fc0a81458d0 0x7fc0a80cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0a5d9b640 1 -- 172.21.15.154:0/1279486154 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 184327081 0 0) 0x7fc0a8071840 con 0x7fc0a8071060 2024-05-14T01:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0a5d9b640 1 -- 172.21.15.154:0/1279486154 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc094003530 con 0x7fc0a8071060 2024-05-14T01:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0a759e640 1 -- 172.21.15.154:0/1279486154 >> v2:172.21.15.176:3300/0 conn(0x7fc0a81458d0 msgr2=0x7fc0a80cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0a759e640 1 --2- 172.21.15.154:0/1279486154 >> v2:172.21.15.176:3300/0 conn(0x7fc0a81458d0 0x7fc0a80cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0a759e640 1 -- 172.21.15.154:0/1279486154 >> v1:172.21.15.154:6789/0 conn(0x7fc0a8071060 legacy=0x7fc0a815fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0a759e640 1 -- 172.21.15.154:0/1279486154 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a80720e0 con 0x7fc0a8160150 2024-05-14T01:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0a6d9d640 1 --2- 172.21.15.154:0/1279486154 >> v2:172.21.15.176:3300/0 conn(0x7fc0a81458d0 0x7fc0a80cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:13.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0a759e640 1 --2- 172.21.15.154:0/1279486154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0a8160150 0x7fc0a806ce40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc0a80d0c30 tx=0x7fc0a001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901d7dc73fe5d18a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:13.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0a5d9b640 1 -- 172.21.15.154:0/1279486154 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00b2070 con 0x7fc0a8160150 2024-05-14T01:24:13.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0a5d9b640 1 -- 172.21.15.154:0/1279486154 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a00a57f0 con 0x7fc0a8160150 2024-05-14T01:24:13.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.909+0000 7fc0a5d9b640 1 -- 172.21.15.154:0/1279486154 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00a5bc0 con 0x7fc0a8160150 2024-05-14T01:24:13.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0ad134640 1 -- 172.21.15.154:0/1279486154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0a8160150 msgr2=0x7fc0a806ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:13.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0ad134640 1 --2- 172.21.15.154:0/1279486154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0a8160150 0x7fc0a806ce40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc0a80d0c30 tx=0x7fc0a001c930 comp rx=0 tx=0).stop 2024-05-14T01:24:13.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0ad134640 1 -- 172.21.15.154:0/1279486154 shutdown_connections 2024-05-14T01:24:13.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0ad134640 1 --2- 172.21.15.154:0/1279486154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0a8160150 0x7fc0a806ce40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0ad134640 1 --2- 172.21.15.154:0/1279486154 >> v2:172.21.15.176:3300/0 conn(0x7fc0a81458d0 0x7fc0a80cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0ad134640 1 -- 172.21.15.154:0/1279486154 >> 172.21.15.154:0/1279486154 conn(0x7fc0a80b1770 msgr2=0x7fc0a80b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:13.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0ad134640 1 -- 172.21.15.154:0/1279486154 shutdown_connections 2024-05-14T01:24:13.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0ad134640 1 -- 172.21.15.154:0/1279486154 wait complete. 2024-05-14T01:24:13.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0ad134640 1 Processor -- start 2024-05-14T01:24:13.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0ad134640 1 -- start start 2024-05-14T01:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0ad134640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0a8071060 0x7fc0a80b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0ad134640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0a81458d0 0x7fc0a8156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0ad134640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0a8160150 0x7fc0a815de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0ad134640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a806dd10 con 0x7fc0a8071060 2024-05-14T01:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0ad134640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a806db90 con 0x7fc0a8160150 2024-05-14T01:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0ad134640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc0a8168de0 con 0x7fc0a81458d0 2024-05-14T01:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0a6d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0a8071060 0x7fc0a80b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0a6d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0a8071060 0x7fc0a80b2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59426/0 (socket says 172.21.15.154:59426) 2024-05-14T01:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0a6d9d640 1 -- 172.21.15.154:0/3238763624 learned_addr learned my addr 172.21.15.154:0/3238763624 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:13.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0a759e640 1 --2- 172.21.15.154:0/3238763624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0a8160150 0x7fc0a815de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:13.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0a659c640 1 --2- 172.21.15.154:0/3238763624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0a81458d0 0x7fc0a8156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:13.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0a6d9d640 1 -- 172.21.15.154:0/3238763624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0a81458d0 msgr2=0x7fc0a8156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:13.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0a6d9d640 1 --2- 172.21.15.154:0/3238763624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0a81458d0 0x7fc0a8156f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0a6d9d640 1 -- 172.21.15.154:0/3238763624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0a8160150 msgr2=0x7fc0a815de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:13.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0a6d9d640 1 --2- 172.21.15.154:0/3238763624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0a8160150 0x7fc0a815de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:13.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0a6d9d640 1 -- 172.21.15.154:0/3238763624 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a80b30b0 con 0x7fc0a8071060 2024-05-14T01:24:13.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0a759e640 1 --2- 172.21.15.154:0/3238763624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0a8160150 0x7fc0a815de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:13.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0a6d9d640 1 --2- 172.21.15.154:0/3238763624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0a8071060 0x7fc0a80b2b70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc09800e840 tx=0x7fc09800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:13.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc09f7fe640 1 -- 172.21.15.154:0/3238763624 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098017070 con 0x7fc0a8071060 2024-05-14T01:24:13.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc09f7fe640 1 -- 172.21.15.154:0/3238763624 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc09800c8d0 con 0x7fc0a8071060 2024-05-14T01:24:13.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0ad134640 1 -- 172.21.15.154:0/3238763624 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a80b3350 con 0x7fc0a8071060 2024-05-14T01:24:13.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc09f7fe640 1 -- 172.21.15.154:0/3238763624 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09800f040 con 0x7fc0a8071060 2024-05-14T01:24:13.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.913+0000 7fc0ad134640 1 -- 172.21.15.154:0/3238763624 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a80b3bf0 con 0x7fc0a8071060 2024-05-14T01:24:13.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.917+0000 7fc0ad134640 1 -- 172.21.15.154:0/3238763624 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a8075470 con 0x7fc0a8071060 2024-05-14T01:24:13.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.917+0000 7fc09f7fe640 1 -- 172.21.15.154:0/3238763624 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc09801a070 con 0x7fc0a8071060 2024-05-14T01:24:13.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.917+0000 7fc09f7fe640 1 --2- 172.21.15.154:0/3238763624 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc0880678c0 0x7fc088069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:13.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.917+0000 7fc0a659c640 1 --2- 172.21.15.154:0/3238763624 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc0880678c0 0x7fc088069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:13.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.917+0000 7fc09f7fe640 1 -- 172.21.15.154:0/3238763624 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc098085890 con 0x7fc0a8071060 2024-05-14T01:24:13.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.917+0000 7fc0a659c640 1 --2- 172.21.15.154:0/3238763624 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc0880678c0 0x7fc088069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc090007fd0 tx=0x7fc090009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:13.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:13.921+0000 7fc09f7fe640 1 -- 172.21.15.154:0/3238763624 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fc0980563d0 con 0x7fc0a8071060 2024-05-14T01:24:14.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.081+0000 7fc0ad134640 1 -- 172.21.15.154:0/3238763624 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc0a815f770 con 0x7fc0a8071060 2024-05-14T01:24:14.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.081+0000 7fc09f7fe640 1 -- 172.21.15.154:0/3238763624 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fc098055cd0 con 0x7fc0a8071060 2024-05-14T01:24:14.068 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:24:14.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.085+0000 7fc0ad134640 1 -- 172.21.15.154:0/3238763624 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc0880678c0 msgr2=0x7fc088069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.085+0000 7fc0ad134640 1 --2- 172.21.15.154:0/3238763624 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc0880678c0 0x7fc088069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc090007fd0 tx=0x7fc090009040 comp rx=0 tx=0).stop 2024-05-14T01:24:14.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.085+0000 7fc0ad134640 1 -- 172.21.15.154:0/3238763624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0a8071060 msgr2=0x7fc0a80b2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.085+0000 7fc0ad134640 1 --2- 172.21.15.154:0/3238763624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0a8071060 0x7fc0a80b2b70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc09800e840 tx=0x7fc09800ed00 comp rx=0 tx=0).stop 2024-05-14T01:24:14.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.085+0000 7fc0ad134640 1 -- 172.21.15.154:0/3238763624 shutdown_connections 2024-05-14T01:24:14.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.085+0000 7fc0ad134640 1 --2- 172.21.15.154:0/3238763624 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc0880678c0 0x7fc088069d80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.085+0000 7fc0ad134640 1 --2- 172.21.15.154:0/3238763624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0a8160150 0x7fc0a815de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.085+0000 7fc0ad134640 1 --2- 172.21.15.154:0/3238763624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0a81458d0 0x7fc0a8156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.085+0000 7fc0ad134640 1 --2- 172.21.15.154:0/3238763624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0a8071060 0x7fc0a80b2b70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.085+0000 7fc0ad134640 1 -- 172.21.15.154:0/3238763624 >> 172.21.15.154:0/3238763624 conn(0x7fc0a80b1770 msgr2=0x7fc0a80b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:14.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.085+0000 7fc0ad134640 1 -- 172.21.15.154:0/3238763624 shutdown_connections 2024-05-14T01:24:14.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.085+0000 7fc0ad134640 1 -- 172.21.15.154:0/3238763624 wait complete. 2024-05-14T01:24:14.087 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T01:24:14.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f7735740640 1 Processor -- start 2024-05-14T01:24:14.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f7735740640 1 -- start start 2024-05-14T01:24:14.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f7735740640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f773015e5a0 0x7f77300d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f7735740640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77300d3d50 con 0x7f77300ce880 2024-05-14T01:24:14.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f7735740640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77300d2cb0 con 0x7f77300d0ff0 2024-05-14T01:24:14.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f7735740640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f77300d38c0 con 0x7f773015e5a0 2024-05-14T01:24:14.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772e7fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f77300ce880 0x7f77300d08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54570/0 (socket says 172.21.15.154:54570) 2024-05-14T01:24:14.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772e7fc640 1 -- 172.21.15.154:0/2610232536 learned_addr learned my addr 172.21.15.154:0/2610232536 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:14.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772effd640 1 --2- 172.21.15.154:0/2610232536 >> v2:172.21.15.176:3300/0 conn(0x7f773015e5a0 0x7f77300d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772dffb640 1 -- 172.21.15.154:0/2610232536 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1585301299 0 0) 0x7f77300d3d50 con 0x7f77300ce880 2024-05-14T01:24:14.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772dffb640 1 -- 172.21.15.154:0/2610232536 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f771c003530 con 0x7f77300ce880 2024-05-14T01:24:14.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772dffb640 1 -- 172.21.15.154:0/2610232536 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2992843720 0 0) 0x7f771c003530 con 0x7f77300ce880 2024-05-14T01:24:14.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772dffb640 1 -- 172.21.15.154:0/2610232536 >> v2:172.21.15.176:3300/0 conn(0x7f773015e5a0 msgr2=0x7f77300d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:14.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772dffb640 1 --2- 172.21.15.154:0/2610232536 >> v2:172.21.15.176:3300/0 conn(0x7f773015e5a0 0x7f77300d2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772dffb640 1 -- 172.21.15.154:0/2610232536 >> v1:172.21.15.176:6789/0 conn(0x7f77300d0ff0 legacy=0x7f77300b72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772dffb640 1 -- 172.21.15.154:0/2610232536 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77300d2f90 con 0x7f77300ce880 2024-05-14T01:24:14.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772dffb640 1 -- 172.21.15.154:0/2610232536 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f7720001680 con 0x7f77300ce880 2024-05-14T01:24:14.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772dffb640 1 -- 172.21.15.154:0/2610232536 >> v1:172.21.15.154:6789/0 conn(0x7f77300ce880 legacy=0x7f77300d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772dffb640 1 --2- 172.21.15.154:0/2610232536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f771c0039c0 0x7f771c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772dffb640 1 --2- 172.21.15.154:0/2610232536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f771c004810 0x7f771c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772dffb640 1 --2- 172.21.15.154:0/2610232536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f771c0051d0 0x7f771c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772dffb640 1 -- 172.21.15.154:0/2610232536 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77300d38c0 con 0x7f771c0039c0 2024-05-14T01:24:14.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772dffb640 1 -- 172.21.15.154:0/2610232536 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f771c00c170 con 0x7f771c004810 2024-05-14T01:24:14.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772dffb640 1 -- 172.21.15.154:0/2610232536 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f771c00c370 con 0x7f771c0051d0 2024-05-14T01:24:14.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772effd640 1 --2- 172.21.15.154:0/2610232536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f771c0039c0 0x7f771c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772e7fc640 1 --2- 172.21.15.154:0/2610232536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f771c004810 0x7f771c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772f7fe640 1 --2- 172.21.15.154:0/2610232536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f771c0051d0 0x7f771c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772effd640 1 -- 172.21.15.154:0/2610232536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f771c0051d0 msgr2=0x7f771c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:14.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772effd640 1 --2- 172.21.15.154:0/2610232536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f771c0051d0 0x7f771c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772effd640 1 -- 172.21.15.154:0/2610232536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f771c004810 msgr2=0x7f771c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:14.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772effd640 1 --2- 172.21.15.154:0/2610232536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f771c004810 0x7f771c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772effd640 1 -- 172.21.15.154:0/2610232536 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771c003530 con 0x7f771c0039c0 2024-05-14T01:24:14.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.221+0000 7f772f7fe640 1 -- 172.21.15.154:0/2610232536 reap_dead start 2024-05-14T01:24:14.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.225+0000 7f772effd640 1 --2- 172.21.15.154:0/2610232536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f771c0039c0 0x7f771c003de0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7718009ac0 tx=0x7f771801ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ff6b8957dde592 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:14.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.225+0000 7f772dffb640 1 -- 172.21.15.154:0/2610232536 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77180b2070 con 0x7f771c0039c0 2024-05-14T01:24:14.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.225+0000 7f772dffb640 1 -- 172.21.15.154:0/2610232536 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77180a5610 con 0x7f771c0039c0 2024-05-14T01:24:14.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.225+0000 7f772dffb640 1 -- 172.21.15.154:0/2610232536 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7718009690 con 0x7f771c0039c0 2024-05-14T01:24:14.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.225+0000 7f7735740640 1 -- 172.21.15.154:0/2610232536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f771c0039c0 msgr2=0x7f771c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.225+0000 7f7735740640 1 --2- 172.21.15.154:0/2610232536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f771c0039c0 0x7f771c003de0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7718009ac0 tx=0x7f771801ca40 comp rx=0 tx=0).stop 2024-05-14T01:24:14.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.225+0000 7f7735740640 1 -- 172.21.15.154:0/2610232536 shutdown_connections 2024-05-14T01:24:14.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.225+0000 7f7735740640 1 --2- 172.21.15.154:0/2610232536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f771c0039c0 0x7f771c003de0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.225+0000 7f7735740640 1 -- 172.21.15.154:0/2610232536 >> 172.21.15.154:0/2610232536 conn(0x7f7730071e70 msgr2=0x7f773006b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:14.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.225+0000 7f7735740640 1 -- 172.21.15.154:0/2610232536 shutdown_connections 2024-05-14T01:24:14.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.225+0000 7f7735740640 1 -- 172.21.15.154:0/2610232536 wait complete. 2024-05-14T01:24:14.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f7735740640 1 Processor -- start 2024-05-14T01:24:14.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f7735740640 1 -- start start 2024-05-14T01:24:14.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f7735740640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f771c0039c0 0x7f773015ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f7735740640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7730158f20 0x7f7730143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f7735740640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7730159380 0x7f7730143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f7735740640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77300d0e70 con 0x7f7730158f20 2024-05-14T01:24:14.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f7735740640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f77300d0cf0 con 0x7f771c0039c0 2024-05-14T01:24:14.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f7735740640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f77300b62b0 con 0x7f7730159380 2024-05-14T01:24:14.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f772e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7730158f20 0x7f7730143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f772e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7730158f20 0x7f7730143570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59446/0 (socket says 172.21.15.154:59446) 2024-05-14T01:24:14.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f772e7fc640 1 -- 172.21.15.154:0/3647514682 learned_addr learned my addr 172.21.15.154:0/3647514682 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:14.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f772effd640 1 --2- 172.21.15.154:0/3647514682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f771c0039c0 0x7f773015ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f772f7fe640 1 --2- 172.21.15.154:0/3647514682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7730159380 0x7f7730143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f772e7fc640 1 -- 172.21.15.154:0/3647514682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7730159380 msgr2=0x7f7730143ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f772e7fc640 1 --2- 172.21.15.154:0/3647514682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7730159380 0x7f7730143ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f772e7fc640 1 -- 172.21.15.154:0/3647514682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f771c0039c0 msgr2=0x7f773015ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f772e7fc640 1 --2- 172.21.15.154:0/3647514682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f771c0039c0 0x7f773015ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f772e7fc640 1 -- 172.21.15.154:0/3647514682 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7730159900 con 0x7f7730158f20 2024-05-14T01:24:14.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f772effd640 1 --2- 172.21.15.154:0/3647514682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f771c0039c0 0x7f773015ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:14.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f772e7fc640 1 --2- 172.21.15.154:0/3647514682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7730158f20 0x7f7730143570 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f77200072c0 tx=0x7f7720007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:14.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f77277fe640 1 -- 172.21.15.154:0/3647514682 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772000f940 con 0x7f7730158f20 2024-05-14T01:24:14.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f77277fe640 1 -- 172.21.15.154:0/3647514682 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7720018070 con 0x7f7730158f20 2024-05-14T01:24:14.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f7735740640 1 -- 172.21.15.154:0/3647514682 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7730159be0 con 0x7f7730158f20 2024-05-14T01:24:14.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f77277fe640 1 -- 172.21.15.154:0/3647514682 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772000fce0 con 0x7f7730158f20 2024-05-14T01:24:14.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f7735740640 1 -- 172.21.15.154:0/3647514682 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f773015a1a0 con 0x7f7730158f20 2024-05-14T01:24:14.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f7735740640 1 -- 172.21.15.154:0/3647514682 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7730075470 con 0x7f7730158f20 2024-05-14T01:24:14.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f77277fe640 1 -- 172.21.15.154:0/3647514682 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f772001c410 con 0x7f7730158f20 2024-05-14T01:24:14.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f77277fe640 1 --2- 172.21.15.154:0/3647514682 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f77100678f0 0x7f7710069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f77277fe640 1 -- 172.21.15.154:0/3647514682 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7720085870 con 0x7f7730158f20 2024-05-14T01:24:14.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.229+0000 7f772effd640 1 --2- 172.21.15.154:0/3647514682 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f77100678f0 0x7f7710069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.233+0000 7f772effd640 1 --2- 172.21.15.154:0/3647514682 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f77100678f0 0x7f7710069db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f77180af000 tx=0x7f7718008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:14.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.237+0000 7f77277fe640 1 -- 172.21.15.154:0/3647514682 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f77200563b0 con 0x7f7730158f20 2024-05-14T01:24:14.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.389+0000 7f7735740640 1 -- 172.21.15.154:0/3647514682 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7730067cd0 con 0x7f7730158f20 2024-05-14T01:24:14.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.389+0000 7f77277fe640 1 -- 172.21.15.154:0/3647514682 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f7720055cb0 con 0x7f7730158f20 2024-05-14T01:24:14.374 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-05-14T01:24:14.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.389+0000 7f7735740640 1 -- 172.21.15.154:0/3647514682 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f77100678f0 msgr2=0x7f7710069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.389+0000 7f7735740640 1 --2- 172.21.15.154:0/3647514682 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f77100678f0 0x7f7710069db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f77180af000 tx=0x7f7718008040 comp rx=0 tx=0).stop 2024-05-14T01:24:14.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.389+0000 7f7735740640 1 -- 172.21.15.154:0/3647514682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7730158f20 msgr2=0x7f7730143570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.389+0000 7f7735740640 1 --2- 172.21.15.154:0/3647514682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7730158f20 0x7f7730143570 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f77200072c0 tx=0x7f7720007780 comp rx=0 tx=0).stop 2024-05-14T01:24:14.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.389+0000 7f7735740640 1 -- 172.21.15.154:0/3647514682 shutdown_connections 2024-05-14T01:24:14.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.389+0000 7f7735740640 1 --2- 172.21.15.154:0/3647514682 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f77100678f0 0x7f7710069db0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.389+0000 7f7735740640 1 --2- 172.21.15.154:0/3647514682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7730159380 0x7f7730143ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.389+0000 7f7735740640 1 --2- 172.21.15.154:0/3647514682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7730158f20 0x7f7730143570 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.389+0000 7f7735740640 1 --2- 172.21.15.154:0/3647514682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f771c0039c0 0x7f773015ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.389+0000 7f7735740640 1 -- 172.21.15.154:0/3647514682 >> 172.21.15.154:0/3647514682 conn(0x7f7730071e70 msgr2=0x7f773015b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:14.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.389+0000 7f7735740640 1 -- 172.21.15.154:0/3647514682 shutdown_connections 2024-05-14T01:24:14.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.389+0000 7f7735740640 1 -- 172.21.15.154:0/3647514682 wait complete. 2024-05-14T01:24:14.392 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T01:24:14.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.517+0000 7f88d0117640 1 Processor -- start 2024-05-14T01:24:14.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.517+0000 7f88d0117640 1 -- start start 2024-05-14T01:24:14.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.517+0000 7f88d0117640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c81458d0 0x7f88c80cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.517+0000 7f88d0117640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f88c8160150 0x7f88c806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.517+0000 7f88d0117640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88c8071840 con 0x7f88c8071060 2024-05-14T01:24:14.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.517+0000 7f88d0117640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f88c8071b20 con 0x7f88c8160150 2024-05-14T01:24:14.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.517+0000 7f88d0117640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f88c8071e00 con 0x7f88c81458d0 2024-05-14T01:24:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.517+0000 7f88cdeb3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c81458d0 0x7f88c80cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.517+0000 7f88cdeb3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c81458d0 0x7f88c80cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:49562/0 (socket says 172.21.15.154:49562) 2024-05-14T01:24:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.517+0000 7f88ce6b4640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f88c8160150 0x7f88c806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.517+0000 7f88cdeb3640 1 -- 172.21.15.154:0/3827145097 learned_addr learned my addr 172.21.15.154:0/3827145097 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.521+0000 7f88cceb1640 1 -- 172.21.15.154:0/3827145097 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1284103105 0 0) 0x7f88c8071840 con 0x7f88c8071060 2024-05-14T01:24:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.521+0000 7f88cceb1640 1 -- 172.21.15.154:0/3827145097 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88b4003530 con 0x7f88c8071060 2024-05-14T01:24:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.521+0000 7f88cdeb3640 1 -- 172.21.15.154:0/3827145097 >> v2:172.21.15.176:3300/0 conn(0x7f88c8160150 msgr2=0x7f88c806ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.521+0000 7f88cdeb3640 1 --2- 172.21.15.154:0/3827145097 >> v2:172.21.15.176:3300/0 conn(0x7f88c8160150 0x7f88c806ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.521+0000 7f88cdeb3640 1 -- 172.21.15.154:0/3827145097 >> v1:172.21.15.176:6789/0 conn(0x7f88c8071060 legacy=0x7f88c815fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.521+0000 7f88cdeb3640 1 -- 172.21.15.154:0/3827145097 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c80720e0 con 0x7f88c81458d0 2024-05-14T01:24:14.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.521+0000 7f88cdeb3640 1 --2- 172.21.15.154:0/3827145097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c81458d0 0x7f88c80cf610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009870 tx=0x7f88c401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d8f3bc3d6feffd1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:14.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.521+0000 7f88cceb1640 1 -- 172.21.15.154:0/3827145097 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c40b2070 con 0x7f88c81458d0 2024-05-14T01:24:14.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.521+0000 7f88cceb1640 1 -- 172.21.15.154:0/3827145097 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c40a9070 con 0x7f88c81458d0 2024-05-14T01:24:14.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.521+0000 7f88cceb1640 1 -- 172.21.15.154:0/3827145097 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c40ad860 con 0x7f88c81458d0 2024-05-14T01:24:14.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88d0117640 1 -- 172.21.15.154:0/3827145097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c81458d0 msgr2=0x7f88c80cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88d0117640 1 --2- 172.21.15.154:0/3827145097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c81458d0 0x7f88c80cf610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009870 tx=0x7f88c401c560 comp rx=0 tx=0).stop 2024-05-14T01:24:14.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88d0117640 1 -- 172.21.15.154:0/3827145097 shutdown_connections 2024-05-14T01:24:14.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88d0117640 1 --2- 172.21.15.154:0/3827145097 >> v2:172.21.15.176:3300/0 conn(0x7f88c8160150 0x7f88c806ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88d0117640 1 --2- 172.21.15.154:0/3827145097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c81458d0 0x7f88c80cf610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88d0117640 1 -- 172.21.15.154:0/3827145097 >> 172.21.15.154:0/3827145097 conn(0x7f88c80b1770 msgr2=0x7f88c80b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:14.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88d0117640 1 -- 172.21.15.154:0/3827145097 shutdown_connections 2024-05-14T01:24:14.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88d0117640 1 -- 172.21.15.154:0/3827145097 wait complete. 2024-05-14T01:24:14.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88d0117640 1 Processor -- start 2024-05-14T01:24:14.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88d0117640 1 -- start start 2024-05-14T01:24:14.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88d0117640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c8071060 0x7f88c81448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88d0117640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88c81458d0 0x7f88c81516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88d0117640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c8160150 0x7f88c8151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88d0117640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f88c806dd10 con 0x7f88c81458d0 2024-05-14T01:24:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88d0117640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f88c806db90 con 0x7f88c8071060 2024-05-14T01:24:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88d0117640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f88c8168de0 con 0x7f88c8160150 2024-05-14T01:24:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88cd6b2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88c81458d0 0x7f88c81516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88cd6b2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88c81458d0 0x7f88c81516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59464/0 (socket says 172.21.15.154:59464) 2024-05-14T01:24:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88cd6b2640 1 -- 172.21.15.154:0/4251894368 learned_addr learned my addr 172.21.15.154:0/4251894368 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88cdeb3640 1 --2- 172.21.15.154:0/4251894368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c8071060 0x7f88c81448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88ce6b4640 1 --2- 172.21.15.154:0/4251894368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c8160150 0x7f88c8151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88cd6b2640 1 -- 172.21.15.154:0/4251894368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c8160150 msgr2=0x7f88c8151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88cd6b2640 1 --2- 172.21.15.154:0/4251894368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c8160150 0x7f88c8151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88cd6b2640 1 -- 172.21.15.154:0/4251894368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c8071060 msgr2=0x7f88c81448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88cd6b2640 1 --2- 172.21.15.154:0/4251894368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c8071060 0x7f88c81448b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88cd6b2640 1 -- 172.21.15.154:0/4251894368 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c814fef0 con 0x7f88c81458d0 2024-05-14T01:24:14.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88cd6b2640 1 --2- 172.21.15.154:0/4251894368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88c81458d0 0x7f88c81516a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f88b800c490 tx=0x7f88b800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:14.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88be7fc640 1 -- 172.21.15.154:0/4251894368 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b80052d0 con 0x7f88c81458d0 2024-05-14T01:24:14.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88be7fc640 1 -- 172.21.15.154:0/4251894368 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b8005470 con 0x7f88c81458d0 2024-05-14T01:24:14.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88be7fc640 1 -- 172.21.15.154:0/4251894368 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8012870 con 0x7f88c81458d0 2024-05-14T01:24:14.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88d0117640 1 -- 172.21.15.154:0/4251894368 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c81501d0 con 0x7f88c81458d0 2024-05-14T01:24:14.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.525+0000 7f88d0117640 1 -- 172.21.15.154:0/4251894368 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c8150790 con 0x7f88c81458d0 2024-05-14T01:24:14.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.529+0000 7f88d0117640 1 -- 172.21.15.154:0/4251894368 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c8075470 con 0x7f88c81458d0 2024-05-14T01:24:14.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.529+0000 7f88be7fc640 1 -- 172.21.15.154:0/4251894368 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f88b8012a10 con 0x7f88c81458d0 2024-05-14T01:24:14.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.529+0000 7f88be7fc640 1 --2- 172.21.15.154:0/4251894368 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f88ac0678f0 0x7f88ac069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.529+0000 7f88be7fc640 1 -- 172.21.15.154:0/4251894368 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f88b8085920 con 0x7f88c81458d0 2024-05-14T01:24:14.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.529+0000 7f88cdeb3640 1 --2- 172.21.15.154:0/4251894368 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f88ac0678f0 0x7f88ac069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.529+0000 7f88cdeb3640 1 --2- 172.21.15.154:0/4251894368 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f88ac0678f0 0x7f88ac069db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f88c40af000 tx=0x7f88c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.533+0000 7f88be7fc640 1 -- 172.21.15.154:0/4251894368 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f88b8056460 con 0x7f88c81458d0 2024-05-14T01:24:14.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.681+0000 7f88d0117640 1 -- 172.21.15.154:0/4251894368 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f88c815e4f0 con 0x7f88c81458d0 2024-05-14T01:24:14.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.681+0000 7f88be7fc640 1 -- 172.21.15.154:0/4251894368 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f88b8055d60 con 0x7f88c81458d0 2024-05-14T01:24:14.667 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-05-14T01:24:14.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.681+0000 7f88d0117640 1 -- 172.21.15.154:0/4251894368 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f88ac0678f0 msgr2=0x7f88ac069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.681+0000 7f88d0117640 1 --2- 172.21.15.154:0/4251894368 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f88ac0678f0 0x7f88ac069db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f88c40af000 tx=0x7f88c4009040 comp rx=0 tx=0).stop 2024-05-14T01:24:14.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.681+0000 7f88d0117640 1 -- 172.21.15.154:0/4251894368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88c81458d0 msgr2=0x7f88c81516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.681+0000 7f88d0117640 1 --2- 172.21.15.154:0/4251894368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88c81458d0 0x7f88c81516a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f88b800c490 tx=0x7f88b800c950 comp rx=0 tx=0).stop 2024-05-14T01:24:14.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.681+0000 7f88d0117640 1 -- 172.21.15.154:0/4251894368 shutdown_connections 2024-05-14T01:24:14.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.681+0000 7f88d0117640 1 --2- 172.21.15.154:0/4251894368 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f88ac0678f0 0x7f88ac069db0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.681+0000 7f88d0117640 1 --2- 172.21.15.154:0/4251894368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c8160150 0x7f88c8151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.681+0000 7f88d0117640 1 --2- 172.21.15.154:0/4251894368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88c81458d0 0x7f88c81516a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.681+0000 7f88d0117640 1 --2- 172.21.15.154:0/4251894368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c8071060 0x7f88c81448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.681+0000 7f88d0117640 1 -- 172.21.15.154:0/4251894368 >> 172.21.15.154:0/4251894368 conn(0x7f88c80b1770 msgr2=0x7f88c80cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:14.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.681+0000 7f88d0117640 1 -- 172.21.15.154:0/4251894368 shutdown_connections 2024-05-14T01:24:14.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.681+0000 7f88d0117640 1 -- 172.21.15.154:0/4251894368 wait complete. 2024-05-14T01:24:14.684 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T01:24:14.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0df3624640 1 Processor -- start 2024-05-14T01:24:14.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0df3624640 1 -- start start 2024-05-14T01:24:14.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0df3624640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0dec13ede0 0x7f0dec1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0df3624640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dec0cf100 con 0x7f0dec141b30 2024-05-14T01:24:14.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0df3624640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dec0cf3e0 con 0x7f0dec0cea50 2024-05-14T01:24:14.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0df3624640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f0dec0ceee0 con 0x7f0dec13ede0 2024-05-14T01:24:14.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0df0bbf640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0dec141b30 0x7f0dec0ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54586/0 (socket says 172.21.15.154:54586) 2024-05-14T01:24:14.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0df0bbf640 1 -- 172.21.15.154:0/1677991304 learned_addr learned my addr 172.21.15.154:0/1677991304 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:14.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0de3fff640 1 -- 172.21.15.154:0/1677991304 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2198449898 0 0) 0x7f0dec0cf100 con 0x7f0dec141b30 2024-05-14T01:24:14.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0de3fff640 1 -- 172.21.15.154:0/1677991304 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dd8003530 con 0x7f0dec141b30 2024-05-14T01:24:14.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0df13c0640 1 --2- 172.21.15.154:0/1677991304 >> v2:172.21.15.176:3300/0 conn(0x7f0dec13ede0 0x7f0dec1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0de3fff640 1 -- 172.21.15.154:0/1677991304 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4162238111 0 0) 0x7f0dd8003530 con 0x7f0dec141b30 2024-05-14T01:24:14.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0de3fff640 1 -- 172.21.15.154:0/1677991304 >> v2:172.21.15.176:3300/0 conn(0x7f0dec13ede0 msgr2=0x7f0dec1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:14.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0de3fff640 1 --2- 172.21.15.154:0/1677991304 >> v2:172.21.15.176:3300/0 conn(0x7f0dec13ede0 0x7f0dec1415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0de3fff640 1 -- 172.21.15.154:0/1677991304 >> v1:172.21.15.176:6789/0 conn(0x7f0dec0cea50 legacy=0x7f0dec06d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0de3fff640 1 -- 172.21.15.154:0/1677991304 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dec06cc80 con 0x7f0dec141b30 2024-05-14T01:24:14.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0de3fff640 1 -- 172.21.15.154:0/1677991304 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f0ddc001680 con 0x7f0dec141b30 2024-05-14T01:24:14.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0de3fff640 1 -- 172.21.15.154:0/1677991304 >> v1:172.21.15.154:6789/0 conn(0x7f0dec141b30 legacy=0x7f0dec0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0de3fff640 1 --2- 172.21.15.154:0/1677991304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd80039c0 0x7f0dd8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0de3fff640 1 --2- 172.21.15.154:0/1677991304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dd8004810 0x7f0dd8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0de3fff640 1 --2- 172.21.15.154:0/1677991304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd80051d0 0x7f0dd800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0de3fff640 1 -- 172.21.15.154:0/1677991304 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec0ceee0 con 0x7f0dd80051d0 2024-05-14T01:24:14.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0de3fff640 1 -- 172.21.15.154:0/1677991304 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd800c120 con 0x7f0dd80039c0 2024-05-14T01:24:14.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0de3fff640 1 -- 172.21.15.154:0/1677991304 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0dd800c320 con 0x7f0dd8004810 2024-05-14T01:24:14.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0df1bc1640 1 --2- 172.21.15.154:0/1677991304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd80051d0 0x7f0dd800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0df13c0640 1 --2- 172.21.15.154:0/1677991304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd80039c0 0x7f0dd8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0df0bbf640 1 --2- 172.21.15.154:0/1677991304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dd8004810 0x7f0dd8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0df1bc1640 1 -- 172.21.15.154:0/1677991304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dd8004810 msgr2=0x7f0dd8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:14.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0df1bc1640 1 --2- 172.21.15.154:0/1677991304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dd8004810 0x7f0dd8004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0df1bc1640 1 -- 172.21.15.154:0/1677991304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd80039c0 msgr2=0x7f0dd8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:14.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0df1bc1640 1 --2- 172.21.15.154:0/1677991304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd80039c0 0x7f0dd8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.805+0000 7f0df1bc1640 1 -- 172.21.15.154:0/1677991304 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd8003530 con 0x7f0dd80051d0 2024-05-14T01:24:14.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.809+0000 7f0df1bc1640 1 -- 172.21.15.154:0/1677991304 reap_dead start 2024-05-14T01:24:14.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.809+0000 7f0df1bc1640 1 --2- 172.21.15.154:0/1677991304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd80051d0 0x7f0dd800b9d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0de4001e70 tx=0x7f0de401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97005e31d65136e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:14.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.809+0000 7f0de3fff640 1 -- 172.21.15.154:0/1677991304 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4001a90 con 0x7f0dd80051d0 2024-05-14T01:24:14.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.809+0000 7f0de3fff640 1 -- 172.21.15.154:0/1677991304 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de4003bc0 con 0x7f0dd80051d0 2024-05-14T01:24:14.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.809+0000 7f0de3fff640 1 -- 172.21.15.154:0/1677991304 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4005020 con 0x7f0dd80051d0 2024-05-14T01:24:14.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.809+0000 7f0df3624640 1 -- 172.21.15.154:0/1677991304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd80051d0 msgr2=0x7f0dd800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.809+0000 7f0df3624640 1 --2- 172.21.15.154:0/1677991304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd80051d0 0x7f0dd800b9d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0de4001e70 tx=0x7f0de401c780 comp rx=0 tx=0).stop 2024-05-14T01:24:14.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.809+0000 7f0df3624640 1 -- 172.21.15.154:0/1677991304 shutdown_connections 2024-05-14T01:24:14.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.809+0000 7f0df3624640 1 --2- 172.21.15.154:0/1677991304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd80051d0 0x7f0dd800b9d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.809+0000 7f0df3624640 1 -- 172.21.15.154:0/1677991304 >> 172.21.15.154:0/1677991304 conn(0x7f0dec0b1850 msgr2=0x7f0dec0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:14.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.809+0000 7f0df3624640 1 -- 172.21.15.154:0/1677991304 shutdown_connections 2024-05-14T01:24:14.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.809+0000 7f0df3624640 1 -- 172.21.15.154:0/1677991304 wait complete. 2024-05-14T01:24:14.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.809+0000 7f0df3624640 1 Processor -- start 2024-05-14T01:24:14.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.809+0000 7f0df3624640 1 -- start start 2024-05-14T01:24:14.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df3624640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd80051d0 0x7f0dec155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df3624640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dec1524d0 0x7f0dec1574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df3624640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec158d90 0x7f0dec159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df3624640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec06cff0 con 0x7f0dec1524d0 2024-05-14T01:24:14.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df3624640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec13f1c0 con 0x7f0dd80051d0 2024-05-14T01:24:14.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df3624640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0dec1415f0 con 0x7f0dec158d90 2024-05-14T01:24:14.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df0bbf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dec1524d0 0x7f0dec1574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df0bbf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dec1524d0 0x7f0dec1574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59486/0 (socket says 172.21.15.154:59486) 2024-05-14T01:24:14.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df0bbf640 1 -- 172.21.15.154:0/2408096549 learned_addr learned my addr 172.21.15.154:0/2408096549 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:14.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df1bc1640 1 --2- 172.21.15.154:0/2408096549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec158d90 0x7f0dec159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df13c0640 1 --2- 172.21.15.154:0/2408096549 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd80051d0 0x7f0dec155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df0bbf640 1 -- 172.21.15.154:0/2408096549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec158d90 msgr2=0x7f0dec159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df0bbf640 1 --2- 172.21.15.154:0/2408096549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec158d90 0x7f0dec159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df0bbf640 1 -- 172.21.15.154:0/2408096549 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd80051d0 msgr2=0x7f0dec155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df0bbf640 1 --2- 172.21.15.154:0/2408096549 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd80051d0 0x7f0dec155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df0bbf640 1 -- 172.21.15.154:0/2408096549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dec157d10 con 0x7f0dec1524d0 2024-05-14T01:24:14.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df13c0640 1 --2- 172.21.15.154:0/2408096549 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd80051d0 0x7f0dec155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:14.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df0bbf640 1 --2- 172.21.15.154:0/2408096549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dec1524d0 0x7f0dec1574e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc007fd0 tx=0x7f0ddc00db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:14.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0de1ffb640 1 -- 172.21.15.154:0/2408096549 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc019070 con 0x7f0dec1524d0 2024-05-14T01:24:14.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0de1ffb640 1 -- 172.21.15.154:0/2408096549 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ddc0072d0 con 0x7f0dec1524d0 2024-05-14T01:24:14.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df3624640 1 -- 172.21.15.154:0/2408096549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dec157ff0 con 0x7f0dec1524d0 2024-05-14T01:24:14.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0de1ffb640 1 -- 172.21.15.154:0/2408096549 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc007680 con 0x7f0dec1524d0 2024-05-14T01:24:14.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df3624640 1 -- 172.21.15.154:0/2408096549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dec157a20 con 0x7f0dec1524d0 2024-05-14T01:24:14.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df3624640 1 -- 172.21.15.154:0/2408096549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dec075470 con 0x7f0dec1524d0 2024-05-14T01:24:14.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0de1ffb640 1 -- 172.21.15.154:0/2408096549 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0ddc01c070 con 0x7f0dec1524d0 2024-05-14T01:24:14.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0de1ffb640 1 --2- 172.21.15.154:0/2408096549 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f0dd00678c0 0x7f0dd0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:14.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df13c0640 1 --2- 172.21.15.154:0/2408096549 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f0dd00678c0 0x7f0dd0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:14.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0de1ffb640 1 -- 172.21.15.154:0/2408096549 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0ddc0855d0 con 0x7f0dec1524d0 2024-05-14T01:24:14.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.813+0000 7f0df13c0640 1 --2- 172.21.15.154:0/2408096549 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f0dd00678c0 0x7f0dd0069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0de800e870 tx=0x7f0de8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:14.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.817+0000 7f0de1ffb640 1 -- 172.21.15.154:0/2408096549 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f0ddc0561a0 con 0x7f0dec1524d0 2024-05-14T01:24:14.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.977+0000 7f0df3624640 1 -- 172.21.15.154:0/2408096549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0dec06f180 con 0x7f0dec1524d0 2024-05-14T01:24:14.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.977+0000 7f0de1ffb640 1 -- 172.21.15.154:0/2408096549 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f0ddc055aa0 con 0x7f0dec1524d0 2024-05-14T01:24:14.963 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-05-14T01:24:14.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.977+0000 7f0df3624640 1 -- 172.21.15.154:0/2408096549 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f0dd00678c0 msgr2=0x7f0dd0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.977+0000 7f0df3624640 1 --2- 172.21.15.154:0/2408096549 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f0dd00678c0 0x7f0dd0069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0de800e870 tx=0x7f0de8008040 comp rx=0 tx=0).stop 2024-05-14T01:24:14.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.977+0000 7f0df3624640 1 -- 172.21.15.154:0/2408096549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dec1524d0 msgr2=0x7f0dec1574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:14.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.977+0000 7f0df3624640 1 --2- 172.21.15.154:0/2408096549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dec1524d0 0x7f0dec1574e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc007fd0 tx=0x7f0ddc00db50 comp rx=0 tx=0).stop 2024-05-14T01:24:14.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.977+0000 7f0df3624640 1 -- 172.21.15.154:0/2408096549 shutdown_connections 2024-05-14T01:24:14.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.977+0000 7f0df3624640 1 --2- 172.21.15.154:0/2408096549 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f0dd00678c0 0x7f0dd0069d80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.977+0000 7f0df3624640 1 --2- 172.21.15.154:0/2408096549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec158d90 0x7f0dec159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.977+0000 7f0df3624640 1 --2- 172.21.15.154:0/2408096549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dec1524d0 0x7f0dec1574e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.977+0000 7f0df3624640 1 --2- 172.21.15.154:0/2408096549 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd80051d0 0x7f0dec155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:14.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.977+0000 7f0df3624640 1 -- 172.21.15.154:0/2408096549 >> 172.21.15.154:0/2408096549 conn(0x7f0dec0b1850 msgr2=0x7f0dec0ce300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:14.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.977+0000 7f0df3624640 1 -- 172.21.15.154:0/2408096549 shutdown_connections 2024-05-14T01:24:14.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:14.977+0000 7f0df3624640 1 -- 172.21.15.154:0/2408096549 wait complete. 2024-05-14T01:24:14.981 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:24:14.981 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T01:24:14.987 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:15.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.149+0000 7f55a964c640 1 Processor -- start 2024-05-14T01:24:15.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.149+0000 7f55a964c640 1 -- start start 2024-05-14T01:24:15.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.153+0000 7f55a964c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a4141d00 0x7f55a40ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:15.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.153+0000 7f55a964c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f55a40ce880 0x7f55a406d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:15.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.153+0000 7f55a964c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55a40cf100 con 0x7f55a413ede0 2024-05-14T01:24:15.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.153+0000 7f55a964c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f55a406cff0 con 0x7f55a40ce880 2024-05-14T01:24:15.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.153+0000 7f55a964c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f55a40cf3e0 con 0x7f55a4141d00 2024-05-14T01:24:15.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.153+0000 7f55a37fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f55a40ce880 0x7f55a406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:15.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.153+0000 7f55a37fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f55a40ce880 0x7f55a406d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59496/0 (socket says 172.21.15.154:59496) 2024-05-14T01:24:15.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.153+0000 7f55a37fe640 1 -- 172.21.15.154:0/3239175251 learned_addr learned my addr 172.21.15.154:0/3239175251 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:15.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.153+0000 7f55a27fc640 1 --2- 172.21.15.154:0/3239175251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a4141d00 0x7f55a40ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:15.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.153+0000 7f55a37fe640 1 -- 172.21.15.154:0/3239175251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a4141d00 msgr2=0x7f55a40ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:15.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.153+0000 7f55a37fe640 1 --2- 172.21.15.154:0/3239175251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a4141d00 0x7f55a40ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.153+0000 7f55a37fe640 1 -- 172.21.15.154:0/3239175251 >> v1:172.21.15.176:6789/0 conn(0x7f55a413ede0 legacy=0x7f55a41415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:15.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.153+0000 7f55a37fe640 1 -- 172.21.15.154:0/3239175251 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a406cc80 con 0x7f55a40ce880 2024-05-14T01:24:15.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.153+0000 7f55a37fe640 1 --2- 172.21.15.154:0/3239175251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55a40ce880 0x7f55a406d480 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5594009870 tx=0x7f559401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc3b4708beb1b85 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:15.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.153+0000 7f55a1ffb640 1 -- 172.21.15.154:0/3239175251 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55940aa650 con 0x7f55a40ce880 2024-05-14T01:24:15.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.153+0000 7f55a1ffb640 1 -- 172.21.15.154:0/3239175251 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55940af070 con 0x7f55a40ce880 2024-05-14T01:24:15.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.153+0000 7f55a1ffb640 1 -- 172.21.15.154:0/3239175251 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55940aaa10 con 0x7f55a40ce880 2024-05-14T01:24:15.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 -- 172.21.15.154:0/3239175251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55a40ce880 msgr2=0x7f55a406d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:15.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 --2- 172.21.15.154:0/3239175251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55a40ce880 0x7f55a406d480 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5594009870 tx=0x7f559401c520 comp rx=0 tx=0).stop 2024-05-14T01:24:15.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 -- 172.21.15.154:0/3239175251 shutdown_connections 2024-05-14T01:24:15.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 --2- 172.21.15.154:0/3239175251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55a40ce880 0x7f55a406d480 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 --2- 172.21.15.154:0/3239175251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a4141d00 0x7f55a40ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 -- 172.21.15.154:0/3239175251 >> 172.21.15.154:0/3239175251 conn(0x7f55a40b1850 msgr2=0x7f55a40b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:15.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 -- 172.21.15.154:0/3239175251 shutdown_connections 2024-05-14T01:24:15.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 -- 172.21.15.154:0/3239175251 wait complete. 2024-05-14T01:24:15.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 Processor -- start 2024-05-14T01:24:15.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 -- start start 2024-05-14T01:24:15.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a40ce880 0x7f55a4158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:15.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55a413ede0 0x7f55a4158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:15.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a4141d00 0x7f55a41593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:15.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55a406e350 con 0x7f55a413ede0 2024-05-14T01:24:15.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f55a406e1d0 con 0x7f55a4141d00 2024-05-14T01:24:15.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f55a406e4d0 con 0x7f55a40ce880 2024-05-14T01:24:15.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a27fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55a413ede0 0x7f55a4158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:15.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a27fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55a413ede0 0x7f55a4158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59508/0 (socket says 172.21.15.154:59508) 2024-05-14T01:24:15.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a27fc640 1 -- 172.21.15.154:0/1335690599 learned_addr learned my addr 172.21.15.154:0/1335690599 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:15.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a2ffd640 1 --2- 172.21.15.154:0/1335690599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a40ce880 0x7f55a4158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:15.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a37fe640 1 --2- 172.21.15.154:0/1335690599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a4141d00 0x7f55a41593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:15.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a27fc640 1 -- 172.21.15.154:0/1335690599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a40ce880 msgr2=0x7f55a4158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:15.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a27fc640 1 --2- 172.21.15.154:0/1335690599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a40ce880 0x7f55a4158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a27fc640 1 -- 172.21.15.154:0/1335690599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a4141d00 msgr2=0x7f55a41593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:15.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a27fc640 1 --2- 172.21.15.154:0/1335690599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a4141d00 0x7f55a41593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a27fc640 1 -- 172.21.15.154:0/1335690599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a415f750 con 0x7f55a413ede0 2024-05-14T01:24:15.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a37fe640 1 --2- 172.21.15.154:0/1335690599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a4141d00 0x7f55a41593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:15.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a27fc640 1 --2- 172.21.15.154:0/1335690599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55a413ede0 0x7f55a4158ea0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f558c00d5f0 tx=0x7f558c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:15.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f559b7fe640 1 -- 172.21.15.154:0/1335690599 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c0125f0 con 0x7f55a413ede0 2024-05-14T01:24:15.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f559b7fe640 1 -- 172.21.15.154:0/1335690599 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f558c019070 con 0x7f55a413ede0 2024-05-14T01:24:15.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 -- 172.21.15.154:0/1335690599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a41414c0 con 0x7f55a413ede0 2024-05-14T01:24:15.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f559b7fe640 1 -- 172.21.15.154:0/1335690599 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c0129b0 con 0x7f55a413ede0 2024-05-14T01:24:15.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 -- 172.21.15.154:0/1335690599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a4157ba0 con 0x7f55a413ede0 2024-05-14T01:24:15.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.157+0000 7f55a964c640 1 -- 172.21.15.154:0/1335690599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55a4075470 con 0x7f55a413ede0 2024-05-14T01:24:15.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.161+0000 7f559b7fe640 1 -- 172.21.15.154:0/1335690599 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f558c012b50 con 0x7f55a413ede0 2024-05-14T01:24:15.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.161+0000 7f559b7fe640 1 --2- 172.21.15.154:0/1335690599 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f55840678c0 0x7f5584069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:15.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.161+0000 7f559b7fe640 1 -- 172.21.15.154:0/1335690599 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f558c0860b0 con 0x7f55a413ede0 2024-05-14T01:24:15.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.161+0000 7f55a2ffd640 1 --2- 172.21.15.154:0/1335690599 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f55840678c0 0x7f5584069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:15.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.161+0000 7f55a2ffd640 1 --2- 172.21.15.154:0/1335690599 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f55840678c0 0x7f5584069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f559c0012f0 tx=0x7f559c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:15.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.165+0000 7f559b7fe640 1 -- 172.21.15.154:0/1335690599 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f558c056bf0 con 0x7f55a413ede0 2024-05-14T01:24:15.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.321+0000 7f55a964c640 1 -- 172.21.15.154:0/1335690599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55a406f180 con 0x7f55a413ede0 2024-05-14T01:24:15.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.321+0000 7f559b7fe640 1 -- 172.21.15.154:0/1335690599 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f558c0564f0 con 0x7f55a413ede0 2024-05-14T01:24:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:15.309 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:23:36.232271+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:15.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.325+0000 7f55a964c640 1 -- 172.21.15.154:0/1335690599 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f55840678c0 msgr2=0x7f5584069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:15.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.325+0000 7f55a964c640 1 --2- 172.21.15.154:0/1335690599 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f55840678c0 0x7f5584069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f559c0012f0 tx=0x7f559c009040 comp rx=0 tx=0).stop 2024-05-14T01:24:15.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.325+0000 7f55a964c640 1 -- 172.21.15.154:0/1335690599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55a413ede0 msgr2=0x7f55a4158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:15.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.325+0000 7f55a964c640 1 --2- 172.21.15.154:0/1335690599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55a413ede0 0x7f55a4158ea0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f558c00d5f0 tx=0x7f558c00dab0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.325+0000 7f55a964c640 1 -- 172.21.15.154:0/1335690599 shutdown_connections 2024-05-14T01:24:15.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.325+0000 7f55a964c640 1 --2- 172.21.15.154:0/1335690599 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f55840678c0 0x7f5584069d80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.325+0000 7f55a964c640 1 --2- 172.21.15.154:0/1335690599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a4141d00 0x7f55a41593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.325+0000 7f55a964c640 1 --2- 172.21.15.154:0/1335690599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55a413ede0 0x7f55a4158ea0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.325+0000 7f55a964c640 1 --2- 172.21.15.154:0/1335690599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a40ce880 0x7f55a4158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.325+0000 7f55a964c640 1 -- 172.21.15.154:0/1335690599 >> 172.21.15.154:0/1335690599 conn(0x7f55a40b1850 msgr2=0x7f55a413d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:15.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.325+0000 7f55a964c640 1 -- 172.21.15.154:0/1335690599 shutdown_connections 2024-05-14T01:24:15.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.325+0000 7f55a964c640 1 -- 172.21.15.154:0/1335690599 wait complete. 2024-05-14T01:24:15.326 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T01:23:33.083538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T01:23:33.556058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:24:15.327 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:24:15.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.461+0000 7f4c2f7fe640 1 Processor -- start 2024-05-14T01:24:15.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.461+0000 7f4c2f7fe640 1 -- start start 2024-05-14T01:24:15.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.461+0000 7f4c2f7fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4c2806fad0 0x7f4c280ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:15.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.461+0000 7f4c2f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4c280b0250 0x7f4c281625c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:15.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.461+0000 7f4c2f7fe640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c2806feb0 con 0x7f4c28074280 2024-05-14T01:24:15.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.461+0000 7f4c2f7fe640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4c280d0a50 con 0x7f4c280b0250 2024-05-14T01:24:15.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.461+0000 7f4c2f7fe640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4c280d01f0 con 0x7f4c2806fad0 2024-05-14T01:24:15.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.461+0000 7f4c2cd99640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4c280b0250 0x7f4c281625c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:15.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.461+0000 7f4c2cd99640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4c280b0250 0x7f4c281625c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59510/0 (socket says 172.21.15.154:59510) 2024-05-14T01:24:15.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.461+0000 7f4c2cd99640 1 -- 172.21.15.154:0/45363129 learned_addr learned my addr 172.21.15.154:0/45363129 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:15.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.465+0000 7f4c2cd99640 1 -- 172.21.15.154:0/45363129 >> v2:172.21.15.176:3300/0 conn(0x7f4c2806fad0 msgr2=0x7f4c280ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:15.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.465+0000 7f4c2cd99640 1 --2- 172.21.15.154:0/45363129 >> v2:172.21.15.176:3300/0 conn(0x7f4c2806fad0 0x7f4c280ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.465+0000 7f4c2cd99640 1 -- 172.21.15.154:0/45363129 >> v1:172.21.15.176:6789/0 conn(0x7f4c28074280 legacy=0x7f4c2806b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:15.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.465+0000 7f4c2cd99640 1 -- 172.21.15.154:0/45363129 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c28161e00 con 0x7f4c280b0250 2024-05-14T01:24:15.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.469+0000 7f4c2cd99640 1 --2- 172.21.15.154:0/45363129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c280b0250 0x7f4c281625c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4c28071c40 tx=0x7f4c1801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d811c483901910 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:15.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.469+0000 7f4c1ffff640 1 -- 172.21.15.154:0/45363129 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c180b5070 con 0x7f4c280b0250 2024-05-14T01:24:15.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.469+0000 7f4c1ffff640 1 -- 172.21.15.154:0/45363129 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c180a89d0 con 0x7f4c280b0250 2024-05-14T01:24:15.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.469+0000 7f4c1ffff640 1 -- 172.21.15.154:0/45363129 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c180a8da0 con 0x7f4c280b0250 2024-05-14T01:24:15.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.469+0000 7f4c2f7fe640 1 -- 172.21.15.154:0/45363129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c280b0250 msgr2=0x7f4c281625c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:15.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.469+0000 7f4c2f7fe640 1 --2- 172.21.15.154:0/45363129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c280b0250 0x7f4c281625c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4c28071c40 tx=0x7f4c1801ecd0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.469+0000 7f4c2f7fe640 1 -- 172.21.15.154:0/45363129 shutdown_connections 2024-05-14T01:24:15.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.469+0000 7f4c2f7fe640 1 --2- 172.21.15.154:0/45363129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c280b0250 0x7f4c281625c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.469+0000 7f4c2f7fe640 1 --2- 172.21.15.154:0/45363129 >> v2:172.21.15.176:3300/0 conn(0x7f4c2806fad0 0x7f4c280ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.469+0000 7f4c2f7fe640 1 -- 172.21.15.154:0/45363129 >> 172.21.15.154:0/45363129 conn(0x7f4c280cd6f0 msgr2=0x7f4c280cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:15.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.469+0000 7f4c2f7fe640 1 -- 172.21.15.154:0/45363129 shutdown_connections 2024-05-14T01:24:15.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.469+0000 7f4c2f7fe640 1 -- 172.21.15.154:0/45363129 wait complete. 2024-05-14T01:24:15.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.469+0000 7f4c2f7fe640 1 Processor -- start 2024-05-14T01:24:15.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.469+0000 7f4c2f7fe640 1 -- start start 2024-05-14T01:24:15.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.469+0000 7f4c2f7fe640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c2806fad0 0x7f4c2815d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:15.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.469+0000 7f4c2f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c28074280 0x7f4c280b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:15.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.469+0000 7f4c2f7fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c280b0250 0x7f4c280b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:15.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c2f7fe640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4c281620a0 con 0x7f4c28074280 2024-05-14T01:24:15.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c2f7fe640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4c280d0770 con 0x7f4c280b0250 2024-05-14T01:24:15.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c2f7fe640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4c28162b00 con 0x7f4c2806fad0 2024-05-14T01:24:15.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c2dd9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c280b0250 0x7f4c280b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:15.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c2dd9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c280b0250 0x7f4c280b2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:41040/0 (socket says 172.21.15.154:41040) 2024-05-14T01:24:15.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c2dd9b640 1 -- 172.21.15.154:0/263703957 learned_addr learned my addr 172.21.15.154:0/263703957 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:15.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c2d59a640 1 --2- 172.21.15.154:0/263703957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c2806fad0 0x7f4c2815d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:15.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c2cd99640 1 --2- 172.21.15.154:0/263703957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c28074280 0x7f4c280b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:15.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c2d59a640 1 -- 172.21.15.154:0/263703957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c280b0250 msgr2=0x7f4c280b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:15.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c2d59a640 1 --2- 172.21.15.154:0/263703957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c280b0250 0x7f4c280b2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c2d59a640 1 -- 172.21.15.154:0/263703957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c28074280 msgr2=0x7f4c280b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:15.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c2d59a640 1 --2- 172.21.15.154:0/263703957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c28074280 0x7f4c280b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c2d59a640 1 -- 172.21.15.154:0/263703957 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c281ed990 con 0x7f4c2806fad0 2024-05-14T01:24:15.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c2d59a640 1 --2- 172.21.15.154:0/263703957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c2806fad0 0x7f4c2815d3c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400bd70 tx=0x7f4c2400be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:15.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c1dffb640 1 -- 172.21.15.154:0/263703957 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c24019070 con 0x7f4c2806fad0 2024-05-14T01:24:15.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c2f7fe640 1 -- 172.21.15.154:0/263703957 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c281f8760 con 0x7f4c2806fad0 2024-05-14T01:24:15.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c2f7fe640 1 -- 172.21.15.154:0/263703957 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c281f8d20 con 0x7f4c2806fad0 2024-05-14T01:24:15.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c1dffb640 1 -- 172.21.15.154:0/263703957 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c2401e440 con 0x7f4c2806fad0 2024-05-14T01:24:15.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c1dffb640 1 -- 172.21.15.154:0/263703957 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c24023060 con 0x7f4c2806fad0 2024-05-14T01:24:15.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.473+0000 7f4c2f7fe640 1 -- 172.21.15.154:0/263703957 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c080052a0 con 0x7f4c2806fad0 2024-05-14T01:24:15.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.477+0000 7f4c1dffb640 1 -- 172.21.15.154:0/263703957 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4c2401c070 con 0x7f4c2806fad0 2024-05-14T01:24:15.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.477+0000 7f4c1dffb640 1 --2- 172.21.15.154:0/263703957 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4c0c0678c0 0x7f4c0c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:15.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.477+0000 7f4c1dffb640 1 -- 172.21.15.154:0/263703957 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f4c240863d0 con 0x7f4c2806fad0 2024-05-14T01:24:15.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.477+0000 7f4c2cd99640 1 --2- 172.21.15.154:0/263703957 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4c0c0678c0 0x7f4c0c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:15.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.477+0000 7f4c2cd99640 1 --2- 172.21.15.154:0/263703957 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4c0c0678c0 0x7f4c0c069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4c180b2000 tx=0x7f4c180aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:15.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.489+0000 7f4c1dffb640 1 -- 172.21.15.154:0/263703957 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f4c240568c0 con 0x7f4c2806fad0 2024-05-14T01:24:15.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.649+0000 7f4c2f7fe640 1 -- 172.21.15.154:0/263703957 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4c08005860 con 0x7f4c2806fad0 2024-05-14T01:24:15.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.653+0000 7f4c1dffb640 1 -- 172.21.15.154:0/263703957 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f4c2405abc0 con 0x7f4c2806fad0 2024-05-14T01:24:15.638 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:24:15.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.653+0000 7f4c2f7fe640 1 -- 172.21.15.154:0/263703957 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4c0c0678c0 msgr2=0x7f4c0c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:15.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.653+0000 7f4c2f7fe640 1 --2- 172.21.15.154:0/263703957 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4c0c0678c0 0x7f4c0c069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4c180b2000 tx=0x7f4c180aa070 comp rx=0 tx=0).stop 2024-05-14T01:24:15.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.653+0000 7f4c2f7fe640 1 -- 172.21.15.154:0/263703957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c2806fad0 msgr2=0x7f4c2815d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:15.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.653+0000 7f4c2f7fe640 1 --2- 172.21.15.154:0/263703957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c2806fad0 0x7f4c2815d3c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400bd70 tx=0x7f4c2400be60 comp rx=0 tx=0).stop 2024-05-14T01:24:15.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.653+0000 7f4c2f7fe640 1 -- 172.21.15.154:0/263703957 shutdown_connections 2024-05-14T01:24:15.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.653+0000 7f4c2f7fe640 1 --2- 172.21.15.154:0/263703957 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4c0c0678c0 0x7f4c0c069d80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.653+0000 7f4c2f7fe640 1 --2- 172.21.15.154:0/263703957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c280b0250 0x7f4c280b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.653+0000 7f4c2f7fe640 1 --2- 172.21.15.154:0/263703957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c28074280 0x7f4c280b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.653+0000 7f4c2f7fe640 1 --2- 172.21.15.154:0/263703957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c2806fad0 0x7f4c2815d3c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.653+0000 7f4c2f7fe640 1 -- 172.21.15.154:0/263703957 >> 172.21.15.154:0/263703957 conn(0x7f4c280cd6f0 msgr2=0x7f4c280cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:15.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.653+0000 7f4c2f7fe640 1 -- 172.21.15.154:0/263703957 shutdown_connections 2024-05-14T01:24:15.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.653+0000 7f4c2f7fe640 1 -- 172.21.15.154:0/263703957 wait complete. 2024-05-14T01:24:15.657 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T01:24:15.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.789+0000 7fd3e1b19640 1 Processor -- start 2024-05-14T01:24:15.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.789+0000 7fd3e1b19640 1 -- start start 2024-05-14T01:24:15.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.789+0000 7fd3e1b19640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd3dc06c290 0x7fd3dc06c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:15.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.789+0000 7fd3e1b19640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3dc15c680 0x7fd3dc15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:15.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.789+0000 7fd3e1b19640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3dc06cbb0 con 0x7fd3dc0cb370 2024-05-14T01:24:15.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.789+0000 7fd3e1b19640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd3dc160540 con 0x7fd3dc06c290 2024-05-14T01:24:15.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.789+0000 7fd3e1b19640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd3dc15d440 con 0x7fd3dc15c680 2024-05-14T01:24:15.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.789+0000 7fd3daffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3dc15c680 0x7fd3dc15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:15.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.789+0000 7fd3dbfff640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fd3dc0cb370 0x7fd3dc0cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:44078/0 (socket says 172.21.15.154:44078) 2024-05-14T01:24:15.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.789+0000 7fd3db7fe640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd3dc06c290 0x7fd3dc06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:15.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.789+0000 7fd3dbfff640 1 -- 172.21.15.154:0/4266117395 learned_addr learned my addr 172.21.15.154:0/4266117395 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:15.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.789+0000 7fd3db7fe640 1 -- 172.21.15.154:0/4266117395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3dc15c680 msgr2=0x7fd3dc15cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:15.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.789+0000 7fd3db7fe640 1 --2- 172.21.15.154:0/4266117395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3dc15c680 0x7fd3dc15cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.789+0000 7fd3db7fe640 1 -- 172.21.15.154:0/4266117395 >> v1:172.21.15.176:6789/0 conn(0x7fd3dc0cb370 legacy=0x7fd3dc0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:15.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.789+0000 7fd3db7fe640 1 -- 172.21.15.154:0/4266117395 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3dc15fc10 con 0x7fd3dc06c290 2024-05-14T01:24:15.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.789+0000 7fd3daffd640 1 --2- 172.21.15.154:0/4266117395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3dc15c680 0x7fd3dc15cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T01:24:15.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.793+0000 7fd3db7fe640 1 --2- 172.21.15.154:0/4266117395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3dc06c290 0x7fd3dc06c670 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40097c0 tx=0x7fd3c401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dad1480e5861b0a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:15.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.793+0000 7fd3da7fc640 1 -- 172.21.15.154:0/4266117395 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c40a7070 con 0x7fd3dc06c290 2024-05-14T01:24:15.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.793+0000 7fd3da7fc640 1 -- 172.21.15.154:0/4266117395 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c40b0070 con 0x7fd3dc06c290 2024-05-14T01:24:15.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.793+0000 7fd3da7fc640 1 -- 172.21.15.154:0/4266117395 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c40ab890 con 0x7fd3dc06c290 2024-05-14T01:24:15.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.793+0000 7fd3e1b19640 1 -- 172.21.15.154:0/4266117395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3dc06c290 msgr2=0x7fd3dc06c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:15.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.793+0000 7fd3e1b19640 1 --2- 172.21.15.154:0/4266117395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3dc06c290 0x7fd3dc06c670 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40097c0 tx=0x7fd3c401c470 comp rx=0 tx=0).stop 2024-05-14T01:24:15.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.793+0000 7fd3e1b19640 1 -- 172.21.15.154:0/4266117395 shutdown_connections 2024-05-14T01:24:15.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.793+0000 7fd3e1b19640 1 --2- 172.21.15.154:0/4266117395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3dc15c680 0x7fd3dc15cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.793+0000 7fd3e1b19640 1 --2- 172.21.15.154:0/4266117395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3dc06c290 0x7fd3dc06c670 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.793+0000 7fd3e1b19640 1 -- 172.21.15.154:0/4266117395 >> 172.21.15.154:0/4266117395 conn(0x7fd3dc071f70 msgr2=0x7fd3dc072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:15.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.793+0000 7fd3e1b19640 1 -- 172.21.15.154:0/4266117395 shutdown_connections 2024-05-14T01:24:15.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.793+0000 7fd3e1b19640 1 -- 172.21.15.154:0/4266117395 wait complete. 2024-05-14T01:24:15.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.793+0000 7fd3e1b19640 1 Processor -- start 2024-05-14T01:24:15.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.793+0000 7fd3e1b19640 1 -- start start 2024-05-14T01:24:15.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3e1b19640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3dc06c290 0x7fd3dc0b6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:15.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3e1b19640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3dc0cb370 0x7fd3dc151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:15.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3e1b19640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3dc15c680 0x7fd3dc151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3e1b19640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc15d000 con 0x7fd3dc0cb370 2024-05-14T01:24:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3e1b19640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc0c6bf0 con 0x7fd3dc06c290 2024-05-14T01:24:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3e1b19640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd3dc15d180 con 0x7fd3dc15c680 2024-05-14T01:24:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3daffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3dc0cb370 0x7fd3dc151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3daffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3dc0cb370 0x7fd3dc151660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59526/0 (socket says 172.21.15.154:59526) 2024-05-14T01:24:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3daffd640 1 -- 172.21.15.154:0/986022047 learned_addr learned my addr 172.21.15.154:0/986022047 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3db7fe640 1 --2- 172.21.15.154:0/986022047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3dc06c290 0x7fd3dc0b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3daffd640 1 -- 172.21.15.154:0/986022047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3dc15c680 msgr2=0x7fd3dc151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3dbfff640 1 --2- 172.21.15.154:0/986022047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3dc15c680 0x7fd3dc151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3daffd640 1 --2- 172.21.15.154:0/986022047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3dc15c680 0x7fd3dc151ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3daffd640 1 -- 172.21.15.154:0/986022047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3dc06c290 msgr2=0x7fd3dc0b6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3daffd640 1 --2- 172.21.15.154:0/986022047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3dc06c290 0x7fd3dc0b6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3daffd640 1 -- 172.21.15.154:0/986022047 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3dc13dde0 con 0x7fd3dc0cb370 2024-05-14T01:24:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3daffd640 1 --2- 172.21.15.154:0/986022047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3dc0cb370 0x7fd3dc151660 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc00e980 tx=0x7fd3cc00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3d3fff640 1 -- 172.21.15.154:0/986022047 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc017070 con 0x7fd3dc0cb370 2024-05-14T01:24:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3d3fff640 1 -- 172.21.15.154:0/986022047 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3cc00ca00 con 0x7fd3dc0cb370 2024-05-14T01:24:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3e1b19640 1 -- 172.21.15.154:0/986022047 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3dc0b6880 con 0x7fd3dc0cb370 2024-05-14T01:24:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3d3fff640 1 -- 172.21.15.154:0/986022047 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc00cdd0 con 0x7fd3dc0cb370 2024-05-14T01:24:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3e1b19640 1 -- 172.21.15.154:0/986022047 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3dc15d770 con 0x7fd3dc0cb370 2024-05-14T01:24:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3e1b19640 1 -- 172.21.15.154:0/986022047 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3dc068360 con 0x7fd3dc0cb370 2024-05-14T01:24:15.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3d3fff640 1 -- 172.21.15.154:0/986022047 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd3cc01a070 con 0x7fd3dc0cb370 2024-05-14T01:24:15.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3d3fff640 1 --2- 172.21.15.154:0/986022047 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd3bc0678c0 0x7fd3bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:15.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3d3fff640 1 -- 172.21.15.154:0/986022047 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7fd3cc085ba0 con 0x7fd3dc0cb370 2024-05-14T01:24:15.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3db7fe640 1 --2- 172.21.15.154:0/986022047 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd3bc0678c0 0x7fd3bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:15.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.797+0000 7fd3db7fe640 1 --2- 172.21.15.154:0/986022047 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd3bc0678c0 0x7fd3bc069d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40af000 tx=0x7fd3c40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:15.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.801+0000 7fd3d3fff640 1 -- 172.21.15.154:0/986022047 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fd3dc0b6880 con 0x7fd3dc0cb370 2024-05-14T01:24:15.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.961+0000 7fd3e1b19640 1 -- 172.21.15.154:0/986022047 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd3dc1599c0 con 0x7fd3dc0cb370 2024-05-14T01:24:15.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.961+0000 7fd3d3fff640 1 -- 172.21.15.154:0/986022047 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fd3cc055f80 con 0x7fd3dc0cb370 2024-05-14T01:24:15.949 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-05-14T01:24:15.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.965+0000 7fd3e1b19640 1 -- 172.21.15.154:0/986022047 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd3bc0678c0 msgr2=0x7fd3bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:15.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.965+0000 7fd3e1b19640 1 --2- 172.21.15.154:0/986022047 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd3bc0678c0 0x7fd3bc069d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40af000 tx=0x7fd3c40a7000 comp rx=0 tx=0).stop 2024-05-14T01:24:15.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.965+0000 7fd3e1b19640 1 -- 172.21.15.154:0/986022047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3dc0cb370 msgr2=0x7fd3dc151660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:15.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.965+0000 7fd3e1b19640 1 --2- 172.21.15.154:0/986022047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3dc0cb370 0x7fd3dc151660 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc00e980 tx=0x7fd3cc00ee40 comp rx=0 tx=0).stop 2024-05-14T01:24:15.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.965+0000 7fd3e1b19640 1 -- 172.21.15.154:0/986022047 shutdown_connections 2024-05-14T01:24:15.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.965+0000 7fd3e1b19640 1 --2- 172.21.15.154:0/986022047 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd3bc0678c0 0x7fd3bc069d80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.965+0000 7fd3e1b19640 1 --2- 172.21.15.154:0/986022047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3dc15c680 0x7fd3dc151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.965+0000 7fd3e1b19640 1 --2- 172.21.15.154:0/986022047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3dc0cb370 0x7fd3dc151660 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.965+0000 7fd3e1b19640 1 --2- 172.21.15.154:0/986022047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3dc06c290 0x7fd3dc0b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:15.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.965+0000 7fd3e1b19640 1 -- 172.21.15.154:0/986022047 >> 172.21.15.154:0/986022047 conn(0x7fd3dc071f70 msgr2=0x7fd3dc15b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:15.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.965+0000 7fd3e1b19640 1 -- 172.21.15.154:0/986022047 shutdown_connections 2024-05-14T01:24:15.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:15.965+0000 7fd3e1b19640 1 -- 172.21.15.154:0/986022047 wait complete. 2024-05-14T01:24:15.968 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T01:24:16.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.109+0000 7f89a4112640 1 Processor -- start 2024-05-14T01:24:16.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.109+0000 7f89a4112640 1 -- start start 2024-05-14T01:24:16.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.109+0000 7f89a4112640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f899c1458d0 0x7f899c0cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:16.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.109+0000 7f89a4112640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f899c071060 0x7f899c15fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:16.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.109+0000 7f89a4112640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f899c071840 con 0x7f899c15ff80 2024-05-14T01:24:16.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.109+0000 7f89a4112640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f899c06de50 con 0x7f899c071060 2024-05-14T01:24:16.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.109+0000 7f89a4112640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f899c071b20 con 0x7f899c1458d0 2024-05-14T01:24:16.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.109+0000 7f89a16ad640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f899c071060 0x7f899c15fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:16.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.109+0000 7f89a16ad640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f899c071060 0x7f899c15fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59528/0 (socket says 172.21.15.154:59528) 2024-05-14T01:24:16.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.109+0000 7f89a16ad640 1 -- 172.21.15.154:0/1290236395 learned_addr learned my addr 172.21.15.154:0/1290236395 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:16.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.109+0000 7f89a1eae640 1 --2- 172.21.15.154:0/1290236395 >> v2:172.21.15.176:3300/0 conn(0x7f899c1458d0 0x7f899c0cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:16.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.109+0000 7f89a16ad640 1 -- 172.21.15.154:0/1290236395 >> v2:172.21.15.176:3300/0 conn(0x7f899c1458d0 msgr2=0x7f899c0cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:16.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.109+0000 7f89a16ad640 1 --2- 172.21.15.154:0/1290236395 >> v2:172.21.15.176:3300/0 conn(0x7f899c1458d0 0x7f899c0cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.109+0000 7f89a16ad640 1 -- 172.21.15.154:0/1290236395 >> v1:172.21.15.176:6789/0 conn(0x7f899c15ff80 legacy=0x7f899c0ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:16.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.109+0000 7f89a16ad640 1 -- 172.21.15.154:0/1290236395 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c071e00 con 0x7f899c071060 2024-05-14T01:24:16.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.113+0000 7f89a16ad640 1 --2- 172.21.15.154:0/1290236395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f899c071060 0x7f899c15fa40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f899c0d0c30 tx=0x7f898c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f31030458b6f0eb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:16.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.113+0000 7f89a0eac640 1 -- 172.21.15.154:0/1290236395 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c0b0070 con 0x7f899c071060 2024-05-14T01:24:16.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.113+0000 7f89a0eac640 1 -- 172.21.15.154:0/1290236395 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f898c0ab600 con 0x7f899c071060 2024-05-14T01:24:16.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.113+0000 7f89a0eac640 1 -- 172.21.15.154:0/1290236395 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c0ab9d0 con 0x7f899c071060 2024-05-14T01:24:16.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.113+0000 7f89a4112640 1 -- 172.21.15.154:0/1290236395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f899c071060 msgr2=0x7f899c15fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:16.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.113+0000 7f89a4112640 1 --2- 172.21.15.154:0/1290236395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f899c071060 0x7f899c15fa40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f899c0d0c30 tx=0x7f898c01c520 comp rx=0 tx=0).stop 2024-05-14T01:24:16.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.113+0000 7f89a4112640 1 -- 172.21.15.154:0/1290236395 shutdown_connections 2024-05-14T01:24:16.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.113+0000 7f89a4112640 1 --2- 172.21.15.154:0/1290236395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f899c071060 0x7f899c15fa40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.113+0000 7f89a4112640 1 --2- 172.21.15.154:0/1290236395 >> v2:172.21.15.176:3300/0 conn(0x7f899c1458d0 0x7f899c0cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.113+0000 7f89a4112640 1 -- 172.21.15.154:0/1290236395 >> 172.21.15.154:0/1290236395 conn(0x7f899c0b1770 msgr2=0x7f899c0b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:16.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.113+0000 7f89a4112640 1 -- 172.21.15.154:0/1290236395 shutdown_connections 2024-05-14T01:24:16.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.113+0000 7f89a4112640 1 -- 172.21.15.154:0/1290236395 wait complete. 2024-05-14T01:24:16.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.113+0000 7f89a4112640 1 Processor -- start 2024-05-14T01:24:16.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.113+0000 7f89a4112640 1 -- start start 2024-05-14T01:24:16.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a4112640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f899c071060 0x7f899c142100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:16.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a4112640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f899c1458d0 0x7f899c15a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:16.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a4112640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f899c15ff80 0x7f899c155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:16.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a4112640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f899c072a60 con 0x7f899c1458d0 2024-05-14T01:24:16.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a4112640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f899c0728e0 con 0x7f899c15ff80 2024-05-14T01:24:16.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a4112640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f899c168de0 con 0x7f899c071060 2024-05-14T01:24:16.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a16ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f899c1458d0 0x7f899c15a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:16.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a16ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f899c1458d0 0x7f899c15a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59538/0 (socket says 172.21.15.154:59538) 2024-05-14T01:24:16.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a16ad640 1 -- 172.21.15.154:0/1470848478 learned_addr learned my addr 172.21.15.154:0/1470848478 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:16.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a26af640 1 --2- 172.21.15.154:0/1470848478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f899c15ff80 0x7f899c155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:16.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a1eae640 1 --2- 172.21.15.154:0/1470848478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f899c071060 0x7f899c142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:16.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a16ad640 1 -- 172.21.15.154:0/1470848478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f899c071060 msgr2=0x7f899c142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:16.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a16ad640 1 --2- 172.21.15.154:0/1470848478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f899c071060 0x7f899c142100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a16ad640 1 -- 172.21.15.154:0/1470848478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f899c15ff80 msgr2=0x7f899c155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:16.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a16ad640 1 --2- 172.21.15.154:0/1470848478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f899c15ff80 0x7f899c155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a16ad640 1 -- 172.21.15.154:0/1470848478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c153570 con 0x7f899c1458d0 2024-05-14T01:24:16.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a26af640 1 --2- 172.21.15.154:0/1470848478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f899c15ff80 0x7f899c155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:16.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a16ad640 1 --2- 172.21.15.154:0/1470848478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f899c1458d0 0x7f899c15a5f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f898c0ae040 tx=0x7f898c0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:16.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89927fc640 1 -- 172.21.15.154:0/1470848478 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c0b8020 con 0x7f899c1458d0 2024-05-14T01:24:16.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89927fc640 1 -- 172.21.15.154:0/1470848478 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f898c0b4610 con 0x7f899c1458d0 2024-05-14T01:24:16.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a4112640 1 -- 172.21.15.154:0/1470848478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899c153850 con 0x7f899c1458d0 2024-05-14T01:24:16.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89927fc640 1 -- 172.21.15.154:0/1470848478 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c0b0040 con 0x7f899c1458d0 2024-05-14T01:24:16.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a4112640 1 -- 172.21.15.154:0/1470848478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f899c153e10 con 0x7f899c1458d0 2024-05-14T01:24:16.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a4112640 1 -- 172.21.15.154:0/1470848478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f899c075470 con 0x7f899c1458d0 2024-05-14T01:24:16.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89927fc640 1 -- 172.21.15.154:0/1470848478 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f898c0bb020 con 0x7f899c1458d0 2024-05-14T01:24:16.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89927fc640 1 --2- 172.21.15.154:0/1470848478 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f89800678c0 0x7f8980069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:16.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89927fc640 1 -- 172.21.15.154:0/1470848478 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f898c11f870 con 0x7f899c1458d0 2024-05-14T01:24:16.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a1eae640 1 --2- 172.21.15.154:0/1470848478 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f89800678c0 0x7f8980069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:16.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.117+0000 7f89a1eae640 1 --2- 172.21.15.154:0/1470848478 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f89800678c0 0x7f8980069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8998009790 tx=0x7f8998008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.121+0000 7f89927fc640 1 -- 172.21.15.154:0/1470848478 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f898c0c2030 con 0x7f899c1458d0 2024-05-14T01:24:16.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.277+0000 7f89a4112640 1 -- 172.21.15.154:0/1470848478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f899c1599c0 con 0x7f899c1458d0 2024-05-14T01:24:16.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.281+0000 7f89927fc640 1 -- 172.21.15.154:0/1470848478 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f898c016110 con 0x7f899c1458d0 2024-05-14T01:24:16.266 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-05-14T01:24:16.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.281+0000 7f89a4112640 1 -- 172.21.15.154:0/1470848478 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f89800678c0 msgr2=0x7f8980069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:16.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.281+0000 7f89a4112640 1 --2- 172.21.15.154:0/1470848478 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f89800678c0 0x7f8980069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8998009790 tx=0x7f8998008040 comp rx=0 tx=0).stop 2024-05-14T01:24:16.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.281+0000 7f89a4112640 1 -- 172.21.15.154:0/1470848478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f899c1458d0 msgr2=0x7f899c15a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:16.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.281+0000 7f89a4112640 1 --2- 172.21.15.154:0/1470848478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f899c1458d0 0x7f899c15a5f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f898c0ae040 tx=0x7f898c0192c0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.281+0000 7f89a4112640 1 -- 172.21.15.154:0/1470848478 shutdown_connections 2024-05-14T01:24:16.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.281+0000 7f89a4112640 1 --2- 172.21.15.154:0/1470848478 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f89800678c0 0x7f8980069d80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.281+0000 7f89a4112640 1 --2- 172.21.15.154:0/1470848478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f899c15ff80 0x7f899c155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.281+0000 7f89a4112640 1 --2- 172.21.15.154:0/1470848478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f899c1458d0 0x7f899c15a5f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.281+0000 7f89a4112640 1 --2- 172.21.15.154:0/1470848478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f899c071060 0x7f899c142100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.281+0000 7f89a4112640 1 -- 172.21.15.154:0/1470848478 >> 172.21.15.154:0/1470848478 conn(0x7f899c0b1770 msgr2=0x7f899c15bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:16.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.281+0000 7f89a4112640 1 -- 172.21.15.154:0/1470848478 shutdown_connections 2024-05-14T01:24:16.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.281+0000 7f89a4112640 1 -- 172.21.15.154:0/1470848478 wait complete. 2024-05-14T01:24:16.284 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T01:24:16.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.421+0000 7fb03bcd5640 1 Processor -- start 2024-05-14T01:24:16.407 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.421+0000 7fb03bcd5640 1 -- start start 2024-05-14T01:24:16.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.421+0000 7fb03bcd5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb03413ede0 0x7fb0341415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:16.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.421+0000 7fb03bcd5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb034141b30 0x7fb0340ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:16.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.421+0000 7fb03bcd5640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0340cf100 con 0x7fb0340ce880 2024-05-14T01:24:16.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.421+0000 7fb03bcd5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb034141f90 con 0x7fb034141b30 2024-05-14T01:24:16.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.421+0000 7fb03bcd5640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb03406cff0 con 0x7fb03413ede0 2024-05-14T01:24:16.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.421+0000 7fb039270640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb034141b30 0x7fb0340ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:16.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.421+0000 7fb039270640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb034141b30 0x7fb0340ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59550/0 (socket says 172.21.15.154:59550) 2024-05-14T01:24:16.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.421+0000 7fb039270640 1 -- 172.21.15.154:0/3545602708 learned_addr learned my addr 172.21.15.154:0/3545602708 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:16.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.421+0000 7fb039a71640 1 --2- 172.21.15.154:0/3545602708 >> v2:172.21.15.176:3300/0 conn(0x7fb03413ede0 0x7fb0341415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:16.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.421+0000 7fb039270640 1 -- 172.21.15.154:0/3545602708 >> v2:172.21.15.176:3300/0 conn(0x7fb03413ede0 msgr2=0x7fb0341415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:16.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.421+0000 7fb039270640 1 --2- 172.21.15.154:0/3545602708 >> v2:172.21.15.176:3300/0 conn(0x7fb03413ede0 0x7fb0341415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.421+0000 7fb039270640 1 -- 172.21.15.154:0/3545602708 >> v1:172.21.15.176:6789/0 conn(0x7fb0340ce880 legacy=0x7fb03415fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:16.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.421+0000 7fb039270640 1 -- 172.21.15.154:0/3545602708 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0340cf3e0 con 0x7fb034141b30 2024-05-14T01:24:16.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.425+0000 7fb039270640 1 --2- 172.21.15.154:0/3545602708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb034141b30 0x7fb0340ce340 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb028009870 tx=0x7fb02801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c777bf286f72584d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:16.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.425+0000 7fb038a6f640 1 -- 172.21.15.154:0/3545602708 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0280aa5f0 con 0x7fb034141b30 2024-05-14T01:24:16.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.425+0000 7fb038a6f640 1 -- 172.21.15.154:0/3545602708 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0280af070 con 0x7fb034141b30 2024-05-14T01:24:16.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.425+0000 7fb038a6f640 1 -- 172.21.15.154:0/3545602708 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0280aa9b0 con 0x7fb034141b30 2024-05-14T01:24:16.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.425+0000 7fb03bcd5640 1 -- 172.21.15.154:0/3545602708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb034141b30 msgr2=0x7fb0340ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:16.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.425+0000 7fb03bcd5640 1 --2- 172.21.15.154:0/3545602708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb034141b30 0x7fb0340ce340 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb028009870 tx=0x7fb02801c4b0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.425+0000 7fb03bcd5640 1 -- 172.21.15.154:0/3545602708 shutdown_connections 2024-05-14T01:24:16.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.425+0000 7fb03bcd5640 1 --2- 172.21.15.154:0/3545602708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb034141b30 0x7fb0340ce340 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.425+0000 7fb03bcd5640 1 --2- 172.21.15.154:0/3545602708 >> v2:172.21.15.176:3300/0 conn(0x7fb03413ede0 0x7fb0341415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.425+0000 7fb03bcd5640 1 -- 172.21.15.154:0/3545602708 >> 172.21.15.154:0/3545602708 conn(0x7fb0340b1850 msgr2=0x7fb0340b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:16.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.425+0000 7fb03bcd5640 1 -- 172.21.15.154:0/3545602708 shutdown_connections 2024-05-14T01:24:16.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.425+0000 7fb03bcd5640 1 -- 172.21.15.154:0/3545602708 wait complete. 2024-05-14T01:24:16.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.425+0000 7fb03bcd5640 1 Processor -- start 2024-05-14T01:24:16.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb03bcd5640 1 -- start start 2024-05-14T01:24:16.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb03bcd5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0340ce880 0x7fb034137800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:16.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb03bcd5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb03413ede0 0x7fb0340b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:16.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb03bcd5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb034141b30 0x7fb034072510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:16.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb03bcd5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb0340cee90 con 0x7fb0340ce880 2024-05-14T01:24:16.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb03bcd5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb0340ced10 con 0x7fb03413ede0 2024-05-14T01:24:16.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb03bcd5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb034168da0 con 0x7fb034141b30 2024-05-14T01:24:16.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb039a71640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0340ce880 0x7fb034137800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:16.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb039a71640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0340ce880 0x7fb034137800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59566/0 (socket says 172.21.15.154:59566) 2024-05-14T01:24:16.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb039a71640 1 -- 172.21.15.154:0/2239206263 learned_addr learned my addr 172.21.15.154:0/2239206263 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:16.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb039270640 1 --2- 172.21.15.154:0/2239206263 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb03413ede0 0x7fb0340b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:16.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb039a71640 1 -- 172.21.15.154:0/2239206263 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb034141b30 msgr2=0x7fb034072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:16.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb03a272640 1 --2- 172.21.15.154:0/2239206263 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb034141b30 0x7fb034072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:16.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb039a71640 1 --2- 172.21.15.154:0/2239206263 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb034141b30 0x7fb034072510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb039a71640 1 -- 172.21.15.154:0/2239206263 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb03413ede0 msgr2=0x7fb0340b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:16.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb039a71640 1 --2- 172.21.15.154:0/2239206263 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb03413ede0 0x7fb0340b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb039a71640 1 -- 172.21.15.154:0/2239206263 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb03413d610 con 0x7fb0340ce880 2024-05-14T01:24:16.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb039270640 1 --2- 172.21.15.154:0/2239206263 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb03413ede0 0x7fb0340b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:16.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb039a71640 1 --2- 172.21.15.154:0/2239206263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0340ce880 0x7fb034137800 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00ce40 tx=0x7fb02c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:16.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb0327fc640 1 -- 172.21.15.154:0/2239206263 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c003ba0 con 0x7fb0340ce880 2024-05-14T01:24:16.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb0327fc640 1 -- 172.21.15.154:0/2239206263 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb02c003d40 con 0x7fb0340ce880 2024-05-14T01:24:16.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb03bcd5640 1 -- 172.21.15.154:0/2239206263 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb03413d8b0 con 0x7fb0340ce880 2024-05-14T01:24:16.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb0327fc640 1 -- 172.21.15.154:0/2239206263 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c004240 con 0x7fb0340ce880 2024-05-14T01:24:16.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb03bcd5640 1 -- 172.21.15.154:0/2239206263 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb03413de70 con 0x7fb0340ce880 2024-05-14T01:24:16.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb03bcd5640 1 -- 172.21.15.154:0/2239206263 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb034075470 con 0x7fb0340ce880 2024-05-14T01:24:16.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb0327fc640 1 -- 172.21.15.154:0/2239206263 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb02c0043e0 con 0x7fb0340ce880 2024-05-14T01:24:16.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb0327fc640 1 --2- 172.21.15.154:0/2239206263 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb0200678c0 0x7fb020069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:16.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb0327fc640 1 -- 172.21.15.154:0/2239206263 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7fb02c0867c0 con 0x7fb0340ce880 2024-05-14T01:24:16.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.429+0000 7fb039270640 1 --2- 172.21.15.154:0/2239206263 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb0200678c0 0x7fb020069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:16.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.433+0000 7fb039270640 1 --2- 172.21.15.154:0/2239206263 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb0200678c0 0x7fb020069d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb0280ae000 tx=0x7fb028008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:16.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.433+0000 7fb0327fc640 1 -- 172.21.15.154:0/2239206263 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb02c057300 con 0x7fb0340ce880 2024-05-14T01:24:16.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.601+0000 7fb03bcd5640 1 -- 172.21.15.154:0/2239206263 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb0340af560 con 0x7fb0340ce880 2024-05-14T01:24:16.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.601+0000 7fb0327fc640 1 -- 172.21.15.154:0/2239206263 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fb02c014e10 con 0x7fb0340ce880 2024-05-14T01:24:16.589 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-05-14T01:24:16.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.605+0000 7fb03bcd5640 1 -- 172.21.15.154:0/2239206263 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb0200678c0 msgr2=0x7fb020069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:16.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.605+0000 7fb03bcd5640 1 --2- 172.21.15.154:0/2239206263 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb0200678c0 0x7fb020069d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb0280ae000 tx=0x7fb028008040 comp rx=0 tx=0).stop 2024-05-14T01:24:16.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.605+0000 7fb03bcd5640 1 -- 172.21.15.154:0/2239206263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0340ce880 msgr2=0x7fb034137800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:16.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.605+0000 7fb03bcd5640 1 --2- 172.21.15.154:0/2239206263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0340ce880 0x7fb034137800 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00ce40 tx=0x7fb02c00a660 comp rx=0 tx=0).stop 2024-05-14T01:24:16.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.605+0000 7fb03bcd5640 1 -- 172.21.15.154:0/2239206263 shutdown_connections 2024-05-14T01:24:16.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.605+0000 7fb03bcd5640 1 --2- 172.21.15.154:0/2239206263 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb0200678c0 0x7fb020069d80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.605+0000 7fb03bcd5640 1 --2- 172.21.15.154:0/2239206263 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb034141b30 0x7fb034072510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.605+0000 7fb03bcd5640 1 --2- 172.21.15.154:0/2239206263 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb03413ede0 0x7fb0340b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.605+0000 7fb03bcd5640 1 --2- 172.21.15.154:0/2239206263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0340ce880 0x7fb034137800 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.605+0000 7fb03bcd5640 1 -- 172.21.15.154:0/2239206263 >> 172.21.15.154:0/2239206263 conn(0x7fb0340b1850 msgr2=0x7fb03415a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:16.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.605+0000 7fb03bcd5640 1 -- 172.21.15.154:0/2239206263 shutdown_connections 2024-05-14T01:24:16.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.605+0000 7fb03bcd5640 1 -- 172.21.15.154:0/2239206263 wait complete. 2024-05-14T01:24:16.606 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi154.front.sepia.ceph.com... 2024-05-14T01:24:16.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:16.607 DEBUG:teuthology.orchestra.run.smithi154:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-05-14T01:24:16.618 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T01:24:16.619 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-05-14T01:24:16.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:16.619 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-14T01:24:16.666 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:24:16.666 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T01:24:16.673 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:24:16.673 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T01:24:16.722 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:16.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.853+0000 7f1684e6d640 1 Processor -- start 2024-05-14T01:24:16.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.853+0000 7f1684e6d640 1 -- start start 2024-05-14T01:24:16.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.853+0000 7f1684e6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f168015e460 0x7f168006b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:16.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.853+0000 7f1684e6d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f16800ce940 0x7f16800cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:16.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.853+0000 7f1684e6d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f168015e840 con 0x7f1680161f50 2024-05-14T01:24:16.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.853+0000 7f1684e6d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f16800d3690 con 0x7f168015e460 2024-05-14T01:24:16.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.853+0000 7f1684e6d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f16801624a0 con 0x7f16800ce940 2024-05-14T01:24:16.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.853+0000 7f167e59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f168015e460 0x7f168006b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:16.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.853+0000 7f167e59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f168015e460 0x7f168006b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59582/0 (socket says 172.21.15.154:59582) 2024-05-14T01:24:16.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.853+0000 7f167e59c640 1 -- 172.21.15.154:0/853128959 learned_addr learned my addr 172.21.15.154:0/853128959 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:16.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.853+0000 7f167e59c640 1 -- 172.21.15.154:0/853128959 >> v2:172.21.15.176:3300/0 conn(0x7f16800ce940 msgr2=0x7f16800cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:16.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.853+0000 7f167e59c640 1 --2- 172.21.15.154:0/853128959 >> v2:172.21.15.176:3300/0 conn(0x7f16800ce940 0x7f16800cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.853+0000 7f167e59c640 1 -- 172.21.15.154:0/853128959 >> v1:172.21.15.176:6789/0 conn(0x7f1680161f50 legacy=0x7f168006b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:16.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.853+0000 7f167e59c640 1 -- 172.21.15.154:0/853128959 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1680162780 con 0x7f168015e460 2024-05-14T01:24:16.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.853+0000 7f167e59c640 1 --2- 172.21.15.154:0/853128959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f168015e460 0x7f168006b280 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1670009870 tx=0x7f167001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f5d933e73a3376 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:16.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f167dd9b640 1 -- 172.21.15.154:0/853128959 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16700b1070 con 0x7f168015e460 2024-05-14T01:24:16.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f167dd9b640 1 -- 172.21.15.154:0/853128959 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16700ac600 con 0x7f168015e460 2024-05-14T01:24:16.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f167dd9b640 1 -- 172.21.15.154:0/853128959 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16700ac9d0 con 0x7f168015e460 2024-05-14T01:24:16.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1684e6d640 1 -- 172.21.15.154:0/853128959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f168015e460 msgr2=0x7f168006b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:16.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1684e6d640 1 --2- 172.21.15.154:0/853128959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f168015e460 0x7f168006b280 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1670009870 tx=0x7f167001c4b0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1684e6d640 1 -- 172.21.15.154:0/853128959 shutdown_connections 2024-05-14T01:24:16.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1684e6d640 1 --2- 172.21.15.154:0/853128959 >> v2:172.21.15.176:3300/0 conn(0x7f16800ce940 0x7f16800cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1684e6d640 1 --2- 172.21.15.154:0/853128959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f168015e460 0x7f168006b280 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1684e6d640 1 -- 172.21.15.154:0/853128959 >> 172.21.15.154:0/853128959 conn(0x7f1680071ea0 msgr2=0x7f16800d3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:16.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1684e6d640 1 -- 172.21.15.154:0/853128959 shutdown_connections 2024-05-14T01:24:16.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1684e6d640 1 -- 172.21.15.154:0/853128959 wait complete. 2024-05-14T01:24:16.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1684e6d640 1 Processor -- start 2024-05-14T01:24:16.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1684e6d640 1 -- start start 2024-05-14T01:24:16.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1684e6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16800ce940 0x7f1680149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:16.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1684e6d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f168015e460 0x7f168014fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1684e6d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1680161f50 0x7f16800b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1684e6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16800b7550 con 0x7f16800ce940 2024-05-14T01:24:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1684e6d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f16800b73d0 con 0x7f1680161f50 2024-05-14T01:24:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1684e6d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f168006bed0 con 0x7f168015e460 2024-05-14T01:24:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f167e59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16800ce940 0x7f1680149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f167e59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16800ce940 0x7f1680149f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59596/0 (socket says 172.21.15.154:59596) 2024-05-14T01:24:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f167e59c640 1 -- 172.21.15.154:0/1299288731 learned_addr learned my addr 172.21.15.154:0/1299288731 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f167e59c640 1 -- 172.21.15.154:0/1299288731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f168015e460 msgr2=0x7f168014fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f167e59c640 1 --2- 172.21.15.154:0/1299288731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f168015e460 0x7f168014fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f167e59c640 1 -- 172.21.15.154:0/1299288731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1680161f50 msgr2=0x7f16800b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f167e59c640 1 --2- 172.21.15.154:0/1299288731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1680161f50 0x7f16800b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f167e59c640 1 -- 172.21.15.154:0/1299288731 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168015fe30 con 0x7f16800ce940 2024-05-14T01:24:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f167e59c640 1 --2- 172.21.15.154:0/1299288731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16800ce940 0x7f1680149f60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f167001ab60 tx=0x7f167001acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1676ffd640 1 -- 172.21.15.154:0/1299288731 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16700bb020 con 0x7f16800ce940 2024-05-14T01:24:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1676ffd640 1 -- 172.21.15.154:0/1299288731 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16700b7640 con 0x7f16800ce940 2024-05-14T01:24:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.857+0000 7f1676ffd640 1 -- 172.21.15.154:0/1299288731 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16700b1040 con 0x7f16800ce940 2024-05-14T01:24:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.861+0000 7f1684e6d640 1 -- 172.21.15.154:0/1299288731 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16801600b0 con 0x7f16800ce940 2024-05-14T01:24:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.861+0000 7f1684e6d640 1 -- 172.21.15.154:0/1299288731 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1680160670 con 0x7f16800ce940 2024-05-14T01:24:16.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.861+0000 7f1684e6d640 1 -- 172.21.15.154:0/1299288731 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1680068360 con 0x7f16800ce940 2024-05-14T01:24:16.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.861+0000 7f1676ffd640 1 -- 172.21.15.154:0/1299288731 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f16700be020 con 0x7f16800ce940 2024-05-14T01:24:16.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.861+0000 7f1676ffd640 1 --2- 172.21.15.154:0/1299288731 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16600678f0 0x7f1660069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:16.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.861+0000 7f1676ffd640 1 -- 172.21.15.154:0/1299288731 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f167011fb80 con 0x7f16800ce940 2024-05-14T01:24:16.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.861+0000 7f1677fff640 1 --2- 172.21.15.154:0/1299288731 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16600678f0 0x7f1660069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:16.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.861+0000 7f1677fff640 1 --2- 172.21.15.154:0/1299288731 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16600678f0 0x7f1660069db0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f16801fad20 tx=0x7f1668006bb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:16.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:16.865+0000 7f1676ffd640 1 -- 172.21.15.154:0/1299288731 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f168015fe30 con 0x7f16800ce940 2024-05-14T01:24:17.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.017+0000 7f1684e6d640 1 -- 172.21.15.154:0/1299288731 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16800d3ff0 con 0x7f16800ce940 2024-05-14T01:24:17.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.021+0000 7f1676ffd640 1 -- 172.21.15.154:0/1299288731 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16950 (secure 0 0 0) 0x7f16700160d0 con 0x7f16800ce940 2024-05-14T01:24:17.006 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:17.006 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":23,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:24:16.454751+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:17.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.021+0000 7f1684e6d640 1 -- 172.21.15.154:0/1299288731 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16600678f0 msgr2=0x7f1660069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.021+0000 7f1684e6d640 1 --2- 172.21.15.154:0/1299288731 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16600678f0 0x7f1660069db0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f16801fad20 tx=0x7f1668006bb0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.021+0000 7f1684e6d640 1 -- 172.21.15.154:0/1299288731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16800ce940 msgr2=0x7f1680149f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.021+0000 7f1684e6d640 1 --2- 172.21.15.154:0/1299288731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16800ce940 0x7f1680149f60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f167001ab60 tx=0x7f167001acf0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.021+0000 7f1684e6d640 1 -- 172.21.15.154:0/1299288731 shutdown_connections 2024-05-14T01:24:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.021+0000 7f1684e6d640 1 --2- 172.21.15.154:0/1299288731 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16600678f0 0x7f1660069db0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.021+0000 7f1684e6d640 1 --2- 172.21.15.154:0/1299288731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1680161f50 0x7f16800b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.021+0000 7f1684e6d640 1 --2- 172.21.15.154:0/1299288731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f168015e460 0x7f168014fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.021+0000 7f1684e6d640 1 --2- 172.21.15.154:0/1299288731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16800ce940 0x7f1680149f60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.021+0000 7f1684e6d640 1 -- 172.21.15.154:0/1299288731 >> 172.21.15.154:0/1299288731 conn(0x7f1680071ea0 msgr2=0x7f16800d4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.021+0000 7f1684e6d640 1 -- 172.21.15.154:0/1299288731 shutdown_connections 2024-05-14T01:24:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.021+0000 7f1684e6d640 1 -- 172.21.15.154:0/1299288731 wait complete. 2024-05-14T01:24:17.024 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T01:23:33.083538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T01:23:33.556058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:24:17.024 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:24:17.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.157+0000 7fdbf3e82640 1 Processor -- start 2024-05-14T01:24:17.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.157+0000 7fdbf3e82640 1 -- start start 2024-05-14T01:24:17.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf3e82640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdbec0ced50 0x7fdbec0cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf3e82640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdbec0cd160 0x7fdbec0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf3e82640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbec0cdcb0 con 0x7fdbec071ef0 2024-05-14T01:24:17.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf3e82640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fdbec0ce8c0 con 0x7fdbec0ced50 2024-05-14T01:24:17.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf3e82640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdbec0cdf90 con 0x7fdbec0cd160 2024-05-14T01:24:17.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf1c1e640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fdbec071ef0 0x7fdbec0722d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54592/0 (socket says 172.21.15.154:54592) 2024-05-14T01:24:17.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf1c1e640 1 -- 172.21.15.154:0/466189920 learned_addr learned my addr 172.21.15.154:0/466189920 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:17.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf141d640 1 --2- 172.21.15.154:0/466189920 >> v2:172.21.15.154:3300/0 conn(0x7fdbec0ced50 0x7fdbec0cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:17.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf241f640 1 --2- 172.21.15.154:0/466189920 >> v2:172.21.15.176:3300/0 conn(0x7fdbec0cd160 0x7fdbec0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:17.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf0c1c640 1 -- 172.21.15.154:0/466189920 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2642259530 0 0) 0x7fdbec0cdcb0 con 0x7fdbec071ef0 2024-05-14T01:24:17.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf0c1c640 1 -- 172.21.15.154:0/466189920 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbd8003530 con 0x7fdbec071ef0 2024-05-14T01:24:17.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf141d640 1 -- 172.21.15.154:0/466189920 >> v2:172.21.15.176:3300/0 conn(0x7fdbec0cd160 msgr2=0x7fdbec0cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:17.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf141d640 1 --2- 172.21.15.154:0/466189920 >> v2:172.21.15.176:3300/0 conn(0x7fdbec0cd160 0x7fdbec0cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf141d640 1 -- 172.21.15.154:0/466189920 >> v1:172.21.15.154:6789/0 conn(0x7fdbec071ef0 legacy=0x7fdbec0722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf141d640 1 -- 172.21.15.154:0/466189920 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbec0ce270 con 0x7fdbec0ced50 2024-05-14T01:24:17.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf141d640 1 --2- 172.21.15.154:0/466189920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbec0ced50 0x7fdbec0cf1b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0732c0 tx=0x7fdbdc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602ca082a30c621 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:17.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf0c1c640 1 -- 172.21.15.154:0/466189920 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc0ab430 con 0x7fdbec0ced50 2024-05-14T01:24:17.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf0c1c640 1 -- 172.21.15.154:0/466189920 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbdc0b0070 con 0x7fdbec0ced50 2024-05-14T01:24:17.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.161+0000 7fdbf0c1c640 1 -- 172.21.15.154:0/466189920 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc0ab7f0 con 0x7fdbec0ced50 2024-05-14T01:24:17.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 -- 172.21.15.154:0/466189920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbec0ced50 msgr2=0x7fdbec0cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 --2- 172.21.15.154:0/466189920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbec0ced50 0x7fdbec0cf1b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0732c0 tx=0x7fdbdc01c450 comp rx=0 tx=0).stop 2024-05-14T01:24:17.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 -- 172.21.15.154:0/466189920 shutdown_connections 2024-05-14T01:24:17.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 --2- 172.21.15.154:0/466189920 >> v2:172.21.15.176:3300/0 conn(0x7fdbec0cd160 0x7fdbec0cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 --2- 172.21.15.154:0/466189920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbec0ced50 0x7fdbec0cf1b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 -- 172.21.15.154:0/466189920 >> 172.21.15.154:0/466189920 conn(0x7fdbec0b1770 msgr2=0x7fdbec0b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:17.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 -- 172.21.15.154:0/466189920 shutdown_connections 2024-05-14T01:24:17.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 -- 172.21.15.154:0/466189920 wait complete. 2024-05-14T01:24:17.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 Processor -- start 2024-05-14T01:24:17.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 -- start start 2024-05-14T01:24:17.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbec071ef0 0x7fdbec0b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbec0cd160 0x7fdbec142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbec0ced50 0x7fdbec159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdbec167b40 con 0x7fdbec0cd160 2024-05-14T01:24:17.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdbec1679c0 con 0x7fdbec071ef0 2024-05-14T01:24:17.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdbec167cc0 con 0x7fdbec0ced50 2024-05-14T01:24:17.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf141d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbec0cd160 0x7fdbec142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:17.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf141d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbec0cd160 0x7fdbec142a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59602/0 (socket says 172.21.15.154:59602) 2024-05-14T01:24:17.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf141d640 1 -- 172.21.15.154:0/2565096471 learned_addr learned my addr 172.21.15.154:0/2565096471 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:17.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf1c1e640 1 --2- 172.21.15.154:0/2565096471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbec071ef0 0x7fdbec0b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:17.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf241f640 1 --2- 172.21.15.154:0/2565096471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbec0ced50 0x7fdbec159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:17.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf141d640 1 -- 172.21.15.154:0/2565096471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbec0ced50 msgr2=0x7fdbec159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf141d640 1 --2- 172.21.15.154:0/2565096471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbec0ced50 0x7fdbec159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf141d640 1 -- 172.21.15.154:0/2565096471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbec071ef0 msgr2=0x7fdbec0b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf141d640 1 --2- 172.21.15.154:0/2565096471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbec071ef0 0x7fdbec0b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf141d640 1 -- 172.21.15.154:0/2565096471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbec0b1390 con 0x7fdbec0cd160 2024-05-14T01:24:17.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf141d640 1 --2- 172.21.15.154:0/2565096471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbec0cd160 0x7fdbec142a30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0ad040 tx=0x7fdbdc01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:17.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbe27fc640 1 -- 172.21.15.154:0/2565096471 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc0bf610 con 0x7fdbec0cd160 2024-05-14T01:24:17.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbe27fc640 1 -- 172.21.15.154:0/2565096471 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbdc0bf7d0 con 0x7fdbec0cd160 2024-05-14T01:24:17.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbe27fc640 1 -- 172.21.15.154:0/2565096471 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc0bfbc0 con 0x7fdbec0cd160 2024-05-14T01:24:17.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 -- 172.21.15.154:0/2565096471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbec0c9720 con 0x7fdbec0cd160 2024-05-14T01:24:17.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 -- 172.21.15.154:0/2565096471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbec0c9ce0 con 0x7fdbec0cd160 2024-05-14T01:24:17.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.165+0000 7fdbf3e82640 1 -- 172.21.15.154:0/2565096471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbec075470 con 0x7fdbec0cd160 2024-05-14T01:24:17.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.169+0000 7fdbe27fc640 1 -- 172.21.15.154:0/2565096471 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdbdc0bd020 con 0x7fdbec0cd160 2024-05-14T01:24:17.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.169+0000 7fdbe27fc640 1 --2- 172.21.15.154:0/2565096471 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdbd00678c0 0x7fdbd0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.169+0000 7fdbe27fc640 1 -- 172.21.15.154:0/2565096471 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fdbdc0a8030 con 0x7fdbec0cd160 2024-05-14T01:24:17.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.169+0000 7fdbf1c1e640 1 --2- 172.21.15.154:0/2565096471 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdbd00678c0 0x7fdbd0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:17.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.169+0000 7fdbf1c1e640 1 --2- 172.21.15.154:0/2565096471 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdbd00678c0 0x7fdbd0069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8007fd0 tx=0x7fdbe8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:17.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.173+0000 7fdbe27fc640 1 -- 172.21.15.154:0/2565096471 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fdbdc0c4060 con 0x7fdbec0cd160 2024-05-14T01:24:17.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.329+0000 7fdbf3e82640 1 -- 172.21.15.154:0/2565096471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdbec06d0f0 con 0x7fdbec0cd160 2024-05-14T01:24:17.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.329+0000 7fdbe27fc640 1 -- 172.21.15.154:0/2565096471 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fdbdc016070 con 0x7fdbec0cd160 2024-05-14T01:24:17.316 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:24:17.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.329+0000 7fdbf3e82640 1 -- 172.21.15.154:0/2565096471 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdbd00678c0 msgr2=0x7fdbd0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.329+0000 7fdbf3e82640 1 --2- 172.21.15.154:0/2565096471 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdbd00678c0 0x7fdbd0069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8007fd0 tx=0x7fdbe8009040 comp rx=0 tx=0).stop 2024-05-14T01:24:17.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.329+0000 7fdbf3e82640 1 -- 172.21.15.154:0/2565096471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbec0cd160 msgr2=0x7fdbec142a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.329+0000 7fdbf3e82640 1 --2- 172.21.15.154:0/2565096471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbec0cd160 0x7fdbec142a30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0ad040 tx=0x7fdbdc01ac90 comp rx=0 tx=0).stop 2024-05-14T01:24:17.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.329+0000 7fdbf3e82640 1 -- 172.21.15.154:0/2565096471 shutdown_connections 2024-05-14T01:24:17.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.329+0000 7fdbf3e82640 1 --2- 172.21.15.154:0/2565096471 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdbd00678c0 0x7fdbd0069d80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.329+0000 7fdbf3e82640 1 --2- 172.21.15.154:0/2565096471 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbec0ced50 0x7fdbec159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.329+0000 7fdbf3e82640 1 --2- 172.21.15.154:0/2565096471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbec0cd160 0x7fdbec142a30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.329+0000 7fdbf3e82640 1 --2- 172.21.15.154:0/2565096471 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbec071ef0 0x7fdbec0b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.333+0000 7fdbf3e82640 1 -- 172.21.15.154:0/2565096471 >> 172.21.15.154:0/2565096471 conn(0x7fdbec0b1770 msgr2=0x7fdbec0b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:17.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.333+0000 7fdbf3e82640 1 -- 172.21.15.154:0/2565096471 shutdown_connections 2024-05-14T01:24:17.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.333+0000 7fdbf3e82640 1 -- 172.21.15.154:0/2565096471 wait complete. 2024-05-14T01:24:17.333 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T01:24:17.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.457+0000 7f7793aaa640 1 Processor -- start 2024-05-14T01:24:17.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.461+0000 7f7793aaa640 1 -- start start 2024-05-14T01:24:17.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.461+0000 7f7793aaa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f778c158920 0x7f778c072c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.461+0000 7f7793aaa640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f778c071f80 0x7f778c0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.461+0000 7f7793aaa640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f778c072410 con 0x7f778c161c60 2024-05-14T01:24:17.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.461+0000 7f7793aaa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f778c071af0 con 0x7f778c158920 2024-05-14T01:24:17.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.461+0000 7f7793aaa640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f778c0b3bb0 con 0x7f778c071f80 2024-05-14T01:24:17.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.461+0000 7f7791846640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f778c158920 0x7f778c072c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:17.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.461+0000 7f7791846640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f778c158920 0x7f778c072c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42566/0 (socket says 172.21.15.154:42566) 2024-05-14T01:24:17.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.461+0000 7f7791846640 1 -- 172.21.15.154:0/2429504579 learned_addr learned my addr 172.21.15.154:0/2429504579 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:17.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.461+0000 7f7791846640 1 -- 172.21.15.154:0/2429504579 >> v2:172.21.15.176:3300/0 conn(0x7f778c071f80 msgr2=0x7f778c0b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:17.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.461+0000 7f7791846640 1 --2- 172.21.15.154:0/2429504579 >> v2:172.21.15.176:3300/0 conn(0x7f778c071f80 0x7f778c0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.461+0000 7f7791846640 1 -- 172.21.15.154:0/2429504579 >> v1:172.21.15.176:6789/0 conn(0x7f778c161c60 legacy=0x7f778c0ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:17.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.461+0000 7f7791846640 1 -- 172.21.15.154:0/2429504579 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f778c0711c0 con 0x7f778c158920 2024-05-14T01:24:17.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.461+0000 7f7791846640 1 --2- 172.21.15.154:0/2429504579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f778c158920 0x7f778c072c40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f778c063070 tx=0x7f778801c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c53623a9b82792 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:17.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.465+0000 7f7790844640 1 -- 172.21.15.154:0/2429504579 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77880b0070 con 0x7f778c158920 2024-05-14T01:24:17.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.465+0000 7f7790844640 1 -- 172.21.15.154:0/2429504579 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77880ab600 con 0x7f778c158920 2024-05-14T01:24:17.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.465+0000 7f7790844640 1 -- 172.21.15.154:0/2429504579 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77880ab9d0 con 0x7f778c158920 2024-05-14T01:24:17.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.465+0000 7f7793aaa640 1 -- 172.21.15.154:0/2429504579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f778c158920 msgr2=0x7f778c072c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.465+0000 7f7793aaa640 1 --2- 172.21.15.154:0/2429504579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f778c158920 0x7f778c072c40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f778c063070 tx=0x7f778801c300 comp rx=0 tx=0).stop 2024-05-14T01:24:17.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.465+0000 7f7793aaa640 1 -- 172.21.15.154:0/2429504579 shutdown_connections 2024-05-14T01:24:17.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.465+0000 7f7793aaa640 1 --2- 172.21.15.154:0/2429504579 >> v2:172.21.15.176:3300/0 conn(0x7f778c071f80 0x7f778c0b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.465+0000 7f7793aaa640 1 --2- 172.21.15.154:0/2429504579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f778c158920 0x7f778c072c40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.465+0000 7f7793aaa640 1 -- 172.21.15.154:0/2429504579 >> 172.21.15.154:0/2429504579 conn(0x7f778c0b1770 msgr2=0x7f778c0b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:17.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.465+0000 7f7793aaa640 1 -- 172.21.15.154:0/2429504579 shutdown_connections 2024-05-14T01:24:17.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.465+0000 7f7793aaa640 1 -- 172.21.15.154:0/2429504579 wait complete. 2024-05-14T01:24:17.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7793aaa640 1 Processor -- start 2024-05-14T01:24:17.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7793aaa640 1 -- start start 2024-05-14T01:24:17.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7793aaa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f778c071f80 0x7f778c0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7793aaa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f778c161c60 0x7f778c06e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7793aaa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f778c14b760 0x7f778c152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7793aaa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f778c0ae520 con 0x7f778c071f80 2024-05-14T01:24:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7793aaa640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f778c0ae3a0 con 0x7f778c14b760 2024-05-14T01:24:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7793aaa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f778c16b810 con 0x7f778c161c60 2024-05-14T01:24:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7791846640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f778c071f80 0x7f778c0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7791846640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f778c071f80 0x7f778c0cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42574/0 (socket says 172.21.15.154:42574) 2024-05-14T01:24:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7791846640 1 -- 172.21.15.154:0/2090802159 learned_addr learned my addr 172.21.15.154:0/2090802159 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7792047640 1 --2- 172.21.15.154:0/2090802159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f778c14b760 0x7f778c152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7791846640 1 -- 172.21.15.154:0/2090802159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f778c161c60 msgr2=0x7f778c06e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7791846640 1 --2- 172.21.15.154:0/2090802159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f778c161c60 0x7f778c06e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7791846640 1 -- 172.21.15.154:0/2090802159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f778c14b760 msgr2=0x7f778c152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7791846640 1 --2- 172.21.15.154:0/2090802159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f778c14b760 0x7f778c152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7791846640 1 -- 172.21.15.154:0/2090802159 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f778c06ea50 con 0x7f778c071f80 2024-05-14T01:24:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7792047640 1 --2- 172.21.15.154:0/2090802159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f778c14b760 0x7f778c152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:17.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7791846640 1 --2- 172.21.15.154:0/2090802159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f778c071f80 0x7f778c0cf0c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f77880ae040 tx=0x7f778801ab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f77827fc640 1 -- 172.21.15.154:0/2090802159 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77880b0040 con 0x7f778c071f80 2024-05-14T01:24:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f77827fc640 1 -- 172.21.15.154:0/2090802159 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77880bc070 con 0x7f778c071f80 2024-05-14T01:24:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7793aaa640 1 -- 172.21.15.154:0/2090802159 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f778c06ed30 con 0x7f778c071f80 2024-05-14T01:24:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f77827fc640 1 -- 172.21.15.154:0/2090802159 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77880b6880 con 0x7f778c071f80 2024-05-14T01:24:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.469+0000 7f7793aaa640 1 -- 172.21.15.154:0/2090802159 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f778c1525a0 con 0x7f778c071f80 2024-05-14T01:24:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.473+0000 7f7793aaa640 1 -- 172.21.15.154:0/2090802159 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f778c075470 con 0x7f778c071f80 2024-05-14T01:24:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.473+0000 7f77827fc640 1 -- 172.21.15.154:0/2090802159 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f77880b6a20 con 0x7f778c071f80 2024-05-14T01:24:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.473+0000 7f77827fc640 1 --2- 172.21.15.154:0/2090802159 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f77700678c0 0x7f7770069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.473+0000 7f77827fc640 1 -- 172.21.15.154:0/2090802159 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f7788120100 con 0x7f778c071f80 2024-05-14T01:24:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.473+0000 7f7791045640 1 --2- 172.21.15.154:0/2090802159 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f77700678c0 0x7f7770069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:17.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.473+0000 7f7791045640 1 --2- 172.21.15.154:0/2090802159 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f77700678c0 0x7f7770069d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f777c009730 tx=0x7f777c006ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:17.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.477+0000 7f77827fc640 1 -- 172.21.15.154:0/2090802159 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f778c072410 con 0x7f778c071f80 2024-05-14T01:24:17.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.621+0000 7f7793aaa640 1 -- 172.21.15.154:0/2090802159 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f778c0cf8d0 con 0x7f778c071f80 2024-05-14T01:24:17.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.625+0000 7f77827fc640 1 -- 172.21.15.154:0/2090802159 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f77880f0d60 con 0x7f778c071f80 2024-05-14T01:24:17.610 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-05-14T01:24:17.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.625+0000 7f7793aaa640 1 -- 172.21.15.154:0/2090802159 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f77700678c0 msgr2=0x7f7770069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.625+0000 7f7793aaa640 1 --2- 172.21.15.154:0/2090802159 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f77700678c0 0x7f7770069d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f777c009730 tx=0x7f777c006ca0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.625+0000 7f7793aaa640 1 -- 172.21.15.154:0/2090802159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f778c071f80 msgr2=0x7f778c0cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.625+0000 7f7793aaa640 1 --2- 172.21.15.154:0/2090802159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f778c071f80 0x7f778c0cf0c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f77880ae040 tx=0x7f778801ab40 comp rx=0 tx=0).stop 2024-05-14T01:24:17.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.625+0000 7f7793aaa640 1 -- 172.21.15.154:0/2090802159 shutdown_connections 2024-05-14T01:24:17.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.625+0000 7f7793aaa640 1 --2- 172.21.15.154:0/2090802159 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f77700678c0 0x7f7770069d80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.625+0000 7f7793aaa640 1 --2- 172.21.15.154:0/2090802159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f778c14b760 0x7f778c152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.625+0000 7f7793aaa640 1 --2- 172.21.15.154:0/2090802159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f778c161c60 0x7f778c06e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.625+0000 7f7793aaa640 1 --2- 172.21.15.154:0/2090802159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f778c071f80 0x7f778c0cf0c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.625+0000 7f7793aaa640 1 -- 172.21.15.154:0/2090802159 >> 172.21.15.154:0/2090802159 conn(0x7f778c0b1770 msgr2=0x7f778c0b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:17.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.625+0000 7f7793aaa640 1 -- 172.21.15.154:0/2090802159 shutdown_connections 2024-05-14T01:24:17.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.625+0000 7f7793aaa640 1 -- 172.21.15.154:0/2090802159 wait complete. 2024-05-14T01:24:17.628 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T01:24:17.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e9e126640 1 Processor -- start 2024-05-14T01:24:17.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e9e126640 1 -- start start 2024-05-14T01:24:17.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e9e126640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6e98071ef0 0x7f6e980722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e9e126640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e980ced50 0x7f6e980cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e9e126640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e98072810 con 0x7f6e980cd160 2024-05-14T01:24:17.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e9e126640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6e980ce8c0 con 0x7f6e98071ef0 2024-05-14T01:24:17.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e9e126640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6e980cdcb0 con 0x7f6e980ced50 2024-05-14T01:24:17.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e97fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6e980cd160 0x7f6e980b2a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37000/0 (socket says 172.21.15.154:37000) 2024-05-14T01:24:17.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e97fff640 1 -- 172.21.15.154:0/3810059626 learned_addr learned my addr 172.21.15.154:0/3810059626 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:17.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e8ffff640 1 --2- 172.21.15.154:0/3810059626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e980ced50 0x7f6e980cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:17.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e96ffd640 1 -- 172.21.15.154:0/3810059626 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 833499107 0 0) 0x7f6e98072810 con 0x7f6e980cd160 2024-05-14T01:24:17.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e96ffd640 1 -- 172.21.15.154:0/3810059626 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e84003530 con 0x7f6e980cd160 2024-05-14T01:24:17.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e977fe640 1 --2- 172.21.15.154:0/3810059626 >> v2:172.21.15.176:3300/0 conn(0x7f6e98071ef0 0x7f6e980722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:17.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e96ffd640 1 -- 172.21.15.154:0/3810059626 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 255603644 0 0) 0x7f6e84003530 con 0x7f6e980cd160 2024-05-14T01:24:17.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e96ffd640 1 -- 172.21.15.154:0/3810059626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e980ced50 msgr2=0x7f6e980cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:17.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e96ffd640 1 --2- 172.21.15.154:0/3810059626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e980ced50 0x7f6e980cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e96ffd640 1 -- 172.21.15.154:0/3810059626 >> v2:172.21.15.176:3300/0 conn(0x7f6e98071ef0 msgr2=0x7f6e980722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:17.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e96ffd640 1 --2- 172.21.15.154:0/3810059626 >> v2:172.21.15.176:3300/0 conn(0x7f6e98071ef0 0x7f6e980722d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e96ffd640 1 -- 172.21.15.154:0/3810059626 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e980cdf90 con 0x7f6e980cd160 2024-05-14T01:24:17.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e96ffd640 1 -- 172.21.15.154:0/3810059626 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f6e90001a00 con 0x7f6e980cd160 2024-05-14T01:24:17.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e96ffd640 1 -- 172.21.15.154:0/3810059626 >> v1:172.21.15.154:6789/0 conn(0x7f6e980cd160 legacy=0x7f6e980b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e96ffd640 1 --2- 172.21.15.154:0/3810059626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e980ced50 0x7f6e840039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e96ffd640 1 --2- 172.21.15.154:0/3810059626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e84003f40 0x7f6e84004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e96ffd640 1 --2- 172.21.15.154:0/3810059626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e84004d50 0x7f6e840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e96ffd640 1 -- 172.21.15.154:0/3810059626 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6e980ce8c0 con 0x7f6e84004d50 2024-05-14T01:24:17.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e96ffd640 1 -- 172.21.15.154:0/3810059626 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6e980cdcb0 con 0x7f6e84003f40 2024-05-14T01:24:17.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e96ffd640 1 -- 172.21.15.154:0/3810059626 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6e8400b9d0 con 0x7f6e980ced50 2024-05-14T01:24:17.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e97fff640 1 --2- 172.21.15.154:0/3810059626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e84004d50 0x7f6e840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:17.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e8ffff640 1 --2- 172.21.15.154:0/3810059626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e84003f40 0x7f6e84004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:17.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e97fff640 1 -- 172.21.15.154:0/3810059626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e980ced50 msgr2=0x7f6e840039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:17.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e97fff640 1 --2- 172.21.15.154:0/3810059626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e980ced50 0x7f6e840039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e97fff640 1 -- 172.21.15.154:0/3810059626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e84003f40 msgr2=0x7f6e84004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:17.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e97fff640 1 --2- 172.21.15.154:0/3810059626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e84003f40 0x7f6e84004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e97fff640 1 -- 172.21.15.154:0/3810059626 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e84003530 con 0x7f6e84004d50 2024-05-14T01:24:17.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.753+0000 7f6e8ffff640 1 --2- 172.21.15.154:0/3810059626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e84003f40 0x7f6e84004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:17.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.757+0000 7f6e97fff640 1 --2- 172.21.15.154:0/3810059626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e84004d50 0x7f6e840051d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6e9000a870 tx=0x7f6e9001d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdfa28a08d1d43aa server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:17.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.757+0000 7f6e96ffd640 1 -- 172.21.15.154:0/3810059626 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9000a4c0 con 0x7f6e84004d50 2024-05-14T01:24:17.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.757+0000 7f6e96ffd640 1 -- 172.21.15.154:0/3810059626 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e900072d0 con 0x7f6e84004d50 2024-05-14T01:24:17.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.757+0000 7f6e96ffd640 1 -- 172.21.15.154:0/3810059626 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e900076c0 con 0x7f6e84004d50 2024-05-14T01:24:17.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.757+0000 7f6e9e126640 1 -- 172.21.15.154:0/3810059626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e84004d50 msgr2=0x7f6e840051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.757+0000 7f6e9e126640 1 --2- 172.21.15.154:0/3810059626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e84004d50 0x7f6e840051d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6e9000a870 tx=0x7f6e9001d340 comp rx=0 tx=0).stop 2024-05-14T01:24:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.757+0000 7f6e97fff640 1 -- 172.21.15.154:0/3810059626 reap_dead start 2024-05-14T01:24:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.757+0000 7f6e9e126640 1 -- 172.21.15.154:0/3810059626 shutdown_connections 2024-05-14T01:24:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.757+0000 7f6e9e126640 1 -- 172.21.15.154:0/3810059626 >> 172.21.15.154:0/3810059626 conn(0x7f6e980b1770 msgr2=0x7f6e980b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.757+0000 7f6e9e126640 1 -- 172.21.15.154:0/3810059626 shutdown_connections 2024-05-14T01:24:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.757+0000 7f6e9e126640 1 -- 172.21.15.154:0/3810059626 wait complete. 2024-05-14T01:24:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.757+0000 7f6e9e126640 1 Processor -- start 2024-05-14T01:24:17.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.757+0000 7f6e9e126640 1 -- start start 2024-05-14T01:24:17.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e9e126640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e84004d50 0x7f6e981f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e9e126640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9813b160 0x7f6e9813baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e9e126640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e980b4070 0x7f6e980b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e9e126640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6e98143f20 con 0x7f6e84004d50 2024-05-14T01:24:17.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e9e126640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6e980ce550 con 0x7f6e980b4070 2024-05-14T01:24:17.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e9e126640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9806e990 con 0x7f6e9813b160 2024-05-14T01:24:17.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e977fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e84004d50 0x7f6e981f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:17.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e977fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e84004d50 0x7f6e981f6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42588/0 (socket says 172.21.15.154:42588) 2024-05-14T01:24:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e977fe640 1 -- 172.21.15.154:0/2617254146 learned_addr learned my addr 172.21.15.154:0/2617254146 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e97fff640 1 --2- 172.21.15.154:0/2617254146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e980b4070 0x7f6e980b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e8ffff640 1 --2- 172.21.15.154:0/2617254146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9813b160 0x7f6e9813baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e977fe640 1 -- 172.21.15.154:0/2617254146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9813b160 msgr2=0x7f6e9813baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e977fe640 1 --2- 172.21.15.154:0/2617254146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9813b160 0x7f6e9813baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e977fe640 1 -- 172.21.15.154:0/2617254146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e980b4070 msgr2=0x7f6e980b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e977fe640 1 --2- 172.21.15.154:0/2617254146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e980b4070 0x7f6e980b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e977fe640 1 -- 172.21.15.154:0/2617254146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9813c320 con 0x7f6e84004d50 2024-05-14T01:24:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e97fff640 1 --2- 172.21.15.154:0/2617254146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e980b4070 0x7f6e980b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e977fe640 1 --2- 172.21.15.154:0/2617254146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e84004d50 0x7f6e981f6bb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800e820 tx=0x7f6e8800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e94ff9640 1 -- 172.21.15.154:0/2617254146 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e88017070 con 0x7f6e84004d50 2024-05-14T01:24:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e94ff9640 1 -- 172.21.15.154:0/2617254146 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e8800c8e0 con 0x7f6e84004d50 2024-05-14T01:24:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e9e126640 1 -- 172.21.15.154:0/2617254146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e9813c600 con 0x7f6e84004d50 2024-05-14T01:24:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e94ff9640 1 -- 172.21.15.154:0/2617254146 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8800ccd0 con 0x7f6e84004d50 2024-05-14T01:24:17.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e9e126640 1 -- 172.21.15.154:0/2617254146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e9813cbc0 con 0x7f6e84004d50 2024-05-14T01:24:17.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e9e126640 1 -- 172.21.15.154:0/2617254146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e98075470 con 0x7f6e84004d50 2024-05-14T01:24:17.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e94ff9640 1 -- 172.21.15.154:0/2617254146 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6e8801a070 con 0x7f6e84004d50 2024-05-14T01:24:17.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e94ff9640 1 --2- 172.21.15.154:0/2617254146 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6e78067860 0x7f6e78069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:17.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e94ff9640 1 -- 172.21.15.154:0/2617254146 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f6e88085f30 con 0x7f6e84004d50 2024-05-14T01:24:17.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e8ffff640 1 --2- 172.21.15.154:0/2617254146 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6e78067860 0x7f6e78069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:17.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.761+0000 7f6e8ffff640 1 --2- 172.21.15.154:0/2617254146 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6e78067860 0x7f6e78069d20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6e980cbb20 tx=0x7f6e80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:17.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.765+0000 7f6e94ff9640 1 -- 172.21.15.154:0/2617254146 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f6e880569e0 con 0x7f6e84004d50 2024-05-14T01:24:17.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.913+0000 7f6e9e126640 1 -- 172.21.15.154:0/2617254146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6e98072520 con 0x7f6e84004d50 2024-05-14T01:24:17.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.913+0000 7f6e94ff9640 1 -- 172.21.15.154:0/2617254146 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f6e880562e0 con 0x7f6e84004d50 2024-05-14T01:24:17.899 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-05-14T01:24:17.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.913+0000 7f6e9e126640 1 -- 172.21.15.154:0/2617254146 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6e78067860 msgr2=0x7f6e78069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.913+0000 7f6e9e126640 1 --2- 172.21.15.154:0/2617254146 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6e78067860 0x7f6e78069d20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6e980cbb20 tx=0x7f6e80008040 comp rx=0 tx=0).stop 2024-05-14T01:24:17.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.913+0000 7f6e9e126640 1 -- 172.21.15.154:0/2617254146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e84004d50 msgr2=0x7f6e981f6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:17.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.913+0000 7f6e9e126640 1 --2- 172.21.15.154:0/2617254146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e84004d50 0x7f6e981f6bb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800e820 tx=0x7f6e8800ece0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.913+0000 7f6e9e126640 1 -- 172.21.15.154:0/2617254146 shutdown_connections 2024-05-14T01:24:17.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.913+0000 7f6e9e126640 1 --2- 172.21.15.154:0/2617254146 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6e78067860 0x7f6e78069d20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.913+0000 7f6e9e126640 1 --2- 172.21.15.154:0/2617254146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e980b4070 0x7f6e980b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.913+0000 7f6e9e126640 1 --2- 172.21.15.154:0/2617254146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9813b160 0x7f6e9813baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.913+0000 7f6e9e126640 1 --2- 172.21.15.154:0/2617254146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e84004d50 0x7f6e981f6bb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:17.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.913+0000 7f6e9e126640 1 -- 172.21.15.154:0/2617254146 >> 172.21.15.154:0/2617254146 conn(0x7f6e980b1770 msgr2=0x7f6e981e6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:17.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.913+0000 7f6e9e126640 1 -- 172.21.15.154:0/2617254146 shutdown_connections 2024-05-14T01:24:17.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:17.913+0000 7f6e9e126640 1 -- 172.21.15.154:0/2617254146 wait complete. 2024-05-14T01:24:17.916 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T01:24:18.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.041+0000 7f9198f44640 1 Processor -- start 2024-05-14T01:24:18.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.041+0000 7f9198f44640 1 -- start start 2024-05-14T01:24:18.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.041+0000 7f9198f44640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f919415e100 0x7f91940d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.041+0000 7f9198f44640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91940cf520 0x7f91940b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.041+0000 7f9198f44640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91940d29f0 con 0x7f919415e4e0 2024-05-14T01:24:18.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.041+0000 7f9198f44640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f91940d2cd0 con 0x7f91940cf520 2024-05-14T01:24:18.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.041+0000 7f9198f44640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f91940d2fb0 con 0x7f919415e100 2024-05-14T01:24:18.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.041+0000 7f9192d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91940cf520 0x7f91940b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.041+0000 7f9192d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91940cf520 0x7f91940b9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42596/0 (socket says 172.21.15.154:42596) 2024-05-14T01:24:18.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.041+0000 7f9192d9d640 1 -- 172.21.15.154:0/853163549 learned_addr learned my addr 172.21.15.154:0/853163549 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:18.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.041+0000 7f919259c640 1 --2- 172.21.15.154:0/853163549 >> v2:172.21.15.176:3300/0 conn(0x7f919415e100 0x7f91940d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.041+0000 7f9192d9d640 1 -- 172.21.15.154:0/853163549 >> v2:172.21.15.176:3300/0 conn(0x7f919415e100 msgr2=0x7f91940d22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:18.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.041+0000 7f9192d9d640 1 --2- 172.21.15.154:0/853163549 >> v2:172.21.15.176:3300/0 conn(0x7f919415e100 0x7f91940d22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.041+0000 7f9192d9d640 1 -- 172.21.15.154:0/853163549 >> v1:172.21.15.176:6789/0 conn(0x7f919415e4e0 legacy=0x7f91940cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:18.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.041+0000 7f9192d9d640 1 -- 172.21.15.154:0/853163549 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91940d3290 con 0x7f91940cf520 2024-05-14T01:24:18.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9192d9d640 1 --2- 172.21.15.154:0/853163549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91940cf520 0x7f91940b9b20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f91940ce640 tx=0x7f918c01f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc85a7b103756e71 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:18.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f919159a640 1 -- 172.21.15.154:0/853163549 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c0b4070 con 0x7f91940cf520 2024-05-14T01:24:18.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f919159a640 1 -- 172.21.15.154:0/853163549 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918c0af400 con 0x7f91940cf520 2024-05-14T01:24:18.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f919159a640 1 -- 172.21.15.154:0/853163549 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c0af7d0 con 0x7f91940cf520 2024-05-14T01:24:18.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9198f44640 1 -- 172.21.15.154:0/853163549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91940cf520 msgr2=0x7f91940b9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9198f44640 1 --2- 172.21.15.154:0/853163549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91940cf520 0x7f91940b9b20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f91940ce640 tx=0x7f918c01f1a0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9198f44640 1 -- 172.21.15.154:0/853163549 shutdown_connections 2024-05-14T01:24:18.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9198f44640 1 --2- 172.21.15.154:0/853163549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91940cf520 0x7f91940b9b20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9198f44640 1 --2- 172.21.15.154:0/853163549 >> v2:172.21.15.176:3300/0 conn(0x7f919415e100 0x7f91940d22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9198f44640 1 -- 172.21.15.154:0/853163549 >> 172.21.15.154:0/853163549 conn(0x7f91940b5b50 msgr2=0x7f91940b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:18.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9198f44640 1 -- 172.21.15.154:0/853163549 shutdown_connections 2024-05-14T01:24:18.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9198f44640 1 -- 172.21.15.154:0/853163549 wait complete. 2024-05-14T01:24:18.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9198f44640 1 Processor -- start 2024-05-14T01:24:18.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9198f44640 1 -- start start 2024-05-14T01:24:18.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9198f44640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91940cf520 0x7f9194159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9198f44640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f919415e100 0x7f91941f3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9198f44640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f919415e4e0 0x7f91940b7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9198f44640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f91940d3c10 con 0x7f919415e4e0 2024-05-14T01:24:18.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9198f44640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f91940d3a90 con 0x7f91940cf520 2024-05-14T01:24:18.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9198f44640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f91940b76b0 con 0x7f919415e100 2024-05-14T01:24:18.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9192d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f919415e4e0 0x7f91940b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9192d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f919415e4e0 0x7f91940b7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42610/0 (socket says 172.21.15.154:42610) 2024-05-14T01:24:18.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9192d9d640 1 -- 172.21.15.154:0/1360526037 learned_addr learned my addr 172.21.15.154:0/1360526037 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:18.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9191d9b640 1 --2- 172.21.15.154:0/1360526037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f919415e100 0x7f91941f3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f919259c640 1 --2- 172.21.15.154:0/1360526037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91940cf520 0x7f9194159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9192d9d640 1 -- 172.21.15.154:0/1360526037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f919415e100 msgr2=0x7f91941f3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9192d9d640 1 --2- 172.21.15.154:0/1360526037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f919415e100 0x7f91941f3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9192d9d640 1 -- 172.21.15.154:0/1360526037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91940cf520 msgr2=0x7f9194159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9192d9d640 1 --2- 172.21.15.154:0/1360526037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91940cf520 0x7f9194159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9192d9d640 1 -- 172.21.15.154:0/1360526037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91940b7950 con 0x7f919415e4e0 2024-05-14T01:24:18.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f919259c640 1 --2- 172.21.15.154:0/1360526037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91940cf520 0x7f9194159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:18.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9191d9b640 1 --2- 172.21.15.154:0/1360526037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f919415e100 0x7f91941f3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:18.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9192d9d640 1 --2- 172.21.15.154:0/1360526037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f919415e4e0 0x7f91940b7170 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f918c01cdd0 tx=0x7f918c01bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:18.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9182ffd640 1 -- 172.21.15.154:0/1360526037 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c0b4040 con 0x7f919415e4e0 2024-05-14T01:24:18.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9182ffd640 1 -- 172.21.15.154:0/1360526037 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918c0c0070 con 0x7f919415e4e0 2024-05-14T01:24:18.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9198f44640 1 -- 172.21.15.154:0/1360526037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91940b7c30 con 0x7f919415e4e0 2024-05-14T01:24:18.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9182ffd640 1 -- 172.21.15.154:0/1360526037 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c009510 con 0x7f919415e4e0 2024-05-14T01:24:18.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.045+0000 7f9198f44640 1 -- 172.21.15.154:0/1360526037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91940b81f0 con 0x7f919415e4e0 2024-05-14T01:24:18.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.049+0000 7f9198f44640 1 -- 172.21.15.154:0/1360526037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9194075470 con 0x7f919415e4e0 2024-05-14T01:24:18.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.049+0000 7f9182ffd640 1 -- 172.21.15.154:0/1360526037 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f918c0c5460 con 0x7f919415e4e0 2024-05-14T01:24:18.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.049+0000 7f9182ffd640 1 --2- 172.21.15.154:0/1360526037 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f91740678c0 0x7f9174069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.049+0000 7f919259c640 1 --2- 172.21.15.154:0/1360526037 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f91740678c0 0x7f9174069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.049+0000 7f9182ffd640 1 -- 172.21.15.154:0/1360526037 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f918c124090 con 0x7f919415e4e0 2024-05-14T01:24:18.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.049+0000 7f919259c640 1 --2- 172.21.15.154:0/1360526037 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f91740678c0 0x7f9174069d80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9184009840 tx=0x7f9184008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:18.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.053+0000 7f9182ffd640 1 -- 172.21.15.154:0/1360526037 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f918c018d00 con 0x7f919415e4e0 2024-05-14T01:24:18.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.213+0000 7f9198f44640 1 -- 172.21.15.154:0/1360526037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f919415d270 con 0x7f919415e4e0 2024-05-14T01:24:18.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.213+0000 7f9182ffd640 1 -- 172.21.15.154:0/1360526037 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f918c0f4b40 con 0x7f919415e4e0 2024-05-14T01:24:18.200 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-05-14T01:24:18.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.213+0000 7f9198f44640 1 -- 172.21.15.154:0/1360526037 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f91740678c0 msgr2=0x7f9174069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.213+0000 7f9198f44640 1 --2- 172.21.15.154:0/1360526037 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f91740678c0 0x7f9174069d80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9184009840 tx=0x7f9184008040 comp rx=0 tx=0).stop 2024-05-14T01:24:18.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.217+0000 7f9198f44640 1 -- 172.21.15.154:0/1360526037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f919415e4e0 msgr2=0x7f91940b7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.217+0000 7f9198f44640 1 --2- 172.21.15.154:0/1360526037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f919415e4e0 0x7f91940b7170 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f918c01cdd0 tx=0x7f918c01bf40 comp rx=0 tx=0).stop 2024-05-14T01:24:18.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.217+0000 7f9198f44640 1 -- 172.21.15.154:0/1360526037 shutdown_connections 2024-05-14T01:24:18.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.217+0000 7f9198f44640 1 --2- 172.21.15.154:0/1360526037 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f91740678c0 0x7f9174069d80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.217+0000 7f9198f44640 1 --2- 172.21.15.154:0/1360526037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f919415e4e0 0x7f91940b7170 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.217+0000 7f9198f44640 1 --2- 172.21.15.154:0/1360526037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f919415e100 0x7f91941f3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.217+0000 7f9198f44640 1 --2- 172.21.15.154:0/1360526037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91940cf520 0x7f9194159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.217+0000 7f9198f44640 1 -- 172.21.15.154:0/1360526037 >> 172.21.15.154:0/1360526037 conn(0x7f91940b5b50 msgr2=0x7f919415aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:18.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.217+0000 7f9198f44640 1 -- 172.21.15.154:0/1360526037 shutdown_connections 2024-05-14T01:24:18.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.217+0000 7f9198f44640 1 -- 172.21.15.154:0/1360526037 wait complete. 2024-05-14T01:24:18.217 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T01:24:18.218 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T01:24:18.224 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:18.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f331a0c6640 1 Processor -- start 2024-05-14T01:24:18.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f331a0c6640 1 -- start start 2024-05-14T01:24:18.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f331a0c6640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f331415e100 0x7f33140d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f331a0c6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f331415e4e0 0x7f33140b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f331a0c6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33140d3a90 0x7f33140cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f331a0c6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f33140d29f0 con 0x7f33140d3a90 2024-05-14T01:24:18.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f331a0c6640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f33140d2cd0 con 0x7f331415e100 2024-05-14T01:24:18.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f331a0c6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f33140d2fb0 con 0x7f331415e4e0 2024-05-14T01:24:18.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f3313fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33140d3a90 0x7f33140cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f3313fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33140d3a90 0x7f33140cee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42616/0 (socket says 172.21.15.154:42616) 2024-05-14T01:24:18.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f3313fff640 1 -- 172.21.15.154:0/1181142447 learned_addr learned my addr 172.21.15.154:0/1181142447 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:18.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f33137fe640 1 --2- 172.21.15.154:0/1181142447 >> v2:172.21.15.176:3300/0 conn(0x7f331415e100 0x7f33140d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f3312ffd640 1 --2- 172.21.15.154:0/1181142447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f331415e4e0 0x7f33140b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f3313fff640 1 -- 172.21.15.154:0/1181142447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f331415e4e0 msgr2=0x7f33140b9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:18.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f3313fff640 1 --2- 172.21.15.154:0/1181142447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f331415e4e0 0x7f33140b9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f3313fff640 1 -- 172.21.15.154:0/1181142447 >> v2:172.21.15.176:3300/0 conn(0x7f331415e100 msgr2=0x7f33140d22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:18.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f3313fff640 1 --2- 172.21.15.154:0/1181142447 >> v2:172.21.15.176:3300/0 conn(0x7f331415e100 0x7f33140d22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f3313fff640 1 -- 172.21.15.154:0/1181142447 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33140d3290 con 0x7f33140d3a90 2024-05-14T01:24:18.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.345+0000 7f3313fff640 1 --2- 172.21.15.154:0/1181142447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33140d3a90 0x7f33140cee10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f33140ce640 tx=0x7f330c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc92ca1e3fdf2900 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:18.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f33127fc640 1 -- 172.21.15.154:0/1181142447 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c0b4070 con 0x7f33140d3a90 2024-05-14T01:24:18.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f33127fc640 1 -- 172.21.15.154:0/1181142447 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c0af400 con 0x7f33140d3a90 2024-05-14T01:24:18.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f33127fc640 1 -- 172.21.15.154:0/1181142447 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c0af7d0 con 0x7f33140d3a90 2024-05-14T01:24:18.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 -- 172.21.15.154:0/1181142447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33140d3a90 msgr2=0x7f33140cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 --2- 172.21.15.154:0/1181142447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33140d3a90 0x7f33140cee10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f33140ce640 tx=0x7f330c01f1e0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 -- 172.21.15.154:0/1181142447 shutdown_connections 2024-05-14T01:24:18.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 --2- 172.21.15.154:0/1181142447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f331415e4e0 0x7f33140b9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 --2- 172.21.15.154:0/1181142447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33140d3a90 0x7f33140cee10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 --2- 172.21.15.154:0/1181142447 >> v2:172.21.15.176:3300/0 conn(0x7f331415e100 0x7f33140d22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 -- 172.21.15.154:0/1181142447 >> 172.21.15.154:0/1181142447 conn(0x7f33140b5b50 msgr2=0x7f33140b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:18.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 -- 172.21.15.154:0/1181142447 shutdown_connections 2024-05-14T01:24:18.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 -- 172.21.15.154:0/1181142447 wait complete. 2024-05-14T01:24:18.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 Processor -- start 2024-05-14T01:24:18.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 -- start start 2024-05-14T01:24:18.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33140d3a90 0x7f3314154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f331415e100 0x7f3314161300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f331415e4e0 0x7f33140c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f33140cf4d0 con 0x7f331415e4e0 2024-05-14T01:24:18.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f33140cf350 con 0x7f33140d3a90 2024-05-14T01:24:18.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f33140cf650 con 0x7f331415e100 2024-05-14T01:24:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f3313fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f331415e4e0 0x7f33140c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f3313fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f331415e4e0 0x7f33140c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42626/0 (socket says 172.21.15.154:42626) 2024-05-14T01:24:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f3313fff640 1 -- 172.21.15.154:0/3615362526 learned_addr learned my addr 172.21.15.154:0/3615362526 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f33137fe640 1 --2- 172.21.15.154:0/3615362526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33140d3a90 0x7f3314154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f3312ffd640 1 --2- 172.21.15.154:0/3615362526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f331415e100 0x7f3314161300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f3313fff640 1 -- 172.21.15.154:0/3615362526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f331415e100 msgr2=0x7f3314161300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f3313fff640 1 --2- 172.21.15.154:0/3615362526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f331415e100 0x7f3314161300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f3313fff640 1 -- 172.21.15.154:0/3615362526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33140d3a90 msgr2=0x7f3314154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f3313fff640 1 --2- 172.21.15.154:0/3615362526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33140d3a90 0x7f3314154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f3313fff640 1 -- 172.21.15.154:0/3615362526 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3314154aa0 con 0x7f331415e4e0 2024-05-14T01:24:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f3313fff640 1 --2- 172.21.15.154:0/3615362526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f331415e4e0 0x7f33140c8cf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f330c0b2040 tx=0x7f330c01bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f32fbfff640 1 -- 172.21.15.154:0/3615362526 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c0be070 con 0x7f331415e4e0 2024-05-14T01:24:18.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f32fbfff640 1 -- 172.21.15.154:0/3615362526 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c0090d0 con 0x7f331415e4e0 2024-05-14T01:24:18.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f32fbfff640 1 -- 172.21.15.154:0/3615362526 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c0b4040 con 0x7f331415e4e0 2024-05-14T01:24:18.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 -- 172.21.15.154:0/3615362526 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33140cb240 con 0x7f331415e4e0 2024-05-14T01:24:18.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.349+0000 7f331a0c6640 1 -- 172.21.15.154:0/3615362526 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33140cb7c0 con 0x7f331415e4e0 2024-05-14T01:24:18.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.353+0000 7f331a0c6640 1 -- 172.21.15.154:0/3615362526 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3314075470 con 0x7f331415e4e0 2024-05-14T01:24:18.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.353+0000 7f32fbfff640 1 -- 172.21.15.154:0/3615362526 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f330c0b7070 con 0x7f331415e4e0 2024-05-14T01:24:18.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.353+0000 7f32fbfff640 1 --2- 172.21.15.154:0/3615362526 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f33000678c0 0x7f3300069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.353+0000 7f32fbfff640 1 -- 172.21.15.154:0/3615362526 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f330c123aa0 con 0x7f331415e4e0 2024-05-14T01:24:18.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.353+0000 7f33137fe640 1 --2- 172.21.15.154:0/3615362526 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f33000678c0 0x7f3300069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.353+0000 7f33137fe640 1 --2- 172.21.15.154:0/3615362526 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f33000678c0 0x7f3300069d80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f330800b9d0 tx=0x7f3308008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:18.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.357+0000 7f32fbfff640 1 -- 172.21.15.154:0/3615362526 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f330c018d40 con 0x7f331415e4e0 2024-05-14T01:24:18.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.509+0000 7f331a0c6640 1 -- 172.21.15.154:0/3615362526 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33140b8a50 con 0x7f331415e4e0 2024-05-14T01:24:18.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.509+0000 7f32fbfff640 1 -- 172.21.15.154:0/3615362526 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16950 (secure 0 0 0) 0x7f330c0f46a0 con 0x7f331415e4e0 2024-05-14T01:24:18.497 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:18.497 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":23,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:24:16.454751+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:18.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.513+0000 7f331a0c6640 1 -- 172.21.15.154:0/3615362526 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f33000678c0 msgr2=0x7f3300069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.513+0000 7f331a0c6640 1 --2- 172.21.15.154:0/3615362526 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f33000678c0 0x7f3300069d80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f330800b9d0 tx=0x7f3308008040 comp rx=0 tx=0).stop 2024-05-14T01:24:18.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.513+0000 7f331a0c6640 1 -- 172.21.15.154:0/3615362526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f331415e4e0 msgr2=0x7f33140c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.513+0000 7f331a0c6640 1 --2- 172.21.15.154:0/3615362526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f331415e4e0 0x7f33140c8cf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f330c0b2040 tx=0x7f330c01bf80 comp rx=0 tx=0).stop 2024-05-14T01:24:18.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.513+0000 7f331a0c6640 1 -- 172.21.15.154:0/3615362526 shutdown_connections 2024-05-14T01:24:18.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.513+0000 7f331a0c6640 1 --2- 172.21.15.154:0/3615362526 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f33000678c0 0x7f3300069d80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.513+0000 7f331a0c6640 1 --2- 172.21.15.154:0/3615362526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f331415e4e0 0x7f33140c8cf0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.513+0000 7f331a0c6640 1 --2- 172.21.15.154:0/3615362526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f331415e100 0x7f3314161300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.513+0000 7f331a0c6640 1 --2- 172.21.15.154:0/3615362526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33140d3a90 0x7f3314154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.513+0000 7f331a0c6640 1 -- 172.21.15.154:0/3615362526 >> 172.21.15.154:0/3615362526 conn(0x7f33140b5b50 msgr2=0x7f33140b8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:18.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.513+0000 7f331a0c6640 1 -- 172.21.15.154:0/3615362526 shutdown_connections 2024-05-14T01:24:18.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.513+0000 7f331a0c6640 1 -- 172.21.15.154:0/3615362526 wait complete. 2024-05-14T01:24:18.516 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T01:23:33.083538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T01:23:33.556058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:24:18.516 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:24:18.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6b29f1640 1 Processor -- start 2024-05-14T01:24:18.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6b29f1640 1 -- start start 2024-05-14T01:24:18.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6b29f1640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd6ac0cf610 0x7fd6ac15fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6b29f1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6ac071840 con 0x7fd6ac1458d0 2024-05-14T01:24:18.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6b29f1640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6ac071b20 con 0x7fd6ac15ff80 2024-05-14T01:24:18.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6b29f1640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd6ac071e00 con 0x7fd6ac0cf610 2024-05-14T01:24:18.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6abfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd6ac1458d0 0x7fd6ac071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37006/0 (socket says 172.21.15.154:37006) 2024-05-14T01:24:18.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6abfff640 1 -- 172.21.15.154:0/336810303 learned_addr learned my addr 172.21.15.154:0/336810303 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:18.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6aaffd640 1 -- 172.21.15.154:0/336810303 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4203793608 0 0) 0x7fd6ac071840 con 0x7fd6ac1458d0 2024-05-14T01:24:18.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6aaffd640 1 -- 172.21.15.154:0/336810303 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd694003530 con 0x7fd6ac1458d0 2024-05-14T01:24:18.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6ab7fe640 1 --2- 172.21.15.154:0/336810303 >> v2:172.21.15.176:3300/0 conn(0x7fd6ac0cf610 0x7fd6ac15fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6aaffd640 1 -- 172.21.15.154:0/336810303 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3812144903 0 0) 0x7fd694003530 con 0x7fd6ac1458d0 2024-05-14T01:24:18.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6aaffd640 1 -- 172.21.15.154:0/336810303 >> v2:172.21.15.176:3300/0 conn(0x7fd6ac0cf610 msgr2=0x7fd6ac15fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:18.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6aaffd640 1 --2- 172.21.15.154:0/336810303 >> v2:172.21.15.176:3300/0 conn(0x7fd6ac0cf610 0x7fd6ac15fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6aaffd640 1 -- 172.21.15.154:0/336810303 >> v1:172.21.15.176:6789/0 conn(0x7fd6ac15ff80 legacy=0x7fd6ac06ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:18.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6aaffd640 1 -- 172.21.15.154:0/336810303 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ac0720e0 con 0x7fd6ac1458d0 2024-05-14T01:24:18.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6aaffd640 1 -- 172.21.15.154:0/336810303 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fd69c001680 con 0x7fd6ac1458d0 2024-05-14T01:24:18.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6aaffd640 1 -- 172.21.15.154:0/336810303 >> v1:172.21.15.154:6789/0 conn(0x7fd6ac1458d0 legacy=0x7fd6ac071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6aaffd640 1 --2- 172.21.15.154:0/336810303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd694003a10 0x7fd694003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6aaffd640 1 --2- 172.21.15.154:0/336810303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd694004810 0x7fd694004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6aaffd640 1 --2- 172.21.15.154:0/336810303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6940051d0 0x7fd69400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6aaffd640 1 -- 172.21.15.154:0/336810303 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac071e00 con 0x7fd694004810 2024-05-14T01:24:18.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6aaffd640 1 -- 172.21.15.154:0/336810303 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd69400c0a0 con 0x7fd694003a10 2024-05-14T01:24:18.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6aaffd640 1 -- 172.21.15.154:0/336810303 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd69400c2a0 con 0x7fd6940051d0 2024-05-14T01:24:18.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6ab7fe640 1 --2- 172.21.15.154:0/336810303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd694004810 0x7fd694004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6ab7fe640 1 -- 172.21.15.154:0/336810303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6940051d0 msgr2=0x7fd69400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:18.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6b0f8e640 1 --2- 172.21.15.154:0/336810303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6940051d0 0x7fd69400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6ab7fe640 1 --2- 172.21.15.154:0/336810303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6940051d0 0x7fd69400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6ab7fe640 1 -- 172.21.15.154:0/336810303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd694003a10 msgr2=0x7fd694003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:18.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6ab7fe640 1 --2- 172.21.15.154:0/336810303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd694003a10 0x7fd694003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6ab7fe640 1 -- 172.21.15.154:0/336810303 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd694003530 con 0x7fd694004810 2024-05-14T01:24:18.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.641+0000 7fd6b0f8e640 1 -- 172.21.15.154:0/336810303 reap_dead start 2024-05-14T01:24:18.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6ab7fe640 1 --2- 172.21.15.154:0/336810303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd694004810 0x7fd694004c90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009ae0 tx=0x7fd6a001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a75fd6746d1f60 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:18.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6aaffd640 1 -- 172.21.15.154:0/336810303 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a00b2070 con 0x7fd694004810 2024-05-14T01:24:18.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6aaffd640 1 -- 172.21.15.154:0/336810303 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6a00a5660 con 0x7fd694004810 2024-05-14T01:24:18.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6aaffd640 1 -- 172.21.15.154:0/336810303 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a00096b0 con 0x7fd694004810 2024-05-14T01:24:18.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6b29f1640 1 -- 172.21.15.154:0/336810303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd694004810 msgr2=0x7fd694004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6b29f1640 1 --2- 172.21.15.154:0/336810303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd694004810 0x7fd694004c90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009ae0 tx=0x7fd6a001ca70 comp rx=0 tx=0).stop 2024-05-14T01:24:18.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6b29f1640 1 -- 172.21.15.154:0/336810303 shutdown_connections 2024-05-14T01:24:18.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6b29f1640 1 --2- 172.21.15.154:0/336810303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd694004810 0x7fd694004c90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6b29f1640 1 -- 172.21.15.154:0/336810303 >> 172.21.15.154:0/336810303 conn(0x7fd6ac0b1770 msgr2=0x7fd6ac0b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:18.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6b29f1640 1 -- 172.21.15.154:0/336810303 shutdown_connections 2024-05-14T01:24:18.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6b29f1640 1 -- 172.21.15.154:0/336810303 wait complete. 2024-05-14T01:24:18.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6b29f1640 1 Processor -- start 2024-05-14T01:24:18.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6b29f1640 1 -- start start 2024-05-14T01:24:18.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6b29f1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd694004810 0x7fd6ac156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6b29f1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6ac1f6630 0x7fd6ac1f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6b29f1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6ac1e7a30 0x7fd6ac1e7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6b29f1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac072a60 con 0x7fd6ac1e7a30 2024-05-14T01:24:18.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6b29f1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac0728e0 con 0x7fd694004810 2024-05-14T01:24:18.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6b29f1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd6ac15fa40 con 0x7fd6ac1f6630 2024-05-14T01:24:18.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6b0f8e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6ac1e7a30 0x7fd6ac1e7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6b0f8e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6ac1e7a30 0x7fd6ac1e7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42648/0 (socket says 172.21.15.154:42648) 2024-05-14T01:24:18.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6b0f8e640 1 -- 172.21.15.154:0/1538615926 learned_addr learned my addr 172.21.15.154:0/1538615926 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:18.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6abfff640 1 --2- 172.21.15.154:0/1538615926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd694004810 0x7fd6ac156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.645+0000 7fd6ab7fe640 1 --2- 172.21.15.154:0/1538615926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6ac1f6630 0x7fd6ac1f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.649+0000 7fd6b0f8e640 1 -- 172.21.15.154:0/1538615926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6ac1f6630 msgr2=0x7fd6ac1f1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.649+0000 7fd6b0f8e640 1 --2- 172.21.15.154:0/1538615926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6ac1f6630 0x7fd6ac1f1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.649+0000 7fd6b0f8e640 1 -- 172.21.15.154:0/1538615926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd694004810 msgr2=0x7fd6ac156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.649+0000 7fd6b0f8e640 1 --2- 172.21.15.154:0/1538615926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd694004810 0x7fd6ac156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.649+0000 7fd6b0f8e640 1 -- 172.21.15.154:0/1538615926 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ac0b0fb0 con 0x7fd6ac1e7a30 2024-05-14T01:24:18.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.649+0000 7fd6b0f8e640 1 --2- 172.21.15.154:0/1538615926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6ac1e7a30 0x7fd6ac1e7eb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400d540 tx=0x7fd6a400da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:18.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.649+0000 7fd6a8ff9640 1 -- 172.21.15.154:0/1538615926 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4012800 con 0x7fd6ac1e7a30 2024-05-14T01:24:18.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.649+0000 7fd6a8ff9640 1 -- 172.21.15.154:0/1538615926 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6a4019070 con 0x7fd6ac1e7a30 2024-05-14T01:24:18.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.649+0000 7fd6b29f1640 1 -- 172.21.15.154:0/1538615926 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6ac1f6ab0 con 0x7fd6ac1e7a30 2024-05-14T01:24:18.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.649+0000 7fd6a8ff9640 1 -- 172.21.15.154:0/1538615926 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4012be0 con 0x7fd6ac1e7a30 2024-05-14T01:24:18.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.649+0000 7fd6b29f1640 1 -- 172.21.15.154:0/1538615926 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6ac156d60 con 0x7fd6ac1e7a30 2024-05-14T01:24:18.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.649+0000 7fd6b29f1640 1 -- 172.21.15.154:0/1538615926 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6ac075470 con 0x7fd6ac1e7a30 2024-05-14T01:24:18.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.649+0000 7fd6a8ff9640 1 -- 172.21.15.154:0/1538615926 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd6a401e460 con 0x7fd6ac1e7a30 2024-05-14T01:24:18.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.649+0000 7fd6a8ff9640 1 --2- 172.21.15.154:0/1538615926 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd6980678c0 0x7fd698069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.649+0000 7fd6a8ff9640 1 -- 172.21.15.154:0/1538615926 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fd6a4085a10 con 0x7fd6ac1e7a30 2024-05-14T01:24:18.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.649+0000 7fd6abfff640 1 --2- 172.21.15.154:0/1538615926 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd6980678c0 0x7fd698069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.649+0000 7fd6abfff640 1 --2- 172.21.15.154:0/1538615926 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd6980678c0 0x7fd698069d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd69c005180 tx=0x7fd69c001630 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:18.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.653+0000 7fd6a8ff9640 1 -- 172.21.15.154:0/1538615926 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fd6a40564c0 con 0x7fd6ac1e7a30 2024-05-14T01:24:18.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.808+0000 7fd6b29f1640 1 -- 172.21.15.154:0/1538615926 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd6ac070e40 con 0x7fd6ac1e7a30 2024-05-14T01:24:18.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.812+0000 7fd6a8ff9640 1 -- 172.21.15.154:0/1538615926 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fd6a4055dc0 con 0x7fd6ac1e7a30 2024-05-14T01:24:18.798 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:24:18.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.812+0000 7fd6b29f1640 1 -- 172.21.15.154:0/1538615926 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd6980678c0 msgr2=0x7fd698069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.812+0000 7fd6b29f1640 1 --2- 172.21.15.154:0/1538615926 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd6980678c0 0x7fd698069d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd69c005180 tx=0x7fd69c001630 comp rx=0 tx=0).stop 2024-05-14T01:24:18.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.812+0000 7fd6b29f1640 1 -- 172.21.15.154:0/1538615926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6ac1e7a30 msgr2=0x7fd6ac1e7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.812+0000 7fd6b29f1640 1 --2- 172.21.15.154:0/1538615926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6ac1e7a30 0x7fd6ac1e7eb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400d540 tx=0x7fd6a400da00 comp rx=0 tx=0).stop 2024-05-14T01:24:18.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.812+0000 7fd6b29f1640 1 -- 172.21.15.154:0/1538615926 shutdown_connections 2024-05-14T01:24:18.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.812+0000 7fd6b29f1640 1 --2- 172.21.15.154:0/1538615926 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd6980678c0 0x7fd698069d80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.812+0000 7fd6b29f1640 1 --2- 172.21.15.154:0/1538615926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6ac1e7a30 0x7fd6ac1e7eb0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.812+0000 7fd6b29f1640 1 --2- 172.21.15.154:0/1538615926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6ac1f6630 0x7fd6ac1f1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.812+0000 7fd6b29f1640 1 --2- 172.21.15.154:0/1538615926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd694004810 0x7fd6ac156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.812+0000 7fd6b29f1640 1 -- 172.21.15.154:0/1538615926 >> 172.21.15.154:0/1538615926 conn(0x7fd6ac0b1770 msgr2=0x7fd6ac06e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:18.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.812+0000 7fd6b29f1640 1 -- 172.21.15.154:0/1538615926 shutdown_connections 2024-05-14T01:24:18.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.812+0000 7fd6b29f1640 1 -- 172.21.15.154:0/1538615926 wait complete. 2024-05-14T01:24:18.816 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T01:24:18.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.952+0000 7f4476b7e640 1 Processor -- start 2024-05-14T01:24:18.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.952+0000 7f4476b7e640 1 -- start start 2024-05-14T01:24:18.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.956+0000 7f4476b7e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44700ced50 0x7f44700cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.956+0000 7f4476b7e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f44700cd160 0x7f44700cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.956+0000 7f4476b7e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44700cdcb0 con 0x7f4470071ef0 2024-05-14T01:24:18.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.956+0000 7f4476b7e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f44700ce8c0 con 0x7f44700ced50 2024-05-14T01:24:18.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.956+0000 7f4476b7e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f44700cdf90 con 0x7f44700cd160 2024-05-14T01:24:18.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.956+0000 7f446ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44700ced50 0x7f44700cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.956+0000 7f447491a640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4470071ef0 0x7f44700722d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37022/0 (socket says 172.21.15.154:37022) 2024-05-14T01:24:18.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.956+0000 7f446ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44700ced50 0x7f44700cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42662/0 (socket says 172.21.15.154:42662) 2024-05-14T01:24:18.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.956+0000 7f447491a640 1 -- 172.21.15.154:0/821727560 learned_addr learned my addr 172.21.15.154:0/821727560 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:18.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.956+0000 7f447511b640 1 --2- 172.21.15.154:0/821727560 >> v2:172.21.15.176:3300/0 conn(0x7f44700cd160 0x7f44700cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.956+0000 7f446ffff640 1 -- 172.21.15.154:0/821727560 >> v2:172.21.15.176:3300/0 conn(0x7f44700cd160 msgr2=0x7f44700cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:18.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.956+0000 7f446ffff640 1 --2- 172.21.15.154:0/821727560 >> v2:172.21.15.176:3300/0 conn(0x7f44700cd160 0x7f44700cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.956+0000 7f446ffff640 1 -- 172.21.15.154:0/821727560 >> v1:172.21.15.154:6789/0 conn(0x7f4470071ef0 legacy=0x7f44700722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.956+0000 7f446f7fe640 1 -- 172.21.15.154:0/821727560 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1181681659 0 0) 0x7f44700cdcb0 con 0x7f4470071ef0 2024-05-14T01:24:18.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.956+0000 7f446ffff640 1 -- 172.21.15.154:0/821727560 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44700ce270 con 0x7f44700ced50 2024-05-14T01:24:18.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.956+0000 7f446ffff640 1 --2- 172.21.15.154:0/821727560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44700ced50 0x7f44700cf1b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f44700732c0 tx=0x7f446401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83fdb0bcf8eed98 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:18.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f446f7fe640 1 -- 172.21.15.154:0/821727560 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44640ab430 con 0x7f44700ced50 2024-05-14T01:24:18.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f446f7fe640 1 -- 172.21.15.154:0/821727560 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44640b0070 con 0x7f44700ced50 2024-05-14T01:24:18.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f446f7fe640 1 -- 172.21.15.154:0/821727560 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44640ab7f0 con 0x7f44700ced50 2024-05-14T01:24:18.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f4476b7e640 1 -- 172.21.15.154:0/821727560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44700ced50 msgr2=0x7f44700cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f4476b7e640 1 --2- 172.21.15.154:0/821727560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44700ced50 0x7f44700cf1b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f44700732c0 tx=0x7f446401c450 comp rx=0 tx=0).stop 2024-05-14T01:24:18.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f4476b7e640 1 -- 172.21.15.154:0/821727560 shutdown_connections 2024-05-14T01:24:18.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f4476b7e640 1 --2- 172.21.15.154:0/821727560 >> v2:172.21.15.176:3300/0 conn(0x7f44700cd160 0x7f44700cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f4476b7e640 1 --2- 172.21.15.154:0/821727560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44700ced50 0x7f44700cf1b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f4476b7e640 1 -- 172.21.15.154:0/821727560 >> 172.21.15.154:0/821727560 conn(0x7f44700b1770 msgr2=0x7f44700b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:18.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f4476b7e640 1 -- 172.21.15.154:0/821727560 shutdown_connections 2024-05-14T01:24:18.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f4476b7e640 1 -- 172.21.15.154:0/821727560 wait complete. 2024-05-14T01:24:18.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f4476b7e640 1 Processor -- start 2024-05-14T01:24:18.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f4476b7e640 1 -- start start 2024-05-14T01:24:18.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f4476b7e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4470071ef0 0x7f447013d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f4476b7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44700cd160 0x7f4470159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f4476b7e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44700ced50 0x7f4470137cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f4476b7e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f447006d850 con 0x7f44700cd160 2024-05-14T01:24:18.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f4476b7e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f447006d6d0 con 0x7f4470071ef0 2024-05-14T01:24:18.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f4476b7e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f447006d9d0 con 0x7f44700ced50 2024-05-14T01:24:18.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f446ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44700cd160 0x7f4470159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f446ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44700cd160 0x7f4470159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42666/0 (socket says 172.21.15.154:42666) 2024-05-14T01:24:18.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f446ffff640 1 -- 172.21.15.154:0/4192557866 learned_addr learned my addr 172.21.15.154:0/4192557866 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:18.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f447491a640 1 --2- 172.21.15.154:0/4192557866 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4470071ef0 0x7f447013d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f447511b640 1 --2- 172.21.15.154:0/4192557866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44700ced50 0x7f4470137cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f446ffff640 1 -- 172.21.15.154:0/4192557866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44700ced50 msgr2=0x7f4470137cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f446ffff640 1 --2- 172.21.15.154:0/4192557866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44700ced50 0x7f4470137cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f446ffff640 1 -- 172.21.15.154:0/4192557866 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4470071ef0 msgr2=0x7f447013d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:18.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f446ffff640 1 --2- 172.21.15.154:0/4192557866 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4470071ef0 0x7f447013d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:18.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f446ffff640 1 -- 172.21.15.154:0/4192557866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447013c000 con 0x7f44700cd160 2024-05-14T01:24:18.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f446ffff640 1 --2- 172.21.15.154:0/4192557866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44700cd160 0x7f4470159ec0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f44640ad040 tx=0x7f446401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:18.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f446d7fa640 1 -- 172.21.15.154:0/4192557866 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464006e20 con 0x7f44700cd160 2024-05-14T01:24:18.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f446d7fa640 1 -- 172.21.15.154:0/4192557866 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4464004230 con 0x7f44700cd160 2024-05-14T01:24:18.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f4476b7e640 1 -- 172.21.15.154:0/4192557866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447013c2e0 con 0x7f44700cd160 2024-05-14T01:24:18.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f446d7fa640 1 -- 172.21.15.154:0/4192557866 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464003620 con 0x7f44700cd160 2024-05-14T01:24:18.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.960+0000 7f4476b7e640 1 -- 172.21.15.154:0/4192557866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f447013c8a0 con 0x7f44700cd160 2024-05-14T01:24:18.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.964+0000 7f4476b7e640 1 -- 172.21.15.154:0/4192557866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4470075470 con 0x7f44700cd160 2024-05-14T01:24:18.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.964+0000 7f446d7fa640 1 -- 172.21.15.154:0/4192557866 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f44640037c0 con 0x7f44700cd160 2024-05-14T01:24:18.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.964+0000 7f446d7fa640 1 --2- 172.21.15.154:0/4192557866 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f445c0678c0 0x7f445c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:18.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.964+0000 7f446d7fa640 1 -- 172.21.15.154:0/4192557866 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f44640a8030 con 0x7f44700cd160 2024-05-14T01:24:18.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.964+0000 7f447491a640 1 --2- 172.21.15.154:0/4192557866 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f445c0678c0 0x7f445c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:18.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.964+0000 7f447491a640 1 --2- 172.21.15.154:0/4192557866 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f445c0678c0 0x7f445c069d80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4460000f70 tx=0x7f4460007b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:18.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:18.968+0000 7f446d7fa640 1 -- 172.21.15.154:0/4192557866 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f44640c4060 con 0x7f44700cd160 2024-05-14T01:24:19.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.128+0000 7f4476b7e640 1 -- 172.21.15.154:0/4192557866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f447006d0f0 con 0x7f44700cd160 2024-05-14T01:24:19.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.128+0000 7f446d7fa640 1 -- 172.21.15.154:0/4192557866 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f4464016070 con 0x7f44700cd160 2024-05-14T01:24:19.115 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-05-14T01:24:19.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.128+0000 7f4476b7e640 1 -- 172.21.15.154:0/4192557866 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f445c0678c0 msgr2=0x7f445c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.132+0000 7f4476b7e640 1 --2- 172.21.15.154:0/4192557866 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f445c0678c0 0x7f445c069d80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4460000f70 tx=0x7f4460007b80 comp rx=0 tx=0).stop 2024-05-14T01:24:19.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.132+0000 7f4476b7e640 1 -- 172.21.15.154:0/4192557866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44700cd160 msgr2=0x7f4470159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.132+0000 7f4476b7e640 1 --2- 172.21.15.154:0/4192557866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44700cd160 0x7f4470159ec0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f44640ad040 tx=0x7f446401ac90 comp rx=0 tx=0).stop 2024-05-14T01:24:19.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.132+0000 7f4476b7e640 1 -- 172.21.15.154:0/4192557866 shutdown_connections 2024-05-14T01:24:19.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.132+0000 7f4476b7e640 1 --2- 172.21.15.154:0/4192557866 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f445c0678c0 0x7f445c069d80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.132+0000 7f4476b7e640 1 --2- 172.21.15.154:0/4192557866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44700ced50 0x7f4470137cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.132+0000 7f4476b7e640 1 --2- 172.21.15.154:0/4192557866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44700cd160 0x7f4470159ec0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.132+0000 7f4476b7e640 1 --2- 172.21.15.154:0/4192557866 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4470071ef0 0x7f447013d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.132+0000 7f4476b7e640 1 -- 172.21.15.154:0/4192557866 >> 172.21.15.154:0/4192557866 conn(0x7f44700b1770 msgr2=0x7f4470141610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:19.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.132+0000 7f4476b7e640 1 -- 172.21.15.154:0/4192557866 shutdown_connections 2024-05-14T01:24:19.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.132+0000 7f4476b7e640 1 -- 172.21.15.154:0/4192557866 wait complete. 2024-05-14T01:24:19.135 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T01:24:19.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.264+0000 7fc8da7b2640 1 Processor -- start 2024-05-14T01:24:19.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.264+0000 7fc8da7b2640 1 -- start start 2024-05-14T01:24:19.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8da7b2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d4160150 0x7fc8d4166dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8da7b2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8d4071840 con 0x7fc8d41458d0 2024-05-14T01:24:19.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8da7b2640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8d4071b20 con 0x7fc8d40cf610 2024-05-14T01:24:19.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8da7b2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc8d406de50 con 0x7fc8d4160150 2024-05-14T01:24:19.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d3fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc8d41458d0 0x7fc8d4071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37030/0 (socket says 172.21.15.154:37030) 2024-05-14T01:24:19.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d3fff640 1 -- 172.21.15.154:0/3020293369 learned_addr learned my addr 172.21.15.154:0/3020293369 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:19.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d2ffd640 1 -- 172.21.15.154:0/3020293369 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4103736877 0 0) 0x7fc8d4071840 con 0x7fc8d41458d0 2024-05-14T01:24:19.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d8d4f640 1 --2- 172.21.15.154:0/3020293369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d4160150 0x7fc8d4166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d2ffd640 1 -- 172.21.15.154:0/3020293369 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8bc003530 con 0x7fc8d41458d0 2024-05-14T01:24:19.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d2ffd640 1 -- 172.21.15.154:0/3020293369 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1519572646 0 0) 0x7fc8bc003530 con 0x7fc8d41458d0 2024-05-14T01:24:19.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d2ffd640 1 -- 172.21.15.154:0/3020293369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d4160150 msgr2=0x7fc8d4166dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:19.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d2ffd640 1 --2- 172.21.15.154:0/3020293369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d4160150 0x7fc8d4166dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d2ffd640 1 -- 172.21.15.154:0/3020293369 >> v1:172.21.15.176:6789/0 conn(0x7fc8d40cf610 legacy=0x7fc8d415fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d2ffd640 1 -- 172.21.15.154:0/3020293369 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d4071e00 con 0x7fc8d41458d0 2024-05-14T01:24:19.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d2ffd640 1 -- 172.21.15.154:0/3020293369 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fc8cc001a00 con 0x7fc8d41458d0 2024-05-14T01:24:19.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d8d4f640 1 --2- 172.21.15.154:0/3020293369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d4160150 0x7fc8d4166dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:19.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d2ffd640 1 -- 172.21.15.154:0/3020293369 >> v1:172.21.15.154:6789/0 conn(0x7fc8d41458d0 legacy=0x7fc8d4071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d2ffd640 1 --2- 172.21.15.154:0/3020293369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8bc0039f0 0x7fc8bc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d2ffd640 1 --2- 172.21.15.154:0/3020293369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d4160150 0x7fc8bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d2ffd640 1 --2- 172.21.15.154:0/3020293369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc004d50 0x7fc8bc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d2ffd640 1 -- 172.21.15.154:0/3020293369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d406de50 con 0x7fc8bc0039f0 2024-05-14T01:24:19.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d2ffd640 1 -- 172.21.15.154:0/3020293369 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc00bb10 con 0x7fc8bc004d50 2024-05-14T01:24:19.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d2ffd640 1 -- 172.21.15.154:0/3020293369 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc8bc00bd10 con 0x7fc8d4160150 2024-05-14T01:24:19.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d3fff640 1 --2- 172.21.15.154:0/3020293369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8bc0039f0 0x7fc8bc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d8d4f640 1 --2- 172.21.15.154:0/3020293369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc004d50 0x7fc8bc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d37fe640 1 --2- 172.21.15.154:0/3020293369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d4160150 0x7fc8bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d3fff640 1 -- 172.21.15.154:0/3020293369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d4160150 msgr2=0x7fc8bc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:19.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d3fff640 1 --2- 172.21.15.154:0/3020293369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d4160150 0x7fc8bc004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d3fff640 1 -- 172.21.15.154:0/3020293369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc004d50 msgr2=0x7fc8bc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:19.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d3fff640 1 --2- 172.21.15.154:0/3020293369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc004d50 0x7fc8bc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d3fff640 1 -- 172.21.15.154:0/3020293369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8bc003530 con 0x7fc8bc0039f0 2024-05-14T01:24:19.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.268+0000 7fc8d8d4f640 1 --2- 172.21.15.154:0/3020293369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc004d50 0x7fc8bc0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:19.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8d3fff640 1 --2- 172.21.15.154:0/3020293369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8bc0039f0 0x7fc8bc003e10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00a810 tx=0x7fc8cc01d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71da1ee406dd56ef server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8d2ffd640 1 -- 172.21.15.154:0/3020293369 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc00a460 con 0x7fc8bc0039f0 2024-05-14T01:24:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8d2ffd640 1 -- 172.21.15.154:0/3020293369 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8cc0ad650 con 0x7fc8bc0039f0 2024-05-14T01:24:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8d2ffd640 1 -- 172.21.15.154:0/3020293369 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc0ada40 con 0x7fc8bc0039f0 2024-05-14T01:24:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8da7b2640 1 -- 172.21.15.154:0/3020293369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8bc0039f0 msgr2=0x7fc8bc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8da7b2640 1 --2- 172.21.15.154:0/3020293369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8bc0039f0 0x7fc8bc003e10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00a810 tx=0x7fc8cc01d280 comp rx=0 tx=0).stop 2024-05-14T01:24:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8d8d4f640 1 -- 172.21.15.154:0/3020293369 reap_dead start 2024-05-14T01:24:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8da7b2640 1 -- 172.21.15.154:0/3020293369 shutdown_connections 2024-05-14T01:24:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8da7b2640 1 -- 172.21.15.154:0/3020293369 >> 172.21.15.154:0/3020293369 conn(0x7fc8d40b1770 msgr2=0x7fc8d40b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8da7b2640 1 -- 172.21.15.154:0/3020293369 shutdown_connections 2024-05-14T01:24:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8da7b2640 1 -- 172.21.15.154:0/3020293369 wait complete. 2024-05-14T01:24:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8da7b2640 1 Processor -- start 2024-05-14T01:24:19.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8da7b2640 1 -- start start 2024-05-14T01:24:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8da7b2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d413e540 0x7fc8d4158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8da7b2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8d4158a70 0x7fc8d41404e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8da7b2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8d4140a20 0x7fc8d41442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8da7b2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d4167760 con 0x7fc8d4158a70 2024-05-14T01:24:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8da7b2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d41675e0 con 0x7fc8d4140a20 2024-05-14T01:24:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8da7b2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc8d41678e0 con 0x7fc8d413e540 2024-05-14T01:24:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8d37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8d4158a70 0x7fc8d41404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8d37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8d4158a70 0x7fc8d41404e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42690/0 (socket says 172.21.15.154:42690) 2024-05-14T01:24:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8d37fe640 1 -- 172.21.15.154:0/4069715248 learned_addr learned my addr 172.21.15.154:0/4069715248 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8d3fff640 1 --2- 172.21.15.154:0/4069715248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d413e540 0x7fc8d4158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8d37fe640 1 -- 172.21.15.154:0/4069715248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d413e540 msgr2=0x7fc8d4158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8d37fe640 1 --2- 172.21.15.154:0/4069715248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d413e540 0x7fc8d4158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8d37fe640 1 -- 172.21.15.154:0/4069715248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8d4140a20 msgr2=0x7fc8d41442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8d37fe640 1 --2- 172.21.15.154:0/4069715248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8d4140a20 0x7fc8d41442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8d37fe640 1 -- 172.21.15.154:0/4069715248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d41647e0 con 0x7fc8d4158a70 2024-05-14T01:24:19.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8d37fe640 1 --2- 172.21.15.154:0/4069715248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8d4158a70 0x7fc8d41404e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800d5a0 tx=0x7fc8c800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:19.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8d0ff9640 1 -- 172.21.15.154:0/4069715248 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8005480 con 0x7fc8d4158a70 2024-05-14T01:24:19.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8d0ff9640 1 -- 172.21.15.154:0/4069715248 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c8017070 con 0x7fc8d4158a70 2024-05-14T01:24:19.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8da7b2640 1 -- 172.21.15.154:0/4069715248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d4158280 con 0x7fc8d4158a70 2024-05-14T01:24:19.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8d0ff9640 1 -- 172.21.15.154:0/4069715248 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8003820 con 0x7fc8d4158a70 2024-05-14T01:24:19.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.272+0000 7fc8da7b2640 1 -- 172.21.15.154:0/4069715248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d41577a0 con 0x7fc8d4158a70 2024-05-14T01:24:19.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.276+0000 7fc8da7b2640 1 -- 172.21.15.154:0/4069715248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d4140e40 con 0x7fc8d4158a70 2024-05-14T01:24:19.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.276+0000 7fc8d0ff9640 1 -- 172.21.15.154:0/4069715248 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc8c80039c0 con 0x7fc8d4158a70 2024-05-14T01:24:19.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.276+0000 7fc8d0ff9640 1 --2- 172.21.15.154:0/4069715248 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc8c00678c0 0x7fc8c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.276+0000 7fc8d0ff9640 1 -- 172.21.15.154:0/4069715248 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fc8c8085990 con 0x7fc8d4158a70 2024-05-14T01:24:19.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.276+0000 7fc8d3fff640 1 --2- 172.21.15.154:0/4069715248 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc8c00678c0 0x7fc8c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.276+0000 7fc8d3fff640 1 --2- 172.21.15.154:0/4069715248 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc8c00678c0 0x7fc8c0069d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc0ad000 tx=0x7fc8cc007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:19.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.280+0000 7fc8d0ff9640 1 -- 172.21.15.154:0/4069715248 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fc8c8019310 con 0x7fc8d4158a70 2024-05-14T01:24:19.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.428+0000 7fc8da7b2640 1 -- 172.21.15.154:0/4069715248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc8d4075470 con 0x7fc8d4158a70 2024-05-14T01:24:19.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.428+0000 7fc8d0ff9640 1 -- 172.21.15.154:0/4069715248 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fc8c80564d0 con 0x7fc8d4158a70 2024-05-14T01:24:19.414 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-05-14T01:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.428+0000 7fc8da7b2640 1 -- 172.21.15.154:0/4069715248 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc8c00678c0 msgr2=0x7fc8c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.428+0000 7fc8da7b2640 1 --2- 172.21.15.154:0/4069715248 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc8c00678c0 0x7fc8c0069d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc0ad000 tx=0x7fc8cc007040 comp rx=0 tx=0).stop 2024-05-14T01:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.428+0000 7fc8da7b2640 1 -- 172.21.15.154:0/4069715248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8d4158a70 msgr2=0x7fc8d41404e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.428+0000 7fc8da7b2640 1 --2- 172.21.15.154:0/4069715248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8d4158a70 0x7fc8d41404e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800d5a0 tx=0x7fc8c800da60 comp rx=0 tx=0).stop 2024-05-14T01:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.428+0000 7fc8da7b2640 1 -- 172.21.15.154:0/4069715248 shutdown_connections 2024-05-14T01:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.428+0000 7fc8da7b2640 1 --2- 172.21.15.154:0/4069715248 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc8c00678c0 0x7fc8c0069d80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.428+0000 7fc8da7b2640 1 --2- 172.21.15.154:0/4069715248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8d4140a20 0x7fc8d41442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.428+0000 7fc8da7b2640 1 --2- 172.21.15.154:0/4069715248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8d4158a70 0x7fc8d41404e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.428+0000 7fc8da7b2640 1 --2- 172.21.15.154:0/4069715248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8d413e540 0x7fc8d4158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.428+0000 7fc8da7b2640 1 -- 172.21.15.154:0/4069715248 >> 172.21.15.154:0/4069715248 conn(0x7fc8d40b1770 msgr2=0x7fc8d40ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.428+0000 7fc8da7b2640 1 -- 172.21.15.154:0/4069715248 shutdown_connections 2024-05-14T01:24:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.428+0000 7fc8da7b2640 1 -- 172.21.15.154:0/4069715248 wait complete. 2024-05-14T01:24:19.432 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T01:24:19.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.556+0000 7fb2e6737640 1 Processor -- start 2024-05-14T01:24:19.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.556+0000 7fb2e6737640 1 -- start start 2024-05-14T01:24:19.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.556+0000 7fb2e6737640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2e0161550 0x7fb2e00afb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.556+0000 7fb2e6737640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb2e006fd70 0x7fb2e00b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.556+0000 7fb2e6737640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2e006ecb0 con 0x7fb2e0074280 2024-05-14T01:24:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.556+0000 7fb2e6737640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb2e00b0050 con 0x7fb2e006fd70 2024-05-14T01:24:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.556+0000 7fb2e6737640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb2e006ea60 con 0x7fb2e0161550 2024-05-14T01:24:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.556+0000 7fb2df7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb2e006fd70 0x7fb2e00b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.556+0000 7fb2df7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb2e006fd70 0x7fb2e00b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42694/0 (socket says 172.21.15.154:42694) 2024-05-14T01:24:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.556+0000 7fb2df7fe640 1 -- 172.21.15.154:0/185774946 learned_addr learned my addr 172.21.15.154:0/185774946 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.556+0000 7fb2dffff640 1 --2- 172.21.15.154:0/185774946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2e0161550 0x7fb2e00afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.556+0000 7fb2df7fe640 1 -- 172.21.15.154:0/185774946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2e0161550 msgr2=0x7fb2e00afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.556+0000 7fb2df7fe640 1 --2- 172.21.15.154:0/185774946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2e0161550 0x7fb2e00afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.556+0000 7fb2df7fe640 1 -- 172.21.15.154:0/185774946 >> v1:172.21.15.176:6789/0 conn(0x7fb2e0074280 legacy=0x7fb2e00746a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.556+0000 7fb2df7fe640 1 -- 172.21.15.154:0/185774946 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e006ef90 con 0x7fb2e006fd70 2024-05-14T01:24:19.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2df7fe640 1 --2- 172.21.15.154:0/185774946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e006fd70 0x7fb2e00b5a90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009870 tx=0x7fb2d401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a113129f522692f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:19.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2deffd640 1 -- 172.21.15.154:0/185774946 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d40b2070 con 0x7fb2e006fd70 2024-05-14T01:24:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2deffd640 1 -- 172.21.15.154:0/185774946 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2d40a9070 con 0x7fb2e006fd70 2024-05-14T01:24:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2deffd640 1 -- 172.21.15.154:0/185774946 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d40ad880 con 0x7fb2e006fd70 2024-05-14T01:24:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2e6737640 1 -- 172.21.15.154:0/185774946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e006fd70 msgr2=0x7fb2e00b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2e6737640 1 --2- 172.21.15.154:0/185774946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e006fd70 0x7fb2e00b5a90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009870 tx=0x7fb2d401c560 comp rx=0 tx=0).stop 2024-05-14T01:24:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2e6737640 1 -- 172.21.15.154:0/185774946 shutdown_connections 2024-05-14T01:24:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2e6737640 1 --2- 172.21.15.154:0/185774946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e006fd70 0x7fb2e00b5a90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2e6737640 1 --2- 172.21.15.154:0/185774946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2e0161550 0x7fb2e00afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2e6737640 1 -- 172.21.15.154:0/185774946 >> 172.21.15.154:0/185774946 conn(0x7fb2e00b3350 msgr2=0x7fb2e00d0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2e6737640 1 -- 172.21.15.154:0/185774946 shutdown_connections 2024-05-14T01:24:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2e6737640 1 -- 172.21.15.154:0/185774946 wait complete. 2024-05-14T01:24:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2e6737640 1 Processor -- start 2024-05-14T01:24:19.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2e6737640 1 -- start start 2024-05-14T01:24:19.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2e6737640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e006fd70 0x7fb2e0153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2e6737640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2e0074280 0x7fb2e015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2e6737640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2e0161550 0x7fb2e0144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2e6737640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e00b6150 con 0x7fb2e006fd70 2024-05-14T01:24:19.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2e6737640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e00b5fd0 con 0x7fb2e0074280 2024-05-14T01:24:19.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2e6737640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb2e016ade0 con 0x7fb2e0161550 2024-05-14T01:24:19.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2dffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e006fd70 0x7fb2e0153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2dffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e006fd70 0x7fb2e0153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42708/0 (socket says 172.21.15.154:42708) 2024-05-14T01:24:19.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2dffff640 1 -- 172.21.15.154:0/225970498 learned_addr learned my addr 172.21.15.154:0/225970498 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:19.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2dffff640 1 -- 172.21.15.154:0/225970498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2e0161550 msgr2=0x7fb2e0144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2dffff640 1 --2- 172.21.15.154:0/225970498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2e0161550 0x7fb2e0144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2df7fe640 1 --2- 172.21.15.154:0/225970498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2e0074280 0x7fb2e015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2dffff640 1 -- 172.21.15.154:0/225970498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2e0074280 msgr2=0x7fb2e015fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2dffff640 1 --2- 172.21.15.154:0/225970498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2e0074280 0x7fb2e015fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.560+0000 7fb2dffff640 1 -- 172.21.15.154:0/225970498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e00d1c80 con 0x7fb2e006fd70 2024-05-14T01:24:19.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.564+0000 7fb2dffff640 1 --2- 172.21.15.154:0/225970498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e006fd70 0x7fb2e0153ff0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000d5f0 tx=0x7fb2d000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:19.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.564+0000 7fb2dcff9640 1 -- 172.21.15.154:0/225970498 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d00125f0 con 0x7fb2e006fd70 2024-05-14T01:24:19.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.564+0000 7fb2dcff9640 1 -- 172.21.15.154:0/225970498 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2d0019070 con 0x7fb2e006fd70 2024-05-14T01:24:19.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.564+0000 7fb2e6737640 1 -- 172.21.15.154:0/225970498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e0159010 con 0x7fb2e006fd70 2024-05-14T01:24:19.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.564+0000 7fb2dcff9640 1 -- 172.21.15.154:0/225970498 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d00129d0 con 0x7fb2e006fd70 2024-05-14T01:24:19.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.564+0000 7fb2e6737640 1 -- 172.21.15.154:0/225970498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e015f1b0 con 0x7fb2e006fd70 2024-05-14T01:24:19.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.564+0000 7fb2e6737640 1 -- 172.21.15.154:0/225970498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2e0075470 con 0x7fb2e006fd70 2024-05-14T01:24:19.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.564+0000 7fb2dcff9640 1 -- 172.21.15.154:0/225970498 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb2d0012b70 con 0x7fb2e006fd70 2024-05-14T01:24:19.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.564+0000 7fb2dcff9640 1 --2- 172.21.15.154:0/225970498 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb2cc0678c0 0x7fb2cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.564+0000 7fb2df7fe640 1 --2- 172.21.15.154:0/225970498 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb2cc0678c0 0x7fb2cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.564+0000 7fb2dcff9640 1 -- 172.21.15.154:0/225970498 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fb2d00861f0 con 0x7fb2e006fd70 2024-05-14T01:24:19.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.564+0000 7fb2df7fe640 1 --2- 172.21.15.154:0/225970498 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb2cc0678c0 0x7fb2cc069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40af000 tx=0x7fb2d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:19.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.568+0000 7fb2dcff9640 1 -- 172.21.15.154:0/225970498 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb2d0056ca0 con 0x7fb2e006fd70 2024-05-14T01:24:19.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.728+0000 7fb2e6737640 1 -- 172.21.15.154:0/225970498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb2e006e840 con 0x7fb2e006fd70 2024-05-14T01:24:19.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.728+0000 7fb2dcff9640 1 -- 172.21.15.154:0/225970498 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fb2d00565a0 con 0x7fb2e006fd70 2024-05-14T01:24:19.716 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-05-14T01:24:19.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.732+0000 7fb2e6737640 1 -- 172.21.15.154:0/225970498 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb2cc0678c0 msgr2=0x7fb2cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.732+0000 7fb2e6737640 1 --2- 172.21.15.154:0/225970498 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb2cc0678c0 0x7fb2cc069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40af000 tx=0x7fb2d4008040 comp rx=0 tx=0).stop 2024-05-14T01:24:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.732+0000 7fb2e6737640 1 -- 172.21.15.154:0/225970498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e006fd70 msgr2=0x7fb2e0153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.732+0000 7fb2e6737640 1 --2- 172.21.15.154:0/225970498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e006fd70 0x7fb2e0153ff0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000d5f0 tx=0x7fb2d000dab0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.732+0000 7fb2e6737640 1 -- 172.21.15.154:0/225970498 shutdown_connections 2024-05-14T01:24:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.732+0000 7fb2e6737640 1 --2- 172.21.15.154:0/225970498 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb2cc0678c0 0x7fb2cc069d80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.732+0000 7fb2e6737640 1 --2- 172.21.15.154:0/225970498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2e0161550 0x7fb2e0144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.732+0000 7fb2e6737640 1 --2- 172.21.15.154:0/225970498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2e0074280 0x7fb2e015fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.732+0000 7fb2e6737640 1 --2- 172.21.15.154:0/225970498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e006fd70 0x7fb2e0153ff0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.732+0000 7fb2e6737640 1 -- 172.21.15.154:0/225970498 >> 172.21.15.154:0/225970498 conn(0x7fb2e00b3350 msgr2=0x7fb2e015e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.732+0000 7fb2e6737640 1 -- 172.21.15.154:0/225970498 shutdown_connections 2024-05-14T01:24:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.732+0000 7fb2e6737640 1 -- 172.21.15.154:0/225970498 wait complete. 2024-05-14T01:24:19.734 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi176.front.sepia.ceph.com... 2024-05-14T01:24:19.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:19.734 DEBUG:teuthology.orchestra.run.smithi176:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-05-14T01:24:19.749 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T01:24:19.749 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-05-14T01:24:19.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:19.749 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-14T01:24:19.798 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-14T01:24:19.798 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T01:24:19.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.920+0000 7f4bb52f1640 1 Processor -- start 2024-05-14T01:24:19.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.920+0000 7f4bb52f1640 1 -- start start 2024-05-14T01:24:19.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4bb52f1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bb0141d00 0x7f4bb00ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4bb52f1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bb00cf100 con 0x7f4bb013ede0 2024-05-14T01:24:19.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4bb52f1640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bb00cf3e0 con 0x7f4bb00ce880 2024-05-14T01:24:19.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4bb52f1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb006cff0 con 0x7f4bb0141d00 2024-05-14T01:24:19.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4baeffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4bb013ede0 0x7f4bb01415f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37040/0 (socket says 172.21.15.154:37040) 2024-05-14T01:24:19.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4baeffd640 1 -- 172.21.15.154:0/2048642039 learned_addr learned my addr 172.21.15.154:0/2048642039 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:19.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4badffb640 1 -- 172.21.15.154:0/2048642039 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2755199907 0 0) 0x7f4bb00cf100 con 0x7f4bb013ede0 2024-05-14T01:24:19.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4badffb640 1 -- 172.21.15.154:0/2048642039 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b9c003530 con 0x7f4bb013ede0 2024-05-14T01:24:19.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4bae7fc640 1 --2- 172.21.15.154:0/2048642039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bb0141d00 0x7f4bb00ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4badffb640 1 -- 172.21.15.154:0/2048642039 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 749297742 0 0) 0x7f4b9c003530 con 0x7f4bb013ede0 2024-05-14T01:24:19.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4badffb640 1 -- 172.21.15.154:0/2048642039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bb0141d00 msgr2=0x7f4bb00ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:19.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4badffb640 1 --2- 172.21.15.154:0/2048642039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bb0141d00 0x7f4bb00ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4badffb640 1 -- 172.21.15.154:0/2048642039 >> v1:172.21.15.176:6789/0 conn(0x7f4bb00ce880 legacy=0x7f4bb006d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4badffb640 1 -- 172.21.15.154:0/2048642039 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb006cc80 con 0x7f4bb013ede0 2024-05-14T01:24:19.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4badffb640 1 -- 172.21.15.154:0/2048642039 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f4ba0001680 con 0x7f4bb013ede0 2024-05-14T01:24:19.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4badffb640 1 -- 172.21.15.154:0/2048642039 >> v1:172.21.15.154:6789/0 conn(0x7f4bb013ede0 legacy=0x7f4bb01415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4badffb640 1 --2- 172.21.15.154:0/2048642039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b9c0039f0 0x7f4b9c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4badffb640 1 --2- 172.21.15.154:0/2048642039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bb0141d00 0x7f4b9c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4badffb640 1 --2- 172.21.15.154:0/2048642039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b9c004d50 0x7f4b9c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4badffb640 1 -- 172.21.15.154:0/2048642039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb006cff0 con 0x7f4b9c004d50 2024-05-14T01:24:19.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4badffb640 1 -- 172.21.15.154:0/2048642039 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c00bb60 con 0x7f4b9c0039f0 2024-05-14T01:24:19.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4badffb640 1 -- 172.21.15.154:0/2048642039 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4b9c00bd30 con 0x7f4bb0141d00 2024-05-14T01:24:19.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4baf7fe640 1 --2- 172.21.15.154:0/2048642039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b9c004d50 0x7f4b9c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4baeffd640 1 --2- 172.21.15.154:0/2048642039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b9c0039f0 0x7f4b9c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4bae7fc640 1 --2- 172.21.15.154:0/2048642039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bb0141d00 0x7f4b9c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4baf7fe640 1 -- 172.21.15.154:0/2048642039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bb0141d00 msgr2=0x7f4b9c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:19.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4baf7fe640 1 --2- 172.21.15.154:0/2048642039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bb0141d00 0x7f4b9c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4baf7fe640 1 -- 172.21.15.154:0/2048642039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b9c0039f0 msgr2=0x7f4b9c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:19.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4baf7fe640 1 --2- 172.21.15.154:0/2048642039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b9c0039f0 0x7f4b9c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4baf7fe640 1 -- 172.21.15.154:0/2048642039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9c003530 con 0x7f4b9c004d50 2024-05-14T01:24:19.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.924+0000 7f4baf7fe640 1 --2- 172.21.15.154:0/2048642039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b9c004d50 0x7f4b9c0051d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8001ea0 tx=0x7f4ba801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3cddc6451882b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:19.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4badffb640 1 -- 172.21.15.154:0/2048642039 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8001a90 con 0x7f4b9c004d50 2024-05-14T01:24:19.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4badffb640 1 -- 172.21.15.154:0/2048642039 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba8003b80 con 0x7f4b9c004d50 2024-05-14T01:24:19.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4badffb640 1 -- 172.21.15.154:0/2048642039 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8005080 con 0x7f4b9c004d50 2024-05-14T01:24:19.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bb52f1640 1 -- 172.21.15.154:0/2048642039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b9c004d50 msgr2=0x7f4b9c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bb52f1640 1 --2- 172.21.15.154:0/2048642039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b9c004d50 0x7f4b9c0051d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8001ea0 tx=0x7f4ba801c780 comp rx=0 tx=0).stop 2024-05-14T01:24:19.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4baf7fe640 1 -- 172.21.15.154:0/2048642039 reap_dead start 2024-05-14T01:24:19.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bb52f1640 1 -- 172.21.15.154:0/2048642039 shutdown_connections 2024-05-14T01:24:19.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bb52f1640 1 -- 172.21.15.154:0/2048642039 >> 172.21.15.154:0/2048642039 conn(0x7f4bb00b1850 msgr2=0x7f4bb00b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:19.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bb52f1640 1 -- 172.21.15.154:0/2048642039 shutdown_connections 2024-05-14T01:24:19.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bb52f1640 1 -- 172.21.15.154:0/2048642039 wait complete. 2024-05-14T01:24:19.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bb52f1640 1 Processor -- start 2024-05-14T01:24:19.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bb52f1640 1 -- start start 2024-05-14T01:24:19.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bb52f1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bb01525b0 0x7f4bb013d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bb52f1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bb013df30 0x7f4bb01556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bb52f1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bb0155c00 0x7f4bb0129cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bb52f1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb00cece0 con 0x7f4bb013df30 2024-05-14T01:24:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bb52f1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb013f1c0 con 0x7f4bb0155c00 2024-05-14T01:24:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bb52f1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb00cee60 con 0x7f4bb01525b0 2024-05-14T01:24:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bae7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bb013df30 0x7f4bb01556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bae7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bb013df30 0x7f4bb01556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42730/0 (socket says 172.21.15.154:42730) 2024-05-14T01:24:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bae7fc640 1 -- 172.21.15.154:0/2925753879 learned_addr learned my addr 172.21.15.154:0/2925753879 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4baeffd640 1 --2- 172.21.15.154:0/2925753879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bb01525b0 0x7f4bb013d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4baf7fe640 1 --2- 172.21.15.154:0/2925753879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bb0155c00 0x7f4bb0129cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bae7fc640 1 -- 172.21.15.154:0/2925753879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bb01525b0 msgr2=0x7f4bb013d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bae7fc640 1 --2- 172.21.15.154:0/2925753879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bb01525b0 0x7f4bb013d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bae7fc640 1 -- 172.21.15.154:0/2925753879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bb0155c00 msgr2=0x7f4bb0129cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bae7fc640 1 --2- 172.21.15.154:0/2925753879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bb0155c00 0x7f4bb0129cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bae7fc640 1 -- 172.21.15.154:0/2925753879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb0154620 con 0x7f4bb013df30 2024-05-14T01:24:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bae7fc640 1 --2- 172.21.15.154:0/2925753879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bb013df30 0x7f4bb01556c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800f650 tx=0x7f4b9800fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4ba77fe640 1 -- 172.21.15.154:0/2925753879 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b98019020 con 0x7f4bb013df30 2024-05-14T01:24:19.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4ba77fe640 1 -- 172.21.15.154:0/2925753879 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b9800d960 con 0x7f4bb013df30 2024-05-14T01:24:19.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bb52f1640 1 -- 172.21.15.154:0/2925753879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb0154900 con 0x7f4bb013df30 2024-05-14T01:24:19.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4ba77fe640 1 -- 172.21.15.154:0/2925753879 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9800dd50 con 0x7f4bb013df30 2024-05-14T01:24:19.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.928+0000 7f4bb52f1640 1 -- 172.21.15.154:0/2925753879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb0154ec0 con 0x7f4bb013df30 2024-05-14T01:24:19.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.932+0000 7f4bb52f1640 1 -- 172.21.15.154:0/2925753879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb0075470 con 0x7f4bb013df30 2024-05-14T01:24:19.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.932+0000 7f4ba77fe640 1 -- 172.21.15.154:0/2925753879 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b9801c020 con 0x7f4bb013df30 2024-05-14T01:24:19.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.932+0000 7f4ba77fe640 1 --2- 172.21.15.154:0/2925753879 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4b900678f0 0x7f4b90069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:19.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.932+0000 7f4baeffd640 1 --2- 172.21.15.154:0/2925753879 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4b900678f0 0x7f4b90069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:19.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.932+0000 7f4ba77fe640 1 -- 172.21.15.154:0/2925753879 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f4b98086570 con 0x7f4bb013df30 2024-05-14T01:24:19.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.932+0000 7f4baeffd640 1 --2- 172.21.15.154:0/2925753879 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4b900678f0 0x7f4b90069db0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0000c10 tx=0x7f4ba0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:19.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:19.936+0000 7f4ba77fe640 1 -- 172.21.15.154:0/2925753879 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f4b98023020 con 0x7f4bb013df30 2024-05-14T01:24:20.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.128+0000 7f4bb52f1640 1 -- 172.21.15.154:0/2925753879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bb006f180 con 0x7f4bb013df30 2024-05-14T01:24:20.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.128+0000 7f4ba77fe640 1 -- 172.21.15.154:0/2925753879 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f4b98057020 con 0x7f4bb013df30 2024-05-14T01:24:20.116 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:20.116 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2575586302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2575586302},{"type":"v1","addr":"172.21.15.154:6836","nonce":2575586302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3108110937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3108110937},{"type":"v1","addr":"172.21.15.154:6837","nonce":3108110937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/77727941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":77727941},{"type":"v1","addr":"172.21.15.176:6833","nonce":77727941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T01:23:34.570674+0000","modified":"2024-05-14T01:23:37.636442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6835/2614790445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2614790445},{"type":"v1","addr":"172.21.15.176:6835","nonce":2614790445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-14T01:24:20.117 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 8 2024-05-14T01:24:20.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.132+0000 7f4bb52f1640 1 -- 172.21.15.154:0/2925753879 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4b900678f0 msgr2=0x7f4b90069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:20.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.132+0000 7f4bb52f1640 1 --2- 172.21.15.154:0/2925753879 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4b900678f0 0x7f4b90069db0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0000c10 tx=0x7f4ba0009040 comp rx=0 tx=0).stop 2024-05-14T01:24:20.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.132+0000 7f4bb52f1640 1 -- 172.21.15.154:0/2925753879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bb013df30 msgr2=0x7f4bb01556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:20.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.132+0000 7f4bb52f1640 1 --2- 172.21.15.154:0/2925753879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bb013df30 0x7f4bb01556c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800f650 tx=0x7f4b9800fb10 comp rx=0 tx=0).stop 2024-05-14T01:24:20.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.132+0000 7f4bb52f1640 1 -- 172.21.15.154:0/2925753879 shutdown_connections 2024-05-14T01:24:20.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.132+0000 7f4bb52f1640 1 --2- 172.21.15.154:0/2925753879 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4b900678f0 0x7f4b90069db0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.132+0000 7f4bb52f1640 1 --2- 172.21.15.154:0/2925753879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bb0155c00 0x7f4bb0129cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.132+0000 7f4bb52f1640 1 --2- 172.21.15.154:0/2925753879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bb013df30 0x7f4bb01556c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.132+0000 7f4bb52f1640 1 --2- 172.21.15.154:0/2925753879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bb01525b0 0x7f4bb013d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.132+0000 7f4bb52f1640 1 -- 172.21.15.154:0/2925753879 >> 172.21.15.154:0/2925753879 conn(0x7f4bb00b1850 msgr2=0x7f4bb00b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:20.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.132+0000 7f4bb52f1640 1 -- 172.21.15.154:0/2925753879 shutdown_connections 2024-05-14T01:24:20.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.132+0000 7f4bb52f1640 1 -- 172.21.15.154:0/2925753879 wait complete. 2024-05-14T01:24:20.134 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:20.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.264+0000 7f50b93eb640 1 Processor -- start 2024-05-14T01:24:20.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.264+0000 7f50b93eb640 1 -- start start 2024-05-14T01:24:20.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b93eb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f50b4141d00 0x7f50b40ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:20.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b93eb640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f50b40ce880 0x7f50b406d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:20.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b93eb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50b40cf100 con 0x7f50b413ede0 2024-05-14T01:24:20.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b93eb640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f50b406cff0 con 0x7f50b4141d00 2024-05-14T01:24:20.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b93eb640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f50b40cf3e0 con 0x7f50b40ce880 2024-05-14T01:24:20.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b27fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f50b4141d00 0x7f50b40ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:20.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b2ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f50b413ede0 0x7f50b41415f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37044/0 (socket says 172.21.15.154:37044) 2024-05-14T01:24:20.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b2ffd640 1 -- 172.21.15.154:0/3134538881 learned_addr learned my addr 172.21.15.154:0/3134538881 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:20.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b27fc640 1 -- 172.21.15.154:0/3134538881 >> v2:172.21.15.176:3300/0 conn(0x7f50b40ce880 msgr2=0x7f50b406d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:20.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b27fc640 1 --2- 172.21.15.154:0/3134538881 >> v2:172.21.15.176:3300/0 conn(0x7f50b40ce880 0x7f50b406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b27fc640 1 -- 172.21.15.154:0/3134538881 >> v1:172.21.15.154:6789/0 conn(0x7f50b413ede0 legacy=0x7f50b41415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:20.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b27fc640 1 -- 172.21.15.154:0/3134538881 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b406cc80 con 0x7f50b4141d00 2024-05-14T01:24:20.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b1ffb640 1 -- 172.21.15.154:0/3134538881 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3641373540 0 0) 0x7f50b40cf100 con 0x7f50b413ede0 2024-05-14T01:24:20.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b27fc640 1 --2- 172.21.15.154:0/3134538881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50b4141d00 0x7f50b40ce340 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f509c0097c0 tx=0x7f509c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1bf17a2ea58a5c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:20.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b1ffb640 1 -- 172.21.15.154:0/3134538881 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c0ab5f0 con 0x7f50b4141d00 2024-05-14T01:24:20.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b1ffb640 1 -- 172.21.15.154:0/3134538881 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f509c0b0070 con 0x7f50b4141d00 2024-05-14T01:24:20.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b1ffb640 1 -- 172.21.15.154:0/3134538881 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c0ab9b0 con 0x7f50b4141d00 2024-05-14T01:24:20.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b93eb640 1 -- 172.21.15.154:0/3134538881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50b4141d00 msgr2=0x7f50b40ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:20.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b93eb640 1 --2- 172.21.15.154:0/3134538881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50b4141d00 0x7f50b40ce340 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f509c0097c0 tx=0x7f509c01c420 comp rx=0 tx=0).stop 2024-05-14T01:24:20.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b93eb640 1 -- 172.21.15.154:0/3134538881 shutdown_connections 2024-05-14T01:24:20.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b93eb640 1 --2- 172.21.15.154:0/3134538881 >> v2:172.21.15.176:3300/0 conn(0x7f50b40ce880 0x7f50b406d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b93eb640 1 --2- 172.21.15.154:0/3134538881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50b4141d00 0x7f50b40ce340 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b93eb640 1 -- 172.21.15.154:0/3134538881 >> 172.21.15.154:0/3134538881 conn(0x7f50b40b1850 msgr2=0x7f50b40b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:20.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b93eb640 1 -- 172.21.15.154:0/3134538881 shutdown_connections 2024-05-14T01:24:20.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.268+0000 7f50b93eb640 1 -- 172.21.15.154:0/3134538881 wait complete. 2024-05-14T01:24:20.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b93eb640 1 Processor -- start 2024-05-14T01:24:20.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b93eb640 1 -- start start 2024-05-14T01:24:20.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b93eb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50b40ce880 0x7f50b4155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:20.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b93eb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50b413ede0 0x7f50b4158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:20.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b93eb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50b4141d00 0x7f50b4158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:20.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b93eb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f50b406e350 con 0x7f50b413ede0 2024-05-14T01:24:20.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b93eb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f50b406e1d0 con 0x7f50b40ce880 2024-05-14T01:24:20.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b93eb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f50b406e4d0 con 0x7f50b4141d00 2024-05-14T01:24:20.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b27fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50b413ede0 0x7f50b4158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:20.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b27fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50b413ede0 0x7f50b4158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42740/0 (socket says 172.21.15.154:42740) 2024-05-14T01:24:20.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b27fc640 1 -- 172.21.15.154:0/189929105 learned_addr learned my addr 172.21.15.154:0/189929105 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b2ffd640 1 --2- 172.21.15.154:0/189929105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50b40ce880 0x7f50b4155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b37fe640 1 --2- 172.21.15.154:0/189929105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50b4141d00 0x7f50b4158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b27fc640 1 -- 172.21.15.154:0/189929105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50b4141d00 msgr2=0x7f50b4158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b27fc640 1 --2- 172.21.15.154:0/189929105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50b4141d00 0x7f50b4158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b27fc640 1 -- 172.21.15.154:0/189929105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50b40ce880 msgr2=0x7f50b4155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b27fc640 1 --2- 172.21.15.154:0/189929105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50b40ce880 0x7f50b4155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b27fc640 1 -- 172.21.15.154:0/189929105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b40b2170 con 0x7f50b413ede0 2024-05-14T01:24:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b37fe640 1 --2- 172.21.15.154:0/189929105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50b4141d00 0x7f50b4158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b27fc640 1 --2- 172.21.15.154:0/189929105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50b413ede0 0x7f50b4158000 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f509c0ad040 tx=0x7f509c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50ab7fe640 1 -- 172.21.15.154:0/189929105 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c0bf610 con 0x7f50b413ede0 2024-05-14T01:24:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50ab7fe640 1 -- 172.21.15.154:0/189929105 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f509c0bf7d0 con 0x7f50b413ede0 2024-05-14T01:24:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b93eb640 1 -- 172.21.15.154:0/189929105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50b40cdd10 con 0x7f50b413ede0 2024-05-14T01:24:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50ab7fe640 1 -- 172.21.15.154:0/189929105 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c0bfbc0 con 0x7f50b413ede0 2024-05-14T01:24:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b93eb640 1 -- 172.21.15.154:0/189929105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50b4157240 con 0x7f50b413ede0 2024-05-14T01:24:20.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50b93eb640 1 -- 172.21.15.154:0/189929105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50b4075470 con 0x7f50b413ede0 2024-05-14T01:24:20.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.272+0000 7f50ab7fe640 1 -- 172.21.15.154:0/189929105 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f509c0bd020 con 0x7f50b413ede0 2024-05-14T01:24:20.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.276+0000 7f50ab7fe640 1 --2- 172.21.15.154:0/189929105 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f50940678c0 0x7f5094069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:20.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.276+0000 7f50ab7fe640 1 -- 172.21.15.154:0/189929105 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f509c120350 con 0x7f50b413ede0 2024-05-14T01:24:20.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.276+0000 7f50b2ffd640 1 --2- 172.21.15.154:0/189929105 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f50940678c0 0x7f5094069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:20.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.276+0000 7f50b2ffd640 1 --2- 172.21.15.154:0/189929105 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f50940678c0 0x7f5094069d80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f50a4000f70 tx=0x7f50a4007b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:20.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.280+0000 7f50ab7fe640 1 -- 172.21.15.154:0/189929105 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f509c016010 con 0x7f50b413ede0 2024-05-14T01:24:20.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.428+0000 7f50b93eb640 1 -- 172.21.15.154:0/189929105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50b413b120 con 0x7f50b413ede0 2024-05-14T01:24:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.432+0000 7f50ab7fe640 1 -- 172.21.15.154:0/189929105 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16950 (secure 0 0 0) 0x7f509c0f0e00 con 0x7f50b413ede0 2024-05-14T01:24:20.418 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:20.418 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":23,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:24:16.454751+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:20.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.432+0000 7f50b93eb640 1 -- 172.21.15.154:0/189929105 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f50940678c0 msgr2=0x7f5094069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:20.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.432+0000 7f50b93eb640 1 --2- 172.21.15.154:0/189929105 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f50940678c0 0x7f5094069d80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f50a4000f70 tx=0x7f50a4007b60 comp rx=0 tx=0).stop 2024-05-14T01:24:20.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.432+0000 7f50b93eb640 1 -- 172.21.15.154:0/189929105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50b413ede0 msgr2=0x7f50b4158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:20.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.432+0000 7f50b93eb640 1 --2- 172.21.15.154:0/189929105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50b413ede0 0x7f50b4158000 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f509c0ad040 tx=0x7f509c01ac60 comp rx=0 tx=0).stop 2024-05-14T01:24:20.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.432+0000 7f50b93eb640 1 -- 172.21.15.154:0/189929105 shutdown_connections 2024-05-14T01:24:20.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.432+0000 7f50b93eb640 1 --2- 172.21.15.154:0/189929105 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f50940678c0 0x7f5094069d80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.432+0000 7f50b93eb640 1 --2- 172.21.15.154:0/189929105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50b4141d00 0x7f50b4158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.432+0000 7f50b93eb640 1 --2- 172.21.15.154:0/189929105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50b413ede0 0x7f50b4158000 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.432+0000 7f50b93eb640 1 --2- 172.21.15.154:0/189929105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50b40ce880 0x7f50b4155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.432+0000 7f50b93eb640 1 -- 172.21.15.154:0/189929105 >> 172.21.15.154:0/189929105 conn(0x7f50b40b1850 msgr2=0x7f50b4070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:20.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.432+0000 7f50b93eb640 1 -- 172.21.15.154:0/189929105 shutdown_connections 2024-05-14T01:24:20.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.432+0000 7f50b93eb640 1 -- 172.21.15.154:0/189929105 wait complete. 2024-05-14T01:24:20.436 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T01:23:33.083538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T01:23:33.556058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:24:20.437 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:24:20.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.572+0000 7ff07bf65640 1 Processor -- start 2024-05-14T01:24:20.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.572+0000 7ff07bf65640 1 -- start start 2024-05-14T01:24:20.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.576+0000 7ff07bf65640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0740cf1b0 0x7ff0740b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:20.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.576+0000 7ff07bf65640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0740cdcb0 con 0x7ff0740ced50 2024-05-14T01:24:20.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.576+0000 7ff07bf65640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0740cdf90 con 0x7ff074071ef0 2024-05-14T01:24:20.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.576+0000 7ff07bf65640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff0740ce8c0 con 0x7ff0740cf1b0 2024-05-14T01:24:20.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.576+0000 7ff07a502640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0740cf1b0 0x7ff0740b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:20.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.576+0000 7ff079500640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff0740ced50 0x7ff0740cd160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37058/0 (socket says 172.21.15.154:37058) 2024-05-14T01:24:20.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.576+0000 7ff079500640 1 -- 172.21.15.154:0/3677510782 learned_addr learned my addr 172.21.15.154:0/3677510782 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:20.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.576+0000 7ff07a502640 1 -- 172.21.15.154:0/3677510782 >> v1:172.21.15.176:6789/0 conn(0x7ff074071ef0 legacy=0x7ff0740722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:20.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.576+0000 7ff078cff640 1 -- 172.21.15.154:0/3677510782 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4231539517 0 0) 0x7ff0740cdcb0 con 0x7ff0740ced50 2024-05-14T01:24:20.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.576+0000 7ff07a502640 1 -- 172.21.15.154:0/3677510782 >> v1:172.21.15.154:6789/0 conn(0x7ff0740ced50 legacy=0x7ff0740cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:20.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.576+0000 7ff07a502640 1 -- 172.21.15.154:0/3677510782 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0740ce270 con 0x7ff0740cf1b0 2024-05-14T01:24:20.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff07a502640 1 --2- 172.21.15.154:0/3677510782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0740cf1b0 0x7ff0740b2a70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff06c009d90 tx=0x7ff06c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e915cfc289a256f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:20.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff078cff640 1 -- 172.21.15.154:0/3677510782 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c0b2070 con 0x7ff0740cf1b0 2024-05-14T01:24:20.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff078cff640 1 -- 172.21.15.154:0/3677510782 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06c0a5910 con 0x7ff0740cf1b0 2024-05-14T01:24:20.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff078cff640 1 -- 172.21.15.154:0/3677510782 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c0a5ce0 con 0x7ff0740cf1b0 2024-05-14T01:24:20.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff07bf65640 1 -- 172.21.15.154:0/3677510782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0740cf1b0 msgr2=0x7ff0740b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:20.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff07bf65640 1 --2- 172.21.15.154:0/3677510782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0740cf1b0 0x7ff0740b2a70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff06c009d90 tx=0x7ff06c01c940 comp rx=0 tx=0).stop 2024-05-14T01:24:20.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff07bf65640 1 -- 172.21.15.154:0/3677510782 shutdown_connections 2024-05-14T01:24:20.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff07bf65640 1 --2- 172.21.15.154:0/3677510782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0740cf1b0 0x7ff0740b2a70 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff07bf65640 1 -- 172.21.15.154:0/3677510782 >> 172.21.15.154:0/3677510782 conn(0x7ff0740b1770 msgr2=0x7ff0740b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:20.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff07bf65640 1 -- 172.21.15.154:0/3677510782 shutdown_connections 2024-05-14T01:24:20.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff07bf65640 1 -- 172.21.15.154:0/3677510782 wait complete. 2024-05-14T01:24:20.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff07bf65640 1 Processor -- start 2024-05-14T01:24:20.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff07bf65640 1 -- start start 2024-05-14T01:24:20.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff07bf65640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff074071ef0 0x7ff074140f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:20.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff07bf65640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0740ced50 0x7ff074135c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:20.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff07bf65640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0740cf1b0 0x7ff07414da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:20.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff07bf65640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff0740cd9f0 con 0x7ff074071ef0 2024-05-14T01:24:20.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff07bf65640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff0740cd870 con 0x7ff0740ced50 2024-05-14T01:24:20.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff07bf65640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff0741695f0 con 0x7ff0740cf1b0 2024-05-14T01:24:20.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff079d01640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff074071ef0 0x7ff074140f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:20.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff079d01640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff074071ef0 0x7ff074140f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42760/0 (socket says 172.21.15.154:42760) 2024-05-14T01:24:20.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.580+0000 7ff079d01640 1 -- 172.21.15.154:0/3715885643 learned_addr learned my addr 172.21.15.154:0/3715885643 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:20.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff079500640 1 --2- 172.21.15.154:0/3715885643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0740ced50 0x7ff074135c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:20.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff079d01640 1 -- 172.21.15.154:0/3715885643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0740cf1b0 msgr2=0x7ff07414da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:20.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff079d01640 1 --2- 172.21.15.154:0/3715885643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0740cf1b0 0x7ff07414da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff079d01640 1 -- 172.21.15.154:0/3715885643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0740ced50 msgr2=0x7ff074135c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:20.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff079d01640 1 --2- 172.21.15.154:0/3715885643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0740ced50 0x7ff074135c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff079d01640 1 -- 172.21.15.154:0/3715885643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff07414c9e0 con 0x7ff074071ef0 2024-05-14T01:24:20.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff079500640 1 --2- 172.21.15.154:0/3715885643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0740ced50 0x7ff074135c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:20.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff079d01640 1 --2- 172.21.15.154:0/3715885643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff074071ef0 0x7ff074140f40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff06400c500 tx=0x7ff06400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:20.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff0727fc640 1 -- 172.21.15.154:0/3715885643 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064016020 con 0x7ff074071ef0 2024-05-14T01:24:20.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff0727fc640 1 -- 172.21.15.154:0/3715885643 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff064005220 con 0x7ff074071ef0 2024-05-14T01:24:20.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff07bf65640 1 -- 172.21.15.154:0/3715885643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff07414ccc0 con 0x7ff074071ef0 2024-05-14T01:24:20.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff0727fc640 1 -- 172.21.15.154:0/3715885643 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064007030 con 0x7ff074071ef0 2024-05-14T01:24:20.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff07bf65640 1 -- 172.21.15.154:0/3715885643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff07414d280 con 0x7ff074071ef0 2024-05-14T01:24:20.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff07bf65640 1 -- 172.21.15.154:0/3715885643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff074075470 con 0x7ff074071ef0 2024-05-14T01:24:20.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff0727fc640 1 -- 172.21.15.154:0/3715885643 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff0640071f0 con 0x7ff074071ef0 2024-05-14T01:24:20.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff0727fc640 1 --2- 172.21.15.154:0/3715885643 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff0600678c0 0x7ff060069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:20.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff079500640 1 --2- 172.21.15.154:0/3715885643 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff0600678c0 0x7ff060069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:20.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff0727fc640 1 -- 172.21.15.154:0/3715885643 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7ff0640851a0 con 0x7ff074071ef0 2024-05-14T01:24:20.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.584+0000 7ff079500640 1 --2- 172.21.15.154:0/3715885643 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff0600678c0 0x7ff060069d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff07414c3b0 tx=0x7ff068009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:20.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.588+0000 7ff0727fc640 1 -- 172.21.15.154:0/3715885643 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7ff064055c60 con 0x7ff074071ef0 2024-05-14T01:24:20.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.748+0000 7ff07bf65640 1 -- 172.21.15.154:0/3715885643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff07406d0f0 con 0x7ff074071ef0 2024-05-14T01:24:20.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.748+0000 7ff0727fc640 1 -- 172.21.15.154:0/3715885643 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7ff064055560 con 0x7ff074071ef0 2024-05-14T01:24:20.735 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:24:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.748+0000 7ff07bf65640 1 -- 172.21.15.154:0/3715885643 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff0600678c0 msgr2=0x7ff060069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.748+0000 7ff07bf65640 1 --2- 172.21.15.154:0/3715885643 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff0600678c0 0x7ff060069d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff07414c3b0 tx=0x7ff068009040 comp rx=0 tx=0).stop 2024-05-14T01:24:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.748+0000 7ff07bf65640 1 -- 172.21.15.154:0/3715885643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff074071ef0 msgr2=0x7ff074140f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.748+0000 7ff07bf65640 1 --2- 172.21.15.154:0/3715885643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff074071ef0 0x7ff074140f40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff06400c500 tx=0x7ff06400c9c0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.748+0000 7ff07bf65640 1 -- 172.21.15.154:0/3715885643 shutdown_connections 2024-05-14T01:24:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.748+0000 7ff07bf65640 1 --2- 172.21.15.154:0/3715885643 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff0600678c0 0x7ff060069d80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.748+0000 7ff07bf65640 1 --2- 172.21.15.154:0/3715885643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0740cf1b0 0x7ff07414da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.748+0000 7ff07bf65640 1 --2- 172.21.15.154:0/3715885643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0740ced50 0x7ff074135c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.748+0000 7ff07bf65640 1 --2- 172.21.15.154:0/3715885643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff074071ef0 0x7ff074140f40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.748+0000 7ff07bf65640 1 -- 172.21.15.154:0/3715885643 >> 172.21.15.154:0/3715885643 conn(0x7ff0740b1770 msgr2=0x7ff074141d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:20.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.748+0000 7ff07bf65640 1 -- 172.21.15.154:0/3715885643 shutdown_connections 2024-05-14T01:24:20.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.748+0000 7ff07bf65640 1 -- 172.21.15.154:0/3715885643 wait complete. 2024-05-14T01:24:20.752 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T01:24:20.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.876+0000 7f06bf9d8640 1 Processor -- start 2024-05-14T01:24:20.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.876+0000 7f06bf9d8640 1 -- start start 2024-05-14T01:24:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.876+0000 7f06bf9d8640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f06b8071ef0 0x7f06b80722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.876+0000 7f06bf9d8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f06b80cf1b0 0x7f06b80b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.876+0000 7f06bf9d8640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b8072810 con 0x7f06b80ced50 2024-05-14T01:24:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.876+0000 7f06bf9d8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f06b80ce8c0 con 0x7f06b80cf1b0 2024-05-14T01:24:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.876+0000 7f06bf9d8640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f06b80cdcb0 con 0x7f06b8071ef0 2024-05-14T01:24:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.876+0000 7f06bdf75640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f06b80cf1b0 0x7f06b80b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.876+0000 7f06bdf75640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f06b80cf1b0 0x7f06b80b2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42768/0 (socket says 172.21.15.154:42768) 2024-05-14T01:24:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.876+0000 7f06bdf75640 1 -- 172.21.15.154:0/501652282 learned_addr learned my addr 172.21.15.154:0/501652282 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.876+0000 7f06bd774640 1 --2- 172.21.15.154:0/501652282 >> v2:172.21.15.176:3300/0 conn(0x7f06b8071ef0 0x7f06b80722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.876+0000 7f06bdf75640 1 -- 172.21.15.154:0/501652282 >> v2:172.21.15.176:3300/0 conn(0x7f06b8071ef0 msgr2=0x7f06b80722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.876+0000 7f06bdf75640 1 --2- 172.21.15.154:0/501652282 >> v2:172.21.15.176:3300/0 conn(0x7f06b8071ef0 0x7f06b80722d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.876+0000 7f06bdf75640 1 -- 172.21.15.154:0/501652282 >> v1:172.21.15.176:6789/0 conn(0x7f06b80ced50 legacy=0x7f06b80cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:20.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.876+0000 7f06bdf75640 1 -- 172.21.15.154:0/501652282 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b80cdf90 con 0x7f06b80cf1b0 2024-05-14T01:24:20.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.876+0000 7f06bdf75640 1 --2- 172.21.15.154:0/501652282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06b80cf1b0 0x7f06b80b2a70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f06b8073a40 tx=0x7f06b001eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5351065f8bb0122a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:20.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06b7fff640 1 -- 172.21.15.154:0/501652282 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b000b2d0 con 0x7f06b80cf1b0 2024-05-14T01:24:20.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06b7fff640 1 -- 172.21.15.154:0/501652282 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b000b470 con 0x7f06b80cf1b0 2024-05-14T01:24:20.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06b7fff640 1 -- 172.21.15.154:0/501652282 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b00a7a80 con 0x7f06b80cf1b0 2024-05-14T01:24:20.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bf9d8640 1 -- 172.21.15.154:0/501652282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06b80cf1b0 msgr2=0x7f06b80b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:20.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bf9d8640 1 --2- 172.21.15.154:0/501652282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06b80cf1b0 0x7f06b80b2a70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f06b8073a40 tx=0x7f06b001eb80 comp rx=0 tx=0).stop 2024-05-14T01:24:20.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bf9d8640 1 -- 172.21.15.154:0/501652282 shutdown_connections 2024-05-14T01:24:20.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bf9d8640 1 --2- 172.21.15.154:0/501652282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06b80cf1b0 0x7f06b80b2a70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bf9d8640 1 --2- 172.21.15.154:0/501652282 >> v2:172.21.15.176:3300/0 conn(0x7f06b8071ef0 0x7f06b80722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bf9d8640 1 -- 172.21.15.154:0/501652282 >> 172.21.15.154:0/501652282 conn(0x7f06b80b1770 msgr2=0x7f06b80b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:20.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bf9d8640 1 -- 172.21.15.154:0/501652282 shutdown_connections 2024-05-14T01:24:20.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bf9d8640 1 -- 172.21.15.154:0/501652282 wait complete. 2024-05-14T01:24:20.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bf9d8640 1 Processor -- start 2024-05-14T01:24:20.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bf9d8640 1 -- start start 2024-05-14T01:24:20.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bf9d8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06b8071ef0 0x7f06b81559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bf9d8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06b80ced50 0x7f06b8158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bf9d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06b80cf1b0 0x7f06b8158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bf9d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f06b806eb10 con 0x7f06b80cf1b0 2024-05-14T01:24:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bf9d8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f06b806e990 con 0x7f06b80ced50 2024-05-14T01:24:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bf9d8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f06b80cd870 con 0x7f06b8071ef0 2024-05-14T01:24:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bdf75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06b80cf1b0 0x7f06b8158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bdf75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06b80cf1b0 0x7f06b8158f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42782/0 (socket says 172.21.15.154:42782) 2024-05-14T01:24:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bdf75640 1 -- 172.21.15.154:0/1629541265 learned_addr learned my addr 172.21.15.154:0/1629541265 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bcf73640 1 --2- 172.21.15.154:0/1629541265 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06b80ced50 0x7f06b8158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bd774640 1 --2- 172.21.15.154:0/1629541265 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06b8071ef0 0x7f06b81559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bdf75640 1 -- 172.21.15.154:0/1629541265 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06b8071ef0 msgr2=0x7f06b81559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bdf75640 1 --2- 172.21.15.154:0/1629541265 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06b8071ef0 0x7f06b81559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bdf75640 1 -- 172.21.15.154:0/1629541265 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06b80ced50 msgr2=0x7f06b8158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:20.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bdf75640 1 --2- 172.21.15.154:0/1629541265 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06b80ced50 0x7f06b8158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:20.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bdf75640 1 -- 172.21.15.154:0/1629541265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b80cb920 con 0x7f06b80cf1b0 2024-05-14T01:24:20.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bdf75640 1 --2- 172.21.15.154:0/1629541265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06b80cf1b0 0x7f06b8158f70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f06b001d230 tx=0x7f06b001b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:20.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06b5ffb640 1 -- 172.21.15.154:0/1629541265 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b000b720 con 0x7f06b80cf1b0 2024-05-14T01:24:20.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06b5ffb640 1 -- 172.21.15.154:0/1629541265 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b00c0070 con 0x7f06b80cf1b0 2024-05-14T01:24:20.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bf9d8640 1 -- 172.21.15.154:0/1629541265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b80cb640 con 0x7f06b80cf1b0 2024-05-14T01:24:20.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06b5ffb640 1 -- 172.21.15.154:0/1629541265 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0009a40 con 0x7f06b80cf1b0 2024-05-14T01:24:20.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.880+0000 7f06bf9d8640 1 -- 172.21.15.154:0/1629541265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b81f3060 con 0x7f06b80cf1b0 2024-05-14T01:24:20.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.884+0000 7f06bf9d8640 1 -- 172.21.15.154:0/1629541265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06b8075470 con 0x7f06b80cf1b0 2024-05-14T01:24:20.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.884+0000 7f06b5ffb640 1 -- 172.21.15.154:0/1629541265 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f06b000b2e0 con 0x7f06b80cf1b0 2024-05-14T01:24:20.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.884+0000 7f06b5ffb640 1 --2- 172.21.15.154:0/1629541265 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f06a40678c0 0x7f06a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:20.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.884+0000 7f06b5ffb640 1 -- 172.21.15.154:0/1629541265 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f06b0122ed0 con 0x7f06b80cf1b0 2024-05-14T01:24:20.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.884+0000 7f06bd774640 1 --2- 172.21.15.154:0/1629541265 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f06a40678c0 0x7f06a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:20.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.884+0000 7f06bd774640 1 --2- 172.21.15.154:0/1629541265 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f06a40678c0 0x7f06a4069d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f06a800b9d0 tx=0x7f06a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:20.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:20.888+0000 7f06b5ffb640 1 -- 172.21.15.154:0/1629541265 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f06b00187a0 con 0x7f06b80cf1b0 2024-05-14T01:24:21.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.036+0000 7f06bf9d8640 1 -- 172.21.15.154:0/1629541265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f06b806d0f0 con 0x7f06b80cf1b0 2024-05-14T01:24:21.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.036+0000 7f06b5ffb640 1 -- 172.21.15.154:0/1629541265 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f06b00f3990 con 0x7f06b80cf1b0 2024-05-14T01:24:21.023 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-05-14T01:24:21.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.036+0000 7f06bf9d8640 1 -- 172.21.15.154:0/1629541265 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f06a40678c0 msgr2=0x7f06a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.036+0000 7f06bf9d8640 1 --2- 172.21.15.154:0/1629541265 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f06a40678c0 0x7f06a4069d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f06a800b9d0 tx=0x7f06a8008040 comp rx=0 tx=0).stop 2024-05-14T01:24:21.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.036+0000 7f06bf9d8640 1 -- 172.21.15.154:0/1629541265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06b80cf1b0 msgr2=0x7f06b8158f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.036+0000 7f06bf9d8640 1 --2- 172.21.15.154:0/1629541265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06b80cf1b0 0x7f06b8158f70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f06b001d230 tx=0x7f06b001b920 comp rx=0 tx=0).stop 2024-05-14T01:24:21.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.036+0000 7f06bf9d8640 1 -- 172.21.15.154:0/1629541265 shutdown_connections 2024-05-14T01:24:21.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.036+0000 7f06bf9d8640 1 --2- 172.21.15.154:0/1629541265 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f06a40678c0 0x7f06a4069d80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.036+0000 7f06bf9d8640 1 --2- 172.21.15.154:0/1629541265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06b80cf1b0 0x7f06b8158f70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.036+0000 7f06bf9d8640 1 --2- 172.21.15.154:0/1629541265 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06b80ced50 0x7f06b8158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.036+0000 7f06bf9d8640 1 --2- 172.21.15.154:0/1629541265 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06b8071ef0 0x7f06b81559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.036+0000 7f06bf9d8640 1 -- 172.21.15.154:0/1629541265 >> 172.21.15.154:0/1629541265 conn(0x7f06b80b1770 msgr2=0x7f06b8070e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:21.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.036+0000 7f06bf9d8640 1 -- 172.21.15.154:0/1629541265 shutdown_connections 2024-05-14T01:24:21.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.036+0000 7f06bf9d8640 1 -- 172.21.15.154:0/1629541265 wait complete. 2024-05-14T01:24:21.041 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T01:24:21.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fcb67d640 1 Processor -- start 2024-05-14T01:24:21.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fcb67d640 1 -- start start 2024-05-14T01:24:21.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fcb67d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fc40d0210 0x7f8fc40d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fcb67d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fc40cf580 con 0x7f8fc40cd390 2024-05-14T01:24:21.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fcb67d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fc40d0b30 con 0x7f8fc40b3080 2024-05-14T01:24:21.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fcb67d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8fc40d1e10 con 0x7f8fc40d0210 2024-05-14T01:24:21.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fc8c18640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8fc40cd390 0x7f8fc40ce760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37064/0 (socket says 172.21.15.154:37064) 2024-05-14T01:24:21.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fc8c18640 1 -- 172.21.15.154:0/3947121063 learned_addr learned my addr 172.21.15.154:0/3947121063 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:21.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fc9419640 1 --2- 172.21.15.154:0/3947121063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fc40d0210 0x7f8fc40d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:21.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fbbfff640 1 -- 172.21.15.154:0/3947121063 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 120543371 0 0) 0x7f8fc40cf580 con 0x7f8fc40cd390 2024-05-14T01:24:21.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fbbfff640 1 -- 172.21.15.154:0/3947121063 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fb0003530 con 0x7f8fc40cd390 2024-05-14T01:24:21.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fbbfff640 1 -- 172.21.15.154:0/3947121063 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 70153539 0 0) 0x7f8fb0003530 con 0x7f8fc40cd390 2024-05-14T01:24:21.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fbbfff640 1 -- 172.21.15.154:0/3947121063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fc40d0210 msgr2=0x7f8fc40d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:21.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fbbfff640 1 --2- 172.21.15.154:0/3947121063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fc40d0210 0x7f8fc40d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fbbfff640 1 -- 172.21.15.154:0/3947121063 >> v1:172.21.15.176:6789/0 conn(0x7f8fc40b3080 legacy=0x7f8fc40cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fbbfff640 1 -- 172.21.15.154:0/3947121063 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc40cdf70 con 0x7f8fc40cd390 2024-05-14T01:24:21.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fbbfff640 1 -- 172.21.15.154:0/3947121063 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f8fb4001680 con 0x7f8fc40cd390 2024-05-14T01:24:21.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fbbfff640 1 -- 172.21.15.154:0/3947121063 >> v1:172.21.15.154:6789/0 conn(0x7f8fc40cd390 legacy=0x7f8fc40ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fbbfff640 1 --2- 172.21.15.154:0/3947121063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb00039f0 0x7f8fb0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fbbfff640 1 --2- 172.21.15.154:0/3947121063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fc40d0210 0x7f8fb0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fbbfff640 1 --2- 172.21.15.154:0/3947121063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fb0004d50 0x7f8fb00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fbbfff640 1 -- 172.21.15.154:0/3947121063 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb000bb60 con 0x7f8fb00039f0 2024-05-14T01:24:21.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fbbfff640 1 -- 172.21.15.154:0/3947121063 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb000bce0 con 0x7f8fb0004d50 2024-05-14T01:24:21.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fbbfff640 1 -- 172.21.15.154:0/3947121063 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb000bee0 con 0x7f8fc40d0210 2024-05-14T01:24:21.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fc9419640 1 --2- 172.21.15.154:0/3947121063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb00039f0 0x7f8fb0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:21.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fc9419640 1 -- 172.21.15.154:0/3947121063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fc40d0210 msgr2=0x7f8fb0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:21.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fc9419640 1 --2- 172.21.15.154:0/3947121063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fc40d0210 0x7f8fb0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fc9419640 1 -- 172.21.15.154:0/3947121063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fb0004d50 msgr2=0x7f8fb00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:21.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fc9419640 1 --2- 172.21.15.154:0/3947121063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fb0004d50 0x7f8fb00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.172+0000 7f8fc9419640 1 -- 172.21.15.154:0/3947121063 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb0003530 con 0x7f8fb00039f0 2024-05-14T01:24:21.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fc9419640 1 --2- 172.21.15.154:0/3947121063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb00039f0 0x7f8fb0003e10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0009ae0 tx=0x7f8fc001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3490661f163678b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:21.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fbbfff640 1 -- 172.21.15.154:0/3947121063 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc00096b0 con 0x7f8fb00039f0 2024-05-14T01:24:21.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fbbfff640 1 -- 172.21.15.154:0/3947121063 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc00a6490 con 0x7f8fb00039f0 2024-05-14T01:24:21.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fbbfff640 1 -- 172.21.15.154:0/3947121063 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc00a6880 con 0x7f8fb00039f0 2024-05-14T01:24:21.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fcb67d640 1 -- 172.21.15.154:0/3947121063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb00039f0 msgr2=0x7f8fb0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fcb67d640 1 --2- 172.21.15.154:0/3947121063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb00039f0 0x7f8fb0003e10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0009ae0 tx=0x7f8fc001cab0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fc9c1a640 1 -- 172.21.15.154:0/3947121063 reap_dead start 2024-05-14T01:24:21.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fcb67d640 1 -- 172.21.15.154:0/3947121063 shutdown_connections 2024-05-14T01:24:21.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fcb67d640 1 -- 172.21.15.154:0/3947121063 >> 172.21.15.154:0/3947121063 conn(0x7f8fc409aa10 msgr2=0x7f8fc409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:21.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fcb67d640 1 -- 172.21.15.154:0/3947121063 shutdown_connections 2024-05-14T01:24:21.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fcb67d640 1 -- 172.21.15.154:0/3947121063 wait complete. 2024-05-14T01:24:21.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fcb67d640 1 Processor -- start 2024-05-14T01:24:21.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fcb67d640 1 -- start start 2024-05-14T01:24:21.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fcb67d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fb00039f0 0x7f8fc415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fcb67d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fc41512f0 0x7f8fc40af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fcb67d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fc415cfb0 0x7f8fc415d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fcb67d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc415c420 con 0x7f8fc415cfb0 2024-05-14T01:24:21.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fcb67d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc415c2a0 con 0x7f8fc41512f0 2024-05-14T01:24:21.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fcb67d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8fc4168340 con 0x7f8fb00039f0 2024-05-14T01:24:21.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fc9c1a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fc415cfb0 0x7f8fc415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:21.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fc9c1a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fc415cfb0 0x7f8fc415d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42798/0 (socket says 172.21.15.154:42798) 2024-05-14T01:24:21.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fc9c1a640 1 -- 172.21.15.154:0/1086786652 learned_addr learned my addr 172.21.15.154:0/1086786652 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:21.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fc8c18640 1 --2- 172.21.15.154:0/1086786652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fc41512f0 0x7f8fc40af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:21.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fc9c1a640 1 -- 172.21.15.154:0/1086786652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fb00039f0 msgr2=0x7f8fc415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fc9c1a640 1 --2- 172.21.15.154:0/1086786652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fb00039f0 0x7f8fc415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fc9c1a640 1 -- 172.21.15.154:0/1086786652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fc41512f0 msgr2=0x7f8fc40af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fc9c1a640 1 --2- 172.21.15.154:0/1086786652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fc41512f0 0x7f8fc40af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fc9c1a640 1 -- 172.21.15.154:0/1086786652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc40af7a0 con 0x7f8fc415cfb0 2024-05-14T01:24:21.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.176+0000 7f8fc8c18640 1 --2- 172.21.15.154:0/1086786652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fc41512f0 0x7f8fc40af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:21.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.180+0000 7f8fc9c1a640 1 --2- 172.21.15.154:0/1086786652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fc415cfb0 0x7f8fc415d430 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40cc670 tx=0x7f8fbc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:21.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.180+0000 7f8fb9ffb640 1 -- 172.21.15.154:0/1086786652 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc017070 con 0x7f8fc415cfb0 2024-05-14T01:24:21.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.180+0000 7f8fb9ffb640 1 -- 172.21.15.154:0/1086786652 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fbc005d50 con 0x7f8fc415cfb0 2024-05-14T01:24:21.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.180+0000 7f8fb9ffb640 1 -- 172.21.15.154:0/1086786652 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc00a850 con 0x7f8fc415cfb0 2024-05-14T01:24:21.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.180+0000 7f8fcb67d640 1 -- 172.21.15.154:0/1086786652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc40afa50 con 0x7f8fc415cfb0 2024-05-14T01:24:21.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.180+0000 7f8fcb67d640 1 -- 172.21.15.154:0/1086786652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc40b0010 con 0x7f8fc415cfb0 2024-05-14T01:24:21.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.180+0000 7f8fcb67d640 1 -- 172.21.15.154:0/1086786652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc40c9fc0 con 0x7f8fc415cfb0 2024-05-14T01:24:21.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.180+0000 7f8fb9ffb640 1 -- 172.21.15.154:0/1086786652 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8fbc01a070 con 0x7f8fc415cfb0 2024-05-14T01:24:21.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.180+0000 7f8fb9ffb640 1 --2- 172.21.15.154:0/1086786652 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8fa80678f0 0x7f8fa8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.180+0000 7f8fc9419640 1 --2- 172.21.15.154:0/1086786652 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8fa80678f0 0x7f8fa8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:21.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.180+0000 7f8fb9ffb640 1 -- 172.21.15.154:0/1086786652 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f8fbc084d50 con 0x7f8fc415cfb0 2024-05-14T01:24:21.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.180+0000 7f8fc9419640 1 --2- 172.21.15.154:0/1086786652 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8fa80678f0 0x7f8fa8069db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00ad000 tx=0x7f8fc0004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:21.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.184+0000 7f8fb9ffb640 1 -- 172.21.15.154:0/1086786652 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f8fbc088030 con 0x7f8fc415cfb0 2024-05-14T01:24:21.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.332+0000 7f8fcb67d640 1 -- 172.21.15.154:0/1086786652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8fc4068360 con 0x7f8fc415cfb0 2024-05-14T01:24:21.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.332+0000 7f8fb9ffb640 1 -- 172.21.15.154:0/1086786652 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f8fbc055800 con 0x7f8fc415cfb0 2024-05-14T01:24:21.319 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-05-14T01:24:21.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.332+0000 7f8fcb67d640 1 -- 172.21.15.154:0/1086786652 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8fa80678f0 msgr2=0x7f8fa8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.332+0000 7f8fcb67d640 1 --2- 172.21.15.154:0/1086786652 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8fa80678f0 0x7f8fa8069db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00ad000 tx=0x7f8fc0004740 comp rx=0 tx=0).stop 2024-05-14T01:24:21.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.332+0000 7f8fcb67d640 1 -- 172.21.15.154:0/1086786652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fc415cfb0 msgr2=0x7f8fc415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.332+0000 7f8fcb67d640 1 --2- 172.21.15.154:0/1086786652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fc415cfb0 0x7f8fc415d430 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40cc670 tx=0x7f8fbc00cb90 comp rx=0 tx=0).stop 2024-05-14T01:24:21.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.332+0000 7f8fcb67d640 1 -- 172.21.15.154:0/1086786652 shutdown_connections 2024-05-14T01:24:21.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.332+0000 7f8fcb67d640 1 --2- 172.21.15.154:0/1086786652 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8fa80678f0 0x7f8fa8069db0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.332+0000 7f8fcb67d640 1 --2- 172.21.15.154:0/1086786652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fc415cfb0 0x7f8fc415d430 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.332+0000 7f8fcb67d640 1 --2- 172.21.15.154:0/1086786652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fc41512f0 0x7f8fc40af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.332+0000 7f8fcb67d640 1 --2- 172.21.15.154:0/1086786652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fb00039f0 0x7f8fc415ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.332+0000 7f8fcb67d640 1 -- 172.21.15.154:0/1086786652 >> 172.21.15.154:0/1086786652 conn(0x7f8fc409aa10 msgr2=0x7f8fc40b4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:21.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.332+0000 7f8fcb67d640 1 -- 172.21.15.154:0/1086786652 shutdown_connections 2024-05-14T01:24:21.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.332+0000 7f8fcb67d640 1 -- 172.21.15.154:0/1086786652 wait complete. 2024-05-14T01:24:21.337 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T01:24:21.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.464+0000 7f92ad7d6640 1 Processor -- start 2024-05-14T01:24:21.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.464+0000 7f92ad7d6640 1 -- start start 2024-05-14T01:24:21.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.464+0000 7f92ad7d6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92a813ede0 0x7f92a81415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.464+0000 7f92ad7d6640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f92a8141b30 0x7f92a80ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.464+0000 7f92ad7d6640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92a80cf100 con 0x7f92a80ce880 2024-05-14T01:24:21.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.464+0000 7f92ad7d6640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f92a8141f90 con 0x7f92a8141b30 2024-05-14T01:24:21.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.464+0000 7f92ad7d6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f92a806cff0 con 0x7f92a813ede0 2024-05-14T01:24:21.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.464+0000 7f929ffff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f92a8141b30 0x7f92a80ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:21.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.464+0000 7f92a6ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92a813ede0 0x7f92a81415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:21.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.464+0000 7f929ffff640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f92a8141b30 0x7f92a80ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:35122/0 (socket says 172.21.15.154:35122) 2024-05-14T01:24:21.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.464+0000 7f929ffff640 1 -- 172.21.15.154:0/2999970232 learned_addr learned my addr 172.21.15.154:0/2999970232 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:21.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.464+0000 7f929ffff640 1 -- 172.21.15.154:0/2999970232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92a813ede0 msgr2=0x7f92a81415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:21.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.464+0000 7f929ffff640 1 --2- 172.21.15.154:0/2999970232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92a813ede0 0x7f92a81415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.464+0000 7f929ffff640 1 -- 172.21.15.154:0/2999970232 >> v1:172.21.15.176:6789/0 conn(0x7f92a80ce880 legacy=0x7f92a815fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.464+0000 7f929ffff640 1 -- 172.21.15.154:0/2999970232 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a80cf3e0 con 0x7f92a8141b30 2024-05-14T01:24:21.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.468+0000 7f929ffff640 1 --2- 172.21.15.154:0/2999970232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92a8141b30 0x7f92a80ce340 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9290009870 tx=0x7f929001c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99d17414a4f4b665 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:21.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.468+0000 7f92a67fc640 1 -- 172.21.15.154:0/2999970232 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92900aa670 con 0x7f92a8141b30 2024-05-14T01:24:21.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.468+0000 7f92a67fc640 1 -- 172.21.15.154:0/2999970232 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92900af070 con 0x7f92a8141b30 2024-05-14T01:24:21.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.468+0000 7f92a67fc640 1 -- 172.21.15.154:0/2999970232 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92900aaa30 con 0x7f92a8141b30 2024-05-14T01:24:21.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.468+0000 7f92ad7d6640 1 -- 172.21.15.154:0/2999970232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92a8141b30 msgr2=0x7f92a80ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.468+0000 7f92ad7d6640 1 --2- 172.21.15.154:0/2999970232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92a8141b30 0x7f92a80ce340 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9290009870 tx=0x7f929001c530 comp rx=0 tx=0).stop 2024-05-14T01:24:21.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.468+0000 7f92ad7d6640 1 -- 172.21.15.154:0/2999970232 shutdown_connections 2024-05-14T01:24:21.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.468+0000 7f92ad7d6640 1 --2- 172.21.15.154:0/2999970232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92a8141b30 0x7f92a80ce340 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.468+0000 7f92ad7d6640 1 --2- 172.21.15.154:0/2999970232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92a813ede0 0x7f92a81415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.468+0000 7f92ad7d6640 1 -- 172.21.15.154:0/2999970232 >> 172.21.15.154:0/2999970232 conn(0x7f92a80b1850 msgr2=0x7f92a80b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:21.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.468+0000 7f92ad7d6640 1 -- 172.21.15.154:0/2999970232 shutdown_connections 2024-05-14T01:24:21.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.468+0000 7f92ad7d6640 1 -- 172.21.15.154:0/2999970232 wait complete. 2024-05-14T01:24:21.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.468+0000 7f92ad7d6640 1 Processor -- start 2024-05-14T01:24:21.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.468+0000 7f92ad7d6640 1 -- start start 2024-05-14T01:24:21.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f92ad7d6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92a80ce880 0x7f92a8138720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f92ad7d6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a813ede0 0x7f92a8156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f92ad7d6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92a8141b30 0x7f92a81f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f92ad7d6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f92a80cede0 con 0x7f92a813ede0 2024-05-14T01:24:21.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f92ad7d6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f92a80cec60 con 0x7f92a80ce880 2024-05-14T01:24:21.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f92ad7d6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f92a8168da0 con 0x7f92a8141b30 2024-05-14T01:24:21.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f929ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a813ede0 0x7f92a8156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:21.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f929ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a813ede0 0x7f92a8156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42804/0 (socket says 172.21.15.154:42804) 2024-05-14T01:24:21.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f929ffff640 1 -- 172.21.15.154:0/1060238460 learned_addr learned my addr 172.21.15.154:0/1060238460 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:21.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f92a6ffd640 1 --2- 172.21.15.154:0/1060238460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92a80ce880 0x7f92a8138720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:21.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f92a77fe640 1 --2- 172.21.15.154:0/1060238460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92a8141b30 0x7f92a81f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:21.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f929ffff640 1 -- 172.21.15.154:0/1060238460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92a8141b30 msgr2=0x7f92a81f51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f929ffff640 1 --2- 172.21.15.154:0/1060238460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92a8141b30 0x7f92a81f51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f929ffff640 1 -- 172.21.15.154:0/1060238460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92a80ce880 msgr2=0x7f92a8138720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f929ffff640 1 --2- 172.21.15.154:0/1060238460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92a80ce880 0x7f92a8138720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f929ffff640 1 -- 172.21.15.154:0/1060238460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a8157440 con 0x7f92a813ede0 2024-05-14T01:24:21.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f92a6ffd640 1 --2- 172.21.15.154:0/1060238460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92a80ce880 0x7f92a8138720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:21.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f929ffff640 1 --2- 172.21.15.154:0/1060238460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a813ede0 0x7f92a8156ad0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f92900ac040 tx=0x7f929001ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:21.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f929f7fe640 1 -- 172.21.15.154:0/1060238460 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92900bd5f0 con 0x7f92a813ede0 2024-05-14T01:24:21.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f929f7fe640 1 -- 172.21.15.154:0/1060238460 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92900bd7b0 con 0x7f92a813ede0 2024-05-14T01:24:21.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f92ad7d6640 1 -- 172.21.15.154:0/1060238460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a8157720 con 0x7f92a813ede0 2024-05-14T01:24:21.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f929f7fe640 1 -- 172.21.15.154:0/1060238460 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92900bdba0 con 0x7f92a813ede0 2024-05-14T01:24:21.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f92ad7d6640 1 -- 172.21.15.154:0/1060238460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a8153530 con 0x7f92a813ede0 2024-05-14T01:24:21.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f92ad7d6640 1 -- 172.21.15.154:0/1060238460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92a8075470 con 0x7f92a813ede0 2024-05-14T01:24:21.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f929f7fe640 1 -- 172.21.15.154:0/1060238460 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f92900b33f0 con 0x7f92a813ede0 2024-05-14T01:24:21.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f929f7fe640 1 --2- 172.21.15.154:0/1060238460 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f92880678c0 0x7f9288069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f929f7fe640 1 -- 172.21.15.154:0/1060238460 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f9290120950 con 0x7f92a813ede0 2024-05-14T01:24:21.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f92a6ffd640 1 --2- 172.21.15.154:0/1060238460 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f92880678c0 0x7f9288069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:21.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.472+0000 7f92a6ffd640 1 --2- 172.21.15.154:0/1060238460 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f92880678c0 0x7f9288069d80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9298009bb0 tx=0x7f9298008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.476+0000 7f929f7fe640 1 -- 172.21.15.154:0/1060238460 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f92900c3060 con 0x7f92a813ede0 2024-05-14T01:24:21.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.668+0000 7f92ad7d6640 1 -- 172.21.15.154:0/1060238460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92a8075470 con 0x7f92a813ede0 2024-05-14T01:24:21.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.668+0000 7f929f7fe640 1 -- 172.21.15.154:0/1060238460 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f9290016150 con 0x7f92a813ede0 2024-05-14T01:24:21.658 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:21.658 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2575586302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2575586302},{"type":"v1","addr":"172.21.15.154:6836","nonce":2575586302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3108110937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3108110937},{"type":"v1","addr":"172.21.15.154:6837","nonce":3108110937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/77727941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":77727941},{"type":"v1","addr":"172.21.15.176:6833","nonce":77727941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T01:23:34.570674+0000","modified":"2024-05-14T01:23:37.636442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6835/2614790445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2614790445},{"type":"v1","addr":"172.21.15.176:6835","nonce":2614790445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-14T01:24:21.658 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 8 2024-05-14T01:24:21.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.672+0000 7f92ad7d6640 1 -- 172.21.15.154:0/1060238460 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f92880678c0 msgr2=0x7f9288069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.672+0000 7f92ad7d6640 1 --2- 172.21.15.154:0/1060238460 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f92880678c0 0x7f9288069d80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9298009bb0 tx=0x7f9298008040 comp rx=0 tx=0).stop 2024-05-14T01:24:21.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.672+0000 7f92ad7d6640 1 -- 172.21.15.154:0/1060238460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a813ede0 msgr2=0x7f92a8156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.672+0000 7f92ad7d6640 1 --2- 172.21.15.154:0/1060238460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a813ede0 0x7f92a8156ad0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f92900ac040 tx=0x7f929001ad70 comp rx=0 tx=0).stop 2024-05-14T01:24:21.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.672+0000 7f92ad7d6640 1 -- 172.21.15.154:0/1060238460 shutdown_connections 2024-05-14T01:24:21.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.672+0000 7f92ad7d6640 1 --2- 172.21.15.154:0/1060238460 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f92880678c0 0x7f9288069d80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.672+0000 7f92ad7d6640 1 --2- 172.21.15.154:0/1060238460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92a8141b30 0x7f92a81f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.672+0000 7f92ad7d6640 1 --2- 172.21.15.154:0/1060238460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a813ede0 0x7f92a8156ad0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.672+0000 7f92ad7d6640 1 --2- 172.21.15.154:0/1060238460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92a80ce880 0x7f92a8138720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.672+0000 7f92ad7d6640 1 -- 172.21.15.154:0/1060238460 >> 172.21.15.154:0/1060238460 conn(0x7f92a80b1850 msgr2=0x7f92a80b4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:21.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.672+0000 7f92ad7d6640 1 -- 172.21.15.154:0/1060238460 shutdown_connections 2024-05-14T01:24:21.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.672+0000 7f92ad7d6640 1 -- 172.21.15.154:0/1060238460 wait complete. 2024-05-14T01:24:21.675 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:21.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.796+0000 7f0bbcb98640 1 Processor -- start 2024-05-14T01:24:21.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.796+0000 7f0bbcb98640 1 -- start start 2024-05-14T01:24:21.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.796+0000 7f0bbcb98640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bb815e100 0x7f0bb80d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.796+0000 7f0bbcb98640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0bb80cf520 0x7f0bb80b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.796+0000 7f0bbcb98640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bb80d29f0 con 0x7f0bb815e4e0 2024-05-14T01:24:21.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.796+0000 7f0bbcb98640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f0bb80d2cd0 con 0x7f0bb80cf520 2024-05-14T01:24:21.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.796+0000 7f0bbcb98640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb80d2fb0 con 0x7f0bb815e100 2024-05-14T01:24:21.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.796+0000 7f0bb6d9d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0bb80cf520 0x7f0bb80b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:21.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.796+0000 7f0bb659c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bb815e100 0x7f0bb80d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:21.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.796+0000 7f0bb6d9d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0bb80cf520 0x7f0bb80b9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:35134/0 (socket says 172.21.15.154:35134) 2024-05-14T01:24:21.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.796+0000 7f0bb5d9b640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f0bb815e4e0 0x7f0bb80cee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:36984/0 (socket says 172.21.15.154:36984) 2024-05-14T01:24:21.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.796+0000 7f0bb6d9d640 1 -- 172.21.15.154:0/681416951 learned_addr learned my addr 172.21.15.154:0/681416951 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:21.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.796+0000 7f0bb6d9d640 1 -- 172.21.15.154:0/681416951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bb815e100 msgr2=0x7f0bb80d22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:21.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.796+0000 7f0bb6d9d640 1 --2- 172.21.15.154:0/681416951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bb815e100 0x7f0bb80d22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.796+0000 7f0bb6d9d640 1 -- 172.21.15.154:0/681416951 >> v1:172.21.15.176:6789/0 conn(0x7f0bb815e4e0 legacy=0x7f0bb80cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.796+0000 7f0bb6d9d640 1 -- 172.21.15.154:0/681416951 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb80d3290 con 0x7f0bb80cf520 2024-05-14T01:24:21.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bb6d9d640 1 --2- 172.21.15.154:0/681416951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bb80cf520 0x7f0bb80b9b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009e50 tx=0x7f0bb001f210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd0c3e73e98238a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:21.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bb559a640 1 -- 172.21.15.154:0/681416951 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00b4070 con 0x7f0bb80cf520 2024-05-14T01:24:21.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bb559a640 1 -- 172.21.15.154:0/681416951 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb00af400 con 0x7f0bb80cf520 2024-05-14T01:24:21.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bb559a640 1 -- 172.21.15.154:0/681416951 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00af7d0 con 0x7f0bb80cf520 2024-05-14T01:24:21.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bbcb98640 1 -- 172.21.15.154:0/681416951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bb80cf520 msgr2=0x7f0bb80b9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bbcb98640 1 --2- 172.21.15.154:0/681416951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bb80cf520 0x7f0bb80b9b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009e50 tx=0x7f0bb001f210 comp rx=0 tx=0).stop 2024-05-14T01:24:21.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bbcb98640 1 -- 172.21.15.154:0/681416951 shutdown_connections 2024-05-14T01:24:21.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bbcb98640 1 --2- 172.21.15.154:0/681416951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bb80cf520 0x7f0bb80b9b20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bbcb98640 1 --2- 172.21.15.154:0/681416951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bb815e100 0x7f0bb80d22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bbcb98640 1 -- 172.21.15.154:0/681416951 >> 172.21.15.154:0/681416951 conn(0x7f0bb80b5b50 msgr2=0x7f0bb80b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:21.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bbcb98640 1 -- 172.21.15.154:0/681416951 shutdown_connections 2024-05-14T01:24:21.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bbcb98640 1 -- 172.21.15.154:0/681416951 wait complete. 2024-05-14T01:24:21.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bbcb98640 1 Processor -- start 2024-05-14T01:24:21.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bbcb98640 1 -- start start 2024-05-14T01:24:21.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bbcb98640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bb80cf520 0x7f0bb8155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bbcb98640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bb815e100 0x7f0bb80cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bbcb98640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bb815e4e0 0x7f0bb80718a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bbcb98640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb80d3c10 con 0x7f0bb815e4e0 2024-05-14T01:24:21.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bbcb98640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb80d3a90 con 0x7f0bb815e100 2024-05-14T01:24:21.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bbcb98640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb80c7f50 con 0x7f0bb80cf520 2024-05-14T01:24:21.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bb6d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bb815e4e0 0x7f0bb80718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:21.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bb6d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bb815e4e0 0x7f0bb80718a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42806/0 (socket says 172.21.15.154:42806) 2024-05-14T01:24:21.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.800+0000 7f0bb6d9d640 1 -- 172.21.15.154:0/954683205 learned_addr learned my addr 172.21.15.154:0/954683205 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0bb5d9b640 1 --2- 172.21.15.154:0/954683205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bb815e100 0x7f0bb80cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0bb659c640 1 --2- 172.21.15.154:0/954683205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bb80cf520 0x7f0bb8155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0bb6d9d640 1 -- 172.21.15.154:0/954683205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bb80cf520 msgr2=0x7f0bb8155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0bb6d9d640 1 --2- 172.21.15.154:0/954683205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bb80cf520 0x7f0bb8155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0bb6d9d640 1 -- 172.21.15.154:0/954683205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bb815e100 msgr2=0x7f0bb80cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0bb6d9d640 1 --2- 172.21.15.154:0/954683205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bb815e100 0x7f0bb80cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0bb6d9d640 1 -- 172.21.15.154:0/954683205 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb80c8230 con 0x7f0bb815e4e0 2024-05-14T01:24:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0bb659c640 1 --2- 172.21.15.154:0/954683205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bb80cf520 0x7f0bb8155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0bb6d9d640 1 --2- 172.21.15.154:0/954683205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bb815e4e0 0x7f0bb80718a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00b2040 tx=0x7f0bb001bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0ba6ffd640 1 -- 172.21.15.154:0/954683205 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00b4040 con 0x7f0bb815e4e0 2024-05-14T01:24:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0ba6ffd640 1 -- 172.21.15.154:0/954683205 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb00afc80 con 0x7f0bb815e4e0 2024-05-14T01:24:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0bbcb98640 1 -- 172.21.15.154:0/954683205 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb80c8510 con 0x7f0bb815e4e0 2024-05-14T01:24:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0ba6ffd640 1 -- 172.21.15.154:0/954683205 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0009510 con 0x7f0bb815e4e0 2024-05-14T01:24:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0bbcb98640 1 -- 172.21.15.154:0/954683205 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb80c8ad0 con 0x7f0bb815e4e0 2024-05-14T01:24:21.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0bbcb98640 1 -- 172.21.15.154:0/954683205 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb8075470 con 0x7f0bb815e4e0 2024-05-14T01:24:21.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0ba6ffd640 1 -- 172.21.15.154:0/954683205 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0bb00a8d10 con 0x7f0bb815e4e0 2024-05-14T01:24:21.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0ba6ffd640 1 --2- 172.21.15.154:0/954683205 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f0b980678c0 0x7f0b98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:21.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0bb659c640 1 --2- 172.21.15.154:0/954683205 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f0b980678c0 0x7f0b98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:21.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0ba6ffd640 1 -- 172.21.15.154:0/954683205 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f0bb0123460 con 0x7f0bb815e4e0 2024-05-14T01:24:21.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.804+0000 7f0bb659c640 1 --2- 172.21.15.154:0/954683205 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f0b980678c0 0x7f0b98069d80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009ae0 tx=0x7f0bac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:21.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.808+0000 7f0ba6ffd640 1 -- 172.21.15.154:0/954683205 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f0bb0018d70 con 0x7f0bb815e4e0 2024-05-14T01:24:21.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.956+0000 7f0bbcb98640 1 -- 172.21.15.154:0/954683205 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0bb80d2410 con 0x7f0bb815e4e0 2024-05-14T01:24:21.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.960+0000 7f0ba6ffd640 1 -- 172.21.15.154:0/954683205 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16950 (secure 0 0 0) 0x7f0bb00f4060 con 0x7f0bb815e4e0 2024-05-14T01:24:21.947 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:21.947 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":23,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:24:16.454751+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:21.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.960+0000 7f0bbcb98640 1 -- 172.21.15.154:0/954683205 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f0b980678c0 msgr2=0x7f0b98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.960+0000 7f0bbcb98640 1 --2- 172.21.15.154:0/954683205 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f0b980678c0 0x7f0b98069d80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009ae0 tx=0x7f0bac008040 comp rx=0 tx=0).stop 2024-05-14T01:24:21.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.960+0000 7f0bbcb98640 1 -- 172.21.15.154:0/954683205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bb815e4e0 msgr2=0x7f0bb80718a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:21.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.960+0000 7f0bbcb98640 1 --2- 172.21.15.154:0/954683205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bb815e4e0 0x7f0bb80718a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00b2040 tx=0x7f0bb001bfb0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.960+0000 7f0bbcb98640 1 -- 172.21.15.154:0/954683205 shutdown_connections 2024-05-14T01:24:21.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.960+0000 7f0bbcb98640 1 --2- 172.21.15.154:0/954683205 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f0b980678c0 0x7f0b98069d80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.960+0000 7f0bbcb98640 1 --2- 172.21.15.154:0/954683205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bb815e4e0 0x7f0bb80718a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.960+0000 7f0bbcb98640 1 --2- 172.21.15.154:0/954683205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bb815e100 0x7f0bb80cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.960+0000 7f0bbcb98640 1 --2- 172.21.15.154:0/954683205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0bb80cf520 0x7f0bb8155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:21.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.960+0000 7f0bbcb98640 1 -- 172.21.15.154:0/954683205 >> 172.21.15.154:0/954683205 conn(0x7f0bb80b5b50 msgr2=0x7f0bb8159220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:21.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.960+0000 7f0bbcb98640 1 -- 172.21.15.154:0/954683205 shutdown_connections 2024-05-14T01:24:21.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:21.960+0000 7f0bbcb98640 1 -- 172.21.15.154:0/954683205 wait complete. 2024-05-14T01:24:21.965 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-14T01:24:21.965 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T01:24:22.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.092+0000 7f88e86b2640 1 Processor -- start 2024-05-14T01:24:22.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.092+0000 7f88e86b2640 1 -- start start 2024-05-14T01:24:22.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e86b2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88e013ede0 0x7f88e01415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e86b2640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f88e00cea50 0x7f88e006d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e86b2640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88e00cf100 con 0x7f88e0141b30 2024-05-14T01:24:22.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e86b2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f88e00ceee0 con 0x7f88e013ede0 2024-05-14T01:24:22.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e86b2640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f88e0141f90 con 0x7f88e00cea50 2024-05-14T01:24:22.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e644e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88e013ede0 0x7f88e01415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e644e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88e013ede0 0x7f88e01415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42808/0 (socket says 172.21.15.154:42808) 2024-05-14T01:24:22.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e644e640 1 -- 172.21.15.154:0/437028690 learned_addr learned my addr 172.21.15.154:0/437028690 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:22.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e6c4f640 1 --2- 172.21.15.154:0/437028690 >> v2:172.21.15.176:3300/0 conn(0x7f88e00cea50 0x7f88e006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e644e640 1 -- 172.21.15.154:0/437028690 >> v2:172.21.15.176:3300/0 conn(0x7f88e00cea50 msgr2=0x7f88e006d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:22.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e644e640 1 --2- 172.21.15.154:0/437028690 >> v2:172.21.15.176:3300/0 conn(0x7f88e00cea50 0x7f88e006d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e644e640 1 -- 172.21.15.154:0/437028690 >> v1:172.21.15.176:6789/0 conn(0x7f88e0141b30 legacy=0x7f88e00ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:22.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e644e640 1 -- 172.21.15.154:0/437028690 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e00cf3e0 con 0x7f88e013ede0 2024-05-14T01:24:22.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e644e640 1 --2- 172.21.15.154:0/437028690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e013ede0 0x7f88e01415f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0098a0 tx=0x7f88dc01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3dfb3a2b7d01d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:22.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e544c640 1 -- 172.21.15.154:0/437028690 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0b2070 con 0x7f88e013ede0 2024-05-14T01:24:22.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e544c640 1 -- 172.21.15.154:0/437028690 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88dc0ad640 con 0x7f88e013ede0 2024-05-14T01:24:22.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e544c640 1 -- 172.21.15.154:0/437028690 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0ada10 con 0x7f88e013ede0 2024-05-14T01:24:22.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e86b2640 1 -- 172.21.15.154:0/437028690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e013ede0 msgr2=0x7f88e01415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:22.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e86b2640 1 --2- 172.21.15.154:0/437028690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e013ede0 0x7f88e01415f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0098a0 tx=0x7f88dc01c4c0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e86b2640 1 -- 172.21.15.154:0/437028690 shutdown_connections 2024-05-14T01:24:22.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e86b2640 1 --2- 172.21.15.154:0/437028690 >> v2:172.21.15.176:3300/0 conn(0x7f88e00cea50 0x7f88e006d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e86b2640 1 --2- 172.21.15.154:0/437028690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e013ede0 0x7f88e01415f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e86b2640 1 -- 172.21.15.154:0/437028690 >> 172.21.15.154:0/437028690 conn(0x7f88e00b1850 msgr2=0x7f88e00b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:22.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e86b2640 1 -- 172.21.15.154:0/437028690 shutdown_connections 2024-05-14T01:24:22.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.096+0000 7f88e86b2640 1 -- 172.21.15.154:0/437028690 wait complete. 2024-05-14T01:24:22.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e86b2640 1 Processor -- start 2024-05-14T01:24:22.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e86b2640 1 -- start start 2024-05-14T01:24:22.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e86b2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e00cea50 0x7f88e013a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e86b2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88e013ede0 0x7f88e013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e86b2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88e0141b30 0x7f88e013b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e86b2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f88e006e350 con 0x7f88e00cea50 2024-05-14T01:24:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e86b2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f88e006e1d0 con 0x7f88e0141b30 2024-05-14T01:24:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e86b2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f88e006e4d0 con 0x7f88e013ede0 2024-05-14T01:24:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e644e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e00cea50 0x7f88e013a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e644e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e00cea50 0x7f88e013a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42820/0 (socket says 172.21.15.154:42820) 2024-05-14T01:24:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e644e640 1 -- 172.21.15.154:0/1298610541 learned_addr learned my addr 172.21.15.154:0/1298610541 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e644e640 1 -- 172.21.15.154:0/1298610541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88e013ede0 msgr2=0x7f88e013b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e644e640 1 --2- 172.21.15.154:0/1298610541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88e013ede0 0x7f88e013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e6c4f640 1 --2- 172.21.15.154:0/1298610541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88e0141b30 0x7f88e013b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e644e640 1 -- 172.21.15.154:0/1298610541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88e0141b30 msgr2=0x7f88e013b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e644e640 1 --2- 172.21.15.154:0/1298610541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88e0141b30 0x7f88e013b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e644e640 1 -- 172.21.15.154:0/1298610541 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e0153cd0 con 0x7f88e00cea50 2024-05-14T01:24:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e644e640 1 --2- 172.21.15.154:0/1298610541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e00cea50 0x7f88e013a2e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f88dc01a0f0 tx=0x7f88dc019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:22.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88d6ffd640 1 -- 172.21.15.154:0/1298610541 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0bd070 con 0x7f88e00cea50 2024-05-14T01:24:22.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88d6ffd640 1 -- 172.21.15.154:0/1298610541 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88dc0b8630 con 0x7f88e00cea50 2024-05-14T01:24:22.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e86b2640 1 -- 172.21.15.154:0/1298610541 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88e0153fb0 con 0x7f88e00cea50 2024-05-14T01:24:22.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88d6ffd640 1 -- 172.21.15.154:0/1298610541 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0b2040 con 0x7f88e00cea50 2024-05-14T01:24:22.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e86b2640 1 -- 172.21.15.154:0/1298610541 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88e0154570 con 0x7f88e00cea50 2024-05-14T01:24:22.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.100+0000 7f88e86b2640 1 -- 172.21.15.154:0/1298610541 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88e0075470 con 0x7f88e00cea50 2024-05-14T01:24:22.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.104+0000 7f88d6ffd640 1 -- 172.21.15.154:0/1298610541 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f88dc0c0070 con 0x7f88e00cea50 2024-05-14T01:24:22.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.104+0000 7f88d6ffd640 1 --2- 172.21.15.154:0/1298610541 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f88c40678c0 0x7f88c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.104+0000 7f88d6ffd640 1 -- 172.21.15.154:0/1298610541 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f88dc11f7f0 con 0x7f88e00cea50 2024-05-14T01:24:22.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.104+0000 7f88e5c4d640 1 --2- 172.21.15.154:0/1298610541 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f88c40678c0 0x7f88c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.104+0000 7f88e5c4d640 1 --2- 172.21.15.154:0/1298610541 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f88c40678c0 0x7f88c4069d80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009670 tx=0x7f88d0006bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:22.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.108+0000 7f88d6ffd640 1 -- 172.21.15.154:0/1298610541 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f88dc0160b0 con 0x7f88e00cea50 2024-05-14T01:24:22.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.304+0000 7f88e86b2640 1 -- 172.21.15.154:0/1298610541 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88e006f180 con 0x7f88e00cea50 2024-05-14T01:24:22.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.304+0000 7f88d6ffd640 1 -- 172.21.15.154:0/1298610541 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f88dc0f0330 con 0x7f88e00cea50 2024-05-14T01:24:22.292 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:22.292 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2575586302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2575586302},{"type":"v1","addr":"172.21.15.154:6836","nonce":2575586302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3108110937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3108110937},{"type":"v1","addr":"172.21.15.154:6837","nonce":3108110937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/77727941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":77727941},{"type":"v1","addr":"172.21.15.176:6833","nonce":77727941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T01:23:34.570674+0000","modified":"2024-05-14T01:23:37.636442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6835/2614790445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2614790445},{"type":"v1","addr":"172.21.15.176:6835","nonce":2614790445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-14T01:24:22.292 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 8 2024-05-14T01:24:22.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.308+0000 7f88e86b2640 1 -- 172.21.15.154:0/1298610541 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f88c40678c0 msgr2=0x7f88c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:22.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.308+0000 7f88e86b2640 1 --2- 172.21.15.154:0/1298610541 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f88c40678c0 0x7f88c4069d80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009670 tx=0x7f88d0006bd0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.308+0000 7f88e86b2640 1 -- 172.21.15.154:0/1298610541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e00cea50 msgr2=0x7f88e013a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:22.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.308+0000 7f88e86b2640 1 --2- 172.21.15.154:0/1298610541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e00cea50 0x7f88e013a2e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f88dc01a0f0 tx=0x7f88dc019260 comp rx=0 tx=0).stop 2024-05-14T01:24:22.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.308+0000 7f88e86b2640 1 -- 172.21.15.154:0/1298610541 shutdown_connections 2024-05-14T01:24:22.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.308+0000 7f88e86b2640 1 --2- 172.21.15.154:0/1298610541 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f88c40678c0 0x7f88c4069d80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.308+0000 7f88e86b2640 1 --2- 172.21.15.154:0/1298610541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88e0141b30 0x7f88e013b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.308+0000 7f88e86b2640 1 --2- 172.21.15.154:0/1298610541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88e013ede0 0x7f88e013b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.308+0000 7f88e86b2640 1 --2- 172.21.15.154:0/1298610541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e00cea50 0x7f88e013a2e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.308+0000 7f88e86b2640 1 -- 172.21.15.154:0/1298610541 >> 172.21.15.154:0/1298610541 conn(0x7f88e00b1850 msgr2=0x7f88e013f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:22.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.308+0000 7f88e86b2640 1 -- 172.21.15.154:0/1298610541 shutdown_connections 2024-05-14T01:24:22.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.308+0000 7f88e86b2640 1 -- 172.21.15.154:0/1298610541 wait complete. 2024-05-14T01:24:22.311 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T01:24:22.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff770d29640 1 Processor -- start 2024-05-14T01:24:22.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff770d29640 1 -- start start 2024-05-14T01:24:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff770d29640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff76c158940 0x7ff76c0adf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff770d29640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff76c0b4370 con 0x7ff76c0b3ec0 2024-05-14T01:24:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff770d29640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff76c0ae660 con 0x7ff76c06c290 2024-05-14T01:24:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff770d29640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff76c15e6a0 con 0x7ff76c158940 2024-05-14T01:24:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff769d9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff76c0b3ec0 0x7ff76c15f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37072/0 (socket says 172.21.15.154:37072) 2024-05-14T01:24:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff769d9b640 1 -- 172.21.15.154:0/2619546254 learned_addr learned my addr 172.21.15.154:0/2619546254 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76a59c640 1 --2- 172.21.15.154:0/2619546254 >> v2:172.21.15.176:3300/0 conn(0x7ff76c158940 0x7ff76c0adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76959a640 1 -- 172.21.15.154:0/2619546254 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1082455411 0 0) 0x7ff76c0b4370 con 0x7ff76c0b3ec0 2024-05-14T01:24:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76959a640 1 -- 172.21.15.154:0/2619546254 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff754003530 con 0x7ff76c0b3ec0 2024-05-14T01:24:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76959a640 1 -- 172.21.15.154:0/2619546254 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 402863238 0 0) 0x7ff754003530 con 0x7ff76c0b3ec0 2024-05-14T01:24:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76959a640 1 -- 172.21.15.154:0/2619546254 >> v2:172.21.15.176:3300/0 conn(0x7ff76c158940 msgr2=0x7ff76c0adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76959a640 1 --2- 172.21.15.154:0/2619546254 >> v2:172.21.15.176:3300/0 conn(0x7ff76c158940 0x7ff76c0adf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76959a640 1 -- 172.21.15.154:0/2619546254 >> v1:172.21.15.176:6789/0 conn(0x7ff76c06c290 legacy=0x7ff76c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76959a640 1 -- 172.21.15.154:0/2619546254 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c0ae940 con 0x7ff76c0b3ec0 2024-05-14T01:24:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76959a640 1 -- 172.21.15.154:0/2619546254 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7ff760001680 con 0x7ff76c0b3ec0 2024-05-14T01:24:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76959a640 1 -- 172.21.15.154:0/2619546254 >> v1:172.21.15.154:6789/0 conn(0x7ff76c0b3ec0 legacy=0x7ff76c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76959a640 1 --2- 172.21.15.154:0/2619546254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7540039c0 0x7ff754003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76959a640 1 --2- 172.21.15.154:0/2619546254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff754004810 0x7ff754004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76959a640 1 --2- 172.21.15.154:0/2619546254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7540051d0 0x7ff75400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76959a640 1 -- 172.21.15.154:0/2619546254 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c15e6a0 con 0x7ff754004810 2024-05-14T01:24:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76959a640 1 -- 172.21.15.154:0/2619546254 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff75400c170 con 0x7ff7540051d0 2024-05-14T01:24:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76959a640 1 -- 172.21.15.154:0/2619546254 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff75400c370 con 0x7ff7540039c0 2024-05-14T01:24:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff769d9b640 1 --2- 172.21.15.154:0/2619546254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff754004810 0x7ff754004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76a59c640 1 --2- 172.21.15.154:0/2619546254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7540039c0 0x7ff754003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff769d9b640 1 -- 172.21.15.154:0/2619546254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7540039c0 msgr2=0x7ff754003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff769d9b640 1 --2- 172.21.15.154:0/2619546254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7540039c0 0x7ff754003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff769d9b640 1 -- 172.21.15.154:0/2619546254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7540051d0 msgr2=0x7ff75400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76ad9d640 1 --2- 172.21.15.154:0/2619546254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7540051d0 0x7ff75400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff769d9b640 1 --2- 172.21.15.154:0/2619546254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7540051d0 0x7ff75400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff769d9b640 1 -- 172.21.15.154:0/2619546254 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff754003530 con 0x7ff754004810 2024-05-14T01:24:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76a59c640 1 --2- 172.21.15.154:0/2619546254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7540039c0 0x7ff754003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76ad9d640 1 --2- 172.21.15.154:0/2619546254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7540051d0 0x7ff75400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.440+0000 7ff76ad9d640 1 -- 172.21.15.154:0/2619546254 reap_dead start 2024-05-14T01:24:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff769d9b640 1 --2- 172.21.15.154:0/2619546254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff754004810 0x7ff754004c90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff76000c240 tx=0x7ff76001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ae9b6fc807a15 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff76959a640 1 -- 172.21.15.154:0/2619546254 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760007d20 con 0x7ff754004810 2024-05-14T01:24:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff76959a640 1 -- 172.21.15.154:0/2619546254 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7600a9070 con 0x7ff754004810 2024-05-14T01:24:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff76959a640 1 -- 172.21.15.154:0/2619546254 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760005da0 con 0x7ff754004810 2024-05-14T01:24:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff770d29640 1 -- 172.21.15.154:0/2619546254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff754004810 msgr2=0x7ff754004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff770d29640 1 --2- 172.21.15.154:0/2619546254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff754004810 0x7ff754004c90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff76000c240 tx=0x7ff76001cc80 comp rx=0 tx=0).stop 2024-05-14T01:24:22.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff770d29640 1 -- 172.21.15.154:0/2619546254 shutdown_connections 2024-05-14T01:24:22.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff770d29640 1 --2- 172.21.15.154:0/2619546254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff754004810 0x7ff754004c90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff770d29640 1 -- 172.21.15.154:0/2619546254 >> 172.21.15.154:0/2619546254 conn(0x7ff76c072000 msgr2=0x7ff76c072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:22.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff770d29640 1 -- 172.21.15.154:0/2619546254 shutdown_connections 2024-05-14T01:24:22.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff770d29640 1 -- 172.21.15.154:0/2619546254 wait complete. 2024-05-14T01:24:22.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff770d29640 1 Processor -- start 2024-05-14T01:24:22.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff770d29640 1 -- start start 2024-05-14T01:24:22.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff770d29640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff754004810 0x7ff76c140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff770d29640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff76c143280 0x7ff76c15acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff770d29640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff76c15b230 0x7ff76c160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff770d29640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c06cc00 con 0x7ff754004810 2024-05-14T01:24:22.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff770d29640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c06ca80 con 0x7ff76c143280 2024-05-14T01:24:22.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff770d29640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff76c0b4dd0 con 0x7ff76c15b230 2024-05-14T01:24:22.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.444+0000 7ff76a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff754004810 0x7ff76c140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff76a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff754004810 0x7ff76c140040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42842/0 (socket says 172.21.15.154:42842) 2024-05-14T01:24:22.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff76a59c640 1 -- 172.21.15.154:0/2081395038 learned_addr learned my addr 172.21.15.154:0/2081395038 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:22.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff769d9b640 1 --2- 172.21.15.154:0/2081395038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff76c143280 0x7ff76c15acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff76ad9d640 1 --2- 172.21.15.154:0/2081395038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff76c15b230 0x7ff76c160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff76a59c640 1 -- 172.21.15.154:0/2081395038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff76c15b230 msgr2=0x7ff76c160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:22.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff76a59c640 1 --2- 172.21.15.154:0/2081395038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff76c15b230 0x7ff76c160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff76a59c640 1 -- 172.21.15.154:0/2081395038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff76c143280 msgr2=0x7ff76c15acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:22.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff76a59c640 1 --2- 172.21.15.154:0/2081395038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff76c143280 0x7ff76c15acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff76a59c640 1 -- 172.21.15.154:0/2081395038 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c15b770 con 0x7ff754004810 2024-05-14T01:24:22.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff76ad9d640 1 --2- 172.21.15.154:0/2081395038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff76c15b230 0x7ff76c160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:22.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff769d9b640 1 --2- 172.21.15.154:0/2081395038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff76c143280 0x7ff76c15acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:22.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff76a59c640 1 --2- 172.21.15.154:0/2081395038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff754004810 0x7ff76c140040 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff75c010980 tx=0x7ff75c010e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:22.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff75affd640 1 -- 172.21.15.154:0/2081395038 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00f040 con 0x7ff754004810 2024-05-14T01:24:22.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff75affd640 1 -- 172.21.15.154:0/2081395038 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75c004220 con 0x7ff754004810 2024-05-14T01:24:22.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff770d29640 1 -- 172.21.15.154:0/2081395038 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76c15ba50 con 0x7ff754004810 2024-05-14T01:24:22.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff75affd640 1 -- 172.21.15.154:0/2081395038 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00e9c0 con 0x7ff754004810 2024-05-14T01:24:22.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff770d29640 1 -- 172.21.15.154:0/2081395038 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76c140580 con 0x7ff754004810 2024-05-14T01:24:22.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff770d29640 1 -- 172.21.15.154:0/2081395038 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff76c068360 con 0x7ff754004810 2024-05-14T01:24:22.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff75affd640 1 -- 172.21.15.154:0/2081395038 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff75c00eb60 con 0x7ff754004810 2024-05-14T01:24:22.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff75affd640 1 --2- 172.21.15.154:0/2081395038 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff74c0678c0 0x7ff74c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff75affd640 1 -- 172.21.15.154:0/2081395038 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7ff75c086130 con 0x7ff754004810 2024-05-14T01:24:22.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff769d9b640 1 --2- 172.21.15.154:0/2081395038 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff74c0678c0 0x7ff74c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.448+0000 7ff769d9b640 1 --2- 172.21.15.154:0/2081395038 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff74c0678c0 0x7ff74c069d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff7600ab000 tx=0x7ff7600b0040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:22.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.452+0000 7ff75affd640 1 -- 172.21.15.154:0/2081395038 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7ff75c018030 con 0x7ff754004810 2024-05-14T01:24:22.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.636+0000 7ff770d29640 1 -- 172.21.15.154:0/2081395038 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff76c072910 con 0x7ff754004810 2024-05-14T01:24:22.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.636+0000 7ff75affd640 1 -- 172.21.15.154:0/2081395038 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7ff75c056c70 con 0x7ff754004810 2024-05-14T01:24:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:22.624 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2575586302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2575586302},{"type":"v1","addr":"172.21.15.154:6836","nonce":2575586302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3108110937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3108110937},{"type":"v1","addr":"172.21.15.154:6837","nonce":3108110937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/77727941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":77727941},{"type":"v1","addr":"172.21.15.176:6833","nonce":77727941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T01:23:34.570674+0000","modified":"2024-05-14T01:23:37.636442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6835/2614790445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2614790445},{"type":"v1","addr":"172.21.15.176:6835","nonce":2614790445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-14T01:24:22.624 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 8 2024-05-14T01:24:22.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.636+0000 7ff770d29640 1 -- 172.21.15.154:0/2081395038 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff74c0678c0 msgr2=0x7ff74c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:22.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.636+0000 7ff770d29640 1 --2- 172.21.15.154:0/2081395038 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff74c0678c0 0x7ff74c069d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff7600ab000 tx=0x7ff7600b0040 comp rx=0 tx=0).stop 2024-05-14T01:24:22.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.636+0000 7ff770d29640 1 -- 172.21.15.154:0/2081395038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff754004810 msgr2=0x7ff76c140040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:22.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.636+0000 7ff770d29640 1 --2- 172.21.15.154:0/2081395038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff754004810 0x7ff76c140040 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff75c010980 tx=0x7ff75c010e40 comp rx=0 tx=0).stop 2024-05-14T01:24:22.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.640+0000 7ff770d29640 1 -- 172.21.15.154:0/2081395038 shutdown_connections 2024-05-14T01:24:22.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.640+0000 7ff770d29640 1 --2- 172.21.15.154:0/2081395038 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff74c0678c0 0x7ff74c069d80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.640+0000 7ff770d29640 1 --2- 172.21.15.154:0/2081395038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff76c15b230 0x7ff76c160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.640+0000 7ff770d29640 1 --2- 172.21.15.154:0/2081395038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff76c143280 0x7ff76c15acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.640+0000 7ff770d29640 1 --2- 172.21.15.154:0/2081395038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff754004810 0x7ff76c140040 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.640+0000 7ff770d29640 1 -- 172.21.15.154:0/2081395038 >> 172.21.15.154:0/2081395038 conn(0x7ff76c072000 msgr2=0x7ff76c074280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.640+0000 7ff770d29640 1 -- 172.21.15.154:0/2081395038 shutdown_connections 2024-05-14T01:24:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.640+0000 7ff770d29640 1 -- 172.21.15.154:0/2081395038 wait complete. 2024-05-14T01:24:22.641 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:22.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.760+0000 7f28c3943640 1 Processor -- start 2024-05-14T01:24:22.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.760+0000 7f28c3943640 1 -- start start 2024-05-14T01:24:22.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.764+0000 7f28c3943640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28bc144760 0x7f28bc06e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.764+0000 7f28c3943640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f28bc15bae0 0x7f28bc15c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.764+0000 7f28c3943640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28bc144b40 con 0x7f28bc0b3530 2024-05-14T01:24:22.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.764+0000 7f28c3943640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f28bc0b4650 con 0x7f28bc15bae0 2024-05-14T01:24:22.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.764+0000 7f28c3943640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f28bc0b3a40 con 0x7f28bc144760 2024-05-14T01:24:22.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.764+0000 7f28c16df640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28bc144760 0x7f28bc06e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.764+0000 7f28c16df640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28bc144760 0x7f28bc06e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:55080/0 (socket says 172.21.15.154:55080) 2024-05-14T01:24:22.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.764+0000 7f28c16df640 1 -- 172.21.15.154:0/525572944 learned_addr learned my addr 172.21.15.154:0/525572944 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:22.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.764+0000 7f28c1ee0640 1 --2- 172.21.15.154:0/525572944 >> v2:172.21.15.176:3300/0 conn(0x7f28bc15bae0 0x7f28bc15c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.764+0000 7f28c16df640 1 -- 172.21.15.154:0/525572944 >> v2:172.21.15.176:3300/0 conn(0x7f28bc15bae0 msgr2=0x7f28bc15c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:22.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.764+0000 7f28c16df640 1 --2- 172.21.15.154:0/525572944 >> v2:172.21.15.176:3300/0 conn(0x7f28bc15bae0 0x7f28bc15c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.764+0000 7f28c16df640 1 -- 172.21.15.154:0/525572944 >> v1:172.21.15.176:6789/0 conn(0x7f28bc0b3530 legacy=0x7f28bc15b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:22.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.764+0000 7f28c16df640 1 -- 172.21.15.154:0/525572944 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28bc0b3d20 con 0x7f28bc144760 2024-05-14T01:24:22.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c16df640 1 --2- 172.21.15.154:0/525572944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28bc144760 0x7f28bc06e680 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f28b8009870 tx=0x7f28b801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b97d40a7364d3260 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:22.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28b3fff640 1 -- 172.21.15.154:0/525572944 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b80a95f0 con 0x7f28bc144760 2024-05-14T01:24:22.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28b3fff640 1 -- 172.21.15.154:0/525572944 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b80a9790 con 0x7f28bc144760 2024-05-14T01:24:22.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28b3fff640 1 -- 172.21.15.154:0/525572944 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b80a9b60 con 0x7f28bc144760 2024-05-14T01:24:22.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c3943640 1 -- 172.21.15.154:0/525572944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28bc144760 msgr2=0x7f28bc06e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:22.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c3943640 1 --2- 172.21.15.154:0/525572944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28bc144760 0x7f28bc06e680 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f28b8009870 tx=0x7f28b801c530 comp rx=0 tx=0).stop 2024-05-14T01:24:22.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c3943640 1 -- 172.21.15.154:0/525572944 shutdown_connections 2024-05-14T01:24:22.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c3943640 1 --2- 172.21.15.154:0/525572944 >> v2:172.21.15.176:3300/0 conn(0x7f28bc15bae0 0x7f28bc15c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c3943640 1 --2- 172.21.15.154:0/525572944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28bc144760 0x7f28bc06e680 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c3943640 1 -- 172.21.15.154:0/525572944 >> 172.21.15.154:0/525572944 conn(0x7f28bc0b1850 msgr2=0x7f28bc0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:22.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c3943640 1 -- 172.21.15.154:0/525572944 shutdown_connections 2024-05-14T01:24:22.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c3943640 1 -- 172.21.15.154:0/525572944 wait complete. 2024-05-14T01:24:22.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c3943640 1 Processor -- start 2024-05-14T01:24:22.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c3943640 1 -- start start 2024-05-14T01:24:22.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c3943640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28bc0b3530 0x7f28bc138cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c3943640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28bc144760 0x7f28bc15a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c3943640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28bc15bae0 0x7f28bc0c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c3943640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc15d4b0 con 0x7f28bc15bae0 2024-05-14T01:24:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c3943640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc15d330 con 0x7f28bc144760 2024-05-14T01:24:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c3943640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f28bc15d630 con 0x7f28bc0b3530 2024-05-14T01:24:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c1ee0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28bc15bae0 0x7f28bc0c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c1ee0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28bc15bae0 0x7f28bc0c4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42858/0 (socket says 172.21.15.154:42858) 2024-05-14T01:24:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c1ee0640 1 -- 172.21.15.154:0/760278633 learned_addr learned my addr 172.21.15.154:0/760278633 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c16df640 1 --2- 172.21.15.154:0/760278633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28bc0b3530 0x7f28bc138cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c0ede640 1 --2- 172.21.15.154:0/760278633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28bc144760 0x7f28bc15a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c1ee0640 1 -- 172.21.15.154:0/760278633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28bc0b3530 msgr2=0x7f28bc138cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c1ee0640 1 --2- 172.21.15.154:0/760278633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28bc0b3530 0x7f28bc138cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c1ee0640 1 -- 172.21.15.154:0/760278633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28bc144760 msgr2=0x7f28bc15a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.768+0000 7f28c1ee0640 1 --2- 172.21.15.154:0/760278633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28bc144760 0x7f28bc15a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.772+0000 7f28c1ee0640 1 -- 172.21.15.154:0/760278633 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28bc1391f0 con 0x7f28bc15bae0 2024-05-14T01:24:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.772+0000 7f28c16df640 1 --2- 172.21.15.154:0/760278633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28bc0b3530 0x7f28bc138cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:22.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.772+0000 7f28c1ee0640 1 --2- 172.21.15.154:0/760278633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28bc15bae0 0x7f28bc0c4ac0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009d30 tx=0x7f28b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:22.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.772+0000 7f28b1ffb640 1 -- 172.21.15.154:0/760278633 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b4018020 con 0x7f28bc15bae0 2024-05-14T01:24:22.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.772+0000 7f28b1ffb640 1 -- 172.21.15.154:0/760278633 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b4014480 con 0x7f28bc15bae0 2024-05-14T01:24:22.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.772+0000 7f28c3943640 1 -- 172.21.15.154:0/760278633 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28bc159310 con 0x7f28bc15bae0 2024-05-14T01:24:22.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.772+0000 7f28b1ffb640 1 -- 172.21.15.154:0/760278633 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b4014870 con 0x7f28bc15bae0 2024-05-14T01:24:22.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.772+0000 7f28c3943640 1 -- 172.21.15.154:0/760278633 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28bc1598d0 con 0x7f28bc15bae0 2024-05-14T01:24:22.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.772+0000 7f28c3943640 1 -- 172.21.15.154:0/760278633 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28bc075470 con 0x7f28bc15bae0 2024-05-14T01:24:22.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.772+0000 7f28b1ffb640 1 -- 172.21.15.154:0/760278633 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f28b401b020 con 0x7f28bc15bae0 2024-05-14T01:24:22.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.772+0000 7f28b1ffb640 1 --2- 172.21.15.154:0/760278633 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f28a00678f0 0x7f28a0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:22.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.772+0000 7f28b1ffb640 1 -- 172.21.15.154:0/760278633 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f28b4086950 con 0x7f28bc15bae0 2024-05-14T01:24:22.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.772+0000 7f28c16df640 1 --2- 172.21.15.154:0/760278633 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f28a00678f0 0x7f28a0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:22.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.772+0000 7f28c16df640 1 --2- 172.21.15.154:0/760278633 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f28a00678f0 0x7f28a0069db0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f28b80ae000 tx=0x7f28b80b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:22.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.776+0000 7f28b1ffb640 1 -- 172.21.15.154:0/760278633 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f28b4022030 con 0x7f28bc15bae0 2024-05-14T01:24:22.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.932+0000 7f28c3943640 1 -- 172.21.15.154:0/760278633 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28bc13d5b0 con 0x7f28bc15bae0 2024-05-14T01:24:22.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.936+0000 7f28b1ffb640 1 -- 172.21.15.154:0/760278633 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16950 (secure 0 0 0) 0x7f28b4010040 con 0x7f28bc15bae0 2024-05-14T01:24:22.923 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:22.923 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":23,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:24:16.454751+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:23:33.083538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T01:23:33.556058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:22.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.936+0000 7f28c3943640 1 -- 172.21.15.154:0/760278633 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f28a00678f0 msgr2=0x7f28a0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:22.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.936+0000 7f28c3943640 1 --2- 172.21.15.154:0/760278633 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f28a00678f0 0x7f28a0069db0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f28b80ae000 tx=0x7f28b80b3040 comp rx=0 tx=0).stop 2024-05-14T01:24:22.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.936+0000 7f28c3943640 1 -- 172.21.15.154:0/760278633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28bc15bae0 msgr2=0x7f28bc0c4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:22.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.936+0000 7f28c3943640 1 --2- 172.21.15.154:0/760278633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28bc15bae0 0x7f28bc0c4ac0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009d30 tx=0x7f28b400c490 comp rx=0 tx=0).stop 2024-05-14T01:24:22.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.936+0000 7f28c3943640 1 -- 172.21.15.154:0/760278633 shutdown_connections 2024-05-14T01:24:22.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.936+0000 7f28c3943640 1 --2- 172.21.15.154:0/760278633 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f28a00678f0 0x7f28a0069db0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.936+0000 7f28c3943640 1 --2- 172.21.15.154:0/760278633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28bc15bae0 0x7f28bc0c4ac0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.936+0000 7f28c3943640 1 --2- 172.21.15.154:0/760278633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28bc144760 0x7f28bc15a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.936+0000 7f28c3943640 1 --2- 172.21.15.154:0/760278633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28bc0b3530 0x7f28bc138cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:22.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.936+0000 7f28c3943640 1 -- 172.21.15.154:0/760278633 >> 172.21.15.154:0/760278633 conn(0x7f28bc0b1850 msgr2=0x7f28bc13dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:22.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.936+0000 7f28c3943640 1 -- 172.21.15.154:0/760278633 shutdown_connections 2024-05-14T01:24:22.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:22.936+0000 7f28c3943640 1 -- 172.21.15.154:0/760278633 wait complete. 2024-05-14T01:24:22.940 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-14T01:24:23.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.072+0000 7f4f9baa0640 1 Processor -- start 2024-05-14T01:24:23.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.072+0000 7f4f9baa0640 1 -- start start 2024-05-14T01:24:23.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9baa0640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4f94144760 0x7f4f9406e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:23.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9baa0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4f940b3530 0x7f4f9415b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:23.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9baa0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f94144b40 con 0x7f4f9415b910 2024-05-14T01:24:23.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9baa0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4f940b4650 con 0x7f4f940b3530 2024-05-14T01:24:23.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9baa0640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4f940b3a40 con 0x7f4f94144760 2024-05-14T01:24:23.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9903b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4f940b3530 0x7f4f9415b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:23.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9a03d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4f9415b910 0x7f4f9415e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37076/0 (socket says 172.21.15.154:37076) 2024-05-14T01:24:23.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9a03d640 1 -- 172.21.15.154:0/208423703 learned_addr learned my addr 172.21.15.154:0/208423703 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:23.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9983c640 1 --2- 172.21.15.154:0/208423703 >> v2:172.21.15.176:3300/0 conn(0x7f4f94144760 0x7f4f9406e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:23.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9903b640 1 -- 172.21.15.154:0/208423703 >> v2:172.21.15.176:3300/0 conn(0x7f4f94144760 msgr2=0x7f4f9406e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:23.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9903b640 1 --2- 172.21.15.154:0/208423703 >> v2:172.21.15.176:3300/0 conn(0x7f4f94144760 0x7f4f9406e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:23.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9903b640 1 -- 172.21.15.154:0/208423703 >> v1:172.21.15.154:6789/0 conn(0x7f4f9415b910 legacy=0x7f4f9415e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:23.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9883a640 1 -- 172.21.15.154:0/208423703 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2099932007 0 0) 0x7f4f94144b40 con 0x7f4f9415b910 2024-05-14T01:24:23.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9903b640 1 -- 172.21.15.154:0/208423703 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f940b3d20 con 0x7f4f940b3530 2024-05-14T01:24:23.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9983c640 1 --2- 172.21.15.154:0/208423703 >> v2:172.21.15.176:3300/0 conn(0x7f4f94144760 0x7f4f9406e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:23.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9903b640 1 --2- 172.21.15.154:0/208423703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f940b3530 0x7f4f9415b3d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4f9406c250 tx=0x7f4f8401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76dd7641afc2e6e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:23.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9883a640 1 -- 172.21.15.154:0/208423703 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f840a7070 con 0x7f4f940b3530 2024-05-14T01:24:23.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9883a640 1 -- 172.21.15.154:0/208423703 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f840b0070 con 0x7f4f940b3530 2024-05-14T01:24:23.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.076+0000 7f4f9883a640 1 -- 172.21.15.154:0/208423703 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f840ab890 con 0x7f4f940b3530 2024-05-14T01:24:23.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9baa0640 1 -- 172.21.15.154:0/208423703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f940b3530 msgr2=0x7f4f9415b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:23.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9baa0640 1 --2- 172.21.15.154:0/208423703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f940b3530 0x7f4f9415b3d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4f9406c250 tx=0x7f4f8401c450 comp rx=0 tx=0).stop 2024-05-14T01:24:23.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9baa0640 1 -- 172.21.15.154:0/208423703 shutdown_connections 2024-05-14T01:24:23.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9baa0640 1 --2- 172.21.15.154:0/208423703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f940b3530 0x7f4f9415b3d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:23.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9baa0640 1 --2- 172.21.15.154:0/208423703 >> v2:172.21.15.176:3300/0 conn(0x7f4f94144760 0x7f4f9406e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:23.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9baa0640 1 -- 172.21.15.154:0/208423703 >> 172.21.15.154:0/208423703 conn(0x7f4f940b1850 msgr2=0x7f4f940b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:23.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9baa0640 1 -- 172.21.15.154:0/208423703 shutdown_connections 2024-05-14T01:24:23.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9baa0640 1 -- 172.21.15.154:0/208423703 wait complete. 2024-05-14T01:24:23.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9baa0640 1 Processor -- start 2024-05-14T01:24:23.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9baa0640 1 -- start start 2024-05-14T01:24:23.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9baa0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f940b3530 0x7f4f94139920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:23.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9baa0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f94144760 0x7f4f940718e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:23.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9baa0640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f9415b910 0x7f4f94140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:23.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9baa0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9406ed40 con 0x7f4f94144760 2024-05-14T01:24:23.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9baa0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9406ebc0 con 0x7f4f940b3530 2024-05-14T01:24:23.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9baa0640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4f94167d20 con 0x7f4f9415b910 2024-05-14T01:24:23.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9903b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f94144760 0x7f4f940718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:23.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9903b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f94144760 0x7f4f940718e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42868/0 (socket says 172.21.15.154:42868) 2024-05-14T01:24:23.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9903b640 1 -- 172.21.15.154:0/3179071031 learned_addr learned my addr 172.21.15.154:0/3179071031 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:23.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9a03d640 1 --2- 172.21.15.154:0/3179071031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f9415b910 0x7f4f94140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:23.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9983c640 1 --2- 172.21.15.154:0/3179071031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f940b3530 0x7f4f94139920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:23.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9903b640 1 -- 172.21.15.154:0/3179071031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f9415b910 msgr2=0x7f4f94140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:23.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9903b640 1 --2- 172.21.15.154:0/3179071031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f9415b910 0x7f4f94140ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:23.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9903b640 1 -- 172.21.15.154:0/3179071031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f940b3530 msgr2=0x7f4f94139920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:23.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9903b640 1 --2- 172.21.15.154:0/3179071031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f940b3530 0x7f4f94139920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:23.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9903b640 1 -- 172.21.15.154:0/3179071031 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9413ae80 con 0x7f4f94144760 2024-05-14T01:24:23.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9903b640 1 --2- 172.21.15.154:0/3179071031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f94144760 0x7f4f940718e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4f840ad040 tx=0x7f4f8401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:23.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f8a7fc640 1 -- 172.21.15.154:0/3179071031 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f840bf610 con 0x7f4f94144760 2024-05-14T01:24:23.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f8a7fc640 1 -- 172.21.15.154:0/3179071031 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f840bf7b0 con 0x7f4f94144760 2024-05-14T01:24:23.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9baa0640 1 -- 172.21.15.154:0/3179071031 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9413b160 con 0x7f4f94144760 2024-05-14T01:24:23.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f8a7fc640 1 -- 172.21.15.154:0/3179071031 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f840bfb60 con 0x7f4f94144760 2024-05-14T01:24:23.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.080+0000 7f4f9baa0640 1 -- 172.21.15.154:0/3179071031 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f94163de0 con 0x7f4f94144760 2024-05-14T01:24:23.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.084+0000 7f4f9baa0640 1 -- 172.21.15.154:0/3179071031 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f94067850 con 0x7f4f94144760 2024-05-14T01:24:23.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.084+0000 7f4f8a7fc640 1 -- 172.21.15.154:0/3179071031 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4f840bd020 con 0x7f4f94144760 2024-05-14T01:24:23.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.084+0000 7f4f8a7fc640 1 --2- 172.21.15.154:0/3179071031 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4f780678c0 0x7f4f78069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:23.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.084+0000 7f4f9983c640 1 --2- 172.21.15.154:0/3179071031 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4f780678c0 0x7f4f78069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:23.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.084+0000 7f4f8a7fc640 1 -- 172.21.15.154:0/3179071031 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f4f841204c0 con 0x7f4f94144760 2024-05-14T01:24:23.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.084+0000 7f4f9983c640 1 --2- 172.21.15.154:0/3179071031 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4f780678c0 0x7f4f78069d80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4f90006fd0 tx=0x7f4f90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:23.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.088+0000 7f4f8a7fc640 1 -- 172.21.15.154:0/3179071031 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f4f84016070 con 0x7f4f94144760 2024-05-14T01:24:23.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.288+0000 7f4f9baa0640 1 -- 172.21.15.154:0/3179071031 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4f9406d250 con 0x7f4f94144760 2024-05-14T01:24:23.275 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-05-14T01:24:23.288+0000 7f81568cc640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-14T01:24:23.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.288+0000 7f4f8a7fc640 1 -- 172.21.15.154:0/3179071031 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f4f840f1000 con 0x7f4f94144760 2024-05-14T01:24:23.277 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-14T01:24:23.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.292+0000 7f4f9baa0640 1 -- 172.21.15.154:0/3179071031 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4f780678c0 msgr2=0x7f4f78069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:23.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.292+0000 7f4f9baa0640 1 --2- 172.21.15.154:0/3179071031 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4f780678c0 0x7f4f78069d80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4f90006fd0 tx=0x7f4f90008040 comp rx=0 tx=0).stop 2024-05-14T01:24:23.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.292+0000 7f4f9baa0640 1 -- 172.21.15.154:0/3179071031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f94144760 msgr2=0x7f4f940718e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:23.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.292+0000 7f4f9baa0640 1 --2- 172.21.15.154:0/3179071031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f94144760 0x7f4f940718e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4f840ad040 tx=0x7f4f8401ac90 comp rx=0 tx=0).stop 2024-05-14T01:24:23.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.292+0000 7f4f9baa0640 1 -- 172.21.15.154:0/3179071031 shutdown_connections 2024-05-14T01:24:23.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.292+0000 7f4f9baa0640 1 --2- 172.21.15.154:0/3179071031 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f4f780678c0 0x7f4f78069d80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:23.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.292+0000 7f4f9baa0640 1 --2- 172.21.15.154:0/3179071031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f9415b910 0x7f4f94140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:23.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.292+0000 7f4f9baa0640 1 --2- 172.21.15.154:0/3179071031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f94144760 0x7f4f940718e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:23.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.292+0000 7f4f9baa0640 1 --2- 172.21.15.154:0/3179071031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f940b3530 0x7f4f94139920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:23.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.292+0000 7f4f9baa0640 1 -- 172.21.15.154:0/3179071031 >> 172.21.15.154:0/3179071031 conn(0x7f4f940b1850 msgr2=0x7f4f9406e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:23.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.292+0000 7f4f9baa0640 1 -- 172.21.15.154:0/3179071031 shutdown_connections 2024-05-14T01:24:23.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.292+0000 7f4f9baa0640 1 -- 172.21.15.154:0/3179071031 wait complete. 2024-05-14T01:24:23.293 INFO:tasks.ceph.mds.b.smithi176.stderr: -3126> 2024-05-14T01:23:40.639+0000 7f9be0e25640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-14T01:24:23.297 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-14T01:24:23.337 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-05-14T01:24:23.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.432+0000 7f97c51b4640 1 Processor -- start 2024-05-14T01:24:23.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.432+0000 7f97c51b4640 1 -- start start 2024-05-14T01:24:23.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.432+0000 7f97c51b4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f97c015a670 0x7f97c0071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:23.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.432+0000 7f97c51b4640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f97c006dde0 0x7f97c0164160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:23.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.432+0000 7f97c51b4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97c0071ea0 con 0x7f97c0071060 2024-05-14T01:24:23.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.432+0000 7f97c51b4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f97c00b32d0 con 0x7f97c015a670 2024-05-14T01:24:23.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.432+0000 7f97c51b4640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f97c00b2c80 con 0x7f97c006dde0 2024-05-14T01:24:23.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.432+0000 7f97b659c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f97c0071060 0x7f97c006d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37082/0 (socket says 172.21.15.154:37082) 2024-05-14T01:24:23.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.432+0000 7f97b659c640 1 -- 172.21.15.154:0/1868489350 learned_addr learned my addr 172.21.15.154:0/1868489350 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:23.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.432+0000 7f97bed9d640 1 --2- 172.21.15.154:0/1868489350 >> v2:172.21.15.154:3300/0 conn(0x7f97c015a670 0x7f97c0071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:23.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.432+0000 7f97bf59e640 1 --2- 172.21.15.154:0/1868489350 >> v2:172.21.15.176:3300/0 conn(0x7f97c006dde0 0x7f97c0164160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:23.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.432+0000 7f97be59c640 1 -- 172.21.15.154:0/1868489350 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3451463653 0 0) 0x7f97c0071ea0 con 0x7f97c0071060 2024-05-14T01:24:23.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.432+0000 7f97be59c640 1 -- 172.21.15.154:0/1868489350 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97ac003450 con 0x7f97c0071060 2024-05-14T01:24:23.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.432+0000 7f97bed9d640 1 -- 172.21.15.154:0/1868489350 >> v2:172.21.15.176:3300/0 conn(0x7f97c006dde0 msgr2=0x7f97c0164160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:23.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.432+0000 7f97bed9d640 1 --2- 172.21.15.154:0/1868489350 >> v2:172.21.15.176:3300/0 conn(0x7f97c006dde0 0x7f97c0164160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:23.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.432+0000 7f97bed9d640 1 -- 172.21.15.154:0/1868489350 >> v1:172.21.15.154:6789/0 conn(0x7f97c0071060 legacy=0x7f97c006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:23.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.432+0000 7f97bed9d640 1 -- 172.21.15.154:0/1868489350 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c00b2f60 con 0x7f97c015a670 2024-05-14T01:24:23.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97bed9d640 1 --2- 172.21.15.154:0/1868489350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97c015a670 0x7f97c0071850 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f97c00cc0a0 tx=0x7f97b001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd70965bffb0a71 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:23.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97be59c640 1 -- 172.21.15.154:0/1868489350 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b00b0070 con 0x7f97c015a670 2024-05-14T01:24:23.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97be59c640 1 -- 172.21.15.154:0/1868489350 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b00ab600 con 0x7f97c015a670 2024-05-14T01:24:23.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97be59c640 1 -- 172.21.15.154:0/1868489350 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b00ab9d0 con 0x7f97c015a670 2024-05-14T01:24:23.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97c51b4640 1 -- 172.21.15.154:0/1868489350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97c015a670 msgr2=0x7f97c0071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:23.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97c51b4640 1 --2- 172.21.15.154:0/1868489350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97c015a670 0x7f97c0071850 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f97c00cc0a0 tx=0x7f97b001c480 comp rx=0 tx=0).stop 2024-05-14T01:24:23.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97c51b4640 1 -- 172.21.15.154:0/1868489350 shutdown_connections 2024-05-14T01:24:23.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97c51b4640 1 --2- 172.21.15.154:0/1868489350 >> v2:172.21.15.176:3300/0 conn(0x7f97c006dde0 0x7f97c0164160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:23.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97c51b4640 1 --2- 172.21.15.154:0/1868489350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97c015a670 0x7f97c0071850 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:23.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97c51b4640 1 -- 172.21.15.154:0/1868489350 >> 172.21.15.154:0/1868489350 conn(0x7f97c00b1770 msgr2=0x7f97c00b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:23.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97c51b4640 1 -- 172.21.15.154:0/1868489350 shutdown_connections 2024-05-14T01:24:23.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97c51b4640 1 -- 172.21.15.154:0/1868489350 wait complete. 2024-05-14T01:24:23.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97c51b4640 1 Processor -- start 2024-05-14T01:24:23.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97c51b4640 1 -- start start 2024-05-14T01:24:23.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97c51b4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97c006dde0 0x7f97c0150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:23.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97c51b4640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97c0071060 0x7f97c0148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:23.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97c51b4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97c015a670 0x7f97c0148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:23.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97c51b4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0166a40 con 0x7f97c015a670 2024-05-14T01:24:23.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97c51b4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f97c01668c0 con 0x7f97c006dde0 2024-05-14T01:24:23.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97c51b4640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f97c0166bc0 con 0x7f97c0071060 2024-05-14T01:24:23.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97bf59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97c015a670 0x7f97c0148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:23.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97bf59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97c015a670 0x7f97c0148fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42884/0 (socket says 172.21.15.154:42884) 2024-05-14T01:24:23.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97bf59e640 1 -- 172.21.15.154:0/191849630 learned_addr learned my addr 172.21.15.154:0/191849630 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:23.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97b659c640 1 --2- 172.21.15.154:0/191849630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97c0071060 0x7f97c0148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:23.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.436+0000 7f97bed9d640 1 --2- 172.21.15.154:0/191849630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97c006dde0 0x7f97c0150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:23.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.440+0000 7f97bf59e640 1 -- 172.21.15.154:0/191849630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97c0071060 msgr2=0x7f97c0148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:23.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.440+0000 7f97bf59e640 1 --2- 172.21.15.154:0/191849630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97c0071060 0x7f97c0148a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:23.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.440+0000 7f97bf59e640 1 -- 172.21.15.154:0/191849630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97c006dde0 msgr2=0x7f97c0150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:23.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.440+0000 7f97bf59e640 1 --2- 172.21.15.154:0/191849630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97c006dde0 0x7f97c0150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:23.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.440+0000 7f97bf59e640 1 -- 172.21.15.154:0/191849630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c0149770 con 0x7f97c015a670 2024-05-14T01:24:23.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.440+0000 7f97bf59e640 1 --2- 172.21.15.154:0/191849630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97c015a670 0x7f97c0148fd0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f97b8007e70 tx=0x7f97b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:23.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.440+0000 7f97b7fff640 1 -- 172.21.15.154:0/191849630 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8014620 con 0x7f97c015a670 2024-05-14T01:24:23.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.440+0000 7f97b7fff640 1 -- 172.21.15.154:0/191849630 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b8019070 con 0x7f97c015a670 2024-05-14T01:24:23.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.440+0000 7f97c51b4640 1 -- 172.21.15.154:0/191849630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c00ccd40 con 0x7f97c015a670 2024-05-14T01:24:23.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.440+0000 7f97b7fff640 1 -- 172.21.15.154:0/191849630 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8014a20 con 0x7f97c015a670 2024-05-14T01:24:23.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.440+0000 7f97c51b4640 1 -- 172.21.15.154:0/191849630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c00cd300 con 0x7f97c015a670 2024-05-14T01:24:23.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.440+0000 7f97c51b4640 1 -- 172.21.15.154:0/191849630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c0075470 con 0x7f97c015a670 2024-05-14T01:24:23.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.440+0000 7f97b7fff640 1 -- 172.21.15.154:0/191849630 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f97b8014bc0 con 0x7f97c015a670 2024-05-14T01:24:23.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.440+0000 7f97b7fff640 1 --2- 172.21.15.154:0/191849630 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f97a00678f0 0x7f97a0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:23.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.440+0000 7f97b7fff640 1 -- 172.21.15.154:0/191849630 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7f97b8086650 con 0x7f97c015a670 2024-05-14T01:24:23.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.440+0000 7f97bed9d640 1 --2- 172.21.15.154:0/191849630 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f97a00678f0 0x7f97a0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:23.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.440+0000 7f97bed9d640 1 --2- 172.21.15.154:0/191849630 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f97a00678f0 0x7f97a0069db0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f97b00ad000 tx=0x7f97b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:23.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.444+0000 7f97b7fff640 1 -- 172.21.15.154:0/191849630 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f97b8011260 con 0x7f97c015a670 2024-05-14T01:24:23.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:23.644+0000 7f97c51b4640 1 -- 172.21.15.154:0/191849630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f97c0150370 con 0x7f97c015a670 2024-05-14T01:24:24.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.292+0000 7f97b7fff640 1 -- 172.21.15.154:0/191849630 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f97b80570a0 con 0x7f97c015a670 2024-05-14T01:24:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.296+0000 7f97c51b4640 1 -- 172.21.15.154:0/191849630 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f97a00678f0 msgr2=0x7f97a0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.296+0000 7f97c51b4640 1 --2- 172.21.15.154:0/191849630 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f97a00678f0 0x7f97a0069db0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f97b00ad000 tx=0x7f97b0008040 comp rx=0 tx=0).stop 2024-05-14T01:24:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.296+0000 7f97c51b4640 1 -- 172.21.15.154:0/191849630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97c015a670 msgr2=0x7f97c0148fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.296+0000 7f97c51b4640 1 --2- 172.21.15.154:0/191849630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97c015a670 0x7f97c0148fd0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f97b8007e70 tx=0x7f97b800e4b0 comp rx=0 tx=0).stop 2024-05-14T01:24:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.296+0000 7f97c51b4640 1 -- 172.21.15.154:0/191849630 shutdown_connections 2024-05-14T01:24:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.296+0000 7f97c51b4640 1 --2- 172.21.15.154:0/191849630 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f97a00678f0 0x7f97a0069db0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.296+0000 7f97c51b4640 1 --2- 172.21.15.154:0/191849630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97c015a670 0x7f97c0148fd0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.296+0000 7f97c51b4640 1 --2- 172.21.15.154:0/191849630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97c0071060 0x7f97c0148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.296+0000 7f97c51b4640 1 --2- 172.21.15.154:0/191849630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97c006dde0 0x7f97c0150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.296+0000 7f97c51b4640 1 -- 172.21.15.154:0/191849630 >> 172.21.15.154:0/191849630 conn(0x7f97c00b1770 msgr2=0x7f97c0152be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.296+0000 7f97c51b4640 1 -- 172.21.15.154:0/191849630 shutdown_connections 2024-05-14T01:24:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.296+0000 7f97c51b4640 1 -- 172.21.15.154:0/191849630 wait complete. 2024-05-14T01:24:24.305 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-14T01:24:24.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.444+0000 7fae93bb8640 1 Processor -- start 2024-05-14T01:24:24.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.444+0000 7fae93bb8640 1 -- start start 2024-05-14T01:24:24.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.448+0000 7fae93bb8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae8c0b4570 0x7fae8c06e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:24.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.448+0000 7fae93bb8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae8c144b00 con 0x7fae8c144720 2024-05-14T01:24:24.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.448+0000 7fae93bb8640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae8c06ece0 con 0x7fae8c15f150 2024-05-14T01:24:24.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.448+0000 7fae93bb8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fae8c06ea80 con 0x7fae8c0b4570 2024-05-14T01:24:24.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.448+0000 7fae91954640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fae8c144720 0x7fae8c15ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37090/0 (socket says 172.21.15.154:37090) 2024-05-14T01:24:24.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.448+0000 7fae91954640 1 -- 172.21.15.154:0/2139546981 learned_addr learned my addr 172.21.15.154:0/2139546981 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:24.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.448+0000 7fae92155640 1 --2- 172.21.15.154:0/2139546981 >> v2:172.21.15.154:3300/0 conn(0x7fae8c0b4570 0x7fae8c06e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:24.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.448+0000 7fae90952640 1 -- 172.21.15.154:0/2139546981 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3401542380 0 0) 0x7fae8c144b00 con 0x7fae8c144720 2024-05-14T01:24:24.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.448+0000 7fae90952640 1 -- 172.21.15.154:0/2139546981 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae78003530 con 0x7fae8c144720 2024-05-14T01:24:24.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.448+0000 7fae92155640 1 -- 172.21.15.154:0/2139546981 >> v1:172.21.15.176:6789/0 conn(0x7fae8c15f150 legacy=0x7fae8c071d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:24.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.448+0000 7fae92155640 1 -- 172.21.15.154:0/2139546981 >> v1:172.21.15.154:6789/0 conn(0x7fae8c144720 legacy=0x7fae8c15ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:24.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.448+0000 7fae92155640 1 -- 172.21.15.154:0/2139546981 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8c070f50 con 0x7fae8c0b4570 2024-05-14T01:24:24.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.448+0000 7fae92155640 1 --2- 172.21.15.154:0/2139546981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae8c0b4570 0x7fae8c06e540 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fae84009d90 tx=0x7fae8401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5265ae9259bac8f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:24.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.448+0000 7fae90952640 1 -- 172.21.15.154:0/2139546981 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae840b2070 con 0x7fae8c0b4570 2024-05-14T01:24:24.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.448+0000 7fae90952640 1 -- 172.21.15.154:0/2139546981 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae840a5930 con 0x7fae8c0b4570 2024-05-14T01:24:24.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.448+0000 7fae90952640 1 -- 172.21.15.154:0/2139546981 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae840a5d00 con 0x7fae8c0b4570 2024-05-14T01:24:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae93bb8640 1 -- 172.21.15.154:0/2139546981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae8c0b4570 msgr2=0x7fae8c06e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae93bb8640 1 --2- 172.21.15.154:0/2139546981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae8c0b4570 0x7fae8c06e540 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fae84009d90 tx=0x7fae8401c870 comp rx=0 tx=0).stop 2024-05-14T01:24:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae93bb8640 1 -- 172.21.15.154:0/2139546981 shutdown_connections 2024-05-14T01:24:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae93bb8640 1 --2- 172.21.15.154:0/2139546981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae8c0b4570 0x7fae8c06e540 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae93bb8640 1 -- 172.21.15.154:0/2139546981 >> 172.21.15.154:0/2139546981 conn(0x7fae8c0b1850 msgr2=0x7fae8c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae93bb8640 1 -- 172.21.15.154:0/2139546981 shutdown_connections 2024-05-14T01:24:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae93bb8640 1 -- 172.21.15.154:0/2139546981 wait complete. 2024-05-14T01:24:24.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae93bb8640 1 Processor -- start 2024-05-14T01:24:24.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae93bb8640 1 -- start start 2024-05-14T01:24:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae93bb8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae8c0b4570 0x7fae8c1598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae93bb8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae8c144720 0x7fae8c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae93bb8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae8c15f150 0x7fae8c13a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae93bb8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c168f50 con 0x7fae8c0b4570 2024-05-14T01:24:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae93bb8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c168dd0 con 0x7fae8c15f150 2024-05-14T01:24:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae93bb8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fae8c1690d0 con 0x7fae8c144720 2024-05-14T01:24:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae91954640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae8c0b4570 0x7fae8c1598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae91954640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae8c0b4570 0x7fae8c1598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42892/0 (socket says 172.21.15.154:42892) 2024-05-14T01:24:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae91954640 1 -- 172.21.15.154:0/4127840638 learned_addr learned my addr 172.21.15.154:0/4127840638 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae92155640 1 --2- 172.21.15.154:0/4127840638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae8c15f150 0x7fae8c13a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae91153640 1 --2- 172.21.15.154:0/4127840638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae8c144720 0x7fae8c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae91954640 1 -- 172.21.15.154:0/4127840638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae8c144720 msgr2=0x7fae8c06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae91954640 1 --2- 172.21.15.154:0/4127840638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae8c144720 0x7fae8c06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae91954640 1 -- 172.21.15.154:0/4127840638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae8c15f150 msgr2=0x7fae8c13a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae91954640 1 --2- 172.21.15.154:0/4127840638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae8c15f150 0x7fae8c13a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae91954640 1 -- 172.21.15.154:0/4127840638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8c1586a0 con 0x7fae8c0b4570 2024-05-14T01:24:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae91153640 1 --2- 172.21.15.154:0/4127840638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae8c144720 0x7fae8c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae91954640 1 --2- 172.21.15.154:0/4127840638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae8c0b4570 0x7fae8c1598f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fae8800c480 tx=0x7fae8800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae827fc640 1 -- 172.21.15.154:0/4127840638 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae88017070 con 0x7fae8c0b4570 2024-05-14T01:24:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae827fc640 1 -- 172.21.15.154:0/4127840638 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae88005cf0 con 0x7fae8c0b4570 2024-05-14T01:24:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae93bb8640 1 -- 172.21.15.154:0/4127840638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae8c158e10 con 0x7fae8c0b4570 2024-05-14T01:24:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae827fc640 1 -- 172.21.15.154:0/4127840638 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae88007290 con 0x7fae8c0b4570 2024-05-14T01:24:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.452+0000 7fae93bb8640 1 -- 172.21.15.154:0/4127840638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae8c1593d0 con 0x7fae8c0b4570 2024-05-14T01:24:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.456+0000 7fae93bb8640 1 -- 172.21.15.154:0/4127840638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae8c075470 con 0x7fae8c0b4570 2024-05-14T01:24:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.456+0000 7fae827fc640 1 -- 172.21.15.154:0/4127840638 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fae8801a070 con 0x7fae8c0b4570 2024-05-14T01:24:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.456+0000 7fae827fc640 1 --2- 172.21.15.154:0/4127840638 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fae700678c0 0x7fae70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.456+0000 7fae827fc640 1 -- 172.21.15.154:0/4127840638 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7fae88085140 con 0x7fae8c0b4570 2024-05-14T01:24:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.456+0000 7fae91153640 1 --2- 172.21.15.154:0/4127840638 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fae700678c0 0x7fae70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.456+0000 7fae91153640 1 --2- 172.21.15.154:0/4127840638 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fae700678c0 0x7fae70069d80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fae8c166d90 tx=0x7fae7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:24.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.460+0000 7fae827fc640 1 -- 172.21.15.154:0/4127840638 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fae88055c20 con 0x7fae8c0b4570 2024-05-14T01:24:24.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:24.620+0000 7fae93bb8640 1 -- 172.21.15.154:0/4127840638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fae8c157510 con 0x7fae8c0b4570 2024-05-14T01:24:25.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.516+0000 7fae827fc640 1 -- 172.21.15.154:0/4127840638 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7fae88055520 con 0x7fae8c0b4570 2024-05-14T01:24:25.504 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2024-05-14T01:24:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.520+0000 7fae93bb8640 1 -- 172.21.15.154:0/4127840638 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fae700678c0 msgr2=0x7fae70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.520+0000 7fae93bb8640 1 --2- 172.21.15.154:0/4127840638 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fae700678c0 0x7fae70069d80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fae8c166d90 tx=0x7fae7c009040 comp rx=0 tx=0).stop 2024-05-14T01:24:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.520+0000 7fae93bb8640 1 -- 172.21.15.154:0/4127840638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae8c0b4570 msgr2=0x7fae8c1598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.520+0000 7fae93bb8640 1 --2- 172.21.15.154:0/4127840638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae8c0b4570 0x7fae8c1598f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fae8800c480 tx=0x7fae8800c940 comp rx=0 tx=0).stop 2024-05-14T01:24:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.520+0000 7fae93bb8640 1 -- 172.21.15.154:0/4127840638 shutdown_connections 2024-05-14T01:24:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.520+0000 7fae93bb8640 1 --2- 172.21.15.154:0/4127840638 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fae700678c0 0x7fae70069d80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.520+0000 7fae93bb8640 1 --2- 172.21.15.154:0/4127840638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae8c15f150 0x7fae8c13a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.520+0000 7fae93bb8640 1 --2- 172.21.15.154:0/4127840638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae8c144720 0x7fae8c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.520+0000 7fae93bb8640 1 --2- 172.21.15.154:0/4127840638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae8c0b4570 0x7fae8c1598f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.520+0000 7fae93bb8640 1 -- 172.21.15.154:0/4127840638 >> 172.21.15.154:0/4127840638 conn(0x7fae8c0b1850 msgr2=0x7fae8c15a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.520+0000 7fae93bb8640 1 -- 172.21.15.154:0/4127840638 shutdown_connections 2024-05-14T01:24:25.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.520+0000 7fae93bb8640 1 -- 172.21.15.154:0/4127840638 wait complete. 2024-05-14T01:24:25.531 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-14T01:24:25.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.672+0000 7f7f47bc5640 1 Processor -- start 2024-05-14T01:24:25.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.672+0000 7f7f47bc5640 1 -- start start 2024-05-14T01:24:25.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.672+0000 7f7f47bc5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7f40160130 0x7f7f400b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:25.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.672+0000 7f7f47bc5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7f4006d240 0x7f7f4006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:25.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.672+0000 7f7f47bc5640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f400b2df0 con 0x7f7f401457c0 2024-05-14T01:24:25.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.672+0000 7f7f47bc5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7f40145ba0 con 0x7f7f4006d240 2024-05-14T01:24:25.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.672+0000 7f7f47bc5640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7f4006cdb0 con 0x7f7f40160130 2024-05-14T01:24:25.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.672+0000 7f7f46162640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7f4006d240 0x7f7f4006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:25.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.672+0000 7f7f46162640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7f4006d240 0x7f7f4006d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42900/0 (socket says 172.21.15.154:42900) 2024-05-14T01:24:25.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.672+0000 7f7f46162640 1 -- 172.21.15.154:0/2487428506 learned_addr learned my addr 172.21.15.154:0/2487428506 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:25.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.672+0000 7f7f45160640 1 --2- 172.21.15.154:0/2487428506 >> v2:172.21.15.176:3300/0 conn(0x7f7f40160130 0x7f7f400b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:25.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.672+0000 7f7f46162640 1 -- 172.21.15.154:0/2487428506 >> v2:172.21.15.176:3300/0 conn(0x7f7f40160130 msgr2=0x7f7f400b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:25.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.672+0000 7f7f46162640 1 --2- 172.21.15.154:0/2487428506 >> v2:172.21.15.176:3300/0 conn(0x7f7f40160130 0x7f7f400b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:25.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.672+0000 7f7f46162640 1 -- 172.21.15.154:0/2487428506 >> v1:172.21.15.176:6789/0 conn(0x7f7f401457c0 legacy=0x7f7f4015fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:25.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.672+0000 7f7f46162640 1 -- 172.21.15.154:0/2487428506 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f400cf230 con 0x7f7f4006d240 2024-05-14T01:24:25.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.672+0000 7f7f45160640 1 --2- 172.21.15.154:0/2487428506 >> v2:172.21.15.176:3300/0 conn(0x7f7f40160130 0x7f7f400b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:25.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.676+0000 7f7f46162640 1 --2- 172.21.15.154:0/2487428506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4006d240 0x7f7f4006d690 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7f40070dd0 tx=0x7f7f3801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf46b7d47a85b251 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:25.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.676+0000 7f7f4495f640 1 -- 172.21.15.154:0/2487428506 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f380a56d0 con 0x7f7f4006d240 2024-05-14T01:24:25.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.676+0000 7f7f4495f640 1 -- 172.21.15.154:0/2487428506 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f380a5870 con 0x7f7f4006d240 2024-05-14T01:24:25.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.676+0000 7f7f4495f640 1 -- 172.21.15.154:0/2487428506 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f380a5c40 con 0x7f7f4006d240 2024-05-14T01:24:25.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.676+0000 7f7f47bc5640 1 -- 172.21.15.154:0/2487428506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4006d240 msgr2=0x7f7f4006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:25.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.676+0000 7f7f47bc5640 1 --2- 172.21.15.154:0/2487428506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4006d240 0x7f7f4006d690 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7f40070dd0 tx=0x7f7f3801c920 comp rx=0 tx=0).stop 2024-05-14T01:24:25.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.676+0000 7f7f47bc5640 1 -- 172.21.15.154:0/2487428506 shutdown_connections 2024-05-14T01:24:25.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.676+0000 7f7f47bc5640 1 --2- 172.21.15.154:0/2487428506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4006d240 0x7f7f4006d690 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:25.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.676+0000 7f7f47bc5640 1 --2- 172.21.15.154:0/2487428506 >> v2:172.21.15.176:3300/0 conn(0x7f7f40160130 0x7f7f400b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:25.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.676+0000 7f7f47bc5640 1 -- 172.21.15.154:0/2487428506 >> 172.21.15.154:0/2487428506 conn(0x7f7f400b1850 msgr2=0x7f7f400b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:25.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.676+0000 7f7f47bc5640 1 -- 172.21.15.154:0/2487428506 shutdown_connections 2024-05-14T01:24:25.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.676+0000 7f7f47bc5640 1 -- 172.21.15.154:0/2487428506 wait complete. 2024-05-14T01:24:25.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.676+0000 7f7f47bc5640 1 Processor -- start 2024-05-14T01:24:25.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f47bc5640 1 -- start start 2024-05-14T01:24:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f47bc5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4006d240 0x7f7f4015ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f47bc5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f401457c0 0x7f7f4013f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f47bc5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f40160130 0x7f7f4013f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f47bc5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7f40168dc0 con 0x7f7f401457c0 2024-05-14T01:24:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f47bc5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7f400cefd0 con 0x7f7f4006d240 2024-05-14T01:24:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f47bc5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7f40168f40 con 0x7f7f40160130 2024-05-14T01:24:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f45160640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f401457c0 0x7f7f4013f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f45160640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f401457c0 0x7f7f4013f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42904/0 (socket says 172.21.15.154:42904) 2024-05-14T01:24:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f45160640 1 -- 172.21.15.154:0/2447619175 learned_addr learned my addr 172.21.15.154:0/2447619175 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f45961640 1 --2- 172.21.15.154:0/2447619175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4006d240 0x7f7f4015ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f46162640 1 --2- 172.21.15.154:0/2447619175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f40160130 0x7f7f4013f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:25.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f45160640 1 -- 172.21.15.154:0/2447619175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f40160130 msgr2=0x7f7f4013f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:25.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f45160640 1 --2- 172.21.15.154:0/2447619175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f40160130 0x7f7f4013f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:25.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f45160640 1 -- 172.21.15.154:0/2447619175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4006d240 msgr2=0x7f7f4015ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:25.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f45160640 1 --2- 172.21.15.154:0/2447619175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4006d240 0x7f7f4015ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:25.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f45160640 1 -- 172.21.15.154:0/2447619175 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4015cb20 con 0x7f7f401457c0 2024-05-14T01:24:25.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f45961640 1 --2- 172.21.15.154:0/2447619175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4006d240 0x7f7f4015ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:25.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f45160640 1 --2- 172.21.15.154:0/2447619175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f401457c0 0x7f7f4013f1b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7f3000c7f0 tx=0x7f7f3000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:25.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f367fc640 1 -- 172.21.15.154:0/2447619175 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f30015070 con 0x7f7f401457c0 2024-05-14T01:24:25.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f367fc640 1 -- 172.21.15.154:0/2447619175 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f30007820 con 0x7f7f401457c0 2024-05-14T01:24:25.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f47bc5640 1 -- 172.21.15.154:0/2447619175 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f4015cd90 con 0x7f7f401457c0 2024-05-14T01:24:25.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f367fc640 1 -- 172.21.15.154:0/2447619175 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f30007c10 con 0x7f7f401457c0 2024-05-14T01:24:25.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f47bc5640 1 -- 172.21.15.154:0/2447619175 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f4015d350 con 0x7f7f401457c0 2024-05-14T01:24:25.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f47bc5640 1 -- 172.21.15.154:0/2447619175 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f40075470 con 0x7f7f401457c0 2024-05-14T01:24:25.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f367fc640 1 -- 172.21.15.154:0/2447619175 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7f30018070 con 0x7f7f401457c0 2024-05-14T01:24:25.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f367fc640 1 --2- 172.21.15.154:0/2447619175 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7f240678f0 0x7f7f24069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:25.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f367fc640 1 -- 172.21.15.154:0/2447619175 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5502+0+0 (secure 0 0 0) 0x7f7f300860b0 con 0x7f7f401457c0 2024-05-14T01:24:25.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.680+0000 7f7f45961640 1 --2- 172.21.15.154:0/2447619175 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7f240678f0 0x7f7f24069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:25.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.684+0000 7f7f45961640 1 --2- 172.21.15.154:0/2447619175 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7f240678f0 0x7f7f24069db0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c003e40 tx=0x7f7f3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:25.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.684+0000 7f7f367fc640 1 -- 172.21.15.154:0/2447619175 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f7f30056da0 con 0x7f7f401457c0 2024-05-14T01:24:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:25.860+0000 7f7f47bc5640 1 -- 172.21.15.154:0/2447619175 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7f4006e890 con 0x7f7f401457c0 2024-05-14T01:24:26.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.516+0000 7f7f367fc640 1 -- 172.21.15.154:0/2447619175 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7f7f300566a0 con 0x7f7f401457c0 2024-05-14T01:24:26.506 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2024-05-14T01:24:26.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.520+0000 7f7f47bc5640 1 -- 172.21.15.154:0/2447619175 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7f240678f0 msgr2=0x7f7f24069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:26.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.520+0000 7f7f47bc5640 1 --2- 172.21.15.154:0/2447619175 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7f240678f0 0x7f7f24069db0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c003e40 tx=0x7f7f3c009040 comp rx=0 tx=0).stop 2024-05-14T01:24:26.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.520+0000 7f7f47bc5640 1 -- 172.21.15.154:0/2447619175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f401457c0 msgr2=0x7f7f4013f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:26.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.520+0000 7f7f47bc5640 1 --2- 172.21.15.154:0/2447619175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f401457c0 0x7f7f4013f1b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7f3000c7f0 tx=0x7f7f3000ccb0 comp rx=0 tx=0).stop 2024-05-14T01:24:26.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.520+0000 7f7f47bc5640 1 -- 172.21.15.154:0/2447619175 shutdown_connections 2024-05-14T01:24:26.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.520+0000 7f7f47bc5640 1 --2- 172.21.15.154:0/2447619175 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7f240678f0 0x7f7f24069db0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:26.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.520+0000 7f7f47bc5640 1 --2- 172.21.15.154:0/2447619175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f40160130 0x7f7f4013f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:26.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.520+0000 7f7f47bc5640 1 --2- 172.21.15.154:0/2447619175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f401457c0 0x7f7f4013f1b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:26.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.520+0000 7f7f47bc5640 1 --2- 172.21.15.154:0/2447619175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4006d240 0x7f7f4015ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:26.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.520+0000 7f7f47bc5640 1 -- 172.21.15.154:0/2447619175 >> 172.21.15.154:0/2447619175 conn(0x7f7f400b1850 msgr2=0x7f7f4013e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:26.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.520+0000 7f7f47bc5640 1 -- 172.21.15.154:0/2447619175 shutdown_connections 2024-05-14T01:24:26.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.520+0000 7f7f47bc5640 1 -- 172.21.15.154:0/2447619175 wait complete. 2024-05-14T01:24:26.537 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-14T01:24:26.537 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-14T01:24:26.537 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-14T01:24:26.538 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T01:24:26.538 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-14T01:24:26.538 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-14T01:24:26.538 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-14T01:24:26.538 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T01:24:26.538 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-14T01:24:26.538 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-14T01:24:26.539 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-14T01:24:26.539 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T01:24:26.539 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-14T01:24:26.539 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-14T01:24:26.539 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-14T01:24:26.539 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T01:24:26.549 INFO:tasks.ceph.mds.a:Stopped 2024-05-14T01:24:26.549 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-14T01:24:26.551 INFO:tasks.ceph.mds.c:Stopped 2024-05-14T01:24:26.552 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-14T01:24:26.557 INFO:tasks.ceph.mds.b:Stopped 2024-05-14T01:24:26.557 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-14T01:24:26.558 INFO:tasks.ceph.mds.d:Stopped 2024-05-14T01:24:26.558 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-14T01:24:26.595 INFO:tasks.ceph.mds.a:Started 2024-05-14T01:24:26.595 DEBUG:teuthology.parallel:result is None 2024-05-14T01:24:26.596 INFO:tasks.ceph.mds.c:Started 2024-05-14T01:24:26.596 DEBUG:teuthology.parallel:result is None 2024-05-14T01:24:26.601 INFO:tasks.ceph.mds.b:Started 2024-05-14T01:24:26.601 DEBUG:teuthology.parallel:result is None 2024-05-14T01:24:26.603 INFO:tasks.ceph.mds.d:Started 2024-05-14T01:24:26.603 DEBUG:teuthology.parallel:result is None 2024-05-14T01:24:26.603 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-14T01:24:26.665 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2024-05-14T01:24:26.665 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2024-05-14T01:24:26.666 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-05-14T01:24:26.676+0000 7f3b8ad8e640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-05-14T01:24:26.672 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-05-14T01:24:26.672 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-05-14T01:24:26.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e7e40d640 1 Processor -- start 2024-05-14T01:24:26.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e7e40d640 1 -- start start 2024-05-14T01:24:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e7e40d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e7815e100 0x7f7e780d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e7e40d640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7e7815e4e0 0x7f7e780b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e7e40d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e780d3a90 0x7f7e780cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e7e40d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7e780d29f0 con 0x7f7e780d3a90 2024-05-14T01:24:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e7e40d640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7e780d2cd0 con 0x7f7e7815e4e0 2024-05-14T01:24:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e7e40d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7e780d2fb0 con 0x7f7e7815e100 2024-05-14T01:24:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e7c9aa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e780d3a90 0x7f7e780cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e7c9aa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e780d3a90 0x7f7e780cee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42944/0 (socket says 172.21.15.154:42944) 2024-05-14T01:24:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e7c9aa640 1 -- 172.21.15.154:0/2674076595 learned_addr learned my addr 172.21.15.154:0/2674076595 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e777fe640 1 --2- 172.21.15.154:0/2674076595 >> v2:172.21.15.176:3300/0 conn(0x7f7e7815e4e0 0x7f7e780b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:26.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e77fff640 1 --2- 172.21.15.154:0/2674076595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e7815e100 0x7f7e780d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:26.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e7c9aa640 1 -- 172.21.15.154:0/2674076595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e7815e100 msgr2=0x7f7e780d22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:26.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e7c9aa640 1 --2- 172.21.15.154:0/2674076595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e7815e100 0x7f7e780d22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:26.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e7c9aa640 1 -- 172.21.15.154:0/2674076595 >> v2:172.21.15.176:3300/0 conn(0x7f7e7815e4e0 msgr2=0x7f7e780b9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:26.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e7c9aa640 1 --2- 172.21.15.154:0/2674076595 >> v2:172.21.15.176:3300/0 conn(0x7f7e7815e4e0 0x7f7e780b9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:26.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e7c9aa640 1 -- 172.21.15.154:0/2674076595 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e780d3290 con 0x7f7e780d3a90 2024-05-14T01:24:26.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.740+0000 7f7e77fff640 1 --2- 172.21.15.154:0/2674076595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e7815e100 0x7f7e780d22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:26.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.744+0000 7f7e7c9aa640 1 --2- 172.21.15.154:0/2674076595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e780d3a90 0x7f7e780cee10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7e7808cab0 tx=0x7f7e7001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bce384f706e49d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:26.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.744+0000 7f7e76ffd640 1 -- 172.21.15.154:0/2674076595 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e700b4070 con 0x7f7e780d3a90 2024-05-14T01:24:26.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.744+0000 7f7e76ffd640 1 -- 172.21.15.154:0/2674076595 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e700af400 con 0x7f7e780d3a90 2024-05-14T01:24:26.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.744+0000 7f7e76ffd640 1 -- 172.21.15.154:0/2674076595 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e700af7d0 con 0x7f7e780d3a90 2024-05-14T01:24:26.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.744+0000 7f7e7e40d640 1 -- 172.21.15.154:0/2674076595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e780d3a90 msgr2=0x7f7e780cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:26.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.744+0000 7f7e7e40d640 1 --2- 172.21.15.154:0/2674076595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e780d3a90 0x7f7e780cee10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7e7808cab0 tx=0x7f7e7001f1e0 comp rx=0 tx=0).stop 2024-05-14T01:24:26.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.744+0000 7f7e7e40d640 1 -- 172.21.15.154:0/2674076595 shutdown_connections 2024-05-14T01:24:26.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.744+0000 7f7e7e40d640 1 --2- 172.21.15.154:0/2674076595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e780d3a90 0x7f7e780cee10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:26.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.744+0000 7f7e7e40d640 1 --2- 172.21.15.154:0/2674076595 >> v2:172.21.15.176:3300/0 conn(0x7f7e7815e4e0 0x7f7e780b9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:26.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.744+0000 7f7e7e40d640 1 --2- 172.21.15.154:0/2674076595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e7815e100 0x7f7e780d22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:26.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.744+0000 7f7e7e40d640 1 -- 172.21.15.154:0/2674076595 >> 172.21.15.154:0/2674076595 conn(0x7f7e780b5b50 msgr2=0x7f7e780b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:26.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.744+0000 7f7e7e40d640 1 -- 172.21.15.154:0/2674076595 shutdown_connections 2024-05-14T01:24:26.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.744+0000 7f7e7e40d640 1 -- 172.21.15.154:0/2674076595 wait complete. 2024-05-14T01:24:26.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.744+0000 7f7e7e40d640 1 Processor -- start 2024-05-14T01:24:26.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.744+0000 7f7e7e40d640 1 -- start start 2024-05-14T01:24:26.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e7e40d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e780d3a90 0x7f7e78156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:26.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e7e40d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e7815e100 0x7f7e7815a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:26.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e7e40d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e7815e4e0 0x7f7e7815a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:26.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e7e40d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e780cf4d0 con 0x7f7e7815e4e0 2024-05-14T01:24:26.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e7e40d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7e780cf350 con 0x7f7e780d3a90 2024-05-14T01:24:26.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e7e40d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7e780cf650 con 0x7f7e7815e100 2024-05-14T01:24:26.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e7c9aa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e7815e4e0 0x7f7e7815a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:26.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e7c9aa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e7815e4e0 0x7f7e7815a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42946/0 (socket says 172.21.15.154:42946) 2024-05-14T01:24:26.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e7c9aa640 1 -- 172.21.15.154:0/1252238867 learned_addr learned my addr 172.21.15.154:0/1252238867 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:26.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e77fff640 1 --2- 172.21.15.154:0/1252238867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e780d3a90 0x7f7e78156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:26.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e777fe640 1 --2- 172.21.15.154:0/1252238867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e7815e100 0x7f7e7815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:26.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e7c9aa640 1 -- 172.21.15.154:0/1252238867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e7815e100 msgr2=0x7f7e7815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:26.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e7c9aa640 1 --2- 172.21.15.154:0/1252238867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e7815e100 0x7f7e7815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:26.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e7c9aa640 1 -- 172.21.15.154:0/1252238867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e780d3a90 msgr2=0x7f7e78156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:26.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e7c9aa640 1 --2- 172.21.15.154:0/1252238867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e780d3a90 0x7f7e78156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:26.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e7c9aa640 1 -- 172.21.15.154:0/1252238867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e780c8750 con 0x7f7e7815e4e0 2024-05-14T01:24:26.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e7c9aa640 1 --2- 172.21.15.154:0/1252238867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e7815e4e0 0x7f7e7815a940 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7e7001d890 tx=0x7f7e7001bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:26.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e74ff9640 1 -- 172.21.15.154:0/1252238867 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e700b4040 con 0x7f7e7815e4e0 2024-05-14T01:24:26.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e74ff9640 1 -- 172.21.15.154:0/1252238867 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e700afd30 con 0x7f7e7815e4e0 2024-05-14T01:24:26.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e7e40d640 1 -- 172.21.15.154:0/1252238867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e780c8a30 con 0x7f7e7815e4e0 2024-05-14T01:24:26.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e74ff9640 1 -- 172.21.15.154:0/1252238867 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70009510 con 0x7f7e7815e4e0 2024-05-14T01:24:26.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e7e40d640 1 -- 172.21.15.154:0/1252238867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e780c8ff0 con 0x7f7e7815e4e0 2024-05-14T01:24:26.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e7e40d640 1 -- 172.21.15.154:0/1252238867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e78075470 con 0x7f7e7815e4e0 2024-05-14T01:24:26.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e74ff9640 1 -- 172.21.15.154:0/1252238867 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7e700c3020 con 0x7f7e7815e4e0 2024-05-14T01:24:26.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e74ff9640 1 --2- 172.21.15.154:0/1252238867 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7e640678c0 0x7f7e64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:26.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e74ff9640 1 -- 172.21.15.154:0/1252238867 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4943+0+0 (secure 0 0 0) 0x7f7e70123e00 con 0x7f7e7815e4e0 2024-05-14T01:24:26.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e77fff640 1 --2- 172.21.15.154:0/1252238867 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7e640678c0 0x7f7e64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:26.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.748+0000 7f7e77fff640 1 --2- 172.21.15.154:0/1252238867 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7e640678c0 0x7f7e64069d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800ab40 tx=0x7f7e68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:26.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.752+0000 7f7e74ff9640 1 -- 172.21.15.154:0/1252238867 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f7e700ca020 con 0x7f7e7815e4e0 2024-05-14T01:24:26.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:26.936+0000 7f7e7e40d640 1 -- 172.21.15.154:0/1252238867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7e781572a0 con 0x7f7e7815e4e0 2024-05-14T01:24:27.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.556+0000 7f7e74ff9640 1 -- 172.21.15.154:0/1252238867 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) ==== 97+0+0 (secure 0 0 0) 0x7f7e70018d40 con 0x7f7e7815e4e0 2024-05-14T01:24:27.543 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2024-05-14T01:24:27.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.560+0000 7f7e7e40d640 1 -- 172.21.15.154:0/1252238867 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7e640678c0 msgr2=0x7f7e64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:27.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.560+0000 7f7e7e40d640 1 --2- 172.21.15.154:0/1252238867 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7e640678c0 0x7f7e64069d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800ab40 tx=0x7f7e68008040 comp rx=0 tx=0).stop 2024-05-14T01:24:27.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.560+0000 7f7e7e40d640 1 -- 172.21.15.154:0/1252238867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e7815e4e0 msgr2=0x7f7e7815a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:27.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.560+0000 7f7e7e40d640 1 --2- 172.21.15.154:0/1252238867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e7815e4e0 0x7f7e7815a940 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7e7001d890 tx=0x7f7e7001bf80 comp rx=0 tx=0).stop 2024-05-14T01:24:27.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.560+0000 7f7e7e40d640 1 -- 172.21.15.154:0/1252238867 shutdown_connections 2024-05-14T01:24:27.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.560+0000 7f7e7e40d640 1 --2- 172.21.15.154:0/1252238867 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7e640678c0 0x7f7e64069d80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:27.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.560+0000 7f7e7e40d640 1 --2- 172.21.15.154:0/1252238867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e7815e4e0 0x7f7e7815a940 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:27.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.560+0000 7f7e7e40d640 1 --2- 172.21.15.154:0/1252238867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e7815e100 0x7f7e7815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:27.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.560+0000 7f7e7e40d640 1 --2- 172.21.15.154:0/1252238867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e780d3a90 0x7f7e78156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:27.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.560+0000 7f7e7e40d640 1 -- 172.21.15.154:0/1252238867 >> 172.21.15.154:0/1252238867 conn(0x7f7e780b5b50 msgr2=0x7f7e78159c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:27.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.560+0000 7f7e7e40d640 1 -- 172.21.15.154:0/1252238867 shutdown_connections 2024-05-14T01:24:27.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.560+0000 7f7e7e40d640 1 -- 172.21.15.154:0/1252238867 wait complete. 2024-05-14T01:24:27.573 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-14T01:24:27.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.704+0000 7fad6178b640 1 Processor -- start 2024-05-14T01:24:27.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.704+0000 7fad6178b640 1 -- start start 2024-05-14T01:24:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad6178b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad5c0d23a0 0x7fad5c166f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad6178b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad5c0b30b0 con 0x7fad5c15bf30 2024-05-14T01:24:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad6178b640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad5c0b3390 con 0x7fad5c15c310 2024-05-14T01:24:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad6178b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fad5c0b3670 con 0x7fad5c0d23a0 2024-05-14T01:24:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad5affd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fad5c15bf30 0x7fad5c0b27b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39886/0 (socket says 172.21.15.154:39886) 2024-05-14T01:24:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad5affd640 1 -- 172.21.15.154:0/2531722928 learned_addr learned my addr 172.21.15.154:0/2531722928 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad59ffb640 1 -- 172.21.15.154:0/2531722928 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2132728424 0 0) 0x7fad5c0b30b0 con 0x7fad5c15bf30 2024-05-14T01:24:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad59ffb640 1 -- 172.21.15.154:0/2531722928 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad48003530 con 0x7fad5c15bf30 2024-05-14T01:24:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad5b7fe640 1 --2- 172.21.15.154:0/2531722928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad5c0d23a0 0x7fad5c166f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad59ffb640 1 -- 172.21.15.154:0/2531722928 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1335668586 0 0) 0x7fad48003530 con 0x7fad5c15bf30 2024-05-14T01:24:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad59ffb640 1 -- 172.21.15.154:0/2531722928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad5c0d23a0 msgr2=0x7fad5c166f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad59ffb640 1 --2- 172.21.15.154:0/2531722928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad5c0d23a0 0x7fad5c166f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad59ffb640 1 -- 172.21.15.154:0/2531722928 >> v1:172.21.15.176:6789/0 conn(0x7fad5c15c310 legacy=0x7fad5c0d1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad59ffb640 1 -- 172.21.15.154:0/2531722928 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5c0aec10 con 0x7fad5c15bf30 2024-05-14T01:24:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad59ffb640 1 -- 172.21.15.154:0/2531722928 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fad44001680 con 0x7fad5c15bf30 2024-05-14T01:24:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad59ffb640 1 -- 172.21.15.154:0/2531722928 >> v1:172.21.15.154:6789/0 conn(0x7fad5c15bf30 legacy=0x7fad5c0b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad59ffb640 1 --2- 172.21.15.154:0/2531722928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad480039f0 0x7fad48003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad59ffb640 1 --2- 172.21.15.154:0/2531722928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad5c0d23a0 0x7fad48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad59ffb640 1 --2- 172.21.15.154:0/2531722928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad48004d50 0x7fad480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad59ffb640 1 -- 172.21.15.154:0/2531722928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad5c0b3670 con 0x7fad480039f0 2024-05-14T01:24:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad59ffb640 1 -- 172.21.15.154:0/2531722928 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fad4800bb40 con 0x7fad48004d50 2024-05-14T01:24:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad59ffb640 1 -- 172.21.15.154:0/2531722928 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fad4800bd40 con 0x7fad5c0d23a0 2024-05-14T01:24:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad5affd640 1 --2- 172.21.15.154:0/2531722928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad480039f0 0x7fad48003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad5b7fe640 1 --2- 172.21.15.154:0/2531722928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad48004d50 0x7fad480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad5a7fc640 1 --2- 172.21.15.154:0/2531722928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad5c0d23a0 0x7fad48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad5affd640 1 -- 172.21.15.154:0/2531722928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad5c0d23a0 msgr2=0x7fad48004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:27.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad5affd640 1 --2- 172.21.15.154:0/2531722928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad5c0d23a0 0x7fad48004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:27.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad5affd640 1 -- 172.21.15.154:0/2531722928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad48004d50 msgr2=0x7fad480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:27.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad5affd640 1 --2- 172.21.15.154:0/2531722928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad48004d50 0x7fad480051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:27.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad5affd640 1 -- 172.21.15.154:0/2531722928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad48003530 con 0x7fad480039f0 2024-05-14T01:24:27.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.708+0000 7fad5a7fc640 1 --2- 172.21.15.154:0/2531722928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad5c0d23a0 0x7fad48004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:27.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad5affd640 1 --2- 172.21.15.154:0/2531722928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad480039f0 0x7fad48003e10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fad4400c210 tx=0x7fad4401f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9197ed02d4f2ef server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:27.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad59ffb640 1 -- 172.21.15.154:0/2531722928 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad44007d20 con 0x7fad480039f0 2024-05-14T01:24:27.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad59ffb640 1 -- 172.21.15.154:0/2531722928 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad44005ae0 con 0x7fad480039f0 2024-05-14T01:24:27.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad59ffb640 1 -- 172.21.15.154:0/2531722928 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad44007070 con 0x7fad480039f0 2024-05-14T01:24:27.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad6178b640 1 -- 172.21.15.154:0/2531722928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad480039f0 msgr2=0x7fad48003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:27.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad6178b640 1 --2- 172.21.15.154:0/2531722928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad480039f0 0x7fad48003e10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fad4400c210 tx=0x7fad4401f3b0 comp rx=0 tx=0).stop 2024-05-14T01:24:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad5b7fe640 1 -- 172.21.15.154:0/2531722928 reap_dead start 2024-05-14T01:24:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad6178b640 1 -- 172.21.15.154:0/2531722928 shutdown_connections 2024-05-14T01:24:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad6178b640 1 -- 172.21.15.154:0/2531722928 >> 172.21.15.154:0/2531722928 conn(0x7fad5c09aa10 msgr2=0x7fad5c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad6178b640 1 -- 172.21.15.154:0/2531722928 shutdown_connections 2024-05-14T01:24:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad6178b640 1 -- 172.21.15.154:0/2531722928 wait complete. 2024-05-14T01:24:27.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad6178b640 1 Processor -- start 2024-05-14T01:24:27.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad6178b640 1 -- start start 2024-05-14T01:24:27.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad6178b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad480039f0 0x7fad5c0b5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:27.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad6178b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad5c150380 0x7fad5c14f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:27.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad6178b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad5c06b280 0x7fad5c0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:27.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad6178b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad5c0d08e0 con 0x7fad5c150380 2024-05-14T01:24:27.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad6178b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fad5c0b0670 con 0x7fad480039f0 2024-05-14T01:24:27.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad6178b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fad5c0d0a60 con 0x7fad5c06b280 2024-05-14T01:24:27.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad5a7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad5c150380 0x7fad5c14f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:27.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad5a7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad5c150380 0x7fad5c14f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50648/0 (socket says 172.21.15.154:50648) 2024-05-14T01:24:27.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad5a7fc640 1 -- 172.21.15.154:0/925040724 learned_addr learned my addr 172.21.15.154:0/925040724 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:27.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad5affd640 1 --2- 172.21.15.154:0/925040724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad480039f0 0x7fad5c0b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:27.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad5b7fe640 1 --2- 172.21.15.154:0/925040724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad5c06b280 0x7fad5c0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:27.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad5a7fc640 1 -- 172.21.15.154:0/925040724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad5c06b280 msgr2=0x7fad5c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:27.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad5a7fc640 1 --2- 172.21.15.154:0/925040724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad5c06b280 0x7fad5c0ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:27.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad5a7fc640 1 -- 172.21.15.154:0/925040724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad480039f0 msgr2=0x7fad5c0b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:27.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad5a7fc640 1 --2- 172.21.15.154:0/925040724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad480039f0 0x7fad5c0b5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:27.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad5a7fc640 1 -- 172.21.15.154:0/925040724 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5c0b59d0 con 0x7fad5c150380 2024-05-14T01:24:27.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad5b7fe640 1 --2- 172.21.15.154:0/925040724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad5c06b280 0x7fad5c0ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:27.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.712+0000 7fad5a7fc640 1 --2- 172.21.15.154:0/925040724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad5c150380 0x7fad5c14f5d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00dae0 tx=0x7fad4c0020d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:27.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.716+0000 7fad537fe640 1 -- 172.21.15.154:0/925040724 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c003db0 con 0x7fad5c150380 2024-05-14T01:24:27.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.716+0000 7fad537fe640 1 -- 172.21.15.154:0/925040724 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad4c017070 con 0x7fad5c150380 2024-05-14T01:24:27.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.716+0000 7fad6178b640 1 -- 172.21.15.154:0/925040724 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad5c06bb60 con 0x7fad5c150380 2024-05-14T01:24:27.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.716+0000 7fad537fe640 1 -- 172.21.15.154:0/925040724 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c00b950 con 0x7fad5c150380 2024-05-14T01:24:27.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.716+0000 7fad6178b640 1 -- 172.21.15.154:0/925040724 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad5c06c120 con 0x7fad5c150380 2024-05-14T01:24:27.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.716+0000 7fad6178b640 1 -- 172.21.15.154:0/925040724 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad5c068360 con 0x7fad5c150380 2024-05-14T01:24:27.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.716+0000 7fad537fe640 1 -- 172.21.15.154:0/925040724 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fad4c00baf0 con 0x7fad5c150380 2024-05-14T01:24:27.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.716+0000 7fad537fe640 1 --2- 172.21.15.154:0/925040724 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fad3c0678c0 0x7fad3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:27.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.716+0000 7fad5affd640 1 --2- 172.21.15.154:0/925040724 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fad3c0678c0 0x7fad3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:27.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.716+0000 7fad537fe640 1 -- 172.21.15.154:0/925040724 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fad4c085af0 con 0x7fad5c150380 2024-05-14T01:24:27.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.716+0000 7fad5affd640 1 --2- 172.21.15.154:0/925040724 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fad3c0678c0 0x7fad3c069d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fad440af000 tx=0x7fad440aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:27.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.720+0000 7fad537fe640 1 -- 172.21.15.154:0/925040724 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fad4c056970 con 0x7fad5c150380 2024-05-14T01:24:27.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.944+0000 7fad6178b640 1 -- 172.21.15.154:0/925040724 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fad5c0b2400 con 0x7fad5c150380 2024-05-14T01:24:27.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.944+0000 7fad537fe640 1 -- 172.21.15.154:0/925040724 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7fad4c056270 con 0x7fad5c150380 2024-05-14T01:24:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:27.931 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-14T01:24:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2024-05-14T01:24:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2024-05-14T01:24:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDcvEJm7yoWDBAA8w2pr2DrTNaVR+wz+Nl/Fg==", 2024-05-14T01:24:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-05-14T01:24:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-05-14T01:24:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-05-14T01:24:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-05-14T01:24:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2024-05-14T01:24:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDcvEJmKSudGhAAwRxetNNW0nPruXpmia03aQ==", 2024-05-14T01:24:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-05-14T01:24:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-05-14T01:24:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-05-14T01:24:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-05-14T01:24:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2024-05-14T01:24:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDcvEJmixGGFBAA5lz67GiLOTlmScmPnHMz7Q==", 2024-05-14T01:24:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-05-14T01:24:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-05-14T01:24:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-05-14T01:24:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-05-14T01:24:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2024-05-14T01:24:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDcvEJmI3RvIBAAtnj8wt+Yr6xzHaWOBMa/WA==", 2024-05-14T01:24:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-05-14T01:24:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-05-14T01:24:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-05-14T01:24:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-05-14T01:24:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2024-05-14T01:24:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDfvEJm6Ye1MRAAwALBzMFgiY3+GhhvAoK+nA==", 2024-05-14T01:24:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-05-14T01:24:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-05-14T01:24:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-05-14T01:24:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2024-05-14T01:24:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDivEJm33htNhAAzuBgsc1mOZzSBTQDi+/E3Q==", 2024-05-14T01:24:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-05-14T01:24:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-05-14T01:24:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-05-14T01:24:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2024-05-14T01:24:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDmvEJm6pO1ARAAshV/uir1lPGJ9aVZ7/FVGQ==", 2024-05-14T01:24:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-05-14T01:24:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-05-14T01:24:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-05-14T01:24:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2024-05-14T01:24:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDpvEJm1vBkCBAAsgyM/byd+Xlj5HjcXzSlvQ==", 2024-05-14T01:24:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-05-14T01:24:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-05-14T01:24:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-05-14T01:24:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2024-05-14T01:24:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDvvEJmOoV7BxAA/xpGtzo9DnnUMIu5bgai1g==", 2024-05-14T01:24:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-05-14T01:24:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-05-14T01:24:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-05-14T01:24:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2024-05-14T01:24:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDyvEJmLBcmDBAAUFs3E6N9NsQJ3vgO/IDRpw==", 2024-05-14T01:24:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-05-14T01:24:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-05-14T01:24:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-05-14T01:24:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2024-05-14T01:24:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQD1vEJmHHrSExAARmp8A//JBhz9SVsOHTbOnQ==", 2024-05-14T01:24:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-05-14T01:24:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-05-14T01:24:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-05-14T01:24:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2024-05-14T01:24:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQD4vEJmkjX8FxAA2++ZWYuV3xaHAcZCx4S1UQ==", 2024-05-14T01:24:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-05-14T01:24:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-05-14T01:24:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-05-14T01:24:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2024-05-14T01:24:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDcvEJmzNwUJhAAZcH888XeSsgDX/xMggOZcg==", 2024-05-14T01:24:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-05-14T01:24:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-05-14T01:24:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-05-14T01:24:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-05-14T01:24:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2024-05-14T01:24:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDcvEJmC7X5LRAA0eJUntNY5LzW27HXKMpkPw==", 2024-05-14T01:24:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-05-14T01:24:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-05-14T01:24:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-05-14T01:24:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-05-14T01:24:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2024-05-14T01:24:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDcvEJmE/tKKxAARhrvkbA+AiYwwDR9zVJ0vg==", 2024-05-14T01:24:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-05-14T01:24:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-05-14T01:24:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-05-14T01:24:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-05-14T01:24:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2024-05-14T01:24:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDcvEJm11A8MxAAlDminVpItJRLzHA6tshdXg==", 2024-05-14T01:24:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-05-14T01:24:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-05-14T01:24:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-05-14T01:24:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-05-14T01:24:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2024-05-14T01:24:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDbvEJmQ9l1LRAABeMGc0scqErBIHQoFrtWcQ==", 2024-05-14T01:24:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-05-14T01:24:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-05-14T01:24:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-05-14T01:24:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-05-14T01:24:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-mds", 2024-05-14T01:24:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQD+vEJmP5HcHhAA1w4fNICOUI1tuCNXfyKXlA==", 2024-05-14T01:24:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-mds" 2024-05-14T01:24:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-mgr", 2024-05-14T01:24:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQD+vEJmsZ7cHhAANsbFEErIbfFXLNjLtozMcg==", 2024-05-14T01:24:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-14T01:24:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-osd", 2024-05-14T01:24:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQD+vEJmWqncHhAAG6sZhrM9eYpJrhN0daromw==", 2024-05-14T01:24:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-osd" 2024-05-14T01:24:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-rbd", 2024-05-14T01:24:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQD+vEJmkbPcHhAAgoh9/xKib1NaJR4v6qrU8w==", 2024-05-14T01:24:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-14T01:24:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-14T01:24:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQD+vEJmbr7cHhAAWjXjXcI9sDPXVf0imwoXNA==", 2024-05-14T01:24:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-14T01:24:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-rgw", 2024-05-14T01:24:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQD+vEJmMcncHhAAqza0VNFuMpxnfoYjGW/krA==", 2024-05-14T01:24:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-14T01:24:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2024-05-14T01:24:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDcvEJmNwwvCBAAA57XzKvJ/C+mHdhWfZjcfA==", 2024-05-14T01:24:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-05-14T01:24:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2024-05-14T01:24:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-05-14T01:24:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2024-05-14T01:24:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDcvEJmDDN4BRAA6pr95tSCM6KDCvT2Ls+eFw==", 2024-05-14T01:24:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-05-14T01:24:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-05-14T01:24:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2024-05-14T01:24:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-05-14T01:24:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-05-14T01:24:27.953 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-14T01:24:27.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.944+0000 7fad6178b640 1 -- 172.21.15.154:0/925040724 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fad3c0678c0 msgr2=0x7fad3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:27.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.944+0000 7fad6178b640 1 --2- 172.21.15.154:0/925040724 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fad3c0678c0 0x7fad3c069d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fad440af000 tx=0x7fad440aa000 comp rx=0 tx=0).stop 2024-05-14T01:24:27.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.944+0000 7fad6178b640 1 -- 172.21.15.154:0/925040724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad5c150380 msgr2=0x7fad5c14f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:27.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.944+0000 7fad6178b640 1 --2- 172.21.15.154:0/925040724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad5c150380 0x7fad5c14f5d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00dae0 tx=0x7fad4c0020d0 comp rx=0 tx=0).stop 2024-05-14T01:24:27.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.944+0000 7fad6178b640 1 -- 172.21.15.154:0/925040724 shutdown_connections 2024-05-14T01:24:27.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.944+0000 7fad6178b640 1 --2- 172.21.15.154:0/925040724 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fad3c0678c0 0x7fad3c069d80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:27.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.944+0000 7fad6178b640 1 --2- 172.21.15.154:0/925040724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad5c06b280 0x7fad5c0ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:27.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.944+0000 7fad6178b640 1 --2- 172.21.15.154:0/925040724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad5c150380 0x7fad5c14f5d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:27.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.944+0000 7fad6178b640 1 --2- 172.21.15.154:0/925040724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad480039f0 0x7fad5c0b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:27.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.944+0000 7fad6178b640 1 -- 172.21.15.154:0/925040724 >> 172.21.15.154:0/925040724 conn(0x7fad5c09aa10 msgr2=0x7fad5c0d1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:27.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.948+0000 7fad6178b640 1 -- 172.21.15.154:0/925040724 shutdown_connections 2024-05-14T01:24:27.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:27.948+0000 7fad6178b640 1 -- 172.21.15.154:0/925040724 wait complete. 2024-05-14T01:24:27.957 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-14T01:24:28.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.092+0000 7fdb4cf1f640 1 Processor -- start 2024-05-14T01:24:28.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.092+0000 7fdb4cf1f640 1 -- start start 2024-05-14T01:24:28.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.092+0000 7fdb4cf1f640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdb48144760 0x7fdb4806e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:28.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.092+0000 7fdb4cf1f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb480b3530 0x7fdb4815b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:28.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.092+0000 7fdb4cf1f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdb4815b910 0x7fdb4815e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:28.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.092+0000 7fdb4cf1f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fdb480b4650 con 0x7fdb4815b910 2024-05-14T01:24:28.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.092+0000 7fdb4cf1f640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdb4815bda0 con 0x7fdb48144760 2024-05-14T01:24:28.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.092+0000 7fdb4cf1f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdb48144b40 con 0x7fdb480b3530 2024-05-14T01:24:28.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.092+0000 7fdb46d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdb4815b910 0x7fdb4815e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:28.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.092+0000 7fdb46d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdb4815b910 0x7fdb4815e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50652/0 (socket says 172.21.15.154:50652) 2024-05-14T01:24:28.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.092+0000 7fdb46d9d640 1 -- 172.21.15.154:0/1901607183 learned_addr learned my addr 172.21.15.154:0/1901607183 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:28.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.092+0000 7fdb4659c640 1 --2- 172.21.15.154:0/1901607183 >> v2:172.21.15.176:3300/0 conn(0x7fdb48144760 0x7fdb4806e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:28.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.092+0000 7fdb3ffff640 1 --2- 172.21.15.154:0/1901607183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb480b3530 0x7fdb4815b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:28.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.092+0000 7fdb46d9d640 1 -- 172.21.15.154:0/1901607183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb480b3530 msgr2=0x7fdb4815b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:28.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.092+0000 7fdb46d9d640 1 --2- 172.21.15.154:0/1901607183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb480b3530 0x7fdb4815b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.092+0000 7fdb46d9d640 1 -- 172.21.15.154:0/1901607183 >> v2:172.21.15.176:3300/0 conn(0x7fdb48144760 msgr2=0x7fdb4806e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:28.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.092+0000 7fdb46d9d640 1 --2- 172.21.15.154:0/1901607183 >> v2:172.21.15.176:3300/0 conn(0x7fdb48144760 0x7fdb4806e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.092+0000 7fdb46d9d640 1 -- 172.21.15.154:0/1901607183 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb480b3a40 con 0x7fdb4815b910 2024-05-14T01:24:28.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb46d9d640 1 --2- 172.21.15.154:0/1901607183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb4815b910 0x7fdb4815e980 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdb4806c250 tx=0x7fdb4001c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81a56fd5223f9e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:28.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb45d9b640 1 -- 172.21.15.154:0/1901607183 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb400a55a0 con 0x7fdb4815b910 2024-05-14T01:24:28.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb45d9b640 1 -- 172.21.15.154:0/1901607183 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb400a5740 con 0x7fdb4815b910 2024-05-14T01:24:28.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb45d9b640 1 -- 172.21.15.154:0/1901607183 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb400a5b10 con 0x7fdb4815b910 2024-05-14T01:24:28.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb4cf1f640 1 -- 172.21.15.154:0/1901607183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb4815b910 msgr2=0x7fdb4815e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:28.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb4cf1f640 1 --2- 172.21.15.154:0/1901607183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb4815b910 0x7fdb4815e980 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdb4806c250 tx=0x7fdb4001c700 comp rx=0 tx=0).stop 2024-05-14T01:24:28.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb4cf1f640 1 -- 172.21.15.154:0/1901607183 shutdown_connections 2024-05-14T01:24:28.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb4cf1f640 1 --2- 172.21.15.154:0/1901607183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb480b3530 0x7fdb4815b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb4cf1f640 1 --2- 172.21.15.154:0/1901607183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb4815b910 0x7fdb4815e980 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb4cf1f640 1 --2- 172.21.15.154:0/1901607183 >> v2:172.21.15.176:3300/0 conn(0x7fdb48144760 0x7fdb4806e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb4cf1f640 1 -- 172.21.15.154:0/1901607183 >> 172.21.15.154:0/1901607183 conn(0x7fdb480b1850 msgr2=0x7fdb480b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:28.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb4cf1f640 1 -- 172.21.15.154:0/1901607183 shutdown_connections 2024-05-14T01:24:28.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb4cf1f640 1 -- 172.21.15.154:0/1901607183 wait complete. 2024-05-14T01:24:28.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb4cf1f640 1 Processor -- start 2024-05-14T01:24:28.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb4cf1f640 1 -- start start 2024-05-14T01:24:28.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb4cf1f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb480b3530 0x7fdb48133970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:28.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb4cf1f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb48144760 0x7fdb48132980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:28.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb4cf1f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb4815b910 0x7fdb48143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:28.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb4cf1f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4806ed40 con 0x7fdb4815b910 2024-05-14T01:24:28.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb4cf1f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4806ebc0 con 0x7fdb480b3530 2024-05-14T01:24:28.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb4cf1f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdb4806d470 con 0x7fdb48144760 2024-05-14T01:24:28.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb46d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb4815b910 0x7fdb48143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:28.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb46d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb4815b910 0x7fdb48143320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50656/0 (socket says 172.21.15.154:50656) 2024-05-14T01:24:28.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb46d9d640 1 -- 172.21.15.154:0/3866923688 learned_addr learned my addr 172.21.15.154:0/3866923688 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:28.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb4659c640 1 --2- 172.21.15.154:0/3866923688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb480b3530 0x7fdb48133970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:28.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb3ffff640 1 --2- 172.21.15.154:0/3866923688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb48144760 0x7fdb48132980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:28.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb46d9d640 1 -- 172.21.15.154:0/3866923688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb48144760 msgr2=0x7fdb48132980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:28.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb46d9d640 1 --2- 172.21.15.154:0/3866923688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb48144760 0x7fdb48132980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb46d9d640 1 -- 172.21.15.154:0/3866923688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb480b3530 msgr2=0x7fdb48133970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:28.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb46d9d640 1 --2- 172.21.15.154:0/3866923688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb480b3530 0x7fdb48133970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb46d9d640 1 -- 172.21.15.154:0/3866923688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb48139cc0 con 0x7fdb4815b910 2024-05-14T01:24:28.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.096+0000 7fdb46d9d640 1 --2- 172.21.15.154:0/3866923688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb4815b910 0x7fdb48143320 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdb4001adb0 tx=0x7fdb400194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:28.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.100+0000 7fdb3effd640 1 -- 172.21.15.154:0/3866923688 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40009510 con 0x7fdb4815b910 2024-05-14T01:24:28.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.100+0000 7fdb3effd640 1 -- 172.21.15.154:0/3866923688 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb400be070 con 0x7fdb4815b910 2024-05-14T01:24:28.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.100+0000 7fdb4cf1f640 1 -- 172.21.15.154:0/3866923688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb4813b330 con 0x7fdb4815b910 2024-05-14T01:24:28.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.100+0000 7fdb3effd640 1 -- 172.21.15.154:0/3866923688 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb400b88d0 con 0x7fdb4815b910 2024-05-14T01:24:28.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.100+0000 7fdb4cf1f640 1 -- 172.21.15.154:0/3866923688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb4813b8f0 con 0x7fdb4815b910 2024-05-14T01:24:28.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.100+0000 7fdb4cf1f640 1 -- 172.21.15.154:0/3866923688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb48075470 con 0x7fdb4815b910 2024-05-14T01:24:28.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.100+0000 7fdb3effd640 1 -- 172.21.15.154:0/3866923688 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdb400b8a70 con 0x7fdb4815b910 2024-05-14T01:24:28.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.100+0000 7fdb3effd640 1 --2- 172.21.15.154:0/3866923688 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdb280678c0 0x7fdb28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:28.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.100+0000 7fdb3effd640 1 -- 172.21.15.154:0/3866923688 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fdb40120700 con 0x7fdb4815b910 2024-05-14T01:24:28.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.100+0000 7fdb4659c640 1 --2- 172.21.15.154:0/3866923688 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdb280678c0 0x7fdb28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:28.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.100+0000 7fdb4659c640 1 --2- 172.21.15.154:0/3866923688 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdb280678c0 0x7fdb28069d80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdb380079e0 tx=0x7fdb38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:28.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.104+0000 7fdb3effd640 1 -- 172.21.15.154:0/3866923688 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fdb400165e0 con 0x7fdb4815b910 2024-05-14T01:24:28.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.308+0000 7fdb4cf1f640 1 -- 172.21.15.154:0/3866923688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fdb4815c9e0 con 0x7fdb4815b910 2024-05-14T01:24:28.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.312+0000 7fdb3effd640 1 -- 172.21.15.154:0/3866923688 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7fdb400f1510 con 0x7fdb4815b910 2024-05-14T01:24:28.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.312+0000 7fdb4cf1f640 1 -- 172.21.15.154:0/3866923688 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdb280678c0 msgr2=0x7fdb28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:28.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.312+0000 7fdb4cf1f640 1 --2- 172.21.15.154:0/3866923688 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdb280678c0 0x7fdb28069d80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdb380079e0 tx=0x7fdb38008040 comp rx=0 tx=0).stop 2024-05-14T01:24:28.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.312+0000 7fdb4cf1f640 1 -- 172.21.15.154:0/3866923688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb4815b910 msgr2=0x7fdb48143320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:28.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.316+0000 7fdb4cf1f640 1 --2- 172.21.15.154:0/3866923688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb4815b910 0x7fdb48143320 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdb4001adb0 tx=0x7fdb400194a0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.316+0000 7fdb4cf1f640 1 -- 172.21.15.154:0/3866923688 shutdown_connections 2024-05-14T01:24:28.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.316+0000 7fdb4cf1f640 1 --2- 172.21.15.154:0/3866923688 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdb280678c0 0x7fdb28069d80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.316+0000 7fdb4cf1f640 1 --2- 172.21.15.154:0/3866923688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb4815b910 0x7fdb48143320 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.316+0000 7fdb4cf1f640 1 --2- 172.21.15.154:0/3866923688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb48144760 0x7fdb48132980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.316+0000 7fdb4cf1f640 1 --2- 172.21.15.154:0/3866923688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb480b3530 0x7fdb48133970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.316+0000 7fdb4cf1f640 1 -- 172.21.15.154:0/3866923688 >> 172.21.15.154:0/3866923688 conn(0x7fdb480b1850 msgr2=0x7fdb480b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:28.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.316+0000 7fdb4cf1f640 1 -- 172.21.15.154:0/3866923688 shutdown_connections 2024-05-14T01:24:28.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.316+0000 7fdb4cf1f640 1 -- 172.21.15.154:0/3866923688 wait complete. 2024-05-14T01:24:28.318 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-14T01:24:28.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.452+0000 7f80fbd12640 1 Processor -- start 2024-05-14T01:24:28.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.452+0000 7f80fbd12640 1 -- start start 2024-05-14T01:24:28.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.452+0000 7f80fbd12640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f80f415ae90 0x7f80f40aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:28.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.452+0000 7f80fbd12640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f80f415b270 0x7f80f406c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:28.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.452+0000 7f80fbd12640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80f40cc420 con 0x7f80f40aeff0 2024-05-14T01:24:28.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.452+0000 7f80fbd12640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f80f415ebc0 con 0x7f80f415b270 2024-05-14T01:24:28.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.452+0000 7f80fbd12640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f80f40cc700 con 0x7f80f415ae90 2024-05-14T01:24:28.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.452+0000 7f80fa2af640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f80f415b270 0x7f80f406c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:28.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.452+0000 7f80fa2af640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f80f415b270 0x7f80f406c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50662/0 (socket says 172.21.15.154:50662) 2024-05-14T01:24:28.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.452+0000 7f80fa2af640 1 -- 172.21.15.154:0/1934257108 learned_addr learned my addr 172.21.15.154:0/1934257108 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.452+0000 7f80fa2af640 1 -- 172.21.15.154:0/1934257108 >> v2:172.21.15.176:3300/0 conn(0x7f80f415ae90 msgr2=0x7f80f40aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.452+0000 7f80f9aae640 1 --2- 172.21.15.154:0/1934257108 >> v2:172.21.15.176:3300/0 conn(0x7f80f415ae90 0x7f80f40aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.452+0000 7f80fa2af640 1 --2- 172.21.15.154:0/1934257108 >> v2:172.21.15.176:3300/0 conn(0x7f80f415ae90 0x7f80f40aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.452+0000 7f80fa2af640 1 -- 172.21.15.154:0/1934257108 >> v1:172.21.15.176:6789/0 conn(0x7f80f40aeff0 legacy=0x7f80f40cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.452+0000 7f80fa2af640 1 -- 172.21.15.154:0/1934257108 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f40cc9e0 con 0x7f80f415b270 2024-05-14T01:24:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.452+0000 7f80f9aae640 1 --2- 172.21.15.154:0/1934257108 >> v2:172.21.15.176:3300/0 conn(0x7f80f415ae90 0x7f80f40aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:28.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fa2af640 1 --2- 172.21.15.154:0/1934257108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80f415b270 0x7f80f406c290 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f80f4068090 tx=0x7f80f001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b5c8476a0938a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:28.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80f8aac640 1 -- 172.21.15.154:0/1934257108 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f00b1070 con 0x7f80f415b270 2024-05-14T01:24:28.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80f8aac640 1 -- 172.21.15.154:0/1934257108 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f00ac620 con 0x7f80f415b270 2024-05-14T01:24:28.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80f8aac640 1 -- 172.21.15.154:0/1934257108 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f00ac9f0 con 0x7f80f415b270 2024-05-14T01:24:28.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fbd12640 1 -- 172.21.15.154:0/1934257108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80f415b270 msgr2=0x7f80f406c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:28.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fbd12640 1 --2- 172.21.15.154:0/1934257108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80f415b270 0x7f80f406c290 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f80f4068090 tx=0x7f80f001c4b0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fbd12640 1 -- 172.21.15.154:0/1934257108 shutdown_connections 2024-05-14T01:24:28.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fbd12640 1 --2- 172.21.15.154:0/1934257108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80f415b270 0x7f80f406c290 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fbd12640 1 --2- 172.21.15.154:0/1934257108 >> v2:172.21.15.176:3300/0 conn(0x7f80f415ae90 0x7f80f40aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fbd12640 1 -- 172.21.15.154:0/1934257108 >> 172.21.15.154:0/1934257108 conn(0x7f80f4072050 msgr2=0x7f80f4072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:28.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fbd12640 1 -- 172.21.15.154:0/1934257108 shutdown_connections 2024-05-14T01:24:28.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fbd12640 1 -- 172.21.15.154:0/1934257108 wait complete. 2024-05-14T01:24:28.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fbd12640 1 Processor -- start 2024-05-14T01:24:28.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fbd12640 1 -- start start 2024-05-14T01:24:28.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fbd12640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80f40aeff0 0x7f80f409e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:28.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fbd12640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80f415ae90 0x7f80f414ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:28.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fbd12640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80f415b270 0x7f80f414e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:28.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fbd12640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f80f415f9c0 con 0x7f80f415b270 2024-05-14T01:24:28.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fbd12640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f80f415f840 con 0x7f80f40aeff0 2024-05-14T01:24:28.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fbd12640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f80f4167f00 con 0x7f80f415ae90 2024-05-14T01:24:28.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fa2af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80f415b270 0x7f80f414e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:28.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fa2af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80f415b270 0x7f80f414e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50676/0 (socket says 172.21.15.154:50676) 2024-05-14T01:24:28.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.456+0000 7f80fa2af640 1 -- 172.21.15.154:0/3693454286 learned_addr learned my addr 172.21.15.154:0/3693454286 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:28.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.460+0000 7f80f9aae640 1 --2- 172.21.15.154:0/3693454286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80f40aeff0 0x7f80f409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:28.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.460+0000 7f80fa2af640 1 -- 172.21.15.154:0/3693454286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80f415ae90 msgr2=0x7f80f414ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:28.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.460+0000 7f80fa2af640 1 --2- 172.21.15.154:0/3693454286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80f415ae90 0x7f80f414ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.460+0000 7f80fa2af640 1 -- 172.21.15.154:0/3693454286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80f40aeff0 msgr2=0x7f80f409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:28.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.460+0000 7f80fa2af640 1 --2- 172.21.15.154:0/3693454286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80f40aeff0 0x7f80f409e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.460+0000 7f80fa2af640 1 -- 172.21.15.154:0/3693454286 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f409ee50 con 0x7f80f415b270 2024-05-14T01:24:28.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.460+0000 7f80fa2af640 1 --2- 172.21.15.154:0/3693454286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80f415b270 0x7f80f414e3c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f80f00af040 tx=0x7f80f0019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:28.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.460+0000 7f80e67fc640 1 -- 172.21.15.154:0/3693454286 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f00bc070 con 0x7f80f415b270 2024-05-14T01:24:28.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.460+0000 7f80e67fc640 1 -- 172.21.15.154:0/3693454286 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f00b7430 con 0x7f80f415b270 2024-05-14T01:24:28.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.460+0000 7f80fbd12640 1 -- 172.21.15.154:0/3693454286 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80f415df10 con 0x7f80f415b270 2024-05-14T01:24:28.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.460+0000 7f80e67fc640 1 -- 172.21.15.154:0/3693454286 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f00b1040 con 0x7f80f415b270 2024-05-14T01:24:28.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.460+0000 7f80fbd12640 1 -- 172.21.15.154:0/3693454286 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80f409c790 con 0x7f80f415b270 2024-05-14T01:24:28.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.460+0000 7f80fbd12640 1 -- 172.21.15.154:0/3693454286 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80f4068360 con 0x7f80f415b270 2024-05-14T01:24:28.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.460+0000 7f80e67fc640 1 -- 172.21.15.154:0/3693454286 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f80f00bf070 con 0x7f80f415b270 2024-05-14T01:24:28.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.460+0000 7f80e67fc640 1 --2- 172.21.15.154:0/3693454286 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f80d80678c0 0x7f80d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:28.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.460+0000 7f80e67fc640 1 -- 172.21.15.154:0/3693454286 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f80f011f160 con 0x7f80f415b270 2024-05-14T01:24:28.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.460+0000 7f80f9aae640 1 --2- 172.21.15.154:0/3693454286 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f80d80678c0 0x7f80d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:28.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.460+0000 7f80f9aae640 1 --2- 172.21.15.154:0/3693454286 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f80d80678c0 0x7f80d8069d80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0075b0 tx=0x7f80ec007540 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:28.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.464+0000 7f80e67fc640 1 -- 172.21.15.154:0/3693454286 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f80f00160d0 con 0x7f80f415b270 2024-05-14T01:24:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.692+0000 7f80fbd12640 1 -- 172.21.15.154:0/3693454286 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f80f415a650 con 0x7f80f415b270 2024-05-14T01:24:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.692+0000 7f80e67fc640 1 -- 172.21.15.154:0/3693454286 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f80f00f0080 con 0x7f80f415b270 2024-05-14T01:24:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.696+0000 7f80fbd12640 1 -- 172.21.15.154:0/3693454286 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f80d80678c0 msgr2=0x7f80d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.696+0000 7f80fbd12640 1 --2- 172.21.15.154:0/3693454286 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f80d80678c0 0x7f80d8069d80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0075b0 tx=0x7f80ec007540 comp rx=0 tx=0).stop 2024-05-14T01:24:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.696+0000 7f80fbd12640 1 -- 172.21.15.154:0/3693454286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80f415b270 msgr2=0x7f80f414e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.696+0000 7f80fbd12640 1 --2- 172.21.15.154:0/3693454286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80f415b270 0x7f80f414e3c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f80f00af040 tx=0x7f80f0019250 comp rx=0 tx=0).stop 2024-05-14T01:24:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.696+0000 7f80fbd12640 1 -- 172.21.15.154:0/3693454286 shutdown_connections 2024-05-14T01:24:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.696+0000 7f80fbd12640 1 --2- 172.21.15.154:0/3693454286 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f80d80678c0 0x7f80d8069d80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.696+0000 7f80fbd12640 1 --2- 172.21.15.154:0/3693454286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80f415b270 0x7f80f414e3c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.696+0000 7f80fbd12640 1 --2- 172.21.15.154:0/3693454286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80f415ae90 0x7f80f414ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.696+0000 7f80fbd12640 1 --2- 172.21.15.154:0/3693454286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80f40aeff0 0x7f80f409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.696+0000 7f80fbd12640 1 -- 172.21.15.154:0/3693454286 >> 172.21.15.154:0/3693454286 conn(0x7f80f4072050 msgr2=0x7f80f40b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.696+0000 7f80fbd12640 1 -- 172.21.15.154:0/3693454286 shutdown_connections 2024-05-14T01:24:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.696+0000 7f80fbd12640 1 -- 172.21.15.154:0/3693454286 wait complete. 2024-05-14T01:24:28.702 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-14T01:24:28.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.828+0000 7f9b4259e640 1 Processor -- start 2024-05-14T01:24:28.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.828+0000 7f9b4259e640 1 -- start start 2024-05-14T01:24:28.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.828+0000 7f9b4259e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9b3c0b3260 0x7f9b3c072300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:28.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.828+0000 7f9b4259e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b3c06cf80 con 0x7f9b3c162350 2024-05-14T01:24:28.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.828+0000 7f9b4259e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b3c06d260 con 0x7f9b3c071ea0 2024-05-14T01:24:28.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.828+0000 7f9b4259e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9b3c06e730 con 0x7f9b3c0b3260 2024-05-14T01:24:28.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.828+0000 7f9b40b3b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9b3c0b3260 0x7f9b3c072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:28.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.828+0000 7f9b3bfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9b3c162350 0x7f9b3c06e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39888/0 (socket says 172.21.15.154:39888) 2024-05-14T01:24:28.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.828+0000 7f9b40b3b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9b3c0b3260 0x7f9b3c072300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50692/0 (socket says 172.21.15.154:50692) 2024-05-14T01:24:28.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.828+0000 7f9b3bfff640 1 -- 172.21.15.154:0/1012025284 learned_addr learned my addr 172.21.15.154:0/1012025284 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:28.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.828+0000 7f9b40b3b640 1 -- 172.21.15.154:0/1012025284 >> v1:172.21.15.176:6789/0 conn(0x7f9b3c071ea0 legacy=0x7f9b3c0b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:28.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.828+0000 7f9b40b3b640 1 -- 172.21.15.154:0/1012025284 >> v1:172.21.15.154:6789/0 conn(0x7f9b3c162350 legacy=0x7f9b3c06e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:28.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.828+0000 7f9b40b3b640 1 -- 172.21.15.154:0/1012025284 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c06d540 con 0x7f9b3c0b3260 2024-05-14T01:24:28.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b40b3b640 1 --2- 172.21.15.154:0/1012025284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b3c0b3260 0x7f9b3c072300 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009d90 tx=0x7f9b3401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a67a0f68953fdac server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:28.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b3affd640 1 -- 172.21.15.154:0/1012025284 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b340b2070 con 0x7f9b3c0b3260 2024-05-14T01:24:28.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b3affd640 1 -- 172.21.15.154:0/1012025284 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b340a5810 con 0x7f9b3c0b3260 2024-05-14T01:24:28.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b3affd640 1 -- 172.21.15.154:0/1012025284 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b340a5be0 con 0x7f9b3c0b3260 2024-05-14T01:24:28.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b4259e640 1 -- 172.21.15.154:0/1012025284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b3c0b3260 msgr2=0x7f9b3c072300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:28.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b4259e640 1 --2- 172.21.15.154:0/1012025284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b3c0b3260 0x7f9b3c072300 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009d90 tx=0x7f9b3401c930 comp rx=0 tx=0).stop 2024-05-14T01:24:28.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b4259e640 1 -- 172.21.15.154:0/1012025284 shutdown_connections 2024-05-14T01:24:28.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b4259e640 1 --2- 172.21.15.154:0/1012025284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b3c0b3260 0x7f9b3c072300 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b4259e640 1 -- 172.21.15.154:0/1012025284 >> 172.21.15.154:0/1012025284 conn(0x7f9b3c0b1850 msgr2=0x7f9b3c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:28.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b4259e640 1 -- 172.21.15.154:0/1012025284 shutdown_connections 2024-05-14T01:24:28.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b4259e640 1 -- 172.21.15.154:0/1012025284 wait complete. 2024-05-14T01:24:28.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b4259e640 1 Processor -- start 2024-05-14T01:24:28.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b4259e640 1 -- start start 2024-05-14T01:24:28.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b4259e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b3c071ea0 0x7f9b3c155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:28.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b4259e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0b3260 0x7f9b3c1fb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:28.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b4259e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c162350 0x7f9b3c1fb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:28.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b4259e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c163310 con 0x7f9b3c071ea0 2024-05-14T01:24:28.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b4259e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c163190 con 0x7f9b3c0b3260 2024-05-14T01:24:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.832+0000 7f9b4259e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3c163490 con 0x7f9b3c162350 2024-05-14T01:24:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b3bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b3c071ea0 0x7f9b3c155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b3bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b3c071ea0 0x7f9b3c155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50698/0 (socket says 172.21.15.154:50698) 2024-05-14T01:24:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b3bfff640 1 -- 172.21.15.154:0/4264670824 learned_addr learned my addr 172.21.15.154:0/4264670824 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b40b3b640 1 --2- 172.21.15.154:0/4264670824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c162350 0x7f9b3c1fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b3bfff640 1 -- 172.21.15.154:0/4264670824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c162350 msgr2=0x7f9b3c1fb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b3bfff640 1 --2- 172.21.15.154:0/4264670824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c162350 0x7f9b3c1fb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b3bfff640 1 -- 172.21.15.154:0/4264670824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0b3260 msgr2=0x7f9b3c1fb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b3bfff640 1 --2- 172.21.15.154:0/4264670824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0b3260 0x7f9b3c1fb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b3bfff640 1 -- 172.21.15.154:0/4264670824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c0ab0d0 con 0x7f9b3c071ea0 2024-05-14T01:24:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b3bfff640 1 --2- 172.21.15.154:0/4264670824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b3c071ea0 0x7f9b3c155ee0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00c420 tx=0x7f9b2c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b38ff9640 1 -- 172.21.15.154:0/4264670824 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c017070 con 0x7f9b3c071ea0 2024-05-14T01:24:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b38ff9640 1 -- 172.21.15.154:0/4264670824 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2c005cf0 con 0x7f9b3c071ea0 2024-05-14T01:24:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b38ff9640 1 -- 172.21.15.154:0/4264670824 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0072f0 con 0x7f9b3c071ea0 2024-05-14T01:24:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b4259e640 1 -- 172.21.15.154:0/4264670824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3c0ab3b0 con 0x7f9b3c071ea0 2024-05-14T01:24:28.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b4259e640 1 -- 172.21.15.154:0/4264670824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3c0ab970 con 0x7f9b3c071ea0 2024-05-14T01:24:28.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b4259e640 1 -- 172.21.15.154:0/4264670824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3c075470 con 0x7f9b3c071ea0 2024-05-14T01:24:28.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b38ff9640 1 -- 172.21.15.154:0/4264670824 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9b2c01a070 con 0x7f9b3c071ea0 2024-05-14T01:24:28.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b38ff9640 1 --2- 172.21.15.154:0/4264670824 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9b280678f0 0x7f9b28069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:28.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b38ff9640 1 -- 172.21.15.154:0/4264670824 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f9b2c084d10 con 0x7f9b3c071ea0 2024-05-14T01:24:28.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b3b7fe640 1 --2- 172.21.15.154:0/4264670824 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9b280678f0 0x7f9b28069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:28.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.836+0000 7f9b3b7fe640 1 --2- 172.21.15.154:0/4264670824 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9b280678f0 0x7f9b28069db0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c1576e0 tx=0x7f9b30006bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:28.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:28.840+0000 7f9b38ff9640 1 -- 172.21.15.154:0/4264670824 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f9b2c055ba0 con 0x7f9b3c071ea0 2024-05-14T01:24:29.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.052+0000 7f9b4259e640 1 -- 172.21.15.154:0/4264670824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f9b3c156420 con 0x7f9b3c071ea0 2024-05-14T01:24:29.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.052+0000 7f9b38ff9640 1 -- 172.21.15.154:0/4264670824 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f9b2c0554a0 con 0x7f9b3c071ea0 2024-05-14T01:24:29.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.056+0000 7f9b4259e640 1 -- 172.21.15.154:0/4264670824 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9b280678f0 msgr2=0x7f9b28069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.056+0000 7f9b4259e640 1 --2- 172.21.15.154:0/4264670824 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9b280678f0 0x7f9b28069db0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c1576e0 tx=0x7f9b30006bd0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.056+0000 7f9b4259e640 1 -- 172.21.15.154:0/4264670824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b3c071ea0 msgr2=0x7f9b3c155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.056+0000 7f9b4259e640 1 --2- 172.21.15.154:0/4264670824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b3c071ea0 0x7f9b3c155ee0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00c420 tx=0x7f9b2c00c8e0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.056+0000 7f9b4259e640 1 -- 172.21.15.154:0/4264670824 shutdown_connections 2024-05-14T01:24:29.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.056+0000 7f9b4259e640 1 --2- 172.21.15.154:0/4264670824 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9b280678f0 0x7f9b28069db0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.056+0000 7f9b4259e640 1 --2- 172.21.15.154:0/4264670824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c162350 0x7f9b3c1fb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.056+0000 7f9b4259e640 1 --2- 172.21.15.154:0/4264670824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0b3260 0x7f9b3c1fb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.056+0000 7f9b4259e640 1 --2- 172.21.15.154:0/4264670824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b3c071ea0 0x7f9b3c155ee0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.056+0000 7f9b4259e640 1 -- 172.21.15.154:0/4264670824 >> 172.21.15.154:0/4264670824 conn(0x7f9b3c0b1850 msgr2=0x7f9b3c164010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:29.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.056+0000 7f9b4259e640 1 -- 172.21.15.154:0/4264670824 shutdown_connections 2024-05-14T01:24:29.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.056+0000 7f9b4259e640 1 -- 172.21.15.154:0/4264670824 wait complete. 2024-05-14T01:24:29.061 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-14T01:24:29.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.188+0000 7f201c4e3640 1 Processor -- start 2024-05-14T01:24:29.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.188+0000 7f201c4e3640 1 -- start start 2024-05-14T01:24:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.188+0000 7f201c4e3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20140b3530 0x7f201415b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.188+0000 7f201c4e3640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2014144b40 con 0x7f2014144760 2024-05-14T01:24:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.188+0000 7f201c4e3640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20140b3a40 con 0x7f201415b910 2024-05-14T01:24:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.188+0000 7f201c4e3640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f201406ed90 con 0x7f20140b3530 2024-05-14T01:24:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.192+0000 7f2019a7e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20140b3530 0x7f201415b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.192+0000 7f201a27f640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2014144760 0x7f201406e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39894/0 (socket says 172.21.15.154:39894) 2024-05-14T01:24:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.192+0000 7f201a27f640 1 -- 172.21.15.154:0/3258072956 learned_addr learned my addr 172.21.15.154:0/3258072956 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.192+0000 7f2019a7e640 1 -- 172.21.15.154:0/3258072956 >> v1:172.21.15.176:6789/0 conn(0x7f201415b910 legacy=0x7f201415c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.192+0000 7f2019a7e640 1 -- 172.21.15.154:0/3258072956 >> v1:172.21.15.154:6789/0 conn(0x7f2014144760 legacy=0x7f201406e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.192+0000 7f2019a7e640 1 -- 172.21.15.154:0/3258072956 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20140b3d20 con 0x7f20140b3530 2024-05-14T01:24:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.192+0000 7f201927d640 1 -- 172.21.15.154:0/3258072956 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1428863841 0 0) 0x7f2014144b40 con 0x7f2014144760 2024-05-14T01:24:29.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.192+0000 7f2019a7e640 1 --2- 172.21.15.154:0/3258072956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20140b3530 0x7f201415b3d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f20040097c0 tx=0x7f200401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d393c75fc9df49 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:29.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.192+0000 7f201927d640 1 -- 172.21.15.154:0/3258072956 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20040b1070 con 0x7f20140b3530 2024-05-14T01:24:29.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.192+0000 7f201927d640 1 -- 172.21.15.154:0/3258072956 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20040ac410 con 0x7f20140b3530 2024-05-14T01:24:29.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.192+0000 7f201927d640 1 -- 172.21.15.154:0/3258072956 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20040ac7e0 con 0x7f20140b3530 2024-05-14T01:24:29.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.192+0000 7f201c4e3640 1 -- 172.21.15.154:0/3258072956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20140b3530 msgr2=0x7f201415b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.192+0000 7f201c4e3640 1 --2- 172.21.15.154:0/3258072956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20140b3530 0x7f201415b3d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f20040097c0 tx=0x7f200401c4a0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.192+0000 7f201c4e3640 1 -- 172.21.15.154:0/3258072956 shutdown_connections 2024-05-14T01:24:29.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.192+0000 7f201c4e3640 1 --2- 172.21.15.154:0/3258072956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20140b3530 0x7f201415b3d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.192+0000 7f201c4e3640 1 -- 172.21.15.154:0/3258072956 >> 172.21.15.154:0/3258072956 conn(0x7f20140b1850 msgr2=0x7f20140b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:29.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.192+0000 7f201c4e3640 1 -- 172.21.15.154:0/3258072956 shutdown_connections 2024-05-14T01:24:29.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.192+0000 7f201c4e3640 1 -- 172.21.15.154:0/3258072956 wait complete. 2024-05-14T01:24:29.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f201c4e3640 1 Processor -- start 2024-05-14T01:24:29.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f201c4e3640 1 -- start start 2024-05-14T01:24:29.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f201c4e3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20140b3530 0x7f2014138130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:29.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f201c4e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2014144760 0x7f2014138f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:29.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f201c4e3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f201415b910 0x7f201413e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:29.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f201c4e3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f201415d680 con 0x7f2014144760 2024-05-14T01:24:29.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f201c4e3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f201415d500 con 0x7f201415b910 2024-05-14T01:24:29.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f201c4e3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f201415d800 con 0x7f20140b3530 2024-05-14T01:24:29.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f2019a7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2014144760 0x7f2014138f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f2019a7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2014144760 0x7f2014138f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50716/0 (socket says 172.21.15.154:50716) 2024-05-14T01:24:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f2019a7e640 1 -- 172.21.15.154:0/733678716 learned_addr learned my addr 172.21.15.154:0/733678716 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f201aa80640 1 --2- 172.21.15.154:0/733678716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f201415b910 0x7f201413e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f201a27f640 1 --2- 172.21.15.154:0/733678716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20140b3530 0x7f2014138130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f2019a7e640 1 -- 172.21.15.154:0/733678716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20140b3530 msgr2=0x7f2014138130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f2019a7e640 1 --2- 172.21.15.154:0/733678716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20140b3530 0x7f2014138130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f2019a7e640 1 -- 172.21.15.154:0/733678716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f201415b910 msgr2=0x7f201413e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f2019a7e640 1 --2- 172.21.15.154:0/733678716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f201415b910 0x7f201413e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f2019a7e640 1 -- 172.21.15.154:0/733678716 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2014138670 con 0x7f2014144760 2024-05-14T01:24:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f201aa80640 1 --2- 172.21.15.154:0/733678716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f201415b910 0x7f201413e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f2019a7e640 1 --2- 172.21.15.154:0/733678716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2014144760 0x7f2014138f60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f20040190b0 tx=0x7f2004019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f200affd640 1 -- 172.21.15.154:0/733678716 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20040b1040 con 0x7f2014144760 2024-05-14T01:24:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f200affd640 1 -- 172.21.15.154:0/733678716 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20040bb070 con 0x7f2014144760 2024-05-14T01:24:29.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f201c4e3640 1 -- 172.21.15.154:0/733678716 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f201413b810 con 0x7f2014144760 2024-05-14T01:24:29.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f200affd640 1 -- 172.21.15.154:0/733678716 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20040b5630 con 0x7f2014144760 2024-05-14T01:24:29.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f201c4e3640 1 -- 172.21.15.154:0/733678716 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f201413bdd0 con 0x7f2014144760 2024-05-14T01:24:29.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f201c4e3640 1 -- 172.21.15.154:0/733678716 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2014075470 con 0x7f2014144760 2024-05-14T01:24:29.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f200affd640 1 -- 172.21.15.154:0/733678716 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f20040b57d0 con 0x7f2014144760 2024-05-14T01:24:29.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f200affd640 1 --2- 172.21.15.154:0/733678716 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1ff80678c0 0x7f1ff8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:29.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f200affd640 1 -- 172.21.15.154:0/733678716 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f200411f4a0 con 0x7f2014144760 2024-05-14T01:24:29.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.196+0000 7f201a27f640 1 --2- 172.21.15.154:0/733678716 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1ff80678c0 0x7f1ff8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:29.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.200+0000 7f201a27f640 1 --2- 172.21.15.154:0/733678716 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1ff80678c0 0x7f1ff8069d80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f20100011f0 tx=0x7f2010009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:29.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.204+0000 7f200affd640 1 -- 172.21.15.154:0/733678716 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f2004016090 con 0x7f2014144760 2024-05-14T01:24:29.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.416+0000 7f201c4e3640 1 -- 172.21.15.154:0/733678716 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f2014072620 con 0x7f2014144760 2024-05-14T01:24:29.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.420+0000 7f200affd640 1 -- 172.21.15.154:0/733678716 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f20040f02a0 con 0x7f2014144760 2024-05-14T01:24:29.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.420+0000 7f201c4e3640 1 -- 172.21.15.154:0/733678716 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1ff80678c0 msgr2=0x7f1ff8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.420+0000 7f201c4e3640 1 --2- 172.21.15.154:0/733678716 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1ff80678c0 0x7f1ff8069d80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f20100011f0 tx=0x7f2010009040 comp rx=0 tx=0).stop 2024-05-14T01:24:29.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.420+0000 7f201c4e3640 1 -- 172.21.15.154:0/733678716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2014144760 msgr2=0x7f2014138f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.420+0000 7f201c4e3640 1 --2- 172.21.15.154:0/733678716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2014144760 0x7f2014138f60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f20040190b0 tx=0x7f2004019240 comp rx=0 tx=0).stop 2024-05-14T01:24:29.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.420+0000 7f201c4e3640 1 -- 172.21.15.154:0/733678716 shutdown_connections 2024-05-14T01:24:29.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.420+0000 7f201c4e3640 1 --2- 172.21.15.154:0/733678716 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1ff80678c0 0x7f1ff8069d80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.420+0000 7f201c4e3640 1 --2- 172.21.15.154:0/733678716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f201415b910 0x7f201413e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.420+0000 7f201c4e3640 1 --2- 172.21.15.154:0/733678716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2014144760 0x7f2014138f60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.420+0000 7f201c4e3640 1 --2- 172.21.15.154:0/733678716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20140b3530 0x7f2014138130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.420+0000 7f201c4e3640 1 -- 172.21.15.154:0/733678716 >> 172.21.15.154:0/733678716 conn(0x7f20140b1850 msgr2=0x7f2014071520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:29.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.420+0000 7f201c4e3640 1 -- 172.21.15.154:0/733678716 shutdown_connections 2024-05-14T01:24:29.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.420+0000 7f201c4e3640 1 -- 172.21.15.154:0/733678716 wait complete. 2024-05-14T01:24:29.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-14T01:24:29.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.544+0000 7ff9b184b640 1 Processor -- start 2024-05-14T01:24:29.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.544+0000 7ff9b184b640 1 -- start start 2024-05-14T01:24:29.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.544+0000 7ff9b184b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9ac13ede0 0x7ff9ac1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:29.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.544+0000 7ff9b184b640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff9ac141b30 0x7ff9ac0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:29.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.544+0000 7ff9b184b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff9ac0ce880 0x7ff9ac15fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:29.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.544+0000 7ff9b184b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff9ac141f90 con 0x7ff9ac0ce880 2024-05-14T01:24:29.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.544+0000 7ff9b184b640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff9ac06cff0 con 0x7ff9ac141b30 2024-05-14T01:24:29.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.544+0000 7ff9b184b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ac0cf100 con 0x7ff9ac13ede0 2024-05-14T01:24:29.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.544+0000 7ff9ab7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff9ac0ce880 0x7ff9ac15fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:29.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.544+0000 7ff9ab7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff9ac0ce880 0x7ff9ac15fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50720/0 (socket says 172.21.15.154:50720) 2024-05-14T01:24:29.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.544+0000 7ff9ab7fe640 1 -- 172.21.15.154:0/1641373877 learned_addr learned my addr 172.21.15.154:0/1641373877 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:29.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.544+0000 7ff9aaffd640 1 --2- 172.21.15.154:0/1641373877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9ac13ede0 0x7ff9ac1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:29.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.544+0000 7ff9aa7fc640 1 --2- 172.21.15.154:0/1641373877 >> v2:172.21.15.176:3300/0 conn(0x7ff9ac141b30 0x7ff9ac0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:29.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.544+0000 7ff9ab7fe640 1 -- 172.21.15.154:0/1641373877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9ac13ede0 msgr2=0x7ff9ac1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:29.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.544+0000 7ff9ab7fe640 1 --2- 172.21.15.154:0/1641373877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9ac13ede0 0x7ff9ac1415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.544+0000 7ff9ab7fe640 1 -- 172.21.15.154:0/1641373877 >> v2:172.21.15.176:3300/0 conn(0x7ff9ac141b30 msgr2=0x7ff9ac0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:29.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.544+0000 7ff9ab7fe640 1 --2- 172.21.15.154:0/1641373877 >> v2:172.21.15.176:3300/0 conn(0x7ff9ac141b30 0x7ff9ac0ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.544+0000 7ff9ab7fe640 1 -- 172.21.15.154:0/1641373877 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac0cf3e0 con 0x7ff9ac0ce880 2024-05-14T01:24:29.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.548+0000 7ff9ab7fe640 1 --2- 172.21.15.154:0/1641373877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ac0ce880 0x7ff9ac15fa00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac06c2d0 tx=0x7ff9a401c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fcaaf2aa83b6ec2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:29.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.548+0000 7ff9a9ffb640 1 -- 172.21.15.154:0/1641373877 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a40a5560 con 0x7ff9ac0ce880 2024-05-14T01:24:29.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.548+0000 7ff9a9ffb640 1 -- 172.21.15.154:0/1641373877 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a40a5700 con 0x7ff9ac0ce880 2024-05-14T01:24:29.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.548+0000 7ff9a9ffb640 1 -- 172.21.15.154:0/1641373877 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a40a5ad0 con 0x7ff9ac0ce880 2024-05-14T01:24:29.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.548+0000 7ff9b184b640 1 -- 172.21.15.154:0/1641373877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ac0ce880 msgr2=0x7ff9ac15fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.548+0000 7ff9b184b640 1 --2- 172.21.15.154:0/1641373877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ac0ce880 0x7ff9ac15fa00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac06c2d0 tx=0x7ff9a401c700 comp rx=0 tx=0).stop 2024-05-14T01:24:29.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.548+0000 7ff9b184b640 1 -- 172.21.15.154:0/1641373877 shutdown_connections 2024-05-14T01:24:29.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.548+0000 7ff9b184b640 1 --2- 172.21.15.154:0/1641373877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ac0ce880 0x7ff9ac15fa00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.548+0000 7ff9b184b640 1 --2- 172.21.15.154:0/1641373877 >> v2:172.21.15.176:3300/0 conn(0x7ff9ac141b30 0x7ff9ac0ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.548+0000 7ff9b184b640 1 --2- 172.21.15.154:0/1641373877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9ac13ede0 0x7ff9ac1415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.548+0000 7ff9b184b640 1 -- 172.21.15.154:0/1641373877 >> 172.21.15.154:0/1641373877 conn(0x7ff9ac0b1850 msgr2=0x7ff9ac0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:29.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.548+0000 7ff9b184b640 1 -- 172.21.15.154:0/1641373877 shutdown_connections 2024-05-14T01:24:29.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.548+0000 7ff9b184b640 1 -- 172.21.15.154:0/1641373877 wait complete. 2024-05-14T01:24:29.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.548+0000 7ff9b184b640 1 Processor -- start 2024-05-14T01:24:29.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.548+0000 7ff9b184b640 1 -- start start 2024-05-14T01:24:29.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9b184b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ac0ce880 0x7ff9ac0b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:29.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9b184b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9ac13ede0 0x7ff9ac152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:29.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9b184b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9ac141b30 0x7ff9ac15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:29.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9b184b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0cee60 con 0x7ff9ac0ce880 2024-05-14T01:24:29.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9b184b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0cece0 con 0x7ff9ac13ede0 2024-05-14T01:24:29.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9b184b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ac06d460 con 0x7ff9ac141b30 2024-05-14T01:24:29.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9aaffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ac0ce880 0x7ff9ac0b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:29.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9aaffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ac0ce880 0x7ff9ac0b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50730/0 (socket says 172.21.15.154:50730) 2024-05-14T01:24:29.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9aaffd640 1 -- 172.21.15.154:0/4045555504 learned_addr learned my addr 172.21.15.154:0/4045555504 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:29.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9ab7fe640 1 --2- 172.21.15.154:0/4045555504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9ac141b30 0x7ff9ac15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:29.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9aaffd640 1 -- 172.21.15.154:0/4045555504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9ac141b30 msgr2=0x7ff9ac15d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9aaffd640 1 --2- 172.21.15.154:0/4045555504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9ac141b30 0x7ff9ac15d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9aaffd640 1 -- 172.21.15.154:0/4045555504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9ac13ede0 msgr2=0x7ff9ac152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9aaffd640 1 --2- 172.21.15.154:0/4045555504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9ac13ede0 0x7ff9ac152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9aaffd640 1 -- 172.21.15.154:0/4045555504 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac0b3980 con 0x7ff9ac0ce880 2024-05-14T01:24:29.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9aaffd640 1 --2- 172.21.15.154:0/4045555504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ac0ce880 0x7ff9ac0b4a20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff99c00d800 tx=0x7ff99c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:29.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff993fff640 1 -- 172.21.15.154:0/4045555504 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c00b6c0 con 0x7ff9ac0ce880 2024-05-14T01:24:29.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff993fff640 1 -- 172.21.15.154:0/4045555504 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff99c019070 con 0x7ff9ac0ce880 2024-05-14T01:24:29.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9b184b640 1 -- 172.21.15.154:0/4045555504 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ac0b3c60 con 0x7ff9ac0ce880 2024-05-14T01:24:29.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff993fff640 1 -- 172.21.15.154:0/4045555504 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c00ba60 con 0x7ff9ac0ce880 2024-05-14T01:24:29.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9b184b640 1 -- 172.21.15.154:0/4045555504 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ac0b4220 con 0x7ff9ac0ce880 2024-05-14T01:24:29.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9b184b640 1 -- 172.21.15.154:0/4045555504 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9ac075470 con 0x7ff9ac0ce880 2024-05-14T01:24:29.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff993fff640 1 -- 172.21.15.154:0/4045555504 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff99c00bc00 con 0x7ff9ac0ce880 2024-05-14T01:24:29.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff993fff640 1 --2- 172.21.15.154:0/4045555504 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff9980678c0 0x7ff998069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:29.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff993fff640 1 -- 172.21.15.154:0/4045555504 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7ff99c085e00 con 0x7ff9ac0ce880 2024-05-14T01:24:29.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9aa7fc640 1 --2- 172.21.15.154:0/4045555504 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff9980678c0 0x7ff998069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:29.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.552+0000 7ff9aa7fc640 1 --2- 172.21.15.154:0/4045555504 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff9980678c0 0x7ff998069d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac073640 tx=0x7ff9a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:29.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.556+0000 7ff993fff640 1 -- 172.21.15.154:0/4045555504 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7ff99c056c90 con 0x7ff9ac0ce880 2024-05-14T01:24:29.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.760+0000 7ff9b184b640 1 -- 172.21.15.154:0/4045555504 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7ff9ac15f600 con 0x7ff9ac0ce880 2024-05-14T01:24:29.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.764+0000 7ff993fff640 1 -- 172.21.15.154:0/4045555504 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7ff99c056590 con 0x7ff9ac0ce880 2024-05-14T01:24:29.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.768+0000 7ff9b184b640 1 -- 172.21.15.154:0/4045555504 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff9980678c0 msgr2=0x7ff998069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.768+0000 7ff9b184b640 1 --2- 172.21.15.154:0/4045555504 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff9980678c0 0x7ff998069d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac073640 tx=0x7ff9a0008040 comp rx=0 tx=0).stop 2024-05-14T01:24:29.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.768+0000 7ff9b184b640 1 -- 172.21.15.154:0/4045555504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ac0ce880 msgr2=0x7ff9ac0b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.768+0000 7ff9b184b640 1 --2- 172.21.15.154:0/4045555504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ac0ce880 0x7ff9ac0b4a20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff99c00d800 tx=0x7ff99c00dcc0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.768+0000 7ff9b184b640 1 -- 172.21.15.154:0/4045555504 shutdown_connections 2024-05-14T01:24:29.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.768+0000 7ff9b184b640 1 --2- 172.21.15.154:0/4045555504 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff9980678c0 0x7ff998069d80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.768+0000 7ff9b184b640 1 --2- 172.21.15.154:0/4045555504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9ac141b30 0x7ff9ac15d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.768+0000 7ff9b184b640 1 --2- 172.21.15.154:0/4045555504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9ac13ede0 0x7ff9ac152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.768+0000 7ff9b184b640 1 --2- 172.21.15.154:0/4045555504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9ac0ce880 0x7ff9ac0b4a20 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.768+0000 7ff9b184b640 1 -- 172.21.15.154:0/4045555504 >> 172.21.15.154:0/4045555504 conn(0x7ff9ac0b1850 msgr2=0x7ff9ac15b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:29.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.768+0000 7ff9b184b640 1 -- 172.21.15.154:0/4045555504 shutdown_connections 2024-05-14T01:24:29.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.768+0000 7ff9b184b640 1 -- 172.21.15.154:0/4045555504 wait complete. 2024-05-14T01:24:29.770 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-14T01:24:29.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.900+0000 7fc1e1afa640 1 Processor -- start 2024-05-14T01:24:29.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.900+0000 7fc1e1afa640 1 -- start start 2024-05-14T01:24:29.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.900+0000 7fc1e1afa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1dc166120 0x7fc1dc0cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:29.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.900+0000 7fc1e1afa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1dc166620 con 0x7fc1dc06c290 2024-05-14T01:24:29.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.900+0000 7fc1e1afa640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1dc166900 con 0x7fc1dc0cbdb0 2024-05-14T01:24:29.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.900+0000 7fc1e1afa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc1dc166be0 con 0x7fc1dc166120 2024-05-14T01:24:29.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.900+0000 7fc1dbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1dc166120 0x7fc1dc0cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:29.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.900+0000 7fc1db7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc1dc06c290 0x7fc1dc06c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39898/0 (socket says 172.21.15.154:39898) 2024-05-14T01:24:29.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.900+0000 7fc1db7fe640 1 -- 172.21.15.154:0/10029525 learned_addr learned my addr 172.21.15.154:0/10029525 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:29.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.900+0000 7fc1dbfff640 1 -- 172.21.15.154:0/10029525 >> v1:172.21.15.176:6789/0 conn(0x7fc1dc0cbdb0 legacy=0x7fc1dc0cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.900+0000 7fc1dbfff640 1 -- 172.21.15.154:0/10029525 >> v1:172.21.15.154:6789/0 conn(0x7fc1dc06c290 legacy=0x7fc1dc06c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.900+0000 7fc1dbfff640 1 -- 172.21.15.154:0/10029525 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1dc166ec0 con 0x7fc1dc166120 2024-05-14T01:24:29.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1dbfff640 1 --2- 172.21.15.154:0/10029525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1dc166120 0x7fc1dc0cf8e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40097c0 tx=0x7fc1d401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44a75a3d7bc0598 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:29.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1da7fc640 1 -- 172.21.15.154:0/10029525 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d40b1070 con 0x7fc1dc166120 2024-05-14T01:24:29.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1da7fc640 1 -- 172.21.15.154:0/10029525 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d40ac410 con 0x7fc1dc166120 2024-05-14T01:24:29.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1da7fc640 1 -- 172.21.15.154:0/10029525 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d40ac7e0 con 0x7fc1dc166120 2024-05-14T01:24:29.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1e1afa640 1 -- 172.21.15.154:0/10029525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1dc166120 msgr2=0x7fc1dc0cf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1e1afa640 1 --2- 172.21.15.154:0/10029525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1dc166120 0x7fc1dc0cf8e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40097c0 tx=0x7fc1d401c4a0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1e1afa640 1 -- 172.21.15.154:0/10029525 shutdown_connections 2024-05-14T01:24:29.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1e1afa640 1 --2- 172.21.15.154:0/10029525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1dc166120 0x7fc1dc0cf8e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1e1afa640 1 -- 172.21.15.154:0/10029525 >> 172.21.15.154:0/10029525 conn(0x7fc1dc072050 msgr2=0x7fc1dc072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:29.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1e1afa640 1 -- 172.21.15.154:0/10029525 shutdown_connections 2024-05-14T01:24:29.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1e1afa640 1 -- 172.21.15.154:0/10029525 wait complete. 2024-05-14T01:24:29.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1e1afa640 1 Processor -- start 2024-05-14T01:24:29.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1e1afa640 1 -- start start 2024-05-14T01:24:29.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1e1afa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1dc06c290 0x7fc1dc149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:29.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1e1afa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1dc0cbdb0 0x7fc1dc0b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:29.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1e1afa640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1dc166120 0x7fc1dc0b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:29.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1e1afa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc171070 con 0x7fc1dc0cbdb0 2024-05-14T01:24:29.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1e1afa640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc170ef0 con 0x7fc1dc06c290 2024-05-14T01:24:29.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1e1afa640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc1dc1711f0 con 0x7fc1dc166120 2024-05-14T01:24:29.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1daffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1dc0cbdb0 0x7fc1dc0b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:29.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1daffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1dc0cbdb0 0x7fc1dc0b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50748/0 (socket says 172.21.15.154:50748) 2024-05-14T01:24:29.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.904+0000 7fc1daffd640 1 -- 172.21.15.154:0/3212236039 learned_addr learned my addr 172.21.15.154:0/3212236039 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:29.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1db7fe640 1 --2- 172.21.15.154:0/3212236039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1dc06c290 0x7fc1dc149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:29.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1dbfff640 1 --2- 172.21.15.154:0/3212236039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1dc166120 0x7fc1dc0b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:29.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1daffd640 1 -- 172.21.15.154:0/3212236039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1dc166120 msgr2=0x7fc1dc0b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1daffd640 1 --2- 172.21.15.154:0/3212236039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1dc166120 0x7fc1dc0b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1daffd640 1 -- 172.21.15.154:0/3212236039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1dc06c290 msgr2=0x7fc1dc149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:29.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1daffd640 1 --2- 172.21.15.154:0/3212236039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1dc06c290 0x7fc1dc149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:29.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1daffd640 1 -- 172.21.15.154:0/3212236039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1dc0b3fa0 con 0x7fc1dc0cbdb0 2024-05-14T01:24:29.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1db7fe640 1 --2- 172.21.15.154:0/3212236039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1dc06c290 0x7fc1dc149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:29.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1dbfff640 1 --2- 172.21.15.154:0/3212236039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1dc166120 0x7fc1dc0b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:29.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1daffd640 1 --2- 172.21.15.154:0/3212236039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1dc0cbdb0 0x7fc1dc0b3a60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400c460 tx=0x7fc1c400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:29.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1d3fff640 1 -- 172.21.15.154:0/3212236039 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4016020 con 0x7fc1dc0cbdb0 2024-05-14T01:24:29.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1d3fff640 1 -- 172.21.15.154:0/3212236039 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c40052d0 con 0x7fc1dc0cbdb0 2024-05-14T01:24:29.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1e1afa640 1 -- 172.21.15.154:0/3212236039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1dc0b4240 con 0x7fc1dc0cbdb0 2024-05-14T01:24:29.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1d3fff640 1 -- 172.21.15.154:0/3212236039 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4007260 con 0x7fc1dc0cbdb0 2024-05-14T01:24:29.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1e1afa640 1 -- 172.21.15.154:0/3212236039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1dc0b4800 con 0x7fc1dc0cbdb0 2024-05-14T01:24:29.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1e1afa640 1 -- 172.21.15.154:0/3212236039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1dc068360 con 0x7fc1dc0cbdb0 2024-05-14T01:24:29.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1d3fff640 1 -- 172.21.15.154:0/3212236039 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc1c4007400 con 0x7fc1dc0cbdb0 2024-05-14T01:24:29.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1d3fff640 1 --2- 172.21.15.154:0/3212236039 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc1bc0678c0 0x7fc1bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:29.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1db7fe640 1 --2- 172.21.15.154:0/3212236039 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc1bc0678c0 0x7fc1bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:29.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1d3fff640 1 -- 172.21.15.154:0/3212236039 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fc1c4085230 con 0x7fc1dc0cbdb0 2024-05-14T01:24:29.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.908+0000 7fc1db7fe640 1 --2- 172.21.15.154:0/3212236039 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc1bc0678c0 0x7fc1bc069d80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc005c10 tx=0x7fc1cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:29.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:29.912+0000 7fc1d3fff640 1 -- 172.21.15.154:0/3212236039 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fc1c4020020 con 0x7fc1dc0cbdb0 2024-05-14T01:24:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.120+0000 7fc1e1afa640 1 -- 172.21.15.154:0/3212236039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fc1dc09eb50 con 0x7fc1dc0cbdb0 2024-05-14T01:24:30.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.124+0000 7fc1d3fff640 1 -- 172.21.15.154:0/3212236039 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fc1c4005480 con 0x7fc1dc0cbdb0 2024-05-14T01:24:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.128+0000 7fc1e1afa640 1 -- 172.21.15.154:0/3212236039 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc1bc0678c0 msgr2=0x7fc1bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.128+0000 7fc1e1afa640 1 --2- 172.21.15.154:0/3212236039 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc1bc0678c0 0x7fc1bc069d80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc005c10 tx=0x7fc1cc009040 comp rx=0 tx=0).stop 2024-05-14T01:24:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.128+0000 7fc1e1afa640 1 -- 172.21.15.154:0/3212236039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1dc0cbdb0 msgr2=0x7fc1dc0b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.128+0000 7fc1e1afa640 1 --2- 172.21.15.154:0/3212236039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1dc0cbdb0 0x7fc1dc0b3a60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400c460 tx=0x7fc1c400c920 comp rx=0 tx=0).stop 2024-05-14T01:24:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.128+0000 7fc1e1afa640 1 -- 172.21.15.154:0/3212236039 shutdown_connections 2024-05-14T01:24:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.128+0000 7fc1e1afa640 1 --2- 172.21.15.154:0/3212236039 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc1bc0678c0 0x7fc1bc069d80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.128+0000 7fc1e1afa640 1 --2- 172.21.15.154:0/3212236039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1dc166120 0x7fc1dc0b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.128+0000 7fc1e1afa640 1 --2- 172.21.15.154:0/3212236039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1dc0cbdb0 0x7fc1dc0b3a60 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.128+0000 7fc1e1afa640 1 --2- 172.21.15.154:0/3212236039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1dc06c290 0x7fc1dc149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.128+0000 7fc1e1afa640 1 -- 172.21.15.154:0/3212236039 >> 172.21.15.154:0/3212236039 conn(0x7fc1dc072050 msgr2=0x7fc1dc074280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.128+0000 7fc1e1afa640 1 -- 172.21.15.154:0/3212236039 shutdown_connections 2024-05-14T01:24:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.128+0000 7fc1e1afa640 1 -- 172.21.15.154:0/3212236039 wait complete. 2024-05-14T01:24:30.131 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:30.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd749999640 1 Processor -- start 2024-05-14T01:24:30.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd749999640 1 -- start start 2024-05-14T01:24:30.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd749999640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd7441513c0 0x7fd7440cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd749999640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74406d470 0x7fd74406d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd749999640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd74415e040 0x7fd74415e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd749999640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd7440cf9d0 con 0x7fd7441513c0 2024-05-14T01:24:30.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd749999640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd74406de10 con 0x7fd74415e040 2024-05-14T01:24:30.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd749999640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd7440b3ad0 con 0x7fd74406d470 2024-05-14T01:24:30.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd742ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd7441513c0 0x7fd7440cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:30.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd742ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd7441513c0 0x7fd7440cf490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50760/0 (socket says 172.21.15.154:50760) 2024-05-14T01:24:30.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd742ffd640 1 -- 172.21.15.154:0/2687311500 learned_addr learned my addr 172.21.15.154:0/2687311500 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:30.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd73bfff640 1 --2- 172.21.15.154:0/2687311500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74406d470 0x7fd74406d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:30.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd7437fe640 1 --2- 172.21.15.154:0/2687311500 >> v2:172.21.15.176:3300/0 conn(0x7fd74415e040 0x7fd74415e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:30.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd742ffd640 1 -- 172.21.15.154:0/2687311500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74406d470 msgr2=0x7fd74406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:30.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd742ffd640 1 --2- 172.21.15.154:0/2687311500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74406d470 0x7fd74406d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd742ffd640 1 -- 172.21.15.154:0/2687311500 >> v2:172.21.15.176:3300/0 conn(0x7fd74415e040 msgr2=0x7fd74415e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:30.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd742ffd640 1 --2- 172.21.15.154:0/2687311500 >> v2:172.21.15.176:3300/0 conn(0x7fd74415e040 0x7fd74415e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd742ffd640 1 -- 172.21.15.154:0/2687311500 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7440b2ec0 con 0x7fd7441513c0 2024-05-14T01:24:30.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.260+0000 7fd7437fe640 1 --2- 172.21.15.154:0/2687311500 >> v2:172.21.15.176:3300/0 conn(0x7fd74415e040 0x7fd74415e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:30.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd742ffd640 1 --2- 172.21.15.154:0/2687311500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7441513c0 0x7fd7440cf490 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd74415dfa0 tx=0x7fd73401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb99c2b1c9437e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:30.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd7427fc640 1 -- 172.21.15.154:0/2687311500 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7340aa610 con 0x7fd7441513c0 2024-05-14T01:24:30.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd7427fc640 1 -- 172.21.15.154:0/2687311500 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7340af070 con 0x7fd7441513c0 2024-05-14T01:24:30.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd7427fc640 1 -- 172.21.15.154:0/2687311500 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7340aa9d0 con 0x7fd7441513c0 2024-05-14T01:24:30.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd749999640 1 -- 172.21.15.154:0/2687311500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7441513c0 msgr2=0x7fd7440cf490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:30.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd749999640 1 --2- 172.21.15.154:0/2687311500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7441513c0 0x7fd7440cf490 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd74415dfa0 tx=0x7fd73401c4f0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd749999640 1 -- 172.21.15.154:0/2687311500 shutdown_connections 2024-05-14T01:24:30.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd749999640 1 --2- 172.21.15.154:0/2687311500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74406d470 0x7fd74406d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd749999640 1 --2- 172.21.15.154:0/2687311500 >> v2:172.21.15.176:3300/0 conn(0x7fd74415e040 0x7fd74415e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd749999640 1 --2- 172.21.15.154:0/2687311500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7441513c0 0x7fd7440cf490 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd749999640 1 -- 172.21.15.154:0/2687311500 >> 172.21.15.154:0/2687311500 conn(0x7fd7440b1850 msgr2=0x7fd7440b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:30.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd749999640 1 -- 172.21.15.154:0/2687311500 shutdown_connections 2024-05-14T01:24:30.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd749999640 1 -- 172.21.15.154:0/2687311500 wait complete. 2024-05-14T01:24:30.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd749999640 1 Processor -- start 2024-05-14T01:24:30.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd749999640 1 -- start start 2024-05-14T01:24:30.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd749999640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd74406d470 0x7fd744135c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd749999640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7441513c0 0x7fd7441361c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd749999640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74415e040 0x7fd744138920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd749999640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7440b2b50 con 0x7fd74406d470 2024-05-14T01:24:30.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd749999640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd7440b3760 con 0x7fd7441513c0 2024-05-14T01:24:30.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd749999640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd74406e810 con 0x7fd74415e040 2024-05-14T01:24:30.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd742ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd74406d470 0x7fd744135c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:30.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd742ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd74406d470 0x7fd744135c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50764/0 (socket says 172.21.15.154:50764) 2024-05-14T01:24:30.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd742ffd640 1 -- 172.21.15.154:0/3283721688 learned_addr learned my addr 172.21.15.154:0/3283721688 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:30.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd7437fe640 1 --2- 172.21.15.154:0/3283721688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74415e040 0x7fd744138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:30.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd742ffd640 1 -- 172.21.15.154:0/3283721688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74415e040 msgr2=0x7fd744138920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:30.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd742ffd640 1 --2- 172.21.15.154:0/3283721688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74415e040 0x7fd744138920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd742ffd640 1 -- 172.21.15.154:0/3283721688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7441513c0 msgr2=0x7fd7441361c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:30.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd742ffd640 1 --2- 172.21.15.154:0/3283721688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7441513c0 0x7fd7441361c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.264+0000 7fd742ffd640 1 -- 172.21.15.154:0/3283721688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd744155a20 con 0x7fd74406d470 2024-05-14T01:24:30.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.268+0000 7fd7437fe640 1 --2- 172.21.15.154:0/3283721688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74415e040 0x7fd744138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:30.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.268+0000 7fd742ffd640 1 --2- 172.21.15.154:0/3283721688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd74406d470 0x7fd744135c80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd7340ac040 tx=0x7fd73401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:30.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.268+0000 7fd740ff9640 1 -- 172.21.15.154:0/3283721688 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7340b3600 con 0x7fd74406d470 2024-05-14T01:24:30.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.268+0000 7fd740ff9640 1 -- 172.21.15.154:0/3283721688 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7340b37c0 con 0x7fd74406d470 2024-05-14T01:24:30.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.268+0000 7fd749999640 1 -- 172.21.15.154:0/3283721688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7440cd8d0 con 0x7fd74406d470 2024-05-14T01:24:30.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.268+0000 7fd740ff9640 1 -- 172.21.15.154:0/3283721688 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7340b3bb0 con 0x7fd74406d470 2024-05-14T01:24:30.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.268+0000 7fd749999640 1 -- 172.21.15.154:0/3283721688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7440ce170 con 0x7fd74406d470 2024-05-14T01:24:30.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.268+0000 7fd749999640 1 -- 172.21.15.154:0/3283721688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd744075470 con 0x7fd74406d470 2024-05-14T01:24:30.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.268+0000 7fd740ff9640 1 -- 172.21.15.154:0/3283721688 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd7340c6390 con 0x7fd74406d470 2024-05-14T01:24:30.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.268+0000 7fd740ff9640 1 --2- 172.21.15.154:0/3283721688 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd7240678f0 0x7fd724069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.268+0000 7fd740ff9640 1 -- 172.21.15.154:0/3283721688 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fd734120170 con 0x7fd74406d470 2024-05-14T01:24:30.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.268+0000 7fd73bfff640 1 --2- 172.21.15.154:0/3283721688 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd7240678f0 0x7fd724069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:30.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.268+0000 7fd73bfff640 1 --2- 172.21.15.154:0/3283721688 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd7240678f0 0x7fd724069db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd7440cef60 tx=0x7fd72c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:30.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.272+0000 7fd740ff9640 1 -- 172.21.15.154:0/3283721688 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fd7340c3060 con 0x7fd74406d470 2024-05-14T01:24:30.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.432+0000 7fd749999640 1 -- 172.21.15.154:0/3283721688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7440cdc60 con 0x7fd74406d470 2024-05-14T01:24:30.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.436+0000 7fd740ff9640 1 -- 172.21.15.154:0/3283721688 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+12939 (secure 0 0 0) 0x7fd744155a20 con 0x7fd74406d470 2024-05-14T01:24:30.423 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:30.423 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":30,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:24:27.573043+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.436+0000 7fd749999640 1 -- 172.21.15.154:0/3283721688 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd7240678f0 msgr2=0x7fd724069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.436+0000 7fd749999640 1 --2- 172.21.15.154:0/3283721688 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd7240678f0 0x7fd724069db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd7440cef60 tx=0x7fd72c008040 comp rx=0 tx=0).stop 2024-05-14T01:24:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.436+0000 7fd749999640 1 -- 172.21.15.154:0/3283721688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd74406d470 msgr2=0x7fd744135c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.436+0000 7fd749999640 1 --2- 172.21.15.154:0/3283721688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd74406d470 0x7fd744135c80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd7340ac040 tx=0x7fd73401ad30 comp rx=0 tx=0).stop 2024-05-14T01:24:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.436+0000 7fd749999640 1 -- 172.21.15.154:0/3283721688 shutdown_connections 2024-05-14T01:24:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.436+0000 7fd749999640 1 --2- 172.21.15.154:0/3283721688 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd7240678f0 0x7fd724069db0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.436+0000 7fd749999640 1 --2- 172.21.15.154:0/3283721688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74415e040 0x7fd744138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.436+0000 7fd749999640 1 --2- 172.21.15.154:0/3283721688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7441513c0 0x7fd7441361c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.436+0000 7fd749999640 1 --2- 172.21.15.154:0/3283721688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd74406d470 0x7fd744135c80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.436+0000 7fd749999640 1 -- 172.21.15.154:0/3283721688 >> 172.21.15.154:0/3283721688 conn(0x7fd7440b1850 msgr2=0x7fd7440b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.436+0000 7fd749999640 1 -- 172.21.15.154:0/3283721688 shutdown_connections 2024-05-14T01:24:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.436+0000 7fd749999640 1 -- 172.21.15.154:0/3283721688 wait complete. 2024-05-14T01:24:30.441 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T01:24:30.442 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T01:24:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.576+0000 7fd75e60c640 1 Processor -- start 2024-05-14T01:24:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.576+0000 7fd75e60c640 1 -- start start 2024-05-14T01:24:30.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.576+0000 7fd75e60c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd7580d0790 0x7fd7580d1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.576+0000 7fd75e60c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd7580d2240 0x7fd7580b0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.576+0000 7fd75e60c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7580cc770 con 0x7fd75815bfe0 2024-05-14T01:24:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.576+0000 7fd75e60c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd7580d2670 con 0x7fd7580d2240 2024-05-14T01:24:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.576+0000 7fd75e60c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd7580af1e0 con 0x7fd7580d0790 2024-05-14T01:24:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.576+0000 7fd75cba9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd7580d2240 0x7fd7580b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.576+0000 7fd757fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd75815bfe0 0x7fd7580aea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39902/0 (socket says 172.21.15.154:39902) 2024-05-14T01:24:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.576+0000 7fd757fff640 1 -- 172.21.15.154:0/2551708228 learned_addr learned my addr 172.21.15.154:0/2551708228 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.576+0000 7fd75cba9640 1 -- 172.21.15.154:0/2551708228 >> v2:172.21.15.176:3300/0 conn(0x7fd7580d0790 msgr2=0x7fd7580d1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.576+0000 7fd75cba9640 1 --2- 172.21.15.154:0/2551708228 >> v2:172.21.15.176:3300/0 conn(0x7fd7580d0790 0x7fd7580d1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.576+0000 7fd75cba9640 1 -- 172.21.15.154:0/2551708228 >> v1:172.21.15.154:6789/0 conn(0x7fd75815bfe0 legacy=0x7fd7580aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.576+0000 7fd75cba9640 1 -- 172.21.15.154:0/2551708228 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7580af4c0 con 0x7fd7580d2240 2024-05-14T01:24:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.576+0000 7fd756ffd640 1 -- 172.21.15.154:0/2551708228 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2881790656 0 0) 0x7fd748001120 con 0x7fd75815bfe0 2024-05-14T01:24:30.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75cba9640 1 --2- 172.21.15.154:0/2551708228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7580d2240 0x7fd7580b0280 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd7580cc370 tx=0x7fd75001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d9f78cd8b027e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:30.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd756ffd640 1 -- 172.21.15.154:0/2551708228 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7500b2070 con 0x7fd7580d2240 2024-05-14T01:24:30.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd756ffd640 1 -- 172.21.15.154:0/2551708228 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7500a5760 con 0x7fd7580d2240 2024-05-14T01:24:30.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd756ffd640 1 -- 172.21.15.154:0/2551708228 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7500a5b30 con 0x7fd7580d2240 2024-05-14T01:24:30.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75e60c640 1 -- 172.21.15.154:0/2551708228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7580d2240 msgr2=0x7fd7580b0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:30.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75e60c640 1 --2- 172.21.15.154:0/2551708228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7580d2240 0x7fd7580b0280 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd7580cc370 tx=0x7fd75001c8a0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75e60c640 1 -- 172.21.15.154:0/2551708228 shutdown_connections 2024-05-14T01:24:30.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75e60c640 1 --2- 172.21.15.154:0/2551708228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7580d2240 0x7fd7580b0280 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75e60c640 1 --2- 172.21.15.154:0/2551708228 >> v2:172.21.15.176:3300/0 conn(0x7fd7580d0790 0x7fd7580d1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75e60c640 1 -- 172.21.15.154:0/2551708228 >> 172.21.15.154:0/2551708228 conn(0x7fd75809aa10 msgr2=0x7fd75809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:30.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75e60c640 1 -- 172.21.15.154:0/2551708228 shutdown_connections 2024-05-14T01:24:30.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75e60c640 1 -- 172.21.15.154:0/2551708228 wait complete. 2024-05-14T01:24:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75e60c640 1 Processor -- start 2024-05-14T01:24:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75e60c640 1 -- start start 2024-05-14T01:24:30.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75e60c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7580d0790 0x7fd758154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75e60c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7580d2240 0x7fd758163f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75e60c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd75815bfe0 0x7fd7580b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75e60c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7580b1150 con 0x7fd75815bfe0 2024-05-14T01:24:30.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75e60c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd7580b0fd0 con 0x7fd7580d2240 2024-05-14T01:24:30.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75e60c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd7580b12d0 con 0x7fd7580d0790 2024-05-14T01:24:30.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75cba9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd75815bfe0 0x7fd7580b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:30.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75cba9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd75815bfe0 0x7fd7580b1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50782/0 (socket says 172.21.15.154:50782) 2024-05-14T01:24:30.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.580+0000 7fd75cba9640 1 -- 172.21.15.154:0/2645754345 learned_addr learned my addr 172.21.15.154:0/2645754345 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:30.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd757fff640 1 --2- 172.21.15.154:0/2645754345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7580d0790 0x7fd758154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:30.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd75cba9640 1 -- 172.21.15.154:0/2645754345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7580d0790 msgr2=0x7fd758154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:30.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd75cba9640 1 --2- 172.21.15.154:0/2645754345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7580d0790 0x7fd758154040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd7577fe640 1 --2- 172.21.15.154:0/2645754345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7580d2240 0x7fd758163f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:30.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd75cba9640 1 -- 172.21.15.154:0/2645754345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7580d2240 msgr2=0x7fd758163f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:30.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd75cba9640 1 --2- 172.21.15.154:0/2645754345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7580d2240 0x7fd758163f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd75cba9640 1 -- 172.21.15.154:0/2645754345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd758159330 con 0x7fd75815bfe0 2024-05-14T01:24:30.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd7577fe640 1 --2- 172.21.15.154:0/2645754345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7580d2240 0x7fd758163f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:30.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd75cba9640 1 --2- 172.21.15.154:0/2645754345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd75815bfe0 0x7fd7580b1d10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd7500194b0 tx=0x7fd750019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:30.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd754ff9640 1 -- 172.21.15.154:0/2645754345 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7500b2040 con 0x7fd75815bfe0 2024-05-14T01:24:30.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd754ff9640 1 -- 172.21.15.154:0/2645754345 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7500bf070 con 0x7fd75815bfe0 2024-05-14T01:24:30.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd75e60c640 1 -- 172.21.15.154:0/2645754345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd758159610 con 0x7fd75815bfe0 2024-05-14T01:24:30.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd754ff9640 1 -- 172.21.15.154:0/2645754345 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7500b88b0 con 0x7fd75815bfe0 2024-05-14T01:24:30.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd75e60c640 1 -- 172.21.15.154:0/2645754345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd758159bd0 con 0x7fd75815bfe0 2024-05-14T01:24:30.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd75e60c640 1 -- 172.21.15.154:0/2645754345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd758068360 con 0x7fd75815bfe0 2024-05-14T01:24:30.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd754ff9640 1 -- 172.21.15.154:0/2645754345 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd7500a55e0 con 0x7fd75815bfe0 2024-05-14T01:24:30.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd754ff9640 1 --2- 172.21.15.154:0/2645754345 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd7440678c0 0x7fd744069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd754ff9640 1 -- 172.21.15.154:0/2645754345 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fd750121430 con 0x7fd75815bfe0 2024-05-14T01:24:30.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd757fff640 1 --2- 172.21.15.154:0/2645754345 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd7440678c0 0x7fd744069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:30.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.584+0000 7fd757fff640 1 --2- 172.21.15.154:0/2645754345 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd7440678c0 0x7fd744069d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd748000f70 tx=0x7fd748009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:30.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.588+0000 7fd754ff9640 1 -- 172.21.15.154:0/2645754345 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fd750016520 con 0x7fd75815bfe0 2024-05-14T01:24:30.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.748+0000 7fd75e60c640 1 -- 172.21.15.154:0/2645754345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd7580b4610 con 0x7fd75815bfe0 2024-05-14T01:24:30.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.748+0000 7fd754ff9640 1 -- 172.21.15.154:0/2645754345 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) ==== 93+0+10 (secure 0 0 0) 0x7fd7500f2310 con 0x7fd75815bfe0 2024-05-14T01:24:30.737 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T01:24:30.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.752+0000 7fd75e60c640 1 -- 172.21.15.154:0/2645754345 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd7440678c0 msgr2=0x7fd744069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:30.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.752+0000 7fd75e60c640 1 --2- 172.21.15.154:0/2645754345 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd7440678c0 0x7fd744069d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd748000f70 tx=0x7fd748009040 comp rx=0 tx=0).stop 2024-05-14T01:24:30.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.752+0000 7fd75e60c640 1 -- 172.21.15.154:0/2645754345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd75815bfe0 msgr2=0x7fd7580b1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:30.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.752+0000 7fd75e60c640 1 --2- 172.21.15.154:0/2645754345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd75815bfe0 0x7fd7580b1d10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd7500194b0 tx=0x7fd750019640 comp rx=0 tx=0).stop 2024-05-14T01:24:30.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.752+0000 7fd75e60c640 1 -- 172.21.15.154:0/2645754345 shutdown_connections 2024-05-14T01:24:30.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.752+0000 7fd75e60c640 1 --2- 172.21.15.154:0/2645754345 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd7440678c0 0x7fd744069d80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.752+0000 7fd75e60c640 1 --2- 172.21.15.154:0/2645754345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd75815bfe0 0x7fd7580b1d10 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.752+0000 7fd75e60c640 1 --2- 172.21.15.154:0/2645754345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7580d2240 0x7fd758163f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.752+0000 7fd75e60c640 1 --2- 172.21.15.154:0/2645754345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7580d0790 0x7fd758154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.752+0000 7fd75e60c640 1 -- 172.21.15.154:0/2645754345 >> 172.21.15.154:0/2645754345 conn(0x7fd75809aa10 msgr2=0x7fd758154a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:30.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.752+0000 7fd75e60c640 1 -- 172.21.15.154:0/2645754345 shutdown_connections 2024-05-14T01:24:30.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.752+0000 7fd75e60c640 1 -- 172.21.15.154:0/2645754345 wait complete. 2024-05-14T01:24:30.756 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-14T01:24:30.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.884+0000 7fcf36312640 1 Processor -- start 2024-05-14T01:24:30.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.884+0000 7fcf36312640 1 -- start start 2024-05-14T01:24:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.888+0000 7fcf36312640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcf3015e100 0x7fcf300d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.888+0000 7fcf36312640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcf3015e4e0 0x7fcf300b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.888+0000 7fcf36312640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf300d29f0 con 0x7fcf300d3a90 2024-05-14T01:24:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.888+0000 7fcf36312640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fcf300d2cd0 con 0x7fcf3015e100 2024-05-14T01:24:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.888+0000 7fcf36312640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fcf300d2fb0 con 0x7fcf3015e4e0 2024-05-14T01:24:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.888+0000 7fcf2ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcf3015e100 0x7fcf300d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.888+0000 7fcf2ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcf3015e100 0x7fcf300d22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50794/0 (socket says 172.21.15.154:50794) 2024-05-14T01:24:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.888+0000 7fcf2ffff640 1 -- 172.21.15.154:0/1537870418 learned_addr learned my addr 172.21.15.154:0/1537870418 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.888+0000 7fcf348af640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcf300d3a90 0x7fcf300cee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39918/0 (socket says 172.21.15.154:39918) 2024-05-14T01:24:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.888+0000 7fcf27fff640 1 --2- 172.21.15.154:0/1537870418 >> v2:172.21.15.176:3300/0 conn(0x7fcf3015e4e0 0x7fcf300b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.888+0000 7fcf2ffff640 1 -- 172.21.15.154:0/1537870418 >> v2:172.21.15.176:3300/0 conn(0x7fcf3015e4e0 msgr2=0x7fcf300b9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.888+0000 7fcf2ffff640 1 --2- 172.21.15.154:0/1537870418 >> v2:172.21.15.176:3300/0 conn(0x7fcf3015e4e0 0x7fcf300b9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.888+0000 7fcf2ffff640 1 -- 172.21.15.154:0/1537870418 >> v1:172.21.15.154:6789/0 conn(0x7fcf300d3a90 legacy=0x7fcf300cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:30.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.888+0000 7fcf2ffff640 1 -- 172.21.15.154:0/1537870418 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf300d3290 con 0x7fcf3015e100 2024-05-14T01:24:30.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.888+0000 7fcf27fff640 1 --2- 172.21.15.154:0/1537870418 >> v2:172.21.15.176:3300/0 conn(0x7fcf3015e4e0 0x7fcf300b9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:30.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.888+0000 7fcf2ffff640 1 --2- 172.21.15.154:0/1537870418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf3015e100 0x7fcf300d22f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcf3008cd10 tx=0x7fcf2001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a13fca4c4119eb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:30.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf2f7fe640 1 -- 172.21.15.154:0/1537870418 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf200b5070 con 0x7fcf3015e100 2024-05-14T01:24:30.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf2f7fe640 1 -- 172.21.15.154:0/1537870418 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf200a8a10 con 0x7fcf3015e100 2024-05-14T01:24:30.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf2f7fe640 1 -- 172.21.15.154:0/1537870418 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf200a8de0 con 0x7fcf3015e100 2024-05-14T01:24:30.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf36312640 1 -- 172.21.15.154:0/1537870418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf3015e100 msgr2=0x7fcf300d22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:30.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf36312640 1 --2- 172.21.15.154:0/1537870418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf3015e100 0x7fcf300d22f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcf3008cd10 tx=0x7fcf2001ed10 comp rx=0 tx=0).stop 2024-05-14T01:24:30.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf36312640 1 -- 172.21.15.154:0/1537870418 shutdown_connections 2024-05-14T01:24:30.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf36312640 1 --2- 172.21.15.154:0/1537870418 >> v2:172.21.15.176:3300/0 conn(0x7fcf3015e4e0 0x7fcf300b9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf36312640 1 --2- 172.21.15.154:0/1537870418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf3015e100 0x7fcf300d22f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf36312640 1 -- 172.21.15.154:0/1537870418 >> 172.21.15.154:0/1537870418 conn(0x7fcf300b5b50 msgr2=0x7fcf300b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:30.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf36312640 1 -- 172.21.15.154:0/1537870418 shutdown_connections 2024-05-14T01:24:30.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf36312640 1 -- 172.21.15.154:0/1537870418 wait complete. 2024-05-14T01:24:30.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf36312640 1 Processor -- start 2024-05-14T01:24:30.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf36312640 1 -- start start 2024-05-14T01:24:30.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf36312640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf300d3a90 0x7fcf301f8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf36312640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf3015e100 0x7fcf3014b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf36312640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf3015e4e0 0x7fcf300cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf36312640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcf300cf6a0 con 0x7fcf3015e4e0 2024-05-14T01:24:30.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf36312640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcf300cf520 con 0x7fcf300d3a90 2024-05-14T01:24:30.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf36312640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcf300b7170 con 0x7fcf3015e100 2024-05-14T01:24:30.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf348af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf3015e4e0 0x7fcf300cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:30.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf348af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf3015e4e0 0x7fcf300cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50804/0 (socket says 172.21.15.154:50804) 2024-05-14T01:24:30.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf348af640 1 -- 172.21.15.154:0/1185323343 learned_addr learned my addr 172.21.15.154:0/1185323343 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:30.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf2ffff640 1 --2- 172.21.15.154:0/1185323343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf300d3a90 0x7fcf301f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:30.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf27fff640 1 --2- 172.21.15.154:0/1185323343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf3015e100 0x7fcf3014b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:30.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf348af640 1 -- 172.21.15.154:0/1185323343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf3015e100 msgr2=0x7fcf3014b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:30.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf348af640 1 --2- 172.21.15.154:0/1185323343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf3015e100 0x7fcf3014b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf348af640 1 -- 172.21.15.154:0/1185323343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf300d3a90 msgr2=0x7fcf301f8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:30.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf348af640 1 --2- 172.21.15.154:0/1185323343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf300d3a90 0x7fcf301f8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:30.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf348af640 1 -- 172.21.15.154:0/1185323343 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf300cc500 con 0x7fcf3015e4e0 2024-05-14T01:24:30.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf348af640 1 --2- 172.21.15.154:0/1185323343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf3015e4e0 0x7fcf300cbcb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800c710 tx=0x7fcf2800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:30.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.892+0000 7fcf2d7fa640 1 -- 172.21.15.154:0/1185323343 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf28017070 con 0x7fcf3015e4e0 2024-05-14T01:24:30.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.896+0000 7fcf2d7fa640 1 -- 172.21.15.154:0/1185323343 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2800ce20 con 0x7fcf3015e4e0 2024-05-14T01:24:30.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.896+0000 7fcf36312640 1 -- 172.21.15.154:0/1185323343 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf30156100 con 0x7fcf3015e4e0 2024-05-14T01:24:30.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.896+0000 7fcf2d7fa640 1 -- 172.21.15.154:0/1185323343 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2800a860 con 0x7fcf3015e4e0 2024-05-14T01:24:30.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.896+0000 7fcf36312640 1 -- 172.21.15.154:0/1185323343 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf301566c0 con 0x7fcf3015e4e0 2024-05-14T01:24:30.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.896+0000 7fcf36312640 1 -- 172.21.15.154:0/1185323343 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf30075470 con 0x7fcf3015e4e0 2024-05-14T01:24:30.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.896+0000 7fcf2d7fa640 1 -- 172.21.15.154:0/1185323343 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcf2801a070 con 0x7fcf3015e4e0 2024-05-14T01:24:30.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.896+0000 7fcf2d7fa640 1 --2- 172.21.15.154:0/1185323343 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fcf100678c0 0x7fcf10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:30.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.896+0000 7fcf2d7fa640 1 -- 172.21.15.154:0/1185323343 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fcf28084ec0 con 0x7fcf3015e4e0 2024-05-14T01:24:30.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.896+0000 7fcf2ffff640 1 --2- 172.21.15.154:0/1185323343 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fcf100678c0 0x7fcf10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:30.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.896+0000 7fcf2ffff640 1 --2- 172.21.15.154:0/1185323343 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fcf100678c0 0x7fcf10069d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcf200b2000 tx=0x7fcf20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:30.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:30.900+0000 7fcf2d7fa640 1 -- 172.21.15.154:0/1185323343 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fcf28055de0 con 0x7fcf3015e4e0 2024-05-14T01:24:31.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.056+0000 7fcf36312640 1 -- 172.21.15.154:0/1185323343 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fcf30156890 con 0x7fcf3015e4e0 2024-05-14T01:24:31.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.056+0000 7fcf2d7fa640 1 -- 172.21.15.154:0/1185323343 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) ==== 84+0+65 (secure 0 0 0) 0x7fcf280556e0 con 0x7fcf3015e4e0 2024-05-14T01:24:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:31.043 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2024-05-14T01:24:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-05-14T01:24:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2024-05-14T01:24:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2024-05-14T01:24:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:31.043 INFO:teuthology.orchestra.run.smithi154.stdout:] 2024-05-14T01:24:31.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.056+0000 7fcf36312640 1 -- 172.21.15.154:0/1185323343 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fcf100678c0 msgr2=0x7fcf10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:31.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.056+0000 7fcf36312640 1 --2- 172.21.15.154:0/1185323343 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fcf100678c0 0x7fcf10069d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcf200b2000 tx=0x7fcf20008040 comp rx=0 tx=0).stop 2024-05-14T01:24:31.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.056+0000 7fcf36312640 1 -- 172.21.15.154:0/1185323343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf3015e4e0 msgr2=0x7fcf300cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:31.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.056+0000 7fcf36312640 1 --2- 172.21.15.154:0/1185323343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf3015e4e0 0x7fcf300cbcb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800c710 tx=0x7fcf2800cbd0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.056+0000 7fcf36312640 1 -- 172.21.15.154:0/1185323343 shutdown_connections 2024-05-14T01:24:31.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.056+0000 7fcf36312640 1 --2- 172.21.15.154:0/1185323343 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fcf100678c0 0x7fcf10069d80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.056+0000 7fcf36312640 1 --2- 172.21.15.154:0/1185323343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf3015e4e0 0x7fcf300cbcb0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.056+0000 7fcf36312640 1 --2- 172.21.15.154:0/1185323343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf3015e100 0x7fcf3014b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.056+0000 7fcf36312640 1 --2- 172.21.15.154:0/1185323343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf300d3a90 0x7fcf301f8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.056+0000 7fcf36312640 1 -- 172.21.15.154:0/1185323343 >> 172.21.15.154:0/1185323343 conn(0x7fcf300b5b50 msgr2=0x7fcf3015ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:31.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.056+0000 7fcf36312640 1 -- 172.21.15.154:0/1185323343 shutdown_connections 2024-05-14T01:24:31.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.056+0000 7fcf36312640 1 -- 172.21.15.154:0/1185323343 wait complete. 2024-05-14T01:24:31.061 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-14T01:24:31.061 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-14T01:24:31.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.188+0000 7f8c63e3a640 1 Processor -- start 2024-05-14T01:24:31.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.188+0000 7f8c63e3a640 1 -- start start 2024-05-14T01:24:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.188+0000 7f8c63e3a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8c5c145930 0x7f8c5c15d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.188+0000 7f8c63e3a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c5c06c290 0x7f8c5c06c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.188+0000 7f8c63e3a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c5c06dd60 0x7f8c5c06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.188+0000 7f8c63e3a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8c5c06e730 con 0x7f8c5c06c290 2024-05-14T01:24:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.188+0000 7f8c63e3a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8c5c15fab0 con 0x7f8c5c145930 2024-05-14T01:24:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.188+0000 7f8c63e3a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8c5c15fd90 con 0x7f8c5c06dd60 2024-05-14T01:24:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.188+0000 7f8c613d5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c5c06c290 0x7f8c5c06c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.188+0000 7f8c613d5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c5c06c290 0x7f8c5c06c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50812/0 (socket says 172.21.15.154:50812) 2024-05-14T01:24:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.188+0000 7f8c613d5640 1 -- 172.21.15.154:0/2799968042 learned_addr learned my addr 172.21.15.154:0/2799968042 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.188+0000 7f8c61bd6640 1 --2- 172.21.15.154:0/2799968042 >> v2:172.21.15.176:3300/0 conn(0x7f8c5c145930 0x7f8c5c15d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.188+0000 7f8c623d7640 1 --2- 172.21.15.154:0/2799968042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c5c06dd60 0x7f8c5c06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.188+0000 7f8c613d5640 1 -- 172.21.15.154:0/2799968042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c5c06dd60 msgr2=0x7f8c5c06e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.188+0000 7f8c613d5640 1 --2- 172.21.15.154:0/2799968042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c5c06dd60 0x7f8c5c06e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.188+0000 7f8c613d5640 1 -- 172.21.15.154:0/2799968042 >> v2:172.21.15.176:3300/0 conn(0x7f8c5c145930 msgr2=0x7f8c5c15d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.188+0000 7f8c613d5640 1 --2- 172.21.15.154:0/2799968042 >> v2:172.21.15.176:3300/0 conn(0x7f8c5c145930 0x7f8c5c15d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.188+0000 7f8c613d5640 1 -- 172.21.15.154:0/2799968042 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c5c160070 con 0x7f8c5c06c290 2024-05-14T01:24:31.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c613d5640 1 --2- 172.21.15.154:0/2799968042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c5c06c290 0x7f8c5c06c710 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c072d20 tx=0x7f8c4c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd3ed5225b7476e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:31.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c60bd4640 1 -- 172.21.15.154:0/2799968042 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c0b1070 con 0x7f8c5c06c290 2024-05-14T01:24:31.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c60bd4640 1 -- 172.21.15.154:0/2799968042 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c4c0ac630 con 0x7f8c5c06c290 2024-05-14T01:24:31.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c60bd4640 1 -- 172.21.15.154:0/2799968042 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c0a8050 con 0x7f8c5c06c290 2024-05-14T01:24:31.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c63e3a640 1 -- 172.21.15.154:0/2799968042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c5c06c290 msgr2=0x7f8c5c06c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:31.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c63e3a640 1 --2- 172.21.15.154:0/2799968042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c5c06c290 0x7f8c5c06c710 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c072d20 tx=0x7f8c4c01c520 comp rx=0 tx=0).stop 2024-05-14T01:24:31.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c63e3a640 1 -- 172.21.15.154:0/2799968042 shutdown_connections 2024-05-14T01:24:31.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c63e3a640 1 --2- 172.21.15.154:0/2799968042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c5c06dd60 0x7f8c5c06e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c63e3a640 1 --2- 172.21.15.154:0/2799968042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c5c06c290 0x7f8c5c06c710 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c63e3a640 1 --2- 172.21.15.154:0/2799968042 >> v2:172.21.15.176:3300/0 conn(0x7f8c5c145930 0x7f8c5c15d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c63e3a640 1 -- 172.21.15.154:0/2799968042 >> 172.21.15.154:0/2799968042 conn(0x7f8c5c071f50 msgr2=0x7f8c5c072360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:31.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c63e3a640 1 -- 172.21.15.154:0/2799968042 shutdown_connections 2024-05-14T01:24:31.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c63e3a640 1 -- 172.21.15.154:0/2799968042 wait complete. 2024-05-14T01:24:31.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c63e3a640 1 Processor -- start 2024-05-14T01:24:31.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c63e3a640 1 -- start start 2024-05-14T01:24:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c63e3a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c5c06c290 0x7f8c5c15b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c63e3a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c5c06dd60 0x7f8c5c13c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c63e3a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c5c145930 0x7f8c5c0af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c63e3a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c15d1a0 con 0x7f8c5c06c290 2024-05-14T01:24:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c63e3a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c15d020 con 0x7f8c5c06dd60 2024-05-14T01:24:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c63e3a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8c5c15d320 con 0x7f8c5c145930 2024-05-14T01:24:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c61bd6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c5c06c290 0x7f8c5c15b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c61bd6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c5c06c290 0x7f8c5c15b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50828/0 (socket says 172.21.15.154:50828) 2024-05-14T01:24:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c61bd6640 1 -- 172.21.15.154:0/4246808680 learned_addr learned my addr 172.21.15.154:0/4246808680 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c613d5640 1 --2- 172.21.15.154:0/4246808680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c5c06dd60 0x7f8c5c13c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c623d7640 1 --2- 172.21.15.154:0/4246808680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c5c145930 0x7f8c5c0af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c61bd6640 1 -- 172.21.15.154:0/4246808680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c5c145930 msgr2=0x7f8c5c0af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c61bd6640 1 --2- 172.21.15.154:0/4246808680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c5c145930 0x7f8c5c0af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c61bd6640 1 -- 172.21.15.154:0/4246808680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c5c06dd60 msgr2=0x7f8c5c13c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c61bd6640 1 --2- 172.21.15.154:0/4246808680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c5c06dd60 0x7f8c5c13c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c61bd6640 1 -- 172.21.15.154:0/4246808680 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c5c0b01f0 con 0x7f8c5c06c290 2024-05-14T01:24:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.192+0000 7f8c613d5640 1 --2- 172.21.15.154:0/4246808680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c5c06dd60 0x7f8c5c13c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.196+0000 7f8c61bd6640 1 --2- 172.21.15.154:0/4246808680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c5c06c290 0x7f8c5c15b3e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800d5f0 tx=0x7f8c5800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.196+0000 7f8c527fc640 1 -- 172.21.15.154:0/4246808680 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c580125f0 con 0x7f8c5c06c290 2024-05-14T01:24:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.196+0000 7f8c527fc640 1 -- 172.21.15.154:0/4246808680 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c58019070 con 0x7f8c5c06c290 2024-05-14T01:24:31.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.196+0000 7f8c63e3a640 1 -- 172.21.15.154:0/4246808680 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c5c0b04d0 con 0x7f8c5c06c290 2024-05-14T01:24:31.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.196+0000 7f8c527fc640 1 -- 172.21.15.154:0/4246808680 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c580129b0 con 0x7f8c5c06c290 2024-05-14T01:24:31.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.196+0000 7f8c63e3a640 1 -- 172.21.15.154:0/4246808680 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c5c1401f0 con 0x7f8c5c06c290 2024-05-14T01:24:31.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.196+0000 7f8c63e3a640 1 -- 172.21.15.154:0/4246808680 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c5c075470 con 0x7f8c5c06c290 2024-05-14T01:24:31.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.196+0000 7f8c527fc640 1 -- 172.21.15.154:0/4246808680 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8c58012b50 con 0x7f8c5c06c290 2024-05-14T01:24:31.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.196+0000 7f8c527fc640 1 --2- 172.21.15.154:0/4246808680 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8c400678c0 0x7f8c40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:31.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.196+0000 7f8c527fc640 1 -- 172.21.15.154:0/4246808680 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f8c58085cd0 con 0x7f8c5c06c290 2024-05-14T01:24:31.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.196+0000 7f8c613d5640 1 --2- 172.21.15.154:0/4246808680 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8c400678c0 0x7f8c40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:31.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.196+0000 7f8c613d5640 1 --2- 172.21.15.154:0/4246808680 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8c400678c0 0x7f8c40069d80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c0ae000 tx=0x7f8c4c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:31.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.200+0000 7f8c527fc640 1 -- 172.21.15.154:0/4246808680 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f8c58056bf0 con 0x7f8c5c06c290 2024-05-14T01:24:31.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.352+0000 7f8c63e3a640 1 -- 172.21.15.154:0/4246808680 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8c5c15f760 con 0x7f8c5c06c290 2024-05-14T01:24:31.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.568+0000 7f8c527fc640 1 -- 172.21.15.154:0/4246808680 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) ==== 138+0+0 (secure 0 0 0) 0x7f8c580564f0 con 0x7f8c5c06c290 2024-05-14T01:24:31.558 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2024-05-14T01:24:31.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.572+0000 7f8c63e3a640 1 -- 172.21.15.154:0/4246808680 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8c400678c0 msgr2=0x7f8c40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:31.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.572+0000 7f8c63e3a640 1 --2- 172.21.15.154:0/4246808680 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8c400678c0 0x7f8c40069d80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c0ae000 tx=0x7f8c4c0a7000 comp rx=0 tx=0).stop 2024-05-14T01:24:31.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.572+0000 7f8c63e3a640 1 -- 172.21.15.154:0/4246808680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c5c06c290 msgr2=0x7f8c5c15b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:31.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.572+0000 7f8c63e3a640 1 --2- 172.21.15.154:0/4246808680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c5c06c290 0x7f8c5c15b3e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800d5f0 tx=0x7f8c5800dab0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.572+0000 7f8c63e3a640 1 -- 172.21.15.154:0/4246808680 shutdown_connections 2024-05-14T01:24:31.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.572+0000 7f8c63e3a640 1 --2- 172.21.15.154:0/4246808680 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8c400678c0 0x7f8c40069d80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.572+0000 7f8c63e3a640 1 --2- 172.21.15.154:0/4246808680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c5c145930 0x7f8c5c0af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.572+0000 7f8c63e3a640 1 --2- 172.21.15.154:0/4246808680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c5c06dd60 0x7f8c5c13c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.572+0000 7f8c63e3a640 1 --2- 172.21.15.154:0/4246808680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c5c06c290 0x7f8c5c15b3e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.572+0000 7f8c63e3a640 1 -- 172.21.15.154:0/4246808680 >> 172.21.15.154:0/4246808680 conn(0x7f8c5c071f50 msgr2=0x7f8c5c072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:31.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.572+0000 7f8c63e3a640 1 -- 172.21.15.154:0/4246808680 shutdown_connections 2024-05-14T01:24:31.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.572+0000 7f8c63e3a640 1 -- 172.21.15.154:0/4246808680 wait complete. 2024-05-14T01:24:31.584 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-14T01:24:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.724+0000 7eff16328640 1 Processor -- start 2024-05-14T01:24:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.724+0000 7eff16328640 1 -- start start 2024-05-14T01:24:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.724+0000 7eff16328640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1015a660 0x7eff1006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.724+0000 7eff16328640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7eff100cab50 0x7eff10071a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.724+0000 7eff16328640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff100cb190 con 0x7eff1006ce60 2024-05-14T01:24:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.724+0000 7eff16328640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7eff10071600 con 0x7eff100cab50 2024-05-14T01:24:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.724+0000 7eff16328640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7eff10071010 con 0x7eff1015a660 2024-05-14T01:24:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.724+0000 7eff0ffff640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1015a660 0x7eff1006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.724+0000 7eff0f7fe640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7eff1006ce60 0x7eff100ca440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:35698/0 (socket says 172.21.15.154:35698) 2024-05-14T01:24:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.724+0000 7eff0f7fe640 1 -- 172.21.15.154:0/2657129061 learned_addr learned my addr 172.21.15.154:0/2657129061 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.724+0000 7eff148c5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7eff100cab50 0x7eff10071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.724+0000 7eff0ffff640 1 -- 172.21.15.154:0/2657129061 >> v2:172.21.15.176:3300/0 conn(0x7eff100cab50 msgr2=0x7eff10071a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.724+0000 7eff0ffff640 1 --2- 172.21.15.154:0/2657129061 >> v2:172.21.15.176:3300/0 conn(0x7eff100cab50 0x7eff10071a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.724+0000 7eff0ffff640 1 -- 172.21.15.154:0/2657129061 >> v1:172.21.15.176:6789/0 conn(0x7eff1006ce60 legacy=0x7eff100ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.724+0000 7eff0ffff640 1 -- 172.21.15.154:0/2657129061 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1006e480 con 0x7eff1015a660 2024-05-14T01:24:31.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.728+0000 7eff0ffff640 1 --2- 172.21.15.154:0/2657129061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1015a660 0x7eff1006dd50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7eff000097c0 tx=0x7eff0001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2b9edb2ce641343 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:31.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.728+0000 7eff0effd640 1 -- 172.21.15.154:0/2657129061 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff000b5070 con 0x7eff1015a660 2024-05-14T01:24:31.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.728+0000 7eff0effd640 1 -- 172.21.15.154:0/2657129061 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff000a8990 con 0x7eff1015a660 2024-05-14T01:24:31.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.728+0000 7eff0effd640 1 -- 172.21.15.154:0/2657129061 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff000a8d60 con 0x7eff1015a660 2024-05-14T01:24:31.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.728+0000 7eff16328640 1 -- 172.21.15.154:0/2657129061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1015a660 msgr2=0x7eff1006dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:31.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.728+0000 7eff16328640 1 --2- 172.21.15.154:0/2657129061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1015a660 0x7eff1006dd50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7eff000097c0 tx=0x7eff0001ec90 comp rx=0 tx=0).stop 2024-05-14T01:24:31.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.728+0000 7eff16328640 1 -- 172.21.15.154:0/2657129061 shutdown_connections 2024-05-14T01:24:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.728+0000 7eff16328640 1 --2- 172.21.15.154:0/2657129061 >> v2:172.21.15.176:3300/0 conn(0x7eff100cab50 0x7eff10071a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.728+0000 7eff16328640 1 --2- 172.21.15.154:0/2657129061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1015a660 0x7eff1006dd50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.728+0000 7eff16328640 1 -- 172.21.15.154:0/2657129061 >> 172.21.15.154:0/2657129061 conn(0x7eff100b1770 msgr2=0x7eff100b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.728+0000 7eff16328640 1 -- 172.21.15.154:0/2657129061 shutdown_connections 2024-05-14T01:24:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.728+0000 7eff16328640 1 -- 172.21.15.154:0/2657129061 wait complete. 2024-05-14T01:24:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.728+0000 7eff16328640 1 Processor -- start 2024-05-14T01:24:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.728+0000 7eff16328640 1 -- start start 2024-05-14T01:24:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff16328640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff1006ce60 0x7eff100c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff16328640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff100cab50 0x7eff100b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff16328640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff1015a660 0x7eff1014c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff16328640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7eff1015aa40 con 0x7eff1006ce60 2024-05-14T01:24:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff16328640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7eff10071290 con 0x7eff1015a660 2024-05-14T01:24:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff16328640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7eff100cc660 con 0x7eff100cab50 2024-05-14T01:24:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff0ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff1006ce60 0x7eff100c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:31.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff0ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff1006ce60 0x7eff100c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50840/0 (socket says 172.21.15.154:50840) 2024-05-14T01:24:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff0ffff640 1 -- 172.21.15.154:0/4212190055 learned_addr learned my addr 172.21.15.154:0/4212190055 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff148c5640 1 --2- 172.21.15.154:0/4212190055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff1015a660 0x7eff1014c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff0f7fe640 1 --2- 172.21.15.154:0/4212190055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff100cab50 0x7eff100b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff0ffff640 1 -- 172.21.15.154:0/4212190055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff100cab50 msgr2=0x7eff100b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff0ffff640 1 --2- 172.21.15.154:0/4212190055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff100cab50 0x7eff100b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff0ffff640 1 -- 172.21.15.154:0/4212190055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff1015a660 msgr2=0x7eff1014c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff0ffff640 1 --2- 172.21.15.154:0/4212190055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff1015a660 0x7eff1014c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff0ffff640 1 -- 172.21.15.154:0/4212190055 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff100c4770 con 0x7eff1006ce60 2024-05-14T01:24:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff0ffff640 1 --2- 172.21.15.154:0/4212190055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff1006ce60 0x7eff100c9a00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7eff000b3040 tx=0x7eff0001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff0cff9640 1 -- 172.21.15.154:0/4212190055 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff000b5040 con 0x7eff1006ce60 2024-05-14T01:24:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff0cff9640 1 -- 172.21.15.154:0/4212190055 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff000c0070 con 0x7eff1006ce60 2024-05-14T01:24:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff16328640 1 -- 172.21.15.154:0/4212190055 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff100c4a50 con 0x7eff1006ce60 2024-05-14T01:24:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff0cff9640 1 -- 172.21.15.154:0/4212190055 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff000b0960 con 0x7eff1006ce60 2024-05-14T01:24:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff16328640 1 -- 172.21.15.154:0/4212190055 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff100c5010 con 0x7eff1006ce60 2024-05-14T01:24:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff16328640 1 -- 172.21.15.154:0/4212190055 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff10075470 con 0x7eff1006ce60 2024-05-14T01:24:31.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff0cff9640 1 -- 172.21.15.154:0/4212190055 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff000b0b00 con 0x7eff1006ce60 2024-05-14T01:24:31.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff0cff9640 1 --2- 172.21.15.154:0/4212190055 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7efefc0678c0 0x7efefc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:31.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff0cff9640 1 -- 172.21.15.154:0/4212190055 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5227+0+0 (secure 0 0 0) 0x7eff00122d30 con 0x7eff1006ce60 2024-05-14T01:24:31.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.732+0000 7eff0f7fe640 1 --2- 172.21.15.154:0/4212190055 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7efefc0678c0 0x7efefc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:31.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.736+0000 7eff0f7fe640 1 --2- 172.21.15.154:0/4212190055 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7efefc0678c0 0x7efefc069d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7eff100c6110 tx=0x7eff04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:31.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.740+0000 7eff0cff9640 1 -- 172.21.15.154:0/4212190055 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7eff000187f0 con 0x7eff1006ce60 2024-05-14T01:24:31.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:31.888+0000 7eff16328640 1 -- 172.21.15.154:0/4212190055 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7eff100727e0 con 0x7eff1006ce60 2024-05-14T01:24:32.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.576+0000 7eff0cff9640 1 -- 172.21.15.154:0/4212190055 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) ==== 170+0+0 (secure 0 0 0) 0x7eff000f3ae0 con 0x7eff1006ce60 2024-05-14T01:24:32.563 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2024-05-14T01:24:32.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.580+0000 7eff16328640 1 -- 172.21.15.154:0/4212190055 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7efefc0678c0 msgr2=0x7efefc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:32.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.580+0000 7eff16328640 1 --2- 172.21.15.154:0/4212190055 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7efefc0678c0 0x7efefc069d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7eff100c6110 tx=0x7eff04009040 comp rx=0 tx=0).stop 2024-05-14T01:24:32.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.580+0000 7eff16328640 1 -- 172.21.15.154:0/4212190055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff1006ce60 msgr2=0x7eff100c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:32.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.580+0000 7eff16328640 1 --2- 172.21.15.154:0/4212190055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff1006ce60 0x7eff100c9a00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7eff000b3040 tx=0x7eff0001ba30 comp rx=0 tx=0).stop 2024-05-14T01:24:32.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.580+0000 7eff16328640 1 -- 172.21.15.154:0/4212190055 shutdown_connections 2024-05-14T01:24:32.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.580+0000 7eff16328640 1 --2- 172.21.15.154:0/4212190055 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7efefc0678c0 0x7efefc069d80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:32.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.580+0000 7eff16328640 1 --2- 172.21.15.154:0/4212190055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff1015a660 0x7eff1014c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:32.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.580+0000 7eff16328640 1 --2- 172.21.15.154:0/4212190055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff100cab50 0x7eff100b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:32.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.580+0000 7eff16328640 1 --2- 172.21.15.154:0/4212190055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff1006ce60 0x7eff100c9a00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:32.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.580+0000 7eff16328640 1 -- 172.21.15.154:0/4212190055 >> 172.21.15.154:0/4212190055 conn(0x7eff100b1770 msgr2=0x7eff101507a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:32.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.580+0000 7eff16328640 1 -- 172.21.15.154:0/4212190055 shutdown_connections 2024-05-14T01:24:32.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.580+0000 7eff16328640 1 -- 172.21.15.154:0/4212190055 wait complete. 2024-05-14T01:24:32.601 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-14T01:24:32.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.736+0000 7fefde90c640 1 Processor -- start 2024-05-14T01:24:32.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.736+0000 7fefde90c640 1 -- start start 2024-05-14T01:24:32.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.736+0000 7fefde90c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fefd8071ef0 0x7fefd80722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:32.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.736+0000 7fefde90c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fefd80ced50 0x7fefd80cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:32.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.736+0000 7fefde90c640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd8072810 con 0x7fefd80cd160 2024-05-14T01:24:32.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.736+0000 7fefde90c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fefd80ce8c0 con 0x7fefd80ced50 2024-05-14T01:24:32.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.736+0000 7fefde90c640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fefd80cdcb0 con 0x7fefd8071ef0 2024-05-14T01:24:32.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.736+0000 7fefd77fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fefd80ced50 0x7fefd80cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:32.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.736+0000 7fefd77fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fefd80ced50 0x7fefd80cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50854/0 (socket says 172.21.15.154:50854) 2024-05-14T01:24:32.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.736+0000 7fefd77fe640 1 -- 172.21.15.154:0/1041680862 learned_addr learned my addr 172.21.15.154:0/1041680862 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:32.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.736+0000 7fefd7fff640 1 --2- 172.21.15.154:0/1041680862 >> v2:172.21.15.176:3300/0 conn(0x7fefd8071ef0 0x7fefd80722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:32.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.736+0000 7fefd77fe640 1 -- 172.21.15.154:0/1041680862 >> v2:172.21.15.176:3300/0 conn(0x7fefd8071ef0 msgr2=0x7fefd80722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:32.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.736+0000 7fefd77fe640 1 --2- 172.21.15.154:0/1041680862 >> v2:172.21.15.176:3300/0 conn(0x7fefd8071ef0 0x7fefd80722d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:32.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.736+0000 7fefd77fe640 1 -- 172.21.15.154:0/1041680862 >> v1:172.21.15.176:6789/0 conn(0x7fefd80cd160 legacy=0x7fefd80b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:32.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.736+0000 7fefd77fe640 1 -- 172.21.15.154:0/1041680862 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd80cdf90 con 0x7fefd80ced50 2024-05-14T01:24:32.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefd77fe640 1 --2- 172.21.15.154:0/1041680862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd80ced50 0x7fefd80cf1b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fefd8073a40 tx=0x7fefcc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2011858cbc68244e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:32.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefd6ffd640 1 -- 172.21.15.154:0/1041680862 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc0aa430 con 0x7fefd80ced50 2024-05-14T01:24:32.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefd6ffd640 1 -- 172.21.15.154:0/1041680862 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefcc0af070 con 0x7fefd80ced50 2024-05-14T01:24:32.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefd6ffd640 1 -- 172.21.15.154:0/1041680862 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc0aa7f0 con 0x7fefd80ced50 2024-05-14T01:24:32.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefde90c640 1 -- 172.21.15.154:0/1041680862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd80ced50 msgr2=0x7fefd80cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:32.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefde90c640 1 --2- 172.21.15.154:0/1041680862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd80ced50 0x7fefd80cf1b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fefd8073a40 tx=0x7fefcc01c4b0 comp rx=0 tx=0).stop 2024-05-14T01:24:32.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefde90c640 1 -- 172.21.15.154:0/1041680862 shutdown_connections 2024-05-14T01:24:32.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefde90c640 1 --2- 172.21.15.154:0/1041680862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd80ced50 0x7fefd80cf1b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:32.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefde90c640 1 --2- 172.21.15.154:0/1041680862 >> v2:172.21.15.176:3300/0 conn(0x7fefd8071ef0 0x7fefd80722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:32.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefde90c640 1 -- 172.21.15.154:0/1041680862 >> 172.21.15.154:0/1041680862 conn(0x7fefd80b1770 msgr2=0x7fefd80b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:32.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefde90c640 1 -- 172.21.15.154:0/1041680862 shutdown_connections 2024-05-14T01:24:32.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefde90c640 1 -- 172.21.15.154:0/1041680862 wait complete. 2024-05-14T01:24:32.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefde90c640 1 Processor -- start 2024-05-14T01:24:32.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefde90c640 1 -- start start 2024-05-14T01:24:32.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefde90c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefd8071ef0 0x7fefd812e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:32.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefde90c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd80cd160 0x7fefd8157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:32.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefde90c640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefd80ced50 0x7fefd806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:32.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefde90c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fefd806e990 con 0x7fefd80cd160 2024-05-14T01:24:32.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefde90c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fefd8143f20 con 0x7fefd8071ef0 2024-05-14T01:24:32.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefde90c640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fefd806eb10 con 0x7fefd80ced50 2024-05-14T01:24:32.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefd77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd80cd160 0x7fefd8157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:32.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefd77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd80cd160 0x7fefd8157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50862/0 (socket says 172.21.15.154:50862) 2024-05-14T01:24:32.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.740+0000 7fefd77fe640 1 -- 172.21.15.154:0/1813977938 learned_addr learned my addr 172.21.15.154:0/1813977938 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:32.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefd7fff640 1 --2- 172.21.15.154:0/1813977938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefd8071ef0 0x7fefd812e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:32.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefdcea9640 1 --2- 172.21.15.154:0/1813977938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefd80ced50 0x7fefd806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:32.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefd77fe640 1 -- 172.21.15.154:0/1813977938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefd80ced50 msgr2=0x7fefd806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:32.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefd77fe640 1 --2- 172.21.15.154:0/1813977938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefd80ced50 0x7fefd806d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:32.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefd77fe640 1 -- 172.21.15.154:0/1813977938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefd8071ef0 msgr2=0x7fefd812e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:32.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefd77fe640 1 --2- 172.21.15.154:0/1813977938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefd8071ef0 0x7fefd812e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:32.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefd77fe640 1 -- 172.21.15.154:0/1813977938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd812eaf0 con 0x7fefd80cd160 2024-05-14T01:24:32.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefd7fff640 1 --2- 172.21.15.154:0/1813977938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefd8071ef0 0x7fefd812e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:32.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefd77fe640 1 --2- 172.21.15.154:0/1813977938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd80cd160 0x7fefd8157eb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fefcc0ac040 tx=0x7fefcc01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:32.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefd4ff9640 1 -- 172.21.15.154:0/1813977938 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc0b3800 con 0x7fefd80cd160 2024-05-14T01:24:32.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefd4ff9640 1 -- 172.21.15.154:0/1813977938 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefcc0b39c0 con 0x7fefd80cd160 2024-05-14T01:24:32.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefd4ff9640 1 -- 172.21.15.154:0/1813977938 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc0b3db0 con 0x7fefd80cd160 2024-05-14T01:24:32.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefde90c640 1 -- 172.21.15.154:0/1813977938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd80af060 con 0x7fefd80cd160 2024-05-14T01:24:32.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefde90c640 1 -- 172.21.15.154:0/1813977938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd80af620 con 0x7fefd80cd160 2024-05-14T01:24:32.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefde90c640 1 -- 172.21.15.154:0/1813977938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd8075470 con 0x7fefd80cd160 2024-05-14T01:24:32.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefd4ff9640 1 -- 172.21.15.154:0/1813977938 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fefcc0b2380 con 0x7fefd80cd160 2024-05-14T01:24:32.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefd4ff9640 1 --2- 172.21.15.154:0/1813977938 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fefc40678c0 0x7fefc4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:32.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefd4ff9640 1 -- 172.21.15.154:0/1813977938 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5609+0+0 (secure 0 0 0) 0x7fefcc11fcb0 con 0x7fefd80cd160 2024-05-14T01:24:32.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefd7fff640 1 --2- 172.21.15.154:0/1813977938 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fefc40678c0 0x7fefc4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:32.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.744+0000 7fefd7fff640 1 --2- 172.21.15.154:0/1813977938 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fefc40678c0 0x7fefc4069d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fefc800a9d0 tx=0x7fefc8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:32.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.752+0000 7fefd4ff9640 1 -- 172.21.15.154:0/1813977938 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fefcc0160d0 con 0x7fefd80cd160 2024-05-14T01:24:32.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:32.948+0000 7fefde90c640 1 -- 172.21.15.154:0/1813977938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fefd80b4d70 con 0x7fefd80cd160 2024-05-14T01:24:33.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.628+0000 7fefd4ff9640 1 -- 172.21.15.154:0/1813977938 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7fefcc0f0170 con 0x7fefd80cd160 2024-05-14T01:24:33.621 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 4 and data pool 5 2024-05-14T01:24:33.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.640+0000 7fefde90c640 1 -- 172.21.15.154:0/1813977938 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fefc40678c0 msgr2=0x7fefc4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:33.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.644+0000 7fefde90c640 1 --2- 172.21.15.154:0/1813977938 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fefc40678c0 0x7fefc4069d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fefc800a9d0 tx=0x7fefc8008040 comp rx=0 tx=0).stop 2024-05-14T01:24:33.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.644+0000 7fefde90c640 1 -- 172.21.15.154:0/1813977938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd80cd160 msgr2=0x7fefd8157eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:33.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.644+0000 7fefde90c640 1 --2- 172.21.15.154:0/1813977938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd80cd160 0x7fefd8157eb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fefcc0ac040 tx=0x7fefcc01acf0 comp rx=0 tx=0).stop 2024-05-14T01:24:33.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.644+0000 7fefde90c640 1 -- 172.21.15.154:0/1813977938 shutdown_connections 2024-05-14T01:24:33.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.644+0000 7fefde90c640 1 --2- 172.21.15.154:0/1813977938 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fefc40678c0 0x7fefc4069d80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:33.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.644+0000 7fefde90c640 1 --2- 172.21.15.154:0/1813977938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefd80ced50 0x7fefd806d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:33.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.644+0000 7fefde90c640 1 --2- 172.21.15.154:0/1813977938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd80cd160 0x7fefd8157eb0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:33.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.644+0000 7fefde90c640 1 --2- 172.21.15.154:0/1813977938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefd8071ef0 0x7fefd812e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:33.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.644+0000 7fefde90c640 1 -- 172.21.15.154:0/1813977938 >> 172.21.15.154:0/1813977938 conn(0x7fefd80b1770 msgr2=0x7fefd813e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:33.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.644+0000 7fefde90c640 1 -- 172.21.15.154:0/1813977938 shutdown_connections 2024-05-14T01:24:33.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.644+0000 7fefde90c640 1 -- 172.21.15.154:0/1813977938 wait complete. 2024-05-14T01:24:33.660 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:33.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.784+0000 7f7afdb7a640 1 Processor -- start 2024-05-14T01:24:33.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.784+0000 7f7afdb7a640 1 -- start start 2024-05-14T01:24:33.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7afdb7a640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7af806e490 0x7f7af80cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7afdb7a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7af80cf100 con 0x7f7af8141d00 2024-05-14T01:24:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7afdb7a640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7af80cf3e0 con 0x7f7af813ede0 2024-05-14T01:24:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7afdb7a640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7af806cff0 con 0x7f7af806e490 2024-05-14T01:24:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af6ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7af8141d00 0x7f7af80ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39926/0 (socket says 172.21.15.154:39926) 2024-05-14T01:24:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af6ffd640 1 -- 172.21.15.154:0/3072491243 learned_addr learned my addr 172.21.15.154:0/3072491243 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af67fc640 1 -- 172.21.15.154:0/3072491243 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701310182 0 0) 0x7f7af80cf100 con 0x7f7af8141d00 2024-05-14T01:24:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af67fc640 1 -- 172.21.15.154:0/3072491243 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ad8003530 con 0x7f7af8141d00 2024-05-14T01:24:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af7fff640 1 --2- 172.21.15.154:0/3072491243 >> v2:172.21.15.176:3300/0 conn(0x7f7af806e490 0x7f7af80cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af67fc640 1 -- 172.21.15.154:0/3072491243 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2811408527 0 0) 0x7f7ad8003530 con 0x7f7af8141d00 2024-05-14T01:24:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af67fc640 1 -- 172.21.15.154:0/3072491243 >> v2:172.21.15.176:3300/0 conn(0x7f7af806e490 msgr2=0x7f7af80cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af67fc640 1 --2- 172.21.15.154:0/3072491243 >> v2:172.21.15.176:3300/0 conn(0x7f7af806e490 0x7f7af80cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af67fc640 1 -- 172.21.15.154:0/3072491243 >> v1:172.21.15.176:6789/0 conn(0x7f7af813ede0 legacy=0x7f7af81415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af67fc640 1 -- 172.21.15.154:0/3072491243 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af806cc80 con 0x7f7af8141d00 2024-05-14T01:24:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af67fc640 1 -- 172.21.15.154:0/3072491243 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f7ae0001a00 con 0x7f7af8141d00 2024-05-14T01:24:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af67fc640 1 -- 172.21.15.154:0/3072491243 >> v1:172.21.15.154:6789/0 conn(0x7f7af8141d00 legacy=0x7f7af80ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af67fc640 1 --2- 172.21.15.154:0/3072491243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ad80039f0 0x7f7ad8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af67fc640 1 --2- 172.21.15.154:0/3072491243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ad8004810 0x7f7ad8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af67fc640 1 --2- 172.21.15.154:0/3072491243 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ad80051d0 0x7f7ad800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af67fc640 1 -- 172.21.15.154:0/3072491243 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7af806cff0 con 0x7f7ad80039f0 2024-05-14T01:24:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af67fc640 1 -- 172.21.15.154:0/3072491243 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad800c0a0 con 0x7f7ad80051d0 2024-05-14T01:24:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af67fc640 1 -- 172.21.15.154:0/3072491243 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad800c2a0 con 0x7f7ad8004810 2024-05-14T01:24:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af77fe640 1 --2- 172.21.15.154:0/3072491243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ad80039f0 0x7f7ad8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af6ffd640 1 --2- 172.21.15.154:0/3072491243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ad8004810 0x7f7ad8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af7fff640 1 --2- 172.21.15.154:0/3072491243 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ad80051d0 0x7f7ad800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af77fe640 1 -- 172.21.15.154:0/3072491243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ad8004810 msgr2=0x7f7ad8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af77fe640 1 --2- 172.21.15.154:0/3072491243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ad8004810 0x7f7ad8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:33.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af77fe640 1 -- 172.21.15.154:0/3072491243 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ad80051d0 msgr2=0x7f7ad800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:33.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af77fe640 1 --2- 172.21.15.154:0/3072491243 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ad80051d0 0x7f7ad800b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:33.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af77fe640 1 -- 172.21.15.154:0/3072491243 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad8003530 con 0x7f7ad80039f0 2024-05-14T01:24:33.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.788+0000 7f7af7fff640 1 -- 172.21.15.154:0/3072491243 reap_dead start 2024-05-14T01:24:33.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7af77fe640 1 --2- 172.21.15.154:0/3072491243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ad80039f0 0x7f7ad8003e10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8001780 tx=0x7f7ae801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b51e6f72ef8e61 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:33.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7af67fc640 1 -- 172.21.15.154:0/3072491243 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae80a8050 con 0x7f7ad80039f0 2024-05-14T01:24:33.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7af67fc640 1 -- 172.21.15.154:0/3072491243 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae80052f0 con 0x7f7ad80039f0 2024-05-14T01:24:33.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7af67fc640 1 -- 172.21.15.154:0/3072491243 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae80013a0 con 0x7f7ad80039f0 2024-05-14T01:24:33.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7afdb7a640 1 -- 172.21.15.154:0/3072491243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ad80039f0 msgr2=0x7f7ad8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:33.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7afdb7a640 1 --2- 172.21.15.154:0/3072491243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ad80039f0 0x7f7ad8003e10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8001780 tx=0x7f7ae801c3c0 comp rx=0 tx=0).stop 2024-05-14T01:24:33.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7afdb7a640 1 -- 172.21.15.154:0/3072491243 shutdown_connections 2024-05-14T01:24:33.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7afdb7a640 1 --2- 172.21.15.154:0/3072491243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ad80039f0 0x7f7ad8003e10 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:33.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7afdb7a640 1 -- 172.21.15.154:0/3072491243 >> 172.21.15.154:0/3072491243 conn(0x7f7af80b1850 msgr2=0x7f7af80b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:33.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7afdb7a640 1 -- 172.21.15.154:0/3072491243 shutdown_connections 2024-05-14T01:24:33.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7afdb7a640 1 -- 172.21.15.154:0/3072491243 wait complete. 2024-05-14T01:24:33.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7afdb7a640 1 Processor -- start 2024-05-14T01:24:33.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7afdb7a640 1 -- start start 2024-05-14T01:24:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7afdb7a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ad80039f0 0x7f7af812de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7afdb7a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7af8142240 0x7f7af8142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7afdb7a640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7af81f46b0 0x7f7af8155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7afdb7a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7af8141b80 con 0x7f7af8142240 2024-05-14T01:24:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7afdb7a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7af8141a00 con 0x7f7ad80039f0 2024-05-14T01:24:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7afdb7a640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7af80cea80 con 0x7f7af81f46b0 2024-05-14T01:24:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7af6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7af8142240 0x7f7af8142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7af6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7af8142240 0x7f7af8142fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50880/0 (socket says 172.21.15.154:50880) 2024-05-14T01:24:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7af6ffd640 1 -- 172.21.15.154:0/2736652874 learned_addr learned my addr 172.21.15.154:0/2736652874 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7af77fe640 1 --2- 172.21.15.154:0/2736652874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ad80039f0 0x7f7af812de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7af7fff640 1 --2- 172.21.15.154:0/2736652874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7af81f46b0 0x7f7af8155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7af6ffd640 1 -- 172.21.15.154:0/2736652874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7af81f46b0 msgr2=0x7f7af8155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7af6ffd640 1 --2- 172.21.15.154:0/2736652874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7af81f46b0 0x7f7af8155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7af6ffd640 1 -- 172.21.15.154:0/2736652874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ad80039f0 msgr2=0x7f7af812de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7af6ffd640 1 --2- 172.21.15.154:0/2736652874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ad80039f0 0x7f7af812de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7af6ffd640 1 -- 172.21.15.154:0/2736652874 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af8143900 con 0x7f7af8142240 2024-05-14T01:24:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7af6ffd640 1 --2- 172.21.15.154:0/2736652874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7af8142240 0x7f7af8142fb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0001bf0 tx=0x7f7ae000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7aeffff640 1 -- 172.21.15.154:0/2736652874 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae000ee50 con 0x7f7af8142240 2024-05-14T01:24:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7aeffff640 1 -- 172.21.15.154:0/2736652874 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae0018070 con 0x7f7af8142240 2024-05-14T01:24:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7afdb7a640 1 -- 172.21.15.154:0/2736652874 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7af813c6d0 con 0x7f7af8142240 2024-05-14T01:24:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7aeffff640 1 -- 172.21.15.154:0/2736652874 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0013660 con 0x7f7af8142240 2024-05-14T01:24:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.792+0000 7f7afdb7a640 1 -- 172.21.15.154:0/2736652874 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7af813cc90 con 0x7f7af8142240 2024-05-14T01:24:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.796+0000 7f7afdb7a640 1 -- 172.21.15.154:0/2736652874 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7af8075470 con 0x7f7af8142240 2024-05-14T01:24:33.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.796+0000 7f7aeffff640 1 -- 172.21.15.154:0/2736652874 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7ae0013800 con 0x7f7af8142240 2024-05-14T01:24:33.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.796+0000 7f7aeffff640 1 --2- 172.21.15.154:0/2736652874 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7adc067a60 0x7f7adc069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:33.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.796+0000 7f7aeffff640 1 -- 172.21.15.154:0/2736652874 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f7ae0086220 con 0x7f7af8142240 2024-05-14T01:24:33.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.796+0000 7f7af77fe640 1 --2- 172.21.15.154:0/2736652874 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7adc067a60 0x7f7adc069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:33.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.796+0000 7f7af77fe640 1 --2- 172.21.15.154:0/2736652874 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7adc067a60 0x7f7adc069f20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8001750 tx=0x7f7ae80011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:33.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.800+0000 7f7aeffff640 1 -- 172.21.15.154:0/2736652874 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f7ae0056eb0 con 0x7f7af8142240 2024-05-14T01:24:33.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.964+0000 7f7afdb7a640 1 -- 172.21.15.154:0/2736652874 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7af813ce60 con 0x7f7af8142240 2024-05-14T01:24:33.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.964+0000 7f7aeffff640 1 -- 172.21.15.154:0/2736652874 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16730 (secure 0 0 0) 0x7f7ae005d080 con 0x7f7af8142240 2024-05-14T01:24:33.954 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:33.954 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":33,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:24:32.951241+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:24:31.391789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-14T01:24:31.927579+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:33.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.968+0000 7f7afdb7a640 1 -- 172.21.15.154:0/2736652874 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7adc067a60 msgr2=0x7f7adc069f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:33.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.968+0000 7f7afdb7a640 1 --2- 172.21.15.154:0/2736652874 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7adc067a60 0x7f7adc069f20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8001750 tx=0x7f7ae80011a0 comp rx=0 tx=0).stop 2024-05-14T01:24:33.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.968+0000 7f7afdb7a640 1 -- 172.21.15.154:0/2736652874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7af8142240 msgr2=0x7f7af8142fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:33.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.968+0000 7f7afdb7a640 1 --2- 172.21.15.154:0/2736652874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7af8142240 0x7f7af8142fb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0001bf0 tx=0x7f7ae000e530 comp rx=0 tx=0).stop 2024-05-14T01:24:33.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.968+0000 7f7afdb7a640 1 -- 172.21.15.154:0/2736652874 shutdown_connections 2024-05-14T01:24:33.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.968+0000 7f7afdb7a640 1 --2- 172.21.15.154:0/2736652874 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7adc067a60 0x7f7adc069f20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:33.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.968+0000 7f7afdb7a640 1 --2- 172.21.15.154:0/2736652874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7af81f46b0 0x7f7af8155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:33.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.968+0000 7f7afdb7a640 1 --2- 172.21.15.154:0/2736652874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7af8142240 0x7f7af8142fb0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:33.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.968+0000 7f7afdb7a640 1 --2- 172.21.15.154:0/2736652874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ad80039f0 0x7f7af812de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:33.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.968+0000 7f7afdb7a640 1 -- 172.21.15.154:0/2736652874 >> 172.21.15.154:0/2736652874 conn(0x7f7af80b1850 msgr2=0x7f7af815e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:33.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.968+0000 7f7afdb7a640 1 -- 172.21.15.154:0/2736652874 shutdown_connections 2024-05-14T01:24:33.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:33.968+0000 7f7afdb7a640 1 -- 172.21.15.154:0/2736652874 wait complete. 2024-05-14T01:24:33.973 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:34.019 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:24:34.023 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:24:34.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.104+0000 7fef4d07e640 1 Processor -- start 2024-05-14T01:24:34.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.104+0000 7fef4d07e640 1 -- start start 2024-05-14T01:24:34.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.104+0000 7fef4d07e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fef48144760 0x7fef4806e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:34.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.104+0000 7fef4d07e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef4815bae0 0x7fef4815c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:34.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.104+0000 7fef4d07e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef48144b40 con 0x7fef480b3530 2024-05-14T01:24:34.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.104+0000 7fef4d07e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fef480b4650 con 0x7fef48144760 2024-05-14T01:24:34.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.104+0000 7fef4d07e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fef480b3a40 con 0x7fef4815bae0 2024-05-14T01:24:34.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.104+0000 7fef46d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fef48144760 0x7fef4806e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:34.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.104+0000 7fef46d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fef48144760 0x7fef4806e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50886/0 (socket says 172.21.15.154:50886) 2024-05-14T01:24:34.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.104+0000 7fef46d9d640 1 -- 172.21.15.154:0/362689593 learned_addr learned my addr 172.21.15.154:0/362689593 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:34.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.108+0000 7fef4759e640 1 --2- 172.21.15.154:0/362689593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef4815bae0 0x7fef4815c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:34.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.108+0000 7fef46d9d640 1 -- 172.21.15.154:0/362689593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef4815bae0 msgr2=0x7fef4815c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:34.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.108+0000 7fef46d9d640 1 --2- 172.21.15.154:0/362689593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef4815bae0 0x7fef4815c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:34.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.108+0000 7fef46d9d640 1 -- 172.21.15.154:0/362689593 >> v1:172.21.15.176:6789/0 conn(0x7fef480b3530 legacy=0x7fef4815b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:34.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.108+0000 7fef46d9d640 1 -- 172.21.15.154:0/362689593 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef480b3d20 con 0x7fef48144760 2024-05-14T01:24:34.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.108+0000 7fef4759e640 1 --2- 172.21.15.154:0/362689593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef4815bae0 0x7fef4815c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:34.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.108+0000 7fef46d9d640 1 --2- 172.21.15.154:0/362689593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef48144760 0x7fef4806e680 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fef30009870 tx=0x7fef3001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48aa1c340d9c142a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:34.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.108+0000 7fef45d9b640 1 -- 172.21.15.154:0/362689593 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef300a95f0 con 0x7fef48144760 2024-05-14T01:24:34.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.108+0000 7fef45d9b640 1 -- 172.21.15.154:0/362689593 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef300a9790 con 0x7fef48144760 2024-05-14T01:24:34.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.108+0000 7fef45d9b640 1 -- 172.21.15.154:0/362689593 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef300a9b60 con 0x7fef48144760 2024-05-14T01:24:34.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.108+0000 7fef4d07e640 1 -- 172.21.15.154:0/362689593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef48144760 msgr2=0x7fef4806e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:34.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.108+0000 7fef4d07e640 1 --2- 172.21.15.154:0/362689593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef48144760 0x7fef4806e680 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fef30009870 tx=0x7fef3001c530 comp rx=0 tx=0).stop 2024-05-14T01:24:34.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.108+0000 7fef4d07e640 1 -- 172.21.15.154:0/362689593 shutdown_connections 2024-05-14T01:24:34.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.108+0000 7fef4d07e640 1 --2- 172.21.15.154:0/362689593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef4815bae0 0x7fef4815c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:34.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.108+0000 7fef4d07e640 1 --2- 172.21.15.154:0/362689593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef48144760 0x7fef4806e680 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:34.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4d07e640 1 -- 172.21.15.154:0/362689593 >> 172.21.15.154:0/362689593 conn(0x7fef480b1850 msgr2=0x7fef480b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:34.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4d07e640 1 -- 172.21.15.154:0/362689593 shutdown_connections 2024-05-14T01:24:34.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4d07e640 1 -- 172.21.15.154:0/362689593 wait complete. 2024-05-14T01:24:34.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4d07e640 1 Processor -- start 2024-05-14T01:24:34.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4d07e640 1 -- start start 2024-05-14T01:24:34.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4d07e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef480b3530 0x7fef4815a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:34.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4d07e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef48144760 0x7fef4815fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:34.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4d07e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef4815bae0 0x7fef4815e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:34.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4d07e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fef4815d4b0 con 0x7fef48144760 2024-05-14T01:24:34.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4d07e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fef4815d330 con 0x7fef4815bae0 2024-05-14T01:24:34.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4d07e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fef4815d630 con 0x7fef480b3530 2024-05-14T01:24:34.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef48144760 0x7fef4815fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:34.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef48144760 0x7fef4815fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50888/0 (socket says 172.21.15.154:50888) 2024-05-14T01:24:34.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4659c640 1 -- 172.21.15.154:0/2045867475 learned_addr learned my addr 172.21.15.154:0/2045867475 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:34.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef46d9d640 1 --2- 172.21.15.154:0/2045867475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef480b3530 0x7fef4815a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:34.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4759e640 1 --2- 172.21.15.154:0/2045867475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef4815bae0 0x7fef4815e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:34.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4659c640 1 -- 172.21.15.154:0/2045867475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef480b3530 msgr2=0x7fef4815a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:34.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4659c640 1 --2- 172.21.15.154:0/2045867475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef480b3530 0x7fef4815a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:34.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4659c640 1 -- 172.21.15.154:0/2045867475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef4815bae0 msgr2=0x7fef4815e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:34.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4659c640 1 --2- 172.21.15.154:0/2045867475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef4815bae0 0x7fef4815e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:34.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4659c640 1 -- 172.21.15.154:0/2045867475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef48165840 con 0x7fef48144760 2024-05-14T01:24:34.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef46d9d640 1 --2- 172.21.15.154:0/2045867475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef480b3530 0x7fef4815a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:34.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4759e640 1 --2- 172.21.15.154:0/2045867475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef4815bae0 0x7fef4815e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:34.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4659c640 1 --2- 172.21.15.154:0/2045867475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef48144760 0x7fef4815fad0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fef3800c450 tx=0x7fef3800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:34.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef3f7fe640 1 -- 172.21.15.154:0/2045867475 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef38016020 con 0x7fef48144760 2024-05-14T01:24:34.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef3f7fe640 1 -- 172.21.15.154:0/2045867475 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef380052d0 con 0x7fef48144760 2024-05-14T01:24:34.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4d07e640 1 -- 172.21.15.154:0/2045867475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef481f6800 con 0x7fef48144760 2024-05-14T01:24:34.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef3f7fe640 1 -- 172.21.15.154:0/2045867475 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef38007260 con 0x7fef48144760 2024-05-14T01:24:34.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4d07e640 1 -- 172.21.15.154:0/2045867475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef481f6dc0 con 0x7fef48144760 2024-05-14T01:24:34.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.112+0000 7fef4d07e640 1 -- 172.21.15.154:0/2045867475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef48075470 con 0x7fef48144760 2024-05-14T01:24:34.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.116+0000 7fef3f7fe640 1 -- 172.21.15.154:0/2045867475 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fef38007400 con 0x7fef48144760 2024-05-14T01:24:34.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.116+0000 7fef3f7fe640 1 --2- 172.21.15.154:0/2045867475 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fef280678c0 0x7fef28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:34.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.116+0000 7fef3f7fe640 1 -- 172.21.15.154:0/2045867475 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fef380855c0 con 0x7fef48144760 2024-05-14T01:24:34.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.116+0000 7fef46d9d640 1 --2- 172.21.15.154:0/2045867475 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fef280678c0 0x7fef28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:34.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.116+0000 7fef46d9d640 1 --2- 172.21.15.154:0/2045867475 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fef280678c0 0x7fef28069d80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fef300ae000 tx=0x7fef300b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:34.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.120+0000 7fef3f7fe640 1 -- 172.21.15.154:0/2045867475 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fef38020020 con 0x7fef48144760 2024-05-14T01:24:34.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.284+0000 7fef4d07e640 1 -- 172.21.15.154:0/2045867475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef48068540 con 0x7fef48144760 2024-05-14T01:24:34.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.288+0000 7fef3f7fe640 1 -- 172.21.15.154:0/2045867475 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16730 (secure 0 0 0) 0x7fef38005480 con 0x7fef48144760 2024-05-14T01:24:34.276 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:34.276 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":33,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:24:32.951241+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:24:31.391789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-14T01:24:31.927579+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:34.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.288+0000 7fef4d07e640 1 -- 172.21.15.154:0/2045867475 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fef280678c0 msgr2=0x7fef28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:34.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.288+0000 7fef4d07e640 1 --2- 172.21.15.154:0/2045867475 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fef280678c0 0x7fef28069d80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fef300ae000 tx=0x7fef300b3040 comp rx=0 tx=0).stop 2024-05-14T01:24:34.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.288+0000 7fef4d07e640 1 -- 172.21.15.154:0/2045867475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef48144760 msgr2=0x7fef4815fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:34.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.288+0000 7fef4d07e640 1 --2- 172.21.15.154:0/2045867475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef48144760 0x7fef4815fad0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fef3800c450 tx=0x7fef3800c910 comp rx=0 tx=0).stop 2024-05-14T01:24:34.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.292+0000 7fef4d07e640 1 -- 172.21.15.154:0/2045867475 shutdown_connections 2024-05-14T01:24:34.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.292+0000 7fef4d07e640 1 --2- 172.21.15.154:0/2045867475 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fef280678c0 0x7fef28069d80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:34.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.292+0000 7fef4d07e640 1 --2- 172.21.15.154:0/2045867475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef4815bae0 0x7fef4815e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:34.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.292+0000 7fef4d07e640 1 --2- 172.21.15.154:0/2045867475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef48144760 0x7fef4815fad0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:34.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.292+0000 7fef4d07e640 1 --2- 172.21.15.154:0/2045867475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef480b3530 0x7fef4815a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:34.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.292+0000 7fef4d07e640 1 -- 172.21.15.154:0/2045867475 >> 172.21.15.154:0/2045867475 conn(0x7fef480b1850 msgr2=0x7fef480b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:34.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.292+0000 7fef4d07e640 1 -- 172.21.15.154:0/2045867475 shutdown_connections 2024-05-14T01:24:34.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.292+0000 7fef4d07e640 1 -- 172.21.15.154:0/2045867475 wait complete. 2024-05-14T01:24:34.295 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-14T01:24:34.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e31cb8640 1 Processor -- start 2024-05-14T01:24:34.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e31cb8640 1 -- start start 2024-05-14T01:24:34.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e31cb8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1e2c1458d0 0x7f1e2c0cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:34.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e31cb8640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1e2c071060 0x7f1e2c15fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:34.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e31cb8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e2c15ff80 0x7f1e2c0ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:34.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e31cb8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1e2c071840 con 0x7f1e2c1458d0 2024-05-14T01:24:34.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e31cb8640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1e2c071b20 con 0x7f1e2c071060 2024-05-14T01:24:34.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e31cb8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1e2c071e00 con 0x7f1e2c15ff80 2024-05-14T01:24:34.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e2b7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1e2c1458d0 0x7f1e2c0cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:34.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e2b7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1e2c1458d0 0x7f1e2c0cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50896/0 (socket says 172.21.15.154:50896) 2024-05-14T01:24:34.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e2b7fe640 1 -- 172.21.15.154:0/1187801515 learned_addr learned my addr 172.21.15.154:0/1187801515 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:34.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e2bfff640 1 --2- 172.21.15.154:0/1187801515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e2c15ff80 0x7f1e2c0ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:34.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e2affd640 1 --2- 172.21.15.154:0/1187801515 >> v2:172.21.15.176:3300/0 conn(0x7f1e2c071060 0x7f1e2c15fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:34.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e2b7fe640 1 -- 172.21.15.154:0/1187801515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e2c15ff80 msgr2=0x7f1e2c0ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:34.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e2b7fe640 1 --2- 172.21.15.154:0/1187801515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e2c15ff80 0x7f1e2c0ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:34.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e2b7fe640 1 -- 172.21.15.154:0/1187801515 >> v2:172.21.15.176:3300/0 conn(0x7f1e2c071060 msgr2=0x7f1e2c15fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:34.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e2b7fe640 1 --2- 172.21.15.154:0/1187801515 >> v2:172.21.15.176:3300/0 conn(0x7f1e2c071060 0x7f1e2c15fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:34.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e2b7fe640 1 -- 172.21.15.154:0/1187801515 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2c0720e0 con 0x7f1e2c1458d0 2024-05-14T01:24:34.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.480+0000 7f1e2affd640 1 --2- 172.21.15.154:0/1187801515 >> v2:172.21.15.176:3300/0 conn(0x7f1e2c071060 0x7f1e2c15fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:34.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.484+0000 7f1e2b7fe640 1 --2- 172.21.15.154:0/1187801515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e2c1458d0 0x7f1e2c0cf610 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c073750 tx=0x7f1e2001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b14627e624be38e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:34.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.484+0000 7f1e2a7fc640 1 -- 172.21.15.154:0/1187801515 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e200b0070 con 0x7f1e2c1458d0 2024-05-14T01:24:34.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.484+0000 7f1e2a7fc640 1 -- 172.21.15.154:0/1187801515 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e200ab600 con 0x7f1e2c1458d0 2024-05-14T01:24:34.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.484+0000 7f1e2a7fc640 1 -- 172.21.15.154:0/1187801515 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e200ab9d0 con 0x7f1e2c1458d0 2024-05-14T01:24:34.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.484+0000 7f1e31cb8640 1 -- 172.21.15.154:0/1187801515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e2c1458d0 msgr2=0x7f1e2c0cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:34.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.484+0000 7f1e31cb8640 1 --2- 172.21.15.154:0/1187801515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e2c1458d0 0x7f1e2c0cf610 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c073750 tx=0x7f1e2001c520 comp rx=0 tx=0).stop 2024-05-14T01:24:34.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.484+0000 7f1e31cb8640 1 -- 172.21.15.154:0/1187801515 shutdown_connections 2024-05-14T01:24:34.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.484+0000 7f1e31cb8640 1 --2- 172.21.15.154:0/1187801515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e2c15ff80 0x7f1e2c0ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:34.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.484+0000 7f1e31cb8640 1 --2- 172.21.15.154:0/1187801515 >> v2:172.21.15.176:3300/0 conn(0x7f1e2c071060 0x7f1e2c15fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:34.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.484+0000 7f1e31cb8640 1 --2- 172.21.15.154:0/1187801515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e2c1458d0 0x7f1e2c0cf610 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:34.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.484+0000 7f1e31cb8640 1 -- 172.21.15.154:0/1187801515 >> 172.21.15.154:0/1187801515 conn(0x7f1e2c0b1770 msgr2=0x7f1e2c0b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:34.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.484+0000 7f1e31cb8640 1 -- 172.21.15.154:0/1187801515 shutdown_connections 2024-05-14T01:24:34.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.484+0000 7f1e31cb8640 1 -- 172.21.15.154:0/1187801515 wait complete. 2024-05-14T01:24:34.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.484+0000 7f1e31cb8640 1 Processor -- start 2024-05-14T01:24:34.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.484+0000 7f1e31cb8640 1 -- start start 2024-05-14T01:24:34.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e31cb8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e2c071060 0x7f1e2c13d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:34.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e31cb8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e2c1458d0 0x7f1e2c15a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:34.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e31cb8640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e2c15ff80 0x7f1e2c152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:34.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e31cb8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2c06cfc0 con 0x7f1e2c071060 2024-05-14T01:24:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e31cb8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2c06ce40 con 0x7f1e2c1458d0 2024-05-14T01:24:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e31cb8640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1e2c06d140 con 0x7f1e2c15ff80 2024-05-14T01:24:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e2b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e2c071060 0x7f1e2c13d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e2b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e2c071060 0x7f1e2c13d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50904/0 (socket says 172.21.15.154:50904) 2024-05-14T01:24:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e2b7fe640 1 -- 172.21.15.154:0/4153475935 learned_addr learned my addr 172.21.15.154:0/4153475935 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e2bfff640 1 --2- 172.21.15.154:0/4153475935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e2c15ff80 0x7f1e2c152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e2affd640 1 --2- 172.21.15.154:0/4153475935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e2c1458d0 0x7f1e2c15a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e2b7fe640 1 -- 172.21.15.154:0/4153475935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e2c15ff80 msgr2=0x7f1e2c152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e2b7fe640 1 --2- 172.21.15.154:0/4153475935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e2c15ff80 0x7f1e2c152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e2b7fe640 1 -- 172.21.15.154:0/4153475935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e2c1458d0 msgr2=0x7f1e2c15a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e2b7fe640 1 --2- 172.21.15.154:0/4153475935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e2c1458d0 0x7f1e2c15a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e2b7fe640 1 -- 172.21.15.154:0/4153475935 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2c15b840 con 0x7f1e2c071060 2024-05-14T01:24:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e2bfff640 1 --2- 172.21.15.154:0/4153475935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e2c15ff80 0x7f1e2c152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:34.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e2b7fe640 1 --2- 172.21.15.154:0/4153475935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e2c071060 0x7f1e2c13d890 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1e200ae040 tx=0x7f1e2001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e13fff640 1 -- 172.21.15.154:0/4153475935 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e200b0040 con 0x7f1e2c071060 2024-05-14T01:24:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e13fff640 1 -- 172.21.15.154:0/4153475935 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e200bc070 con 0x7f1e2c071060 2024-05-14T01:24:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e13fff640 1 -- 172.21.15.154:0/4153475935 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e200b6660 con 0x7f1e2c071060 2024-05-14T01:24:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e31cb8640 1 -- 172.21.15.154:0/4153475935 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2c15bb20 con 0x7f1e2c071060 2024-05-14T01:24:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e31cb8640 1 -- 172.21.15.154:0/4153475935 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e2c15d2e0 con 0x7f1e2c071060 2024-05-14T01:24:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e31cb8640 1 -- 172.21.15.154:0/4153475935 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e2c075470 con 0x7f1e2c071060 2024-05-14T01:24:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e13fff640 1 -- 172.21.15.154:0/4153475935 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1e200b6800 con 0x7f1e2c071060 2024-05-14T01:24:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e13fff640 1 --2- 172.21.15.154:0/4153475935 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1e180678c0 0x7f1e18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e13fff640 1 -- 172.21.15.154:0/4153475935 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1e2011ff60 con 0x7f1e2c071060 2024-05-14T01:24:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.488+0000 7f1e2affd640 1 --2- 172.21.15.154:0/4153475935 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1e180678c0 0x7f1e18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:34.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.492+0000 7f1e2affd640 1 --2- 172.21.15.154:0/4153475935 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1e180678c0 0x7f1e18069d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c156050 tx=0x7f1e1c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:34.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.496+0000 7f1e13fff640 1 -- 172.21.15.154:0/4153475935 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1e20016110 con 0x7f1e2c071060 2024-05-14T01:24:34.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:34.684+0000 7f1e31cb8640 1 -- 172.21.15.154:0/4153475935 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1e2c070e40 con 0x7f1e2c071060 2024-05-14T01:24:35.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.636+0000 7f1e13fff640 1 -- 172.21.15.154:0/4153475935 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f1e200f0aa0 con 0x7f1e2c071060 2024-05-14T01:24:35.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.640+0000 7f1e31cb8640 1 -- 172.21.15.154:0/4153475935 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1e180678c0 msgr2=0x7f1e18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:35.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.640+0000 7f1e31cb8640 1 --2- 172.21.15.154:0/4153475935 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1e180678c0 0x7f1e18069d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c156050 tx=0x7f1e1c008040 comp rx=0 tx=0).stop 2024-05-14T01:24:35.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.640+0000 7f1e31cb8640 1 -- 172.21.15.154:0/4153475935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e2c071060 msgr2=0x7f1e2c13d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:35.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.640+0000 7f1e31cb8640 1 --2- 172.21.15.154:0/4153475935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e2c071060 0x7f1e2c13d890 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1e200ae040 tx=0x7f1e2001ad60 comp rx=0 tx=0).stop 2024-05-14T01:24:35.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.640+0000 7f1e31cb8640 1 -- 172.21.15.154:0/4153475935 shutdown_connections 2024-05-14T01:24:35.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.640+0000 7f1e31cb8640 1 --2- 172.21.15.154:0/4153475935 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1e180678c0 0x7f1e18069d80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:35.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.640+0000 7f1e31cb8640 1 --2- 172.21.15.154:0/4153475935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e2c15ff80 0x7f1e2c152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:35.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.640+0000 7f1e31cb8640 1 --2- 172.21.15.154:0/4153475935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e2c1458d0 0x7f1e2c15a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:35.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.640+0000 7f1e31cb8640 1 --2- 172.21.15.154:0/4153475935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e2c071060 0x7f1e2c13d890 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:35.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.640+0000 7f1e31cb8640 1 -- 172.21.15.154:0/4153475935 >> 172.21.15.154:0/4153475935 conn(0x7f1e2c0b1770 msgr2=0x7f1e2c0b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:35.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.640+0000 7f1e31cb8640 1 -- 172.21.15.154:0/4153475935 shutdown_connections 2024-05-14T01:24:35.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.640+0000 7f1e31cb8640 1 -- 172.21.15.154:0/4153475935 wait complete. 2024-05-14T01:24:35.647 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-14T01:24:35.648 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-14T01:24:35.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.784+0000 7f086532e640 1 Processor -- start 2024-05-14T01:24:35.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.788+0000 7f086532e640 1 -- start start 2024-05-14T01:24:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.788+0000 7f086532e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f086015a670 0x7f0860071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.788+0000 7f086532e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0860071060 0x7f086006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.788+0000 7f086532e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f086006dc10 0x7f08600b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.788+0000 7f086532e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f086006e080 con 0x7f086006dc10 2024-05-14T01:24:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.788+0000 7f086532e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f08600b32d0 con 0x7f086015a670 2024-05-14T01:24:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.788+0000 7f086532e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0860071ea0 con 0x7f0860071060 2024-05-14T01:24:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.788+0000 7f085f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f086006dc10 0x7f08600b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.788+0000 7f085f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f086006dc10 0x7f08600b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50912/0 (socket says 172.21.15.154:50912) 2024-05-14T01:24:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.788+0000 7f085f7fe640 1 -- 172.21.15.154:0/4255209990 learned_addr learned my addr 172.21.15.154:0/4255209990 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.788+0000 7f085effd640 1 --2- 172.21.15.154:0/4255209990 >> v2:172.21.15.176:3300/0 conn(0x7f086015a670 0x7f0860071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:35.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.788+0000 7f085e7fc640 1 --2- 172.21.15.154:0/4255209990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0860071060 0x7f086006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:35.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.788+0000 7f085f7fe640 1 -- 172.21.15.154:0/4255209990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0860071060 msgr2=0x7f086006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:35.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.788+0000 7f085f7fe640 1 --2- 172.21.15.154:0/4255209990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0860071060 0x7f086006d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:35.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.788+0000 7f085f7fe640 1 -- 172.21.15.154:0/4255209990 >> v2:172.21.15.176:3300/0 conn(0x7f086015a670 msgr2=0x7f0860071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:35.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.788+0000 7f085f7fe640 1 --2- 172.21.15.154:0/4255209990 >> v2:172.21.15.176:3300/0 conn(0x7f086015a670 0x7f0860071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:35.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.788+0000 7f085f7fe640 1 -- 172.21.15.154:0/4255209990 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08600b2c80 con 0x7f086006dc10 2024-05-14T01:24:35.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.788+0000 7f085f7fe640 1 --2- 172.21.15.154:0/4255209990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f086006dc10 0x7f08600b3760 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0860063070 tx=0x7f085801daf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2df09407649b85 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:35.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f085dffb640 1 -- 172.21.15.154:0/4255209990 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085800a2d0 con 0x7f086006dc10 2024-05-14T01:24:35.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f085dffb640 1 -- 172.21.15.154:0/4255209990 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08580a6710 con 0x7f086006dc10 2024-05-14T01:24:35.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f085dffb640 1 -- 172.21.15.154:0/4255209990 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08580a6ae0 con 0x7f086006dc10 2024-05-14T01:24:35.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 -- 172.21.15.154:0/4255209990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f086006dc10 msgr2=0x7f08600b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:35.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 --2- 172.21.15.154:0/4255209990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f086006dc10 0x7f08600b3760 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0860063070 tx=0x7f085801daf0 comp rx=0 tx=0).stop 2024-05-14T01:24:35.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 -- 172.21.15.154:0/4255209990 shutdown_connections 2024-05-14T01:24:35.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 --2- 172.21.15.154:0/4255209990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0860071060 0x7f086006d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:35.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 --2- 172.21.15.154:0/4255209990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f086006dc10 0x7f08600b3760 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:35.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 --2- 172.21.15.154:0/4255209990 >> v2:172.21.15.176:3300/0 conn(0x7f086015a670 0x7f0860071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:35.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 -- 172.21.15.154:0/4255209990 >> 172.21.15.154:0/4255209990 conn(0x7f08600b1770 msgr2=0x7f08600b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:35.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 -- 172.21.15.154:0/4255209990 shutdown_connections 2024-05-14T01:24:35.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 -- 172.21.15.154:0/4255209990 wait complete. 2024-05-14T01:24:35.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 Processor -- start 2024-05-14T01:24:35.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 -- start start 2024-05-14T01:24:35.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f086006dc10 0x7f08601f7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:35.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0860071060 0x7f0860156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f086015a670 0x7f08601f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f08600b3eb0 con 0x7f086015a670 2024-05-14T01:24:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0860071650 con 0x7f0860071060 2024-05-14T01:24:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08600b4030 con 0x7f086006dc10 2024-05-14T01:24:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f085f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f086015a670 0x7f08601f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f085f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f086015a670 0x7f08601f7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50918/0 (socket says 172.21.15.154:50918) 2024-05-14T01:24:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f085f7fe640 1 -- 172.21.15.154:0/3128214565 learned_addr learned my addr 172.21.15.154:0/3128214565 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f085e7fc640 1 --2- 172.21.15.154:0/3128214565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0860071060 0x7f0860156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f085effd640 1 --2- 172.21.15.154:0/3128214565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f086006dc10 0x7f08601f7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f085f7fe640 1 -- 172.21.15.154:0/3128214565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f086006dc10 msgr2=0x7f08601f7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f085f7fe640 1 --2- 172.21.15.154:0/3128214565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f086006dc10 0x7f08601f7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f085f7fe640 1 -- 172.21.15.154:0/3128214565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0860071060 msgr2=0x7f0860156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f085f7fe640 1 --2- 172.21.15.154:0/3128214565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0860071060 0x7f0860156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f085f7fe640 1 -- 172.21.15.154:0/3128214565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08601f7cd0 con 0x7f086015a670 2024-05-14T01:24:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f085e7fc640 1 --2- 172.21.15.154:0/3128214565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0860071060 0x7f0860156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:35.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f085f7fe640 1 --2- 172.21.15.154:0/3128214565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f086015a670 0x7f08601f7ed0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f085801c1a0 tx=0x7f085801a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:35.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f08477fe640 1 -- 172.21.15.154:0/3128214565 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0858008500 con 0x7f086015a670 2024-05-14T01:24:35.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f08477fe640 1 -- 172.21.15.154:0/3128214565 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08580bd070 con 0x7f086015a670 2024-05-14T01:24:35.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 -- 172.21.15.154:0/3128214565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f086014f250 con 0x7f086015a670 2024-05-14T01:24:35.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f08477fe640 1 -- 172.21.15.154:0/3128214565 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0858008920 con 0x7f086015a670 2024-05-14T01:24:35.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.792+0000 7f086532e640 1 -- 172.21.15.154:0/3128214565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f086014f810 con 0x7f086015a670 2024-05-14T01:24:35.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.796+0000 7f086532e640 1 -- 172.21.15.154:0/3128214565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0860075470 con 0x7f086015a670 2024-05-14T01:24:35.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.796+0000 7f08477fe640 1 -- 172.21.15.154:0/3128214565 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0858008ac0 con 0x7f086015a670 2024-05-14T01:24:35.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.796+0000 7f08477fe640 1 --2- 172.21.15.154:0/3128214565 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f084c0678c0 0x7f084c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:35.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.796+0000 7f08477fe640 1 -- 172.21.15.154:0/3128214565 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0858121820 con 0x7f086015a670 2024-05-14T01:24:35.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.796+0000 7f085effd640 1 --2- 172.21.15.154:0/3128214565 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f084c0678c0 0x7f084c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:35.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.796+0000 7f085effd640 1 --2- 172.21.15.154:0/3128214565 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f084c0678c0 0x7f084c069d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f085000b930 tx=0x7f0850008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:35.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.800+0000 7f08477fe640 1 -- 172.21.15.154:0/3128214565 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f08601f7cd0 con 0x7f086015a670 2024-05-14T01:24:35.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:35.996+0000 7f086532e640 1 -- 172.21.15.154:0/3128214565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f08600b10d0 con 0x7f086015a670 2024-05-14T01:24:36.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.648+0000 7f08477fe640 1 -- 172.21.15.154:0/3128214565 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f08580176e0 con 0x7f086015a670 2024-05-14T01:24:36.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.652+0000 7f086532e640 1 -- 172.21.15.154:0/3128214565 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f084c0678c0 msgr2=0x7f084c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:36.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.652+0000 7f086532e640 1 --2- 172.21.15.154:0/3128214565 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f084c0678c0 0x7f084c069d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f085000b930 tx=0x7f0850008040 comp rx=0 tx=0).stop 2024-05-14T01:24:36.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.652+0000 7f086532e640 1 -- 172.21.15.154:0/3128214565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f086015a670 msgr2=0x7f08601f7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:36.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.652+0000 7f086532e640 1 --2- 172.21.15.154:0/3128214565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f086015a670 0x7f08601f7ed0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f085801c1a0 tx=0x7f085801a890 comp rx=0 tx=0).stop 2024-05-14T01:24:36.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.652+0000 7f086532e640 1 -- 172.21.15.154:0/3128214565 shutdown_connections 2024-05-14T01:24:36.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.652+0000 7f086532e640 1 --2- 172.21.15.154:0/3128214565 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f084c0678c0 0x7f084c069d80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:36.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.652+0000 7f086532e640 1 --2- 172.21.15.154:0/3128214565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f086015a670 0x7f08601f7ed0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:36.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.652+0000 7f086532e640 1 --2- 172.21.15.154:0/3128214565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0860071060 0x7f0860156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:36.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.652+0000 7f086532e640 1 --2- 172.21.15.154:0/3128214565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f086006dc10 0x7f08601f7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:36.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.652+0000 7f086532e640 1 -- 172.21.15.154:0/3128214565 >> 172.21.15.154:0/3128214565 conn(0x7f08600b1770 msgr2=0x7f0860151b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:36.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.652+0000 7f086532e640 1 -- 172.21.15.154:0/3128214565 shutdown_connections 2024-05-14T01:24:36.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.652+0000 7f086532e640 1 -- 172.21.15.154:0/3128214565 wait complete. 2024-05-14T01:24:36.660 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-14T01:24:36.660 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T01:24:36.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.792+0000 7f84562bb640 1 Processor -- start 2024-05-14T01:24:36.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.796+0000 7f84562bb640 1 -- start start 2024-05-14T01:24:36.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.796+0000 7f84562bb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84500b3530 0x7f845015b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:36.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.796+0000 7f84562bb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f845015b910 0x7f845015c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:36.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.796+0000 7f84562bb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f845015bda0 con 0x7f8450144760 2024-05-14T01:24:36.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.796+0000 7f84562bb640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f845006ed90 con 0x7f845015b910 2024-05-14T01:24:36.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.796+0000 7f84562bb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f84500b4650 con 0x7f84500b3530 2024-05-14T01:24:36.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.796+0000 7f844ffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8450144760 0x7f845006e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39930/0 (socket says 172.21.15.154:39930) 2024-05-14T01:24:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.796+0000 7f844ffff640 1 -- 172.21.15.154:0/541827544 learned_addr learned my addr 172.21.15.154:0/541827544 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.796+0000 7f8454858640 1 --2- 172.21.15.154:0/541827544 >> v2:172.21.15.154:3300/0 conn(0x7f845015b910 0x7f845015c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.796+0000 7f844f7fe640 1 --2- 172.21.15.154:0/541827544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84500b3530 0x7f845015b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.796+0000 7f844effd640 1 -- 172.21.15.154:0/541827544 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2806369765 0 0) 0x7f845015bda0 con 0x7f8450144760 2024-05-14T01:24:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.796+0000 7f844effd640 1 -- 172.21.15.154:0/541827544 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f843c003530 con 0x7f8450144760 2024-05-14T01:24:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.796+0000 7f8454858640 1 -- 172.21.15.154:0/541827544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84500b3530 msgr2=0x7f845015b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.796+0000 7f8454858640 1 --2- 172.21.15.154:0/541827544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84500b3530 0x7f845015b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.796+0000 7f8454858640 1 -- 172.21.15.154:0/541827544 >> v1:172.21.15.154:6789/0 conn(0x7f8450144760 legacy=0x7f845006e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.796+0000 7f844effd640 1 -- 172.21.15.154:0/541827544 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3834196240 0 0) 0x7f843c003530 con 0x7f8450144760 2024-05-14T01:24:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.796+0000 7f8454858640 1 -- 172.21.15.154:0/541827544 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8450144b40 con 0x7f845015b910 2024-05-14T01:24:36.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f8454858640 1 --2- 172.21.15.154:0/541827544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f845015b910 0x7f845015c5e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8440009d90 tx=0x7f844001c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6af95574847a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:36.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f844effd640 1 -- 172.21.15.154:0/541827544 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84400b2070 con 0x7f845015b910 2024-05-14T01:24:36.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f844effd640 1 -- 172.21.15.154:0/541827544 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84400a5660 con 0x7f845015b910 2024-05-14T01:24:36.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f844effd640 1 -- 172.21.15.154:0/541827544 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8448001680 con 0x7f845015b910 2024-05-14T01:24:36.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f84562bb640 1 -- 172.21.15.154:0/541827544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f845015b910 msgr2=0x7f845015c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:36.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f84562bb640 1 --2- 172.21.15.154:0/541827544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f845015b910 0x7f845015c5e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8440009d90 tx=0x7f844001c860 comp rx=0 tx=0).stop 2024-05-14T01:24:36.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f84562bb640 1 -- 172.21.15.154:0/541827544 shutdown_connections 2024-05-14T01:24:36.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f84562bb640 1 --2- 172.21.15.154:0/541827544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f845015b910 0x7f845015c5e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:36.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f84562bb640 1 --2- 172.21.15.154:0/541827544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84500b3530 0x7f845015b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:36.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f84562bb640 1 -- 172.21.15.154:0/541827544 >> 172.21.15.154:0/541827544 conn(0x7f84500b1850 msgr2=0x7f84500b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:36.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f84562bb640 1 -- 172.21.15.154:0/541827544 shutdown_connections 2024-05-14T01:24:36.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f84562bb640 1 -- 172.21.15.154:0/541827544 wait complete. 2024-05-14T01:24:36.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f84562bb640 1 Processor -- start 2024-05-14T01:24:36.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f84562bb640 1 -- start start 2024-05-14T01:24:36.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f84562bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84500b3530 0x7f8450148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:36.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f84562bb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8450144760 0x7f8450165470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:36.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f84562bb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f845015b910 0x7f845006d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:36.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f84562bb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f845015d330 con 0x7f84500b3530 2024-05-14T01:24:36.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f84562bb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84500b42e0 con 0x7f845015b910 2024-05-14T01:24:36.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f84562bb640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f845015d4b0 con 0x7f8450144760 2024-05-14T01:24:36.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f844ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84500b3530 0x7f8450148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:36.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f844ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84500b3530 0x7f8450148230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50944/0 (socket says 172.21.15.154:50944) 2024-05-14T01:24:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f844ffff640 1 -- 172.21.15.154:0/3107522446 learned_addr learned my addr 172.21.15.154:0/3107522446 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f844f7fe640 1 --2- 172.21.15.154:0/3107522446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8450144760 0x7f8450165470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f8454858640 1 --2- 172.21.15.154:0/3107522446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f845015b910 0x7f845006d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f844ffff640 1 -- 172.21.15.154:0/3107522446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8450144760 msgr2=0x7f8450165470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f844ffff640 1 --2- 172.21.15.154:0/3107522446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8450144760 0x7f8450165470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f844ffff640 1 -- 172.21.15.154:0/3107522446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f845015b910 msgr2=0x7f845006d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f844ffff640 1 --2- 172.21.15.154:0/3107522446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f845015b910 0x7f845006d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f844ffff640 1 -- 172.21.15.154:0/3107522446 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84501659b0 con 0x7f84500b3530 2024-05-14T01:24:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f8454858640 1 --2- 172.21.15.154:0/3107522446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f845015b910 0x7f845006d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f844ffff640 1 --2- 172.21.15.154:0/3107522446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84500b3530 0x7f8450148230 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f844800c750 tx=0x7f844800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f844cff9640 1 -- 172.21.15.154:0/3107522446 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8448005ae0 con 0x7f84500b3530 2024-05-14T01:24:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f844cff9640 1 -- 172.21.15.154:0/3107522446 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8448005ca0 con 0x7f84500b3530 2024-05-14T01:24:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f844cff9640 1 -- 172.21.15.154:0/3107522446 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84480072b0 con 0x7f84500b3530 2024-05-14T01:24:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f84562bb640 1 -- 172.21.15.154:0/3107522446 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f845013b610 con 0x7f84500b3530 2024-05-14T01:24:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.800+0000 7f84562bb640 1 -- 172.21.15.154:0/3107522446 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84500cf1f0 con 0x7f84500b3530 2024-05-14T01:24:36.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.804+0000 7f84562bb640 1 -- 172.21.15.154:0/3107522446 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8450075470 con 0x7f84500b3530 2024-05-14T01:24:36.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.804+0000 7f844cff9640 1 -- 172.21.15.154:0/3107522446 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8448007450 con 0x7f84500b3530 2024-05-14T01:24:36.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.804+0000 7f844cff9640 1 --2- 172.21.15.154:0/3107522446 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f84300678f0 0x7f8430069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:36.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.804+0000 7f844cff9640 1 -- 172.21.15.154:0/3107522446 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8448085ae0 con 0x7f84500b3530 2024-05-14T01:24:36.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.804+0000 7f844f7fe640 1 --2- 172.21.15.154:0/3107522446 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f84300678f0 0x7f8430069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:36.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.804+0000 7f844f7fe640 1 --2- 172.21.15.154:0/3107522446 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f84300678f0 0x7f8430069db0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f845013b500 tx=0x7f8438008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:36.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.808+0000 7f844cff9640 1 -- 172.21.15.154:0/3107522446 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f8448010300 con 0x7f84500b3530 2024-05-14T01:24:36.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.988+0000 7f84562bb640 1 -- 172.21.15.154:0/3107522446 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f845015c220 con 0x7f84500b3530 2024-05-14T01:24:36.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.992+0000 7f844cff9640 1 -- 172.21.15.154:0/3107522446 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5190 (secure 0 0 0) 0x7f84480566b0 con 0x7f84500b3530 2024-05-14T01:24:36.979 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:36.979 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3153095738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3153095738},{"type":"v1","addr":"172.21.15.176:6835","nonce":3153095738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1660216913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":1660216913},{"type":"v1","addr":"172.21.15.176:6834","nonce":1660216913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1431439777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1431439777},{"type":"v1","addr":"172.21.15.154:6837","nonce":1431439777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T01:24:32.952086+0000","modified":"2024-05-14T01:24:36.000491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5124":{"gid":5124,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6836/848393842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":848393842},{"type":"v1","addr":"172.21.15.154:6836","nonce":848393842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5124,"qdb_cluster":[5124]},"id":2}]} 2024-05-14T01:24:36.980 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 17 2024-05-14T01:24:36.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.992+0000 7f84562bb640 1 -- 172.21.15.154:0/3107522446 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f84300678f0 msgr2=0x7f8430069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:36.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.992+0000 7f84562bb640 1 --2- 172.21.15.154:0/3107522446 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f84300678f0 0x7f8430069db0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f845013b500 tx=0x7f8438008040 comp rx=0 tx=0).stop 2024-05-14T01:24:36.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.992+0000 7f84562bb640 1 -- 172.21.15.154:0/3107522446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84500b3530 msgr2=0x7f8450148230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:36.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.992+0000 7f84562bb640 1 --2- 172.21.15.154:0/3107522446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84500b3530 0x7f8450148230 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f844800c750 tx=0x7f844800cc10 comp rx=0 tx=0).stop 2024-05-14T01:24:36.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.992+0000 7f84562bb640 1 -- 172.21.15.154:0/3107522446 shutdown_connections 2024-05-14T01:24:36.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.992+0000 7f84562bb640 1 --2- 172.21.15.154:0/3107522446 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f84300678f0 0x7f8430069db0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:36.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.992+0000 7f84562bb640 1 --2- 172.21.15.154:0/3107522446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f845015b910 0x7f845006d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:36.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.992+0000 7f84562bb640 1 --2- 172.21.15.154:0/3107522446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8450144760 0x7f8450165470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:36.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.992+0000 7f84562bb640 1 --2- 172.21.15.154:0/3107522446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84500b3530 0x7f8450148230 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:36.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.992+0000 7f84562bb640 1 -- 172.21.15.154:0/3107522446 >> 172.21.15.154:0/3107522446 conn(0x7f84500b1850 msgr2=0x7f845013ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:36.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.992+0000 7f84562bb640 1 -- 172.21.15.154:0/3107522446 shutdown_connections 2024-05-14T01:24:36.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:36.992+0000 7f84562bb640 1 -- 172.21.15.154:0/3107522446 wait complete. 2024-05-14T01:24:36.996 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T01:24:37.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.112+0000 7f2f60c22640 1 Processor -- start 2024-05-14T01:24:37.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.112+0000 7f2f60c22640 1 -- start start 2024-05-14T01:24:37.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f60c22640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2f5c070e60 0x7f2f5c0b3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f60c22640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f5c0b4820 0x7f2f5c06d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f60c22640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5c0b3e40 con 0x7f2f5c071240 2024-05-14T01:24:37.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f60c22640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2f5c0b2d60 con 0x7f2f5c070e60 2024-05-14T01:24:37.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f60c22640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2f5c0ae1b0 con 0x7f2f5c0b4820 2024-05-14T01:24:37.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5ad9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2f5c071240 0x7f2f5c0716d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39932/0 (socket says 172.21.15.154:39932) 2024-05-14T01:24:37.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5ad9d640 1 -- 172.21.15.154:0/1733083100 learned_addr learned my addr 172.21.15.154:0/1733083100 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:37.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5a59c640 1 --2- 172.21.15.154:0/1733083100 >> v2:172.21.15.176:3300/0 conn(0x7f2f5c070e60 0x7f2f5c0b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f59d9b640 1 --2- 172.21.15.154:0/1733083100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f5c0b4820 0x7f2f5c06d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5959a640 1 -- 172.21.15.154:0/1733083100 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2294530955 0 0) 0x7f2f5c0b3e40 con 0x7f2f5c071240 2024-05-14T01:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5959a640 1 -- 172.21.15.154:0/1733083100 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f44003530 con 0x7f2f5c071240 2024-05-14T01:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5959a640 1 -- 172.21.15.154:0/1733083100 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2491891429 0 0) 0x7f2f44003530 con 0x7f2f5c071240 2024-05-14T01:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5959a640 1 -- 172.21.15.154:0/1733083100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f5c0b4820 msgr2=0x7f2f5c06d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5959a640 1 --2- 172.21.15.154:0/1733083100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f5c0b4820 0x7f2f5c06d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5959a640 1 -- 172.21.15.154:0/1733083100 >> v2:172.21.15.176:3300/0 conn(0x7f2f5c070e60 msgr2=0x7f2f5c0b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5959a640 1 --2- 172.21.15.154:0/1733083100 >> v2:172.21.15.176:3300/0 conn(0x7f2f5c070e60 0x7f2f5c0b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5959a640 1 -- 172.21.15.154:0/1733083100 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c0b4110 con 0x7f2f5c071240 2024-05-14T01:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5959a640 1 -- 172.21.15.154:0/1733083100 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f2f54001a00 con 0x7f2f5c071240 2024-05-14T01:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5959a640 1 -- 172.21.15.154:0/1733083100 >> v1:172.21.15.154:6789/0 conn(0x7f2f5c071240 legacy=0x7f2f5c0716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5959a640 1 --2- 172.21.15.154:0/1733083100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f440039c0 0x7f2f44003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5959a640 1 --2- 172.21.15.154:0/1733083100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f5c0b4820 0x7f2f44004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5959a640 1 --2- 172.21.15.154:0/1733083100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f44004d50 0x7f2f440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5959a640 1 -- 172.21.15.154:0/1733083100 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c0ae1b0 con 0x7f2f44004d50 2024-05-14T01:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5959a640 1 -- 172.21.15.154:0/1733083100 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4400b9d0 con 0x7f2f440039c0 2024-05-14T01:24:37.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5959a640 1 -- 172.21.15.154:0/1733083100 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2f4400bb50 con 0x7f2f5c0b4820 2024-05-14T01:24:37.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5ad9d640 1 --2- 172.21.15.154:0/1733083100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f44004d50 0x7f2f440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f59d9b640 1 --2- 172.21.15.154:0/1733083100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f5c0b4820 0x7f2f44004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5ad9d640 1 -- 172.21.15.154:0/1733083100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f5c0b4820 msgr2=0x7f2f44004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:37.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5a59c640 1 --2- 172.21.15.154:0/1733083100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f440039c0 0x7f2f44003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5ad9d640 1 --2- 172.21.15.154:0/1733083100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f5c0b4820 0x7f2f44004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5ad9d640 1 -- 172.21.15.154:0/1733083100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f440039c0 msgr2=0x7f2f44003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:37.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5ad9d640 1 --2- 172.21.15.154:0/1733083100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f440039c0 0x7f2f44003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.116+0000 7f2f5ad9d640 1 -- 172.21.15.154:0/1733083100 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f44003530 con 0x7f2f44004d50 2024-05-14T01:24:37.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f5ad9d640 1 --2- 172.21.15.154:0/1733083100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f44004d50 0x7f2f440051d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2f540013e0 tx=0x7f2f5401d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b7a97b40d4af66 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:37.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f5959a640 1 -- 172.21.15.154:0/1733083100 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400a4e0 con 0x7f2f44004d50 2024-05-14T01:24:37.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f5959a640 1 -- 172.21.15.154:0/1733083100 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f540072f0 con 0x7f2f44004d50 2024-05-14T01:24:37.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f5959a640 1 -- 172.21.15.154:0/1733083100 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f540076e0 con 0x7f2f44004d50 2024-05-14T01:24:37.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f60c22640 1 -- 172.21.15.154:0/1733083100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f44004d50 msgr2=0x7f2f440051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f60c22640 1 --2- 172.21.15.154:0/1733083100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f44004d50 0x7f2f440051d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2f540013e0 tx=0x7f2f5401d3a0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f5ad9d640 1 -- 172.21.15.154:0/1733083100 reap_dead start 2024-05-14T01:24:37.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f60c22640 1 -- 172.21.15.154:0/1733083100 shutdown_connections 2024-05-14T01:24:37.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f60c22640 1 -- 172.21.15.154:0/1733083100 >> 172.21.15.154:0/1733083100 conn(0x7f2f5c0b1850 msgr2=0x7f2f5c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:37.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f60c22640 1 -- 172.21.15.154:0/1733083100 shutdown_connections 2024-05-14T01:24:37.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f60c22640 1 -- 172.21.15.154:0/1733083100 wait complete. 2024-05-14T01:24:37.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f60c22640 1 Processor -- start 2024-05-14T01:24:37.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f60c22640 1 -- start start 2024-05-14T01:24:37.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f60c22640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f44004d50 0x7f2f5c155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f60c22640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f5c14a710 0x7f2f5c15c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f60c22640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f5c158880 0x7f2f5c158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f60c22640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c0ade40 con 0x7f2f44004d50 2024-05-14T01:24:37.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f60c22640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c0adb60 con 0x7f2f5c158880 2024-05-14T01:24:37.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f60c22640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2f5c06d170 con 0x7f2f5c14a710 2024-05-14T01:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f5a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f44004d50 0x7f2f5c155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f5a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f44004d50 0x7f2f5c155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50960/0 (socket says 172.21.15.154:50960) 2024-05-14T01:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f5a59c640 1 -- 172.21.15.154:0/3290543250 learned_addr learned my addr 172.21.15.154:0/3290543250 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f5ad9d640 1 --2- 172.21.15.154:0/3290543250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f5c158880 0x7f2f5c158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f59d9b640 1 --2- 172.21.15.154:0/3290543250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f5c14a710 0x7f2f5c15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f5a59c640 1 -- 172.21.15.154:0/3290543250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f5c14a710 msgr2=0x7f2f5c15c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f5a59c640 1 --2- 172.21.15.154:0/3290543250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f5c14a710 0x7f2f5c15c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f5a59c640 1 -- 172.21.15.154:0/3290543250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f5c158880 msgr2=0x7f2f5c158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f5a59c640 1 --2- 172.21.15.154:0/3290543250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f5c158880 0x7f2f5c158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f5a59c640 1 -- 172.21.15.154:0/3290543250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c1561c0 con 0x7f2f44004d50 2024-05-14T01:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.120+0000 7f2f5a59c640 1 --2- 172.21.15.154:0/3290543250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f44004d50 0x7f2f5c155be0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2f500108c0 tx=0x7f2f50010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.124+0000 7f2f4affd640 1 -- 172.21.15.154:0/3290543250 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5000f040 con 0x7f2f44004d50 2024-05-14T01:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.124+0000 7f2f4affd640 1 -- 172.21.15.154:0/3290543250 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f5000eb60 con 0x7f2f44004d50 2024-05-14T01:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.124+0000 7f2f4affd640 1 -- 172.21.15.154:0/3290543250 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5001c400 con 0x7f2f44004d50 2024-05-14T01:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.124+0000 7f2f60c22640 1 -- 172.21.15.154:0/3290543250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5c1564a0 con 0x7f2f44004d50 2024-05-14T01:24:37.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.124+0000 7f2f60c22640 1 -- 172.21.15.154:0/3290543250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5c156a60 con 0x7f2f44004d50 2024-05-14T01:24:37.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.124+0000 7f2f60c22640 1 -- 172.21.15.154:0/3290543250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f5c075470 con 0x7f2f44004d50 2024-05-14T01:24:37.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.124+0000 7f2f4affd640 1 -- 172.21.15.154:0/3290543250 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2f5001c5a0 con 0x7f2f44004d50 2024-05-14T01:24:37.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.124+0000 7f2f4affd640 1 --2- 172.21.15.154:0/3290543250 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2f3c0678f0 0x7f2f3c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.124+0000 7f2f59d9b640 1 --2- 172.21.15.154:0/3290543250 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2f3c0678f0 0x7f2f3c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.124+0000 7f2f4affd640 1 -- 172.21.15.154:0/3290543250 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2f50086240 con 0x7f2f44004d50 2024-05-14T01:24:37.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.124+0000 7f2f59d9b640 1 --2- 172.21.15.154:0/3290543250 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2f3c0678f0 0x7f2f3c069db0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0b3d90 tx=0x7f2f4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:37.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.128+0000 7f2f4affd640 1 -- 172.21.15.154:0/3290543250 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f2f50018030 con 0x7f2f44004d50 2024-05-14T01:24:37.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.284+0000 7f2f60c22640 1 -- 172.21.15.154:0/3290543250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2f5c1598c0 con 0x7f2f44004d50 2024-05-14T01:24:37.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.288+0000 7f2f4affd640 1 -- 172.21.15.154:0/3290543250 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16717 (secure 0 0 0) 0x7f2f500566a0 con 0x7f2f44004d50 2024-05-14T01:24:37.275 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:37.275 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":34,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:24:34.630046+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:24:31.391789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-14T01:24:31.927579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T01:24:37.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.288+0000 7f2f60c22640 1 -- 172.21.15.154:0/3290543250 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2f3c0678f0 msgr2=0x7f2f3c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.288+0000 7f2f60c22640 1 --2- 172.21.15.154:0/3290543250 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2f3c0678f0 0x7f2f3c069db0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0b3d90 tx=0x7f2f4c008040 comp rx=0 tx=0).stop 2024-05-14T01:24:37.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.288+0000 7f2f60c22640 1 -- 172.21.15.154:0/3290543250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f44004d50 msgr2=0x7f2f5c155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.288+0000 7f2f60c22640 1 --2- 172.21.15.154:0/3290543250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f44004d50 0x7f2f5c155be0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2f500108c0 tx=0x7f2f50010d80 comp rx=0 tx=0).stop 2024-05-14T01:24:37.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.288+0000 7f2f60c22640 1 -- 172.21.15.154:0/3290543250 shutdown_connections 2024-05-14T01:24:37.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.288+0000 7f2f60c22640 1 --2- 172.21.15.154:0/3290543250 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2f3c0678f0 0x7f2f3c069db0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.288+0000 7f2f60c22640 1 --2- 172.21.15.154:0/3290543250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f5c158880 0x7f2f5c158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.288+0000 7f2f60c22640 1 --2- 172.21.15.154:0/3290543250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f5c14a710 0x7f2f5c15c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.288+0000 7f2f60c22640 1 --2- 172.21.15.154:0/3290543250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f44004d50 0x7f2f5c155be0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.288+0000 7f2f60c22640 1 -- 172.21.15.154:0/3290543250 >> 172.21.15.154:0/3290543250 conn(0x7f2f5c0b1850 msgr2=0x7f2f5c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:37.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.288+0000 7f2f60c22640 1 -- 172.21.15.154:0/3290543250 shutdown_connections 2024-05-14T01:24:37.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.288+0000 7f2f60c22640 1 -- 172.21.15.154:0/3290543250 wait complete. 2024-05-14T01:24:37.293 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-14T01:24:37.294 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T01:24:37.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.424+0000 7fa33a95f640 1 Processor -- start 2024-05-14T01:24:37.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.424+0000 7fa33a95f640 1 -- start start 2024-05-14T01:24:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.424+0000 7fa33a95f640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa3340b4820 0x7fa33406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.424+0000 7fa33a95f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa334071240 0x7fa3340716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.424+0000 7fa33a95f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3340b4110 con 0x7fa334070e60 2024-05-14T01:24:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.424+0000 7fa33a95f640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa3340b2d60 con 0x7fa3340b4820 2024-05-14T01:24:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.424+0000 7fa33a95f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa3340ae1b0 con 0x7fa334071240 2024-05-14T01:24:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.424+0000 7fa333fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa334070e60 0x7fa3340b3900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37602/0 (socket says 172.21.15.154:37602) 2024-05-14T01:24:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.424+0000 7fa333fff640 1 -- 172.21.15.154:0/1709615979 learned_addr learned my addr 172.21.15.154:0/1709615979 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa3337fe640 1 --2- 172.21.15.154:0/1709615979 >> v2:172.21.15.176:3300/0 conn(0x7fa3340b4820 0x7fa33406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa338efc640 1 --2- 172.21.15.154:0/1709615979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa334071240 0x7fa3340716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 -- 172.21.15.154:0/1709615979 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2201418212 0 0) 0x7fa3340b4110 con 0x7fa334070e60 2024-05-14T01:24:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 -- 172.21.15.154:0/1709615979 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa31c003530 con 0x7fa334070e60 2024-05-14T01:24:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 -- 172.21.15.154:0/1709615979 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1318747692 0 0) 0x7fa31c003530 con 0x7fa334070e60 2024-05-14T01:24:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 -- 172.21.15.154:0/1709615979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa334071240 msgr2=0x7fa3340716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 --2- 172.21.15.154:0/1709615979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa334071240 0x7fa3340716d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 -- 172.21.15.154:0/1709615979 >> v2:172.21.15.176:3300/0 conn(0x7fa3340b4820 msgr2=0x7fa33406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 --2- 172.21.15.154:0/1709615979 >> v2:172.21.15.176:3300/0 conn(0x7fa3340b4820 0x7fa33406d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 -- 172.21.15.154:0/1709615979 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3340ad880 con 0x7fa334070e60 2024-05-14T01:24:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 -- 172.21.15.154:0/1709615979 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fa324001a00 con 0x7fa334070e60 2024-05-14T01:24:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 -- 172.21.15.154:0/1709615979 >> v1:172.21.15.154:6789/0 conn(0x7fa334070e60 legacy=0x7fa3340b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 --2- 172.21.15.154:0/1709615979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa31c0039c0 0x7fa31c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 --2- 172.21.15.154:0/1709615979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa334071240 0x7fa31c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 --2- 172.21.15.154:0/1709615979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31c004d50 0x7fa31c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 -- 172.21.15.154:0/1709615979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa3340ae1b0 con 0x7fa31c0039c0 2024-05-14T01:24:37.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 -- 172.21.15.154:0/1709615979 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c00b9d0 con 0x7fa31c004d50 2024-05-14T01:24:37.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 -- 172.21.15.154:0/1709615979 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa31c00bb50 con 0x7fa334071240 2024-05-14T01:24:37.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa333fff640 1 --2- 172.21.15.154:0/1709615979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa31c0039c0 0x7fa31c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa3337fe640 1 --2- 172.21.15.154:0/1709615979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa334071240 0x7fa31c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa338efc640 1 --2- 172.21.15.154:0/1709615979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31c004d50 0x7fa31c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa333fff640 1 -- 172.21.15.154:0/1709615979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa334071240 msgr2=0x7fa31c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:37.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa333fff640 1 --2- 172.21.15.154:0/1709615979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa334071240 0x7fa31c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa333fff640 1 -- 172.21.15.154:0/1709615979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31c004d50 msgr2=0x7fa31c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:37.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa333fff640 1 --2- 172.21.15.154:0/1709615979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31c004d50 0x7fa31c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa333fff640 1 -- 172.21.15.154:0/1709615979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa31c003530 con 0x7fa31c0039c0 2024-05-14T01:24:37.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa333fff640 1 --2- 172.21.15.154:0/1709615979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa31c0039c0 0x7fa31c003de0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa3240013e0 tx=0x7fa32401fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b0953601681849 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 -- 172.21.15.154:0/1709615979 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32400a4e0 con 0x7fa31c0039c0 2024-05-14T01:24:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 -- 172.21.15.154:0/1709615979 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3240ad020 con 0x7fa31c0039c0 2024-05-14T01:24:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa332ffd640 1 -- 172.21.15.154:0/1709615979 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3240a9740 con 0x7fa31c0039c0 2024-05-14T01:24:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa33a95f640 1 -- 172.21.15.154:0/1709615979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa31c0039c0 msgr2=0x7fa31c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa33a95f640 1 --2- 172.21.15.154:0/1709615979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa31c0039c0 0x7fa31c003de0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa3240013e0 tx=0x7fa32401fb00 comp rx=0 tx=0).stop 2024-05-14T01:24:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa338efc640 1 -- 172.21.15.154:0/1709615979 reap_dead start 2024-05-14T01:24:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa33a95f640 1 -- 172.21.15.154:0/1709615979 shutdown_connections 2024-05-14T01:24:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.428+0000 7fa33a95f640 1 -- 172.21.15.154:0/1709615979 >> 172.21.15.154:0/1709615979 conn(0x7fa3340b1850 msgr2=0x7fa3340b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa33a95f640 1 -- 172.21.15.154:0/1709615979 shutdown_connections 2024-05-14T01:24:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa33a95f640 1 -- 172.21.15.154:0/1709615979 wait complete. 2024-05-14T01:24:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa33a95f640 1 Processor -- start 2024-05-14T01:24:37.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa33a95f640 1 -- start start 2024-05-14T01:24:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa33a95f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31c0039c0 0x7fa334151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa33a95f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa334150c70 0x7fa3341f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa33a95f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3341f4230 0x7fa3341f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa33a95f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa33406d6b0 con 0x7fa334150c70 2024-05-14T01:24:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa33a95f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa3340ade40 con 0x7fa31c0039c0 2024-05-14T01:24:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa33a95f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa3340716d0 con 0x7fa3341f4230 2024-05-14T01:24:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa3337fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa334150c70 0x7fa3341f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa3337fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa334150c70 0x7fa3341f3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42712/0 (socket says 172.21.15.154:42712) 2024-05-14T01:24:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa3337fe640 1 -- 172.21.15.154:0/709557837 learned_addr learned my addr 172.21.15.154:0/709557837 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa333fff640 1 --2- 172.21.15.154:0/709557837 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31c0039c0 0x7fa334151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa338efc640 1 --2- 172.21.15.154:0/709557837 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3341f4230 0x7fa3341f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa3337fe640 1 -- 172.21.15.154:0/709557837 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3341f4230 msgr2=0x7fa3341f46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa3337fe640 1 --2- 172.21.15.154:0/709557837 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3341f4230 0x7fa3341f46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa3337fe640 1 -- 172.21.15.154:0/709557837 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31c0039c0 msgr2=0x7fa334151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa3337fe640 1 --2- 172.21.15.154:0/709557837 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31c0039c0 0x7fa334151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa3337fe640 1 -- 172.21.15.154:0/709557837 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3341f4f70 con 0x7fa334150c70 2024-05-14T01:24:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa338efc640 1 --2- 172.21.15.154:0/709557837 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3341f4230 0x7fa3341f46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa333fff640 1 --2- 172.21.15.154:0/709557837 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31c0039c0 0x7fa334151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa3337fe640 1 --2- 172.21.15.154:0/709557837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa334150c70 0x7fa3341f3cf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa328011660 tx=0x7fa328011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa330ff9640 1 -- 172.21.15.154:0/709557837 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32800f960 con 0x7fa334150c70 2024-05-14T01:24:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa330ff9640 1 -- 172.21.15.154:0/709557837 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa32800fb00 con 0x7fa334150c70 2024-05-14T01:24:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa33a95f640 1 -- 172.21.15.154:0/709557837 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3341f5250 con 0x7fa334150c70 2024-05-14T01:24:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa330ff9640 1 -- 172.21.15.154:0/709557837 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa328015460 con 0x7fa334150c70 2024-05-14T01:24:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa33a95f640 1 -- 172.21.15.154:0/709557837 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3341f5810 con 0x7fa334150c70 2024-05-14T01:24:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.432+0000 7fa33a95f640 1 -- 172.21.15.154:0/709557837 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa334075470 con 0x7fa334150c70 2024-05-14T01:24:37.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.436+0000 7fa330ff9640 1 -- 172.21.15.154:0/709557837 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa328015600 con 0x7fa334150c70 2024-05-14T01:24:37.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.436+0000 7fa330ff9640 1 --2- 172.21.15.154:0/709557837 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa3200678c0 0x7fa320069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.436+0000 7fa330ff9640 1 -- 172.21.15.154:0/709557837 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa328086570 con 0x7fa334150c70 2024-05-14T01:24:37.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.436+0000 7fa333fff640 1 --2- 172.21.15.154:0/709557837 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa3200678c0 0x7fa320069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.436+0000 7fa333fff640 1 --2- 172.21.15.154:0/709557837 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa3200678c0 0x7fa320069d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa3240ae000 tx=0x7fa324001dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:37.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.440+0000 7fa330ff9640 1 -- 172.21.15.154:0/709557837 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fa328019030 con 0x7fa334150c70 2024-05-14T01:24:37.538 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-05-14T01:24:37.548+0000 7fc435c3e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-14T01:24:37.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.596+0000 7fa33a95f640 1 -- 172.21.15.154:0/709557837 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa3341523b0 con 0x7fa3200678c0 2024-05-14T01:24:37.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.608+0000 7fa330ff9640 1 -- 172.21.15.154:0/709557837 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245505 (secure 0 0 0) 0x7fa3341523b0 con 0x7fa3200678c0 2024-05-14T01:24:37.598 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:37.599 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-05-14T01:24:37.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.612+0000 7fa33a95f640 1 -- 172.21.15.154:0/709557837 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa3200678c0 msgr2=0x7fa320069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.612+0000 7fa33a95f640 1 --2- 172.21.15.154:0/709557837 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa3200678c0 0x7fa320069d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa3240ae000 tx=0x7fa324001dd0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.612+0000 7fa33a95f640 1 -- 172.21.15.154:0/709557837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa334150c70 msgr2=0x7fa3341f3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.612+0000 7fa33a95f640 1 --2- 172.21.15.154:0/709557837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa334150c70 0x7fa3341f3cf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa328011660 tx=0x7fa328011b20 comp rx=0 tx=0).stop 2024-05-14T01:24:37.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.612+0000 7fa33a95f640 1 -- 172.21.15.154:0/709557837 shutdown_connections 2024-05-14T01:24:37.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.612+0000 7fa33a95f640 1 --2- 172.21.15.154:0/709557837 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa3200678c0 0x7fa320069d80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.612+0000 7fa33a95f640 1 --2- 172.21.15.154:0/709557837 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3341f4230 0x7fa3341f46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.612+0000 7fa33a95f640 1 --2- 172.21.15.154:0/709557837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa334150c70 0x7fa3341f3cf0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.612+0000 7fa33a95f640 1 --2- 172.21.15.154:0/709557837 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa31c0039c0 0x7fa334151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.612+0000 7fa33a95f640 1 -- 172.21.15.154:0/709557837 >> 172.21.15.154:0/709557837 conn(0x7fa3340b1850 msgr2=0x7fa3340b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:37.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.612+0000 7fa33a95f640 1 -- 172.21.15.154:0/709557837 shutdown_connections 2024-05-14T01:24:37.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.612+0000 7fa33a95f640 1 -- 172.21.15.154:0/709557837 wait complete. 2024-05-14T01:24:37.616 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-05-14T01:24:37.120073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224252,"kb_used_data":3928,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750468,"statfs":{"total":773094113280,"available":772864479232,"internally_reserved":0,"allocated":4022272,"data_stored":2262724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.544414"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587167+0000","last_change":"2024-05-14T01:24:32.587167+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587167+0000","last_undegraded":"2024-05-14T01:24:32.587167+0000","last_fullsized":"2024-05-14T01:24:32.587167+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.599284+0000","last_change":"2024-05-14T01:24:32.599284+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.599284+0000","last_undegraded":"2024-05-14T01:24:32.599284+0000","last_fullsized":"2024-05-14T01:24:32.599284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.604151+0000","last_change":"2024-05-14T01:24:32.604151+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.604151+0000","last_undegraded":"2024-05-14T01:24:32.604151+0000","last_fullsized":"2024-05-14T01:24:32.604151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.594638+0000","last_change":"2024-05-14T01:24:32.594638+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.594638+0000","last_undegraded":"2024-05-14T01:24:32.594638+0000","last_fullsized":"2024-05-14T01:24:32.594638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.604163+0000","last_change":"2024-05-14T01:24:32.604163+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.604163+0000","last_undegraded":"2024-05-14T01:24:32.604163+0000","last_fullsized":"2024-05-14T01:24:32.604163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.619361+0000","last_change":"2024-05-14T01:24:32.619361+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.619361+0000","last_undegraded":"2024-05-14T01:24:32.619361+0000","last_fullsized":"2024-05-14T01:24:32.619361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.594896+0000","last_change":"2024-05-14T01:24:32.594896+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.594896+0000","last_undegraded":"2024-05-14T01:24:32.594896+0000","last_fullsized":"2024-05-14T01:24:32.594896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603481+0000","last_change":"2024-05-14T01:24:32.603481+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603481+0000","last_undegraded":"2024-05-14T01:24:32.603481+0000","last_fullsized":"2024-05-14T01:24:32.603481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603829+0000","last_change":"2024-05-14T01:24:32.603829+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603829+0000","last_undegraded":"2024-05-14T01:24:32.603829+0000","last_fullsized":"2024-05-14T01:24:32.603829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.599753+0000","last_change":"2024-05-14T01:24:32.599753+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.599753+0000","last_undegraded":"2024-05-14T01:24:32.599753+0000","last_fullsized":"2024-05-14T01:24:32.599753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.594055+0000","last_change":"2024-05-14T01:24:32.594055+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.594055+0000","last_undegraded":"2024-05-14T01:24:32.594055+0000","last_fullsized":"2024-05-14T01:24:32.594055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.597522+0000","last_change":"2024-05-14T01:24:32.597522+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.597522+0000","last_undegraded":"2024-05-14T01:24:32.597522+0000","last_fullsized":"2024-05-14T01:24:32.597522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.601904+0000","last_change":"2024-05-14T01:24:32.601904+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.601904+0000","last_undegraded":"2024-05-14T01:24:32.601904+0000","last_fullsized":"2024-05-14T01:24:32.601904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.610800+0000","last_change":"2024-05-14T01:24:32.610800+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.610800+0000","last_undegraded":"2024-05-14T01:24:32.610800+0000","last_fullsized":"2024-05-14T01:24:32.610800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.593038+0000","last_change":"2024-05-14T01:24:32.593038+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.593038+0000","last_undegraded":"2024-05-14T01:24:32.593038+0000","last_fullsized":"2024-05-14T01:24:32.593038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.595452+0000","last_change":"2024-05-14T01:24:32.595452+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.595452+0000","last_undegraded":"2024-05-14T01:24:32.595452+0000","last_fullsized":"2024-05-14T01:24:32.595452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587363+0000","last_change":"2024-05-14T01:24:32.587363+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587363+0000","last_undegraded":"2024-05-14T01:24:32.587363+0000","last_fullsized":"2024-05-14T01:24:32.587363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587693+0000","last_change":"2024-05-14T01:24:32.587693+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587693+0000","last_undegraded":"2024-05-14T01:24:32.587693+0000","last_fullsized":"2024-05-14T01:24:32.587693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.595864+0000","last_change":"2024-05-14T01:24:32.595864+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.595864+0000","last_undegraded":"2024-05-14T01:24:32.595864+0000","last_fullsized":"2024-05-14T01:24:32.595864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.605029+0000","last_change":"2024-05-14T01:24:32.605029+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.605029+0000","last_undegraded":"2024-05-14T01:24:32.605029+0000","last_fullsized":"2024-05-14T01:24:32.605029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.604559+0000","last_change":"2024-05-14T01:24:32.604559+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.604559+0000","last_undegraded":"2024-05-14T01:24:32.604559+0000","last_fullsized":"2024-05-14T01:24:32.604559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.598735+0000","last_change":"2024-05-14T01:24:32.598735+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.598735+0000","last_undegraded":"2024-05-14T01:24:32.598735+0000","last_fullsized":"2024-05-14T01:24:32.598735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587360+0000","last_change":"2024-05-14T01:24:32.587360+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587360+0000","last_undegraded":"2024-05-14T01:24:32.587360+0000","last_fullsized":"2024-05-14T01:24:32.587360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.611370+0000","last_change":"2024-05-14T01:24:32.611370+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.611370+0000","last_undegraded":"2024-05-14T01:24:32.611370+0000","last_fullsized":"2024-05-14T01:24:32.611370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.585963+0000","last_change":"2024-05-14T01:24:32.585963+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.585963+0000","last_undegraded":"2024-05-14T01:24:32.585963+0000","last_fullsized":"2024-05-14T01:24:32.585963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.616332+0000","last_change":"2024-05-14T01:24:32.616332+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.616332+0000","last_undegraded":"2024-05-14T01:24:32.616332+0000","last_fullsized":"2024-05-14T01:24:32.616332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.589008+0000","last_change":"2024-05-14T01:24:32.589008+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.589008+0000","last_undegraded":"2024-05-14T01:24:32.589008+0000","last_fullsized":"2024-05-14T01:24:32.589008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.624605+0000","last_change":"2024-05-14T01:24:32.621045+0000","last_active":"2024-05-14T01:24:32.624605+0000","last_peered":"2024-05-14T01:24:32.624605+0000","last_clean":"2024-05-14T01:24:32.624605+0000","last_became_active":"2024-05-14T01:24:32.620438+0000","last_became_peered":"2024-05-14T01:24:32.620438+0000","last_unstale":"2024-05-14T01:24:32.624605+0000","last_undegraded":"2024-05-14T01:24:32.624605+0000","last_fullsized":"2024-05-14T01:24:32.624605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:35:30.482169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.586055+0000","last_change":"2024-05-14T01:24:32.586055+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.586055+0000","last_undegraded":"2024-05-14T01:24:32.586055+0000","last_fullsized":"2024-05-14T01:24:32.586055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.619340+0000","last_change":"2024-05-14T01:24:32.617319+0000","last_active":"2024-05-14T01:24:32.619340+0000","last_peered":"2024-05-14T01:24:32.619340+0000","last_clean":"2024-05-14T01:24:32.619340+0000","last_became_active":"2024-05-14T01:24:32.616699+0000","last_became_peered":"2024-05-14T01:24:32.616699+0000","last_unstale":"2024-05-14T01:24:32.619340+0000","last_undegraded":"2024-05-14T01:24:32.619340+0000","last_fullsized":"2024-05-14T01:24:32.619340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:30:59.119076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587346+0000","last_change":"2024-05-14T01:24:32.587346+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587346+0000","last_undegraded":"2024-05-14T01:24:32.587346+0000","last_fullsized":"2024-05-14T01:24:32.587346+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.583945+0000","last_change":"2024-05-14T01:24:31.583945+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.583945+0000","last_undegraded":"2024-05-14T01:24:31.583945+0000","last_fullsized":"2024-05-14T01:24:31.583945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.604027+0000","last_change":"2024-05-14T01:24:32.604027+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.604027+0000","last_undegraded":"2024-05-14T01:24:32.604027+0000","last_fullsized":"2024-05-14T01:24:32.604027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.602753+0000","last_change":"2024-05-14T01:24:32.599149+0000","last_active":"2024-05-14T01:24:32.602753+0000","last_peered":"2024-05-14T01:24:32.602753+0000","last_clean":"2024-05-14T01:24:32.602753+0000","last_became_active":"2024-05-14T01:24:32.598789+0000","last_became_peered":"2024-05-14T01:24:32.598789+0000","last_unstale":"2024-05-14T01:24:32.602753+0000","last_undegraded":"2024-05-14T01:24:32.602753+0000","last_fullsized":"2024-05-14T01:24:32.602753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:22:32.117284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603914+0000","last_change":"2024-05-14T01:24:32.603914+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603914+0000","last_undegraded":"2024-05-14T01:24:32.603914+0000","last_fullsized":"2024-05-14T01:24:32.603914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.607889+0000","last_change":"2024-05-14T01:24:32.605488+0000","last_active":"2024-05-14T01:24:32.607889+0000","last_peered":"2024-05-14T01:24:32.607889+0000","last_clean":"2024-05-14T01:24:32.607889+0000","last_became_active":"2024-05-14T01:24:32.604323+0000","last_became_peered":"2024-05-14T01:24:32.604323+0000","last_unstale":"2024-05-14T01:24:32.607889+0000","last_undegraded":"2024-05-14T01:24:32.607889+0000","last_fullsized":"2024-05-14T01:24:32.607889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:28:05.246816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.607441+0000","last_change":"2024-05-14T01:24:32.607441+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.607441+0000","last_undegraded":"2024-05-14T01:24:32.607441+0000","last_fullsized":"2024-05-14T01:24:32.607441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.613164+0000","last_change":"2024-05-14T01:24:32.607898+0000","last_active":"2024-05-14T01:24:32.613164+0000","last_peered":"2024-05-14T01:24:32.613164+0000","last_clean":"2024-05-14T01:24:32.613164+0000","last_became_active":"2024-05-14T01:24:32.606398+0000","last_became_peered":"2024-05-14T01:24:32.606398+0000","last_unstale":"2024-05-14T01:24:32.613164+0000","last_undegraded":"2024-05-14T01:24:32.613164+0000","last_fullsized":"2024-05-14T01:24:32.613164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:22:32.117284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.592132+0000","last_change":"2024-05-14T01:24:32.592132+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.592132+0000","last_undegraded":"2024-05-14T01:24:32.592132+0000","last_fullsized":"2024-05-14T01:24:32.592132+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.584852+0000","last_change":"2024-05-14T01:24:31.584852+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.584852+0000","last_undegraded":"2024-05-14T01:24:31.584852+0000","last_fullsized":"2024-05-14T01:24:31.584852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603406+0000","last_change":"2024-05-14T01:24:32.603406+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603406+0000","last_undegraded":"2024-05-14T01:24:32.603406+0000","last_fullsized":"2024-05-14T01:24:32.603406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.613113+0000","last_change":"2024-05-14T01:24:32.609292+0000","last_active":"2024-05-14T01:24:32.613113+0000","last_peered":"2024-05-14T01:24:32.613113+0000","last_clean":"2024-05-14T01:24:32.613113+0000","last_became_active":"2024-05-14T01:24:32.603873+0000","last_became_peered":"2024-05-14T01:24:32.603873+0000","last_unstale":"2024-05-14T01:24:32.613113+0000","last_undegraded":"2024-05-14T01:24:32.613113+0000","last_fullsized":"2024-05-14T01:24:32.613113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:55:08.731639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.609275+0000","last_change":"2024-05-14T01:24:32.609275+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.609275+0000","last_undegraded":"2024-05-14T01:24:32.609275+0000","last_fullsized":"2024-05-14T01:24:32.609275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.584140+0000","last_change":"2024-05-14T01:24:31.584140+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.584140+0000","last_undegraded":"2024-05-14T01:24:31.584140+0000","last_fullsized":"2024-05-14T01:24:31.584140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.602008+0000","last_change":"2024-05-14T01:24:32.600536+0000","last_active":"2024-05-14T01:24:32.602008+0000","last_peered":"2024-05-14T01:24:32.602008+0000","last_clean":"2024-05-14T01:24:32.602008+0000","last_became_active":"2024-05-14T01:24:32.600218+0000","last_became_peered":"2024-05-14T01:24:32.600218+0000","last_unstale":"2024-05-14T01:24:32.602008+0000","last_undegraded":"2024-05-14T01:24:32.602008+0000","last_fullsized":"2024-05-14T01:24:32.602008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:35:30.482169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.625303+0000","last_change":"2024-05-14T01:24:32.621948+0000","last_active":"2024-05-14T01:24:32.625303+0000","last_peered":"2024-05-14T01:24:32.625303+0000","last_clean":"2024-05-14T01:24:32.625303+0000","last_became_active":"2024-05-14T01:24:32.619217+0000","last_became_peered":"2024-05-14T01:24:32.619217+0000","last_unstale":"2024-05-14T01:24:32.625303+0000","last_undegraded":"2024-05-14T01:24:32.625303+0000","last_fullsized":"2024-05-14T01:24:32.625303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:12:41.013625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.600344+0000","last_change":"2024-05-14T01:24:32.600344+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.600344+0000","last_undegraded":"2024-05-14T01:24:32.600344+0000","last_fullsized":"2024-05-14T01:24:32.600344+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.585656+0000","last_change":"2024-05-14T01:24:31.585656+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.585656+0000","last_undegraded":"2024-05-14T01:24:31.585656+0000","last_fullsized":"2024-05-14T01:24:31.585656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603377+0000","last_change":"2024-05-14T01:24:32.603377+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603377+0000","last_undegraded":"2024-05-14T01:24:32.603377+0000","last_fullsized":"2024-05-14T01:24:32.603377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.606312+0000","last_change":"2024-05-14T01:24:32.597406+0000","last_active":"2024-05-14T01:24:32.606312+0000","last_peered":"2024-05-14T01:24:32.606312+0000","last_clean":"2024-05-14T01:24:32.606312+0000","last_became_active":"2024-05-14T01:24:32.596659+0000","last_became_peered":"2024-05-14T01:24:32.596659+0000","last_unstale":"2024-05-14T01:24:32.606312+0000","last_undegraded":"2024-05-14T01:24:32.606312+0000","last_fullsized":"2024-05-14T01:24:32.606312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:53:24.102472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.605306+0000","last_change":"2024-05-14T01:24:32.602252+0000","last_active":"2024-05-14T01:24:32.605306+0000","last_peered":"2024-05-14T01:24:32.605306+0000","last_clean":"2024-05-14T01:24:32.605306+0000","last_became_active":"2024-05-14T01:24:32.601892+0000","last_became_peered":"2024-05-14T01:24:32.601892+0000","last_unstale":"2024-05-14T01:24:32.605306+0000","last_undegraded":"2024-05-14T01:24:32.605306+0000","last_fullsized":"2024-05-14T01:24:32.605306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:28:29.191976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.615199+0000","last_change":"2024-05-14T01:24:32.615199+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.615199+0000","last_undegraded":"2024-05-14T01:24:32.615199+0000","last_fullsized":"2024-05-14T01:24:32.615199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.585239+0000","last_change":"2024-05-14T01:24:31.585239+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.585239+0000","last_undegraded":"2024-05-14T01:24:31.585239+0000","last_fullsized":"2024-05-14T01:24:31.585239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.584473+0000","last_change":"2024-05-14T01:24:32.584473+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.584473+0000","last_undegraded":"2024-05-14T01:24:32.584473+0000","last_fullsized":"2024-05-14T01:24:32.584473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.586108+0000","last_change":"2024-05-14T01:24:31.586108+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.586108+0000","last_undegraded":"2024-05-14T01:24:31.586108+0000","last_fullsized":"2024-05-14T01:24:31.586108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.589427+0000","last_change":"2024-05-14T01:24:32.589427+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.589427+0000","last_undegraded":"2024-05-14T01:24:32.589427+0000","last_fullsized":"2024-05-14T01:24:32.589427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.605352+0000","last_change":"2024-05-14T01:24:32.600443+0000","last_active":"2024-05-14T01:24:32.605352+0000","last_peered":"2024-05-14T01:24:32.605352+0000","last_clean":"2024-05-14T01:24:32.605352+0000","last_became_active":"2024-05-14T01:24:32.600055+0000","last_became_peered":"2024-05-14T01:24:32.600055+0000","last_unstale":"2024-05-14T01:24:32.605352+0000","last_undegraded":"2024-05-14T01:24:32.605352+0000","last_fullsized":"2024-05-14T01:24:32.605352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:14:21.154539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.613800+0000","last_change":"2024-05-14T01:24:32.613800+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.613800+0000","last_undegraded":"2024-05-14T01:24:32.613800+0000","last_fullsized":"2024-05-14T01:24:32.613800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.606647+0000","last_change":"2024-05-14T01:24:32.600044+0000","last_active":"2024-05-14T01:24:32.606647+0000","last_peered":"2024-05-14T01:24:32.606647+0000","last_clean":"2024-05-14T01:24:32.606647+0000","last_became_active":"2024-05-14T01:24:32.598727+0000","last_became_peered":"2024-05-14T01:24:32.598727+0000","last_unstale":"2024-05-14T01:24:32.606647+0000","last_undegraded":"2024-05-14T01:24:32.606647+0000","last_fullsized":"2024-05-14T01:24:32.606647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:52:21.925895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603413+0000","last_change":"2024-05-14T01:24:32.603413+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603413+0000","last_undegraded":"2024-05-14T01:24:32.603413+0000","last_fullsized":"2024-05-14T01:24:32.603413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.606374+0000","last_change":"2024-05-14T01:24:32.598165+0000","last_active":"2024-05-14T01:24:32.606374+0000","last_peered":"2024-05-14T01:24:32.606374+0000","last_clean":"2024-05-14T01:24:32.606374+0000","last_became_active":"2024-05-14T01:24:32.597345+0000","last_became_peered":"2024-05-14T01:24:32.597345+0000","last_unstale":"2024-05-14T01:24:32.606374+0000","last_undegraded":"2024-05-14T01:24:32.606374+0000","last_fullsized":"2024-05-14T01:24:32.606374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:46:09.858831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.591022+0000","last_change":"2024-05-14T01:24:32.591022+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.591022+0000","last_undegraded":"2024-05-14T01:24:32.591022+0000","last_fullsized":"2024-05-14T01:24:32.591022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.612349+0000","last_change":"2024-05-14T01:24:32.607306+0000","last_active":"2024-05-14T01:24:32.612349+0000","last_peered":"2024-05-14T01:24:32.612349+0000","last_clean":"2024-05-14T01:24:32.612349+0000","last_became_active":"2024-05-14T01:24:32.605320+0000","last_became_peered":"2024-05-14T01:24:32.605320+0000","last_unstale":"2024-05-14T01:24:32.612349+0000","last_undegraded":"2024-05-14T01:24:32.612349+0000","last_fullsized":"2024-05-14T01:24:32.612349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:37:33.536316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.592267+0000","last_change":"2024-05-14T01:24:32.592267+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.592267+0000","last_undegraded":"2024-05-14T01:24:32.592267+0000","last_fullsized":"2024-05-14T01:24:32.592267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.601557+0000","last_change":"2024-05-14T01:24:32.599796+0000","last_active":"2024-05-14T01:24:32.601557+0000","last_peered":"2024-05-14T01:24:32.601557+0000","last_clean":"2024-05-14T01:24:32.601557+0000","last_became_active":"2024-05-14T01:24:32.599365+0000","last_became_peered":"2024-05-14T01:24:32.599365+0000","last_unstale":"2024-05-14T01:24:32.601557+0000","last_undegraded":"2024-05-14T01:24:32.601557+0000","last_fullsized":"2024-05-14T01:24:32.601557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:18:20.146184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.591263+0000","last_change":"2024-05-14T01:24:32.591263+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.591263+0000","last_undegraded":"2024-05-14T01:24:32.591263+0000","last_fullsized":"2024-05-14T01:24:32.591263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.608077+0000","last_change":"2024-05-14T01:24:32.601347+0000","last_active":"2024-05-14T01:24:32.608077+0000","last_peered":"2024-05-14T01:24:32.608077+0000","last_clean":"2024-05-14T01:24:32.608077+0000","last_became_active":"2024-05-14T01:24:32.598291+0000","last_became_peered":"2024-05-14T01:24:32.598291+0000","last_unstale":"2024-05-14T01:24:32.608077+0000","last_undegraded":"2024-05-14T01:24:32.608077+0000","last_fullsized":"2024-05-14T01:24:32.608077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:28:29.191976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.590083+0000","last_change":"2024-05-14T01:24:32.590083+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.590083+0000","last_undegraded":"2024-05-14T01:24:32.590083+0000","last_fullsized":"2024-05-14T01:24:32.590083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.609599+0000","last_change":"2024-05-14T01:24:32.599604+0000","last_active":"2024-05-14T01:24:32.609599+0000","last_peered":"2024-05-14T01:24:32.609599+0000","last_clean":"2024-05-14T01:24:32.609599+0000","last_became_active":"2024-05-14T01:24:32.598939+0000","last_became_peered":"2024-05-14T01:24:32.598939+0000","last_unstale":"2024-05-14T01:24:32.609599+0000","last_undegraded":"2024-05-14T01:24:32.609599+0000","last_fullsized":"2024-05-14T01:24:32.609599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:45:33.606315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.611940+0000","last_change":"2024-05-14T01:24:32.611940+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.611940+0000","last_undegraded":"2024-05-14T01:24:32.611940+0000","last_fullsized":"2024-05-14T01:24:32.611940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.625384+0000","last_change":"2024-05-14T01:24:32.622632+0000","last_active":"2024-05-14T01:24:32.625384+0000","last_peered":"2024-05-14T01:24:32.625384+0000","last_clean":"2024-05-14T01:24:32.625384+0000","last_became_active":"2024-05-14T01:24:32.622340+0000","last_became_peered":"2024-05-14T01:24:32.622340+0000","last_unstale":"2024-05-14T01:24:32.625384+0000","last_undegraded":"2024-05-14T01:24:32.625384+0000","last_fullsized":"2024-05-14T01:24:32.625384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:03:58.243337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.590669+0000","last_change":"2024-05-14T01:24:32.590669+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.590669+0000","last_undegraded":"2024-05-14T01:24:32.590669+0000","last_fullsized":"2024-05-14T01:24:32.590669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.619764+0000","last_change":"2024-05-14T01:24:32.615997+0000","last_active":"2024-05-14T01:24:32.619764+0000","last_peered":"2024-05-14T01:24:32.619764+0000","last_clean":"2024-05-14T01:24:32.619764+0000","last_became_active":"2024-05-14T01:24:32.615650+0000","last_became_peered":"2024-05-14T01:24:32.615650+0000","last_unstale":"2024-05-14T01:24:32.619764+0000","last_undegraded":"2024-05-14T01:24:32.619764+0000","last_fullsized":"2024-05-14T01:24:32.619764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:18:20.146184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.605880+0000","last_change":"2024-05-14T01:24:32.605880+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.605880+0000","last_undegraded":"2024-05-14T01:24:32.605880+0000","last_fullsized":"2024-05-14T01:24:32.605880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.599270+0000","last_change":"2024-05-14T01:24:32.598174+0000","last_active":"2024-05-14T01:24:32.599270+0000","last_peered":"2024-05-14T01:24:32.599270+0000","last_clean":"2024-05-14T01:24:32.599270+0000","last_became_active":"2024-05-14T01:24:32.595656+0000","last_became_peered":"2024-05-14T01:24:32.595656+0000","last_unstale":"2024-05-14T01:24:32.599270+0000","last_undegraded":"2024-05-14T01:24:32.599270+0000","last_fullsized":"2024-05-14T01:24:32.599270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:28:29.191976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587378+0000","last_change":"2024-05-14T01:24:32.587378+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587378+0000","last_undegraded":"2024-05-14T01:24:32.587378+0000","last_fullsized":"2024-05-14T01:24:32.587378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.603719+0000","last_change":"2024-05-14T01:24:32.600486+0000","last_active":"2024-05-14T01:24:32.603719+0000","last_peered":"2024-05-14T01:24:32.603719+0000","last_clean":"2024-05-14T01:24:32.603719+0000","last_became_active":"2024-05-14T01:24:32.599524+0000","last_became_peered":"2024-05-14T01:24:32.599524+0000","last_unstale":"2024-05-14T01:24:32.603719+0000","last_undegraded":"2024-05-14T01:24:32.603719+0000","last_fullsized":"2024-05-14T01:24:32.603719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:03:43.259015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.584591+0000","last_change":"2024-05-14T01:24:32.584591+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.584591+0000","last_undegraded":"2024-05-14T01:24:32.584591+0000","last_fullsized":"2024-05-14T01:24:32.584591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.624826+0000","last_change":"2024-05-14T01:24:32.619963+0000","last_active":"2024-05-14T01:24:32.624826+0000","last_peered":"2024-05-14T01:24:32.624826+0000","last_clean":"2024-05-14T01:24:32.624826+0000","last_became_active":"2024-05-14T01:24:32.619603+0000","last_became_peered":"2024-05-14T01:24:32.619603+0000","last_unstale":"2024-05-14T01:24:32.624826+0000","last_undegraded":"2024-05-14T01:24:32.624826+0000","last_fullsized":"2024-05-14T01:24:32.624826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:10:08.387975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.589558+0000","last_change":"2024-05-14T01:24:32.589558+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.589558+0000","last_undegraded":"2024-05-14T01:24:32.589558+0000","last_fullsized":"2024-05-14T01:24:32.589558+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.624881+0000","last_change":"2024-05-14T01:24:32.619957+0000","last_active":"2024-05-14T01:24:32.624881+0000","last_peered":"2024-05-14T01:24:32.624881+0000","last_clean":"2024-05-14T01:24:32.624881+0000","last_became_active":"2024-05-14T01:24:32.619431+0000","last_became_peered":"2024-05-14T01:24:32.619431+0000","last_unstale":"2024-05-14T01:24:32.624881+0000","last_undegraded":"2024-05-14T01:24:32.624881+0000","last_fullsized":"2024-05-14T01:24:32.624881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:35:30.482169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.622961+0000","last_change":"2024-05-14T01:24:32.618571+0000","last_active":"2024-05-14T01:24:32.622961+0000","last_peered":"2024-05-14T01:24:32.622961+0000","last_clean":"2024-05-14T01:24:32.622961+0000","last_became_active":"2024-05-14T01:24:32.617821+0000","last_became_peered":"2024-05-14T01:24:32.617821+0000","last_unstale":"2024-05-14T01:24:32.622961+0000","last_undegraded":"2024-05-14T01:24:32.622961+0000","last_fullsized":"2024-05-14T01:24:32.622961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:27:57.390857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.593038+0000","last_change":"2024-05-14T01:24:32.593038+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.593038+0000","last_undegraded":"2024-05-14T01:24:32.593038+0000","last_fullsized":"2024-05-14T01:24:32.593038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.586498+0000","last_change":"2024-05-14T01:24:31.586498+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.586498+0000","last_undegraded":"2024-05-14T01:24:31.586498+0000","last_fullsized":"2024-05-14T01:24:31.586498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.610717+0000","last_change":"2024-05-14T01:24:32.610717+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.610717+0000","last_undegraded":"2024-05-14T01:24:32.610717+0000","last_fullsized":"2024-05-14T01:24:32.610717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.614515+0000","last_change":"2024-05-14T01:24:32.608635+0000","last_active":"2024-05-14T01:24:32.614515+0000","last_peered":"2024-05-14T01:24:32.614515+0000","last_clean":"2024-05-14T01:24:32.614515+0000","last_became_active":"2024-05-14T01:24:32.608351+0000","last_became_peered":"2024-05-14T01:24:32.608351+0000","last_unstale":"2024-05-14T01:24:32.614515+0000","last_undegraded":"2024-05-14T01:24:32.614515+0000","last_fullsized":"2024-05-14T01:24:32.614515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:18:20.146184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.620680+0000","last_change":"2024-05-14T01:23:25.487525+0000","last_active":"2024-05-14T01:24:32.620680+0000","last_peered":"2024-05-14T01:24:32.620680+0000","last_clean":"2024-05-14T01:24:32.620680+0000","last_became_active":"2024-05-14T01:23:25.485622+0000","last_became_peered":"2024-05-14T01:23:25.485622+0000","last_unstale":"2024-05-14T01:24:32.620680+0000","last_undegraded":"2024-05-14T01:24:32.620680+0000","last_fullsized":"2024-05-14T01:24:32.620680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_clean_scrub_stamp":"2024-05-14T01:23:24.138255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:26:23.884962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":942080,"data_stored":722483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":728750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":360448,"data_stored":138382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T01:24:37.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T01:24:37.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.792+0000 7f8cf4a31640 1 Processor -- start 2024-05-14T01:24:37.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.792+0000 7f8cf4a31640 1 -- start start 2024-05-14T01:24:37.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.792+0000 7f8cf4a31640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8cf013ede0 0x7f8cf01415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.792+0000 7f8cf4a31640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cf00cf100 con 0x7f8cf0141b30 2024-05-14T01:24:37.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.792+0000 7f8cf4a31640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cf00cf3e0 con 0x7f8cf00cea50 2024-05-14T01:24:37.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.792+0000 7f8cf4a31640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8cf00ceee0 con 0x7f8cf013ede0 2024-05-14T01:24:37.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.792+0000 7f8cee59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8cf013ede0 0x7f8cf01415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.792+0000 7f8cedd9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8cf0141b30 0x7f8cf00ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37610/0 (socket says 172.21.15.154:37610) 2024-05-14T01:24:37.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.792+0000 7f8cedd9b640 1 -- 172.21.15.154:0/3746438649 learned_addr learned my addr 172.21.15.154:0/3746438649 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:37.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.792+0000 7f8cee59c640 1 -- 172.21.15.154:0/3746438649 >> v1:172.21.15.176:6789/0 conn(0x7f8cf00cea50 legacy=0x7f8cf006d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.792+0000 7f8cee59c640 1 -- 172.21.15.154:0/3746438649 >> v1:172.21.15.154:6789/0 conn(0x7f8cf0141b30 legacy=0x7f8cf00ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.792+0000 7f8ced59a640 1 -- 172.21.15.154:0/3746438649 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4237684540 0 0) 0x7f8cf00cf100 con 0x7f8cf0141b30 2024-05-14T01:24:37.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.792+0000 7f8cee59c640 1 -- 172.21.15.154:0/3746438649 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf006cc80 con 0x7f8cf013ede0 2024-05-14T01:24:37.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8cee59c640 1 --2- 172.21.15.154:0/3746438649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf013ede0 0x7f8cf01415f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00097f0 tx=0x7f8ce001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf2d727f84e6721 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:37.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8ced59a640 1 -- 172.21.15.154:0/3746438649 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00b0070 con 0x7f8cf013ede0 2024-05-14T01:24:37.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8ced59a640 1 -- 172.21.15.154:0/3746438649 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce00ab600 con 0x7f8cf013ede0 2024-05-14T01:24:37.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8ced59a640 1 -- 172.21.15.154:0/3746438649 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00ab9d0 con 0x7f8cf013ede0 2024-05-14T01:24:37.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8cf4a31640 1 -- 172.21.15.154:0/3746438649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf013ede0 msgr2=0x7f8cf01415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8cf4a31640 1 --2- 172.21.15.154:0/3746438649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf013ede0 0x7f8cf01415f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00097f0 tx=0x7f8ce001c4a0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8cf4a31640 1 -- 172.21.15.154:0/3746438649 shutdown_connections 2024-05-14T01:24:37.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8cf4a31640 1 --2- 172.21.15.154:0/3746438649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf013ede0 0x7f8cf01415f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8cf4a31640 1 -- 172.21.15.154:0/3746438649 >> 172.21.15.154:0/3746438649 conn(0x7f8cf00b1850 msgr2=0x7f8cf00b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:37.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8cf4a31640 1 -- 172.21.15.154:0/3746438649 shutdown_connections 2024-05-14T01:24:37.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8cf4a31640 1 -- 172.21.15.154:0/3746438649 wait complete. 2024-05-14T01:24:37.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8cf4a31640 1 Processor -- start 2024-05-14T01:24:37.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8cf4a31640 1 -- start start 2024-05-14T01:24:37.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8cf4a31640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cf00cea50 0x7f8cf013e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8cf4a31640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cf013ede0 0x7f8cf0155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8cf4a31640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf0141b30 0x7f8cf015e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8cf4a31640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf006e730 con 0x7f8cf0141b30 2024-05-14T01:24:37.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8cf4a31640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf006e5b0 con 0x7f8cf013ede0 2024-05-14T01:24:37.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8cf4a31640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf0169db0 con 0x7f8cf00cea50 2024-05-14T01:24:37.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8ceed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf0141b30 0x7f8cf015e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8ceed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf0141b30 0x7f8cf015e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42732/0 (socket says 172.21.15.154:42732) 2024-05-14T01:24:37.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8ceed9d640 1 -- 172.21.15.154:0/2421266695 learned_addr learned my addr 172.21.15.154:0/2421266695 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:37.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8cee59c640 1 --2- 172.21.15.154:0/2421266695 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cf00cea50 0x7f8cf013e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.796+0000 7f8cedd9b640 1 --2- 172.21.15.154:0/2421266695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cf013ede0 0x7f8cf0155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.800+0000 7f8ceed9d640 1 -- 172.21.15.154:0/2421266695 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cf00cea50 msgr2=0x7f8cf013e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.800+0000 7f8ceed9d640 1 --2- 172.21.15.154:0/2421266695 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cf00cea50 0x7f8cf013e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.800+0000 7f8ceed9d640 1 -- 172.21.15.154:0/2421266695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cf013ede0 msgr2=0x7f8cf0155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.800+0000 7f8ceed9d640 1 --2- 172.21.15.154:0/2421266695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cf013ede0 0x7f8cf0155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.800+0000 7f8ceed9d640 1 -- 172.21.15.154:0/2421266695 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf015d740 con 0x7f8cf0141b30 2024-05-14T01:24:37.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.800+0000 7f8cedd9b640 1 --2- 172.21.15.154:0/2421266695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cf013ede0 0x7f8cf0155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:37.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.800+0000 7f8ceed9d640 1 --2- 172.21.15.154:0/2421266695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf0141b30 0x7f8cf015e500 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800c760 tx=0x7f8ce800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:37.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.800+0000 7f8cdeffd640 1 -- 172.21.15.154:0/2421266695 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8003b80 con 0x7f8cf0141b30 2024-05-14T01:24:37.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.800+0000 7f8cdeffd640 1 -- 172.21.15.154:0/2421266695 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce8003d20 con 0x7f8cf0141b30 2024-05-14T01:24:37.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.800+0000 7f8cdeffd640 1 -- 172.21.15.154:0/2421266695 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce800aa30 con 0x7f8cf0141b30 2024-05-14T01:24:37.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.800+0000 7f8cf4a31640 1 -- 172.21.15.154:0/2421266695 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf015da20 con 0x7f8cf0141b30 2024-05-14T01:24:37.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.800+0000 7f8cf4a31640 1 -- 172.21.15.154:0/2421266695 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf01535c0 con 0x7f8cf0141b30 2024-05-14T01:24:37.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.800+0000 7f8cf4a31640 1 -- 172.21.15.154:0/2421266695 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cf0075470 con 0x7f8cf0141b30 2024-05-14T01:24:37.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.800+0000 7f8cdeffd640 1 -- 172.21.15.154:0/2421266695 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8ce800abd0 con 0x7f8cf0141b30 2024-05-14T01:24:37.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.800+0000 7f8cdeffd640 1 --2- 172.21.15.154:0/2421266695 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8cd00678c0 0x7f8cd0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:37.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.800+0000 7f8cdeffd640 1 -- 172.21.15.154:0/2421266695 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8ce8085ae0 con 0x7f8cf0141b30 2024-05-14T01:24:37.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.800+0000 7f8cee59c640 1 --2- 172.21.15.154:0/2421266695 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8cd00678c0 0x7f8cd0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:37.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.800+0000 7f8cee59c640 1 --2- 172.21.15.154:0/2421266695 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8cd00678c0 0x7f8cd0069d80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00ad000 tx=0x7f8ce00a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:37.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.804+0000 7f8cdeffd640 1 -- 172.21.15.154:0/2421266695 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f8ce8056620 con 0x7f8cf0141b30 2024-05-14T01:24:37.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.948+0000 7f8cf4a31640 1 -- 172.21.15.154:0/2421266695 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8cf006f180 con 0x7f8cd00678c0 2024-05-14T01:24:37.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.956+0000 7f8cdeffd640 1 -- 172.21.15.154:0/2421266695 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245505 (secure 0 0 0) 0x7f8cf006f180 con 0x7f8cd00678c0 2024-05-14T01:24:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:37.948 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-05-14T01:24:37.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.960+0000 7f8cf4a31640 1 -- 172.21.15.154:0/2421266695 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8cd00678c0 msgr2=0x7f8cd0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.960+0000 7f8cf4a31640 1 --2- 172.21.15.154:0/2421266695 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8cd00678c0 0x7f8cd0069d80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00ad000 tx=0x7f8ce00a6000 comp rx=0 tx=0).stop 2024-05-14T01:24:37.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.960+0000 7f8cf4a31640 1 -- 172.21.15.154:0/2421266695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf0141b30 msgr2=0x7f8cf015e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:37.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.960+0000 7f8cf4a31640 1 --2- 172.21.15.154:0/2421266695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf0141b30 0x7f8cf015e500 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800c760 tx=0x7f8ce800cc20 comp rx=0 tx=0).stop 2024-05-14T01:24:37.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.960+0000 7f8cf4a31640 1 -- 172.21.15.154:0/2421266695 shutdown_connections 2024-05-14T01:24:37.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.960+0000 7f8cf4a31640 1 --2- 172.21.15.154:0/2421266695 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8cd00678c0 0x7f8cd0069d80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.960+0000 7f8cf4a31640 1 --2- 172.21.15.154:0/2421266695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf0141b30 0x7f8cf015e500 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.960+0000 7f8cf4a31640 1 --2- 172.21.15.154:0/2421266695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cf013ede0 0x7f8cf0155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.960+0000 7f8cf4a31640 1 --2- 172.21.15.154:0/2421266695 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cf00cea50 0x7f8cf013e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:37.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.960+0000 7f8cf4a31640 1 -- 172.21.15.154:0/2421266695 >> 172.21.15.154:0/2421266695 conn(0x7f8cf00b1850 msgr2=0x7f8cf015b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:37.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.960+0000 7f8cf4a31640 1 -- 172.21.15.154:0/2421266695 shutdown_connections 2024-05-14T01:24:37.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:37.960+0000 7f8cf4a31640 1 -- 172.21.15.154:0/2421266695 wait complete. 2024-05-14T01:24:37.964 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-05-14T01:24:37.120073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224252,"kb_used_data":3928,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750468,"statfs":{"total":773094113280,"available":772864479232,"internally_reserved":0,"allocated":4022272,"data_stored":2262724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.544414"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587167+0000","last_change":"2024-05-14T01:24:32.587167+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587167+0000","last_undegraded":"2024-05-14T01:24:32.587167+0000","last_fullsized":"2024-05-14T01:24:32.587167+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.599284+0000","last_change":"2024-05-14T01:24:32.599284+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.599284+0000","last_undegraded":"2024-05-14T01:24:32.599284+0000","last_fullsized":"2024-05-14T01:24:32.599284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.604151+0000","last_change":"2024-05-14T01:24:32.604151+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.604151+0000","last_undegraded":"2024-05-14T01:24:32.604151+0000","last_fullsized":"2024-05-14T01:24:32.604151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.594638+0000","last_change":"2024-05-14T01:24:32.594638+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.594638+0000","last_undegraded":"2024-05-14T01:24:32.594638+0000","last_fullsized":"2024-05-14T01:24:32.594638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.604163+0000","last_change":"2024-05-14T01:24:32.604163+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.604163+0000","last_undegraded":"2024-05-14T01:24:32.604163+0000","last_fullsized":"2024-05-14T01:24:32.604163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.619361+0000","last_change":"2024-05-14T01:24:32.619361+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.619361+0000","last_undegraded":"2024-05-14T01:24:32.619361+0000","last_fullsized":"2024-05-14T01:24:32.619361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.594896+0000","last_change":"2024-05-14T01:24:32.594896+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.594896+0000","last_undegraded":"2024-05-14T01:24:32.594896+0000","last_fullsized":"2024-05-14T01:24:32.594896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603481+0000","last_change":"2024-05-14T01:24:32.603481+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603481+0000","last_undegraded":"2024-05-14T01:24:32.603481+0000","last_fullsized":"2024-05-14T01:24:32.603481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603829+0000","last_change":"2024-05-14T01:24:32.603829+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603829+0000","last_undegraded":"2024-05-14T01:24:32.603829+0000","last_fullsized":"2024-05-14T01:24:32.603829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.599753+0000","last_change":"2024-05-14T01:24:32.599753+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.599753+0000","last_undegraded":"2024-05-14T01:24:32.599753+0000","last_fullsized":"2024-05-14T01:24:32.599753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.594055+0000","last_change":"2024-05-14T01:24:32.594055+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.594055+0000","last_undegraded":"2024-05-14T01:24:32.594055+0000","last_fullsized":"2024-05-14T01:24:32.594055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.597522+0000","last_change":"2024-05-14T01:24:32.597522+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.597522+0000","last_undegraded":"2024-05-14T01:24:32.597522+0000","last_fullsized":"2024-05-14T01:24:32.597522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.601904+0000","last_change":"2024-05-14T01:24:32.601904+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.601904+0000","last_undegraded":"2024-05-14T01:24:32.601904+0000","last_fullsized":"2024-05-14T01:24:32.601904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.610800+0000","last_change":"2024-05-14T01:24:32.610800+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.610800+0000","last_undegraded":"2024-05-14T01:24:32.610800+0000","last_fullsized":"2024-05-14T01:24:32.610800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.593038+0000","last_change":"2024-05-14T01:24:32.593038+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.593038+0000","last_undegraded":"2024-05-14T01:24:32.593038+0000","last_fullsized":"2024-05-14T01:24:32.593038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.595452+0000","last_change":"2024-05-14T01:24:32.595452+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.595452+0000","last_undegraded":"2024-05-14T01:24:32.595452+0000","last_fullsized":"2024-05-14T01:24:32.595452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587363+0000","last_change":"2024-05-14T01:24:32.587363+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587363+0000","last_undegraded":"2024-05-14T01:24:32.587363+0000","last_fullsized":"2024-05-14T01:24:32.587363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587693+0000","last_change":"2024-05-14T01:24:32.587693+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587693+0000","last_undegraded":"2024-05-14T01:24:32.587693+0000","last_fullsized":"2024-05-14T01:24:32.587693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.595864+0000","last_change":"2024-05-14T01:24:32.595864+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.595864+0000","last_undegraded":"2024-05-14T01:24:32.595864+0000","last_fullsized":"2024-05-14T01:24:32.595864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.605029+0000","last_change":"2024-05-14T01:24:32.605029+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.605029+0000","last_undegraded":"2024-05-14T01:24:32.605029+0000","last_fullsized":"2024-05-14T01:24:32.605029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.604559+0000","last_change":"2024-05-14T01:24:32.604559+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.604559+0000","last_undegraded":"2024-05-14T01:24:32.604559+0000","last_fullsized":"2024-05-14T01:24:32.604559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.598735+0000","last_change":"2024-05-14T01:24:32.598735+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.598735+0000","last_undegraded":"2024-05-14T01:24:32.598735+0000","last_fullsized":"2024-05-14T01:24:32.598735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587360+0000","last_change":"2024-05-14T01:24:32.587360+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587360+0000","last_undegraded":"2024-05-14T01:24:32.587360+0000","last_fullsized":"2024-05-14T01:24:32.587360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.611370+0000","last_change":"2024-05-14T01:24:32.611370+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.611370+0000","last_undegraded":"2024-05-14T01:24:32.611370+0000","last_fullsized":"2024-05-14T01:24:32.611370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.585963+0000","last_change":"2024-05-14T01:24:32.585963+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.585963+0000","last_undegraded":"2024-05-14T01:24:32.585963+0000","last_fullsized":"2024-05-14T01:24:32.585963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.616332+0000","last_change":"2024-05-14T01:24:32.616332+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.616332+0000","last_undegraded":"2024-05-14T01:24:32.616332+0000","last_fullsized":"2024-05-14T01:24:32.616332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.589008+0000","last_change":"2024-05-14T01:24:32.589008+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.589008+0000","last_undegraded":"2024-05-14T01:24:32.589008+0000","last_fullsized":"2024-05-14T01:24:32.589008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.624605+0000","last_change":"2024-05-14T01:24:32.621045+0000","last_active":"2024-05-14T01:24:32.624605+0000","last_peered":"2024-05-14T01:24:32.624605+0000","last_clean":"2024-05-14T01:24:32.624605+0000","last_became_active":"2024-05-14T01:24:32.620438+0000","last_became_peered":"2024-05-14T01:24:32.620438+0000","last_unstale":"2024-05-14T01:24:32.624605+0000","last_undegraded":"2024-05-14T01:24:32.624605+0000","last_fullsized":"2024-05-14T01:24:32.624605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:35:30.482169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.586055+0000","last_change":"2024-05-14T01:24:32.586055+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.586055+0000","last_undegraded":"2024-05-14T01:24:32.586055+0000","last_fullsized":"2024-05-14T01:24:32.586055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.619340+0000","last_change":"2024-05-14T01:24:32.617319+0000","last_active":"2024-05-14T01:24:32.619340+0000","last_peered":"2024-05-14T01:24:32.619340+0000","last_clean":"2024-05-14T01:24:32.619340+0000","last_became_active":"2024-05-14T01:24:32.616699+0000","last_became_peered":"2024-05-14T01:24:32.616699+0000","last_unstale":"2024-05-14T01:24:32.619340+0000","last_undegraded":"2024-05-14T01:24:32.619340+0000","last_fullsized":"2024-05-14T01:24:32.619340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:30:59.119076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587346+0000","last_change":"2024-05-14T01:24:32.587346+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587346+0000","last_undegraded":"2024-05-14T01:24:32.587346+0000","last_fullsized":"2024-05-14T01:24:32.587346+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.583945+0000","last_change":"2024-05-14T01:24:31.583945+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.583945+0000","last_undegraded":"2024-05-14T01:24:31.583945+0000","last_fullsized":"2024-05-14T01:24:31.583945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.604027+0000","last_change":"2024-05-14T01:24:32.604027+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.604027+0000","last_undegraded":"2024-05-14T01:24:32.604027+0000","last_fullsized":"2024-05-14T01:24:32.604027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.602753+0000","last_change":"2024-05-14T01:24:32.599149+0000","last_active":"2024-05-14T01:24:32.602753+0000","last_peered":"2024-05-14T01:24:32.602753+0000","last_clean":"2024-05-14T01:24:32.602753+0000","last_became_active":"2024-05-14T01:24:32.598789+0000","last_became_peered":"2024-05-14T01:24:32.598789+0000","last_unstale":"2024-05-14T01:24:32.602753+0000","last_undegraded":"2024-05-14T01:24:32.602753+0000","last_fullsized":"2024-05-14T01:24:32.602753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:22:32.117284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603914+0000","last_change":"2024-05-14T01:24:32.603914+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603914+0000","last_undegraded":"2024-05-14T01:24:32.603914+0000","last_fullsized":"2024-05-14T01:24:32.603914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.607889+0000","last_change":"2024-05-14T01:24:32.605488+0000","last_active":"2024-05-14T01:24:32.607889+0000","last_peered":"2024-05-14T01:24:32.607889+0000","last_clean":"2024-05-14T01:24:32.607889+0000","last_became_active":"2024-05-14T01:24:32.604323+0000","last_became_peered":"2024-05-14T01:24:32.604323+0000","last_unstale":"2024-05-14T01:24:32.607889+0000","last_undegraded":"2024-05-14T01:24:32.607889+0000","last_fullsized":"2024-05-14T01:24:32.607889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:28:05.246816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.607441+0000","last_change":"2024-05-14T01:24:32.607441+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.607441+0000","last_undegraded":"2024-05-14T01:24:32.607441+0000","last_fullsized":"2024-05-14T01:24:32.607441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.613164+0000","last_change":"2024-05-14T01:24:32.607898+0000","last_active":"2024-05-14T01:24:32.613164+0000","last_peered":"2024-05-14T01:24:32.613164+0000","last_clean":"2024-05-14T01:24:32.613164+0000","last_became_active":"2024-05-14T01:24:32.606398+0000","last_became_peered":"2024-05-14T01:24:32.606398+0000","last_unstale":"2024-05-14T01:24:32.613164+0000","last_undegraded":"2024-05-14T01:24:32.613164+0000","last_fullsized":"2024-05-14T01:24:32.613164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:22:32.117284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.592132+0000","last_change":"2024-05-14T01:24:32.592132+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.592132+0000","last_undegraded":"2024-05-14T01:24:32.592132+0000","last_fullsized":"2024-05-14T01:24:32.592132+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.584852+0000","last_change":"2024-05-14T01:24:31.584852+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.584852+0000","last_undegraded":"2024-05-14T01:24:31.584852+0000","last_fullsized":"2024-05-14T01:24:31.584852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603406+0000","last_change":"2024-05-14T01:24:32.603406+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603406+0000","last_undegraded":"2024-05-14T01:24:32.603406+0000","last_fullsized":"2024-05-14T01:24:32.603406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.613113+0000","last_change":"2024-05-14T01:24:32.609292+0000","last_active":"2024-05-14T01:24:32.613113+0000","last_peered":"2024-05-14T01:24:32.613113+0000","last_clean":"2024-05-14T01:24:32.613113+0000","last_became_active":"2024-05-14T01:24:32.603873+0000","last_became_peered":"2024-05-14T01:24:32.603873+0000","last_unstale":"2024-05-14T01:24:32.613113+0000","last_undegraded":"2024-05-14T01:24:32.613113+0000","last_fullsized":"2024-05-14T01:24:32.613113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:55:08.731639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.609275+0000","last_change":"2024-05-14T01:24:32.609275+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.609275+0000","last_undegraded":"2024-05-14T01:24:32.609275+0000","last_fullsized":"2024-05-14T01:24:32.609275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.584140+0000","last_change":"2024-05-14T01:24:31.584140+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.584140+0000","last_undegraded":"2024-05-14T01:24:31.584140+0000","last_fullsized":"2024-05-14T01:24:31.584140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.602008+0000","last_change":"2024-05-14T01:24:32.600536+0000","last_active":"2024-05-14T01:24:32.602008+0000","last_peered":"2024-05-14T01:24:32.602008+0000","last_clean":"2024-05-14T01:24:32.602008+0000","last_became_active":"2024-05-14T01:24:32.600218+0000","last_became_peered":"2024-05-14T01:24:32.600218+0000","last_unstale":"2024-05-14T01:24:32.602008+0000","last_undegraded":"2024-05-14T01:24:32.602008+0000","last_fullsized":"2024-05-14T01:24:32.602008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:35:30.482169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.625303+0000","last_change":"2024-05-14T01:24:32.621948+0000","last_active":"2024-05-14T01:24:32.625303+0000","last_peered":"2024-05-14T01:24:32.625303+0000","last_clean":"2024-05-14T01:24:32.625303+0000","last_became_active":"2024-05-14T01:24:32.619217+0000","last_became_peered":"2024-05-14T01:24:32.619217+0000","last_unstale":"2024-05-14T01:24:32.625303+0000","last_undegraded":"2024-05-14T01:24:32.625303+0000","last_fullsized":"2024-05-14T01:24:32.625303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:12:41.013625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.600344+0000","last_change":"2024-05-14T01:24:32.600344+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.600344+0000","last_undegraded":"2024-05-14T01:24:32.600344+0000","last_fullsized":"2024-05-14T01:24:32.600344+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.585656+0000","last_change":"2024-05-14T01:24:31.585656+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.585656+0000","last_undegraded":"2024-05-14T01:24:31.585656+0000","last_fullsized":"2024-05-14T01:24:31.585656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603377+0000","last_change":"2024-05-14T01:24:32.603377+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603377+0000","last_undegraded":"2024-05-14T01:24:32.603377+0000","last_fullsized":"2024-05-14T01:24:32.603377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.606312+0000","last_change":"2024-05-14T01:24:32.597406+0000","last_active":"2024-05-14T01:24:32.606312+0000","last_peered":"2024-05-14T01:24:32.606312+0000","last_clean":"2024-05-14T01:24:32.606312+0000","last_became_active":"2024-05-14T01:24:32.596659+0000","last_became_peered":"2024-05-14T01:24:32.596659+0000","last_unstale":"2024-05-14T01:24:32.606312+0000","last_undegraded":"2024-05-14T01:24:32.606312+0000","last_fullsized":"2024-05-14T01:24:32.606312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:53:24.102472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.605306+0000","last_change":"2024-05-14T01:24:32.602252+0000","last_active":"2024-05-14T01:24:32.605306+0000","last_peered":"2024-05-14T01:24:32.605306+0000","last_clean":"2024-05-14T01:24:32.605306+0000","last_became_active":"2024-05-14T01:24:32.601892+0000","last_became_peered":"2024-05-14T01:24:32.601892+0000","last_unstale":"2024-05-14T01:24:32.605306+0000","last_undegraded":"2024-05-14T01:24:32.605306+0000","last_fullsized":"2024-05-14T01:24:32.605306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:28:29.191976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.615199+0000","last_change":"2024-05-14T01:24:32.615199+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.615199+0000","last_undegraded":"2024-05-14T01:24:32.615199+0000","last_fullsized":"2024-05-14T01:24:32.615199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.585239+0000","last_change":"2024-05-14T01:24:31.585239+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.585239+0000","last_undegraded":"2024-05-14T01:24:31.585239+0000","last_fullsized":"2024-05-14T01:24:31.585239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.584473+0000","last_change":"2024-05-14T01:24:32.584473+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.584473+0000","last_undegraded":"2024-05-14T01:24:32.584473+0000","last_fullsized":"2024-05-14T01:24:32.584473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.586108+0000","last_change":"2024-05-14T01:24:31.586108+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.586108+0000","last_undegraded":"2024-05-14T01:24:31.586108+0000","last_fullsized":"2024-05-14T01:24:31.586108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.589427+0000","last_change":"2024-05-14T01:24:32.589427+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.589427+0000","last_undegraded":"2024-05-14T01:24:32.589427+0000","last_fullsized":"2024-05-14T01:24:32.589427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.605352+0000","last_change":"2024-05-14T01:24:32.600443+0000","last_active":"2024-05-14T01:24:32.605352+0000","last_peered":"2024-05-14T01:24:32.605352+0000","last_clean":"2024-05-14T01:24:32.605352+0000","last_became_active":"2024-05-14T01:24:32.600055+0000","last_became_peered":"2024-05-14T01:24:32.600055+0000","last_unstale":"2024-05-14T01:24:32.605352+0000","last_undegraded":"2024-05-14T01:24:32.605352+0000","last_fullsized":"2024-05-14T01:24:32.605352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:14:21.154539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.613800+0000","last_change":"2024-05-14T01:24:32.613800+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.613800+0000","last_undegraded":"2024-05-14T01:24:32.613800+0000","last_fullsized":"2024-05-14T01:24:32.613800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.606647+0000","last_change":"2024-05-14T01:24:32.600044+0000","last_active":"2024-05-14T01:24:32.606647+0000","last_peered":"2024-05-14T01:24:32.606647+0000","last_clean":"2024-05-14T01:24:32.606647+0000","last_became_active":"2024-05-14T01:24:32.598727+0000","last_became_peered":"2024-05-14T01:24:32.598727+0000","last_unstale":"2024-05-14T01:24:32.606647+0000","last_undegraded":"2024-05-14T01:24:32.606647+0000","last_fullsized":"2024-05-14T01:24:32.606647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:52:21.925895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603413+0000","last_change":"2024-05-14T01:24:32.603413+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603413+0000","last_undegraded":"2024-05-14T01:24:32.603413+0000","last_fullsized":"2024-05-14T01:24:32.603413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.606374+0000","last_change":"2024-05-14T01:24:32.598165+0000","last_active":"2024-05-14T01:24:32.606374+0000","last_peered":"2024-05-14T01:24:32.606374+0000","last_clean":"2024-05-14T01:24:32.606374+0000","last_became_active":"2024-05-14T01:24:32.597345+0000","last_became_peered":"2024-05-14T01:24:32.597345+0000","last_unstale":"2024-05-14T01:24:32.606374+0000","last_undegraded":"2024-05-14T01:24:32.606374+0000","last_fullsized":"2024-05-14T01:24:32.606374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:46:09.858831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.591022+0000","last_change":"2024-05-14T01:24:32.591022+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.591022+0000","last_undegraded":"2024-05-14T01:24:32.591022+0000","last_fullsized":"2024-05-14T01:24:32.591022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.612349+0000","last_change":"2024-05-14T01:24:32.607306+0000","last_active":"2024-05-14T01:24:32.612349+0000","last_peered":"2024-05-14T01:24:32.612349+0000","last_clean":"2024-05-14T01:24:32.612349+0000","last_became_active":"2024-05-14T01:24:32.605320+0000","last_became_peered":"2024-05-14T01:24:32.605320+0000","last_unstale":"2024-05-14T01:24:32.612349+0000","last_undegraded":"2024-05-14T01:24:32.612349+0000","last_fullsized":"2024-05-14T01:24:32.612349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:37:33.536316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.592267+0000","last_change":"2024-05-14T01:24:32.592267+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.592267+0000","last_undegraded":"2024-05-14T01:24:32.592267+0000","last_fullsized":"2024-05-14T01:24:32.592267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.601557+0000","last_change":"2024-05-14T01:24:32.599796+0000","last_active":"2024-05-14T01:24:32.601557+0000","last_peered":"2024-05-14T01:24:32.601557+0000","last_clean":"2024-05-14T01:24:32.601557+0000","last_became_active":"2024-05-14T01:24:32.599365+0000","last_became_peered":"2024-05-14T01:24:32.599365+0000","last_unstale":"2024-05-14T01:24:32.601557+0000","last_undegraded":"2024-05-14T01:24:32.601557+0000","last_fullsized":"2024-05-14T01:24:32.601557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:18:20.146184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.591263+0000","last_change":"2024-05-14T01:24:32.591263+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.591263+0000","last_undegraded":"2024-05-14T01:24:32.591263+0000","last_fullsized":"2024-05-14T01:24:32.591263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.608077+0000","last_change":"2024-05-14T01:24:32.601347+0000","last_active":"2024-05-14T01:24:32.608077+0000","last_peered":"2024-05-14T01:24:32.608077+0000","last_clean":"2024-05-14T01:24:32.608077+0000","last_became_active":"2024-05-14T01:24:32.598291+0000","last_became_peered":"2024-05-14T01:24:32.598291+0000","last_unstale":"2024-05-14T01:24:32.608077+0000","last_undegraded":"2024-05-14T01:24:32.608077+0000","last_fullsized":"2024-05-14T01:24:32.608077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:28:29.191976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.590083+0000","last_change":"2024-05-14T01:24:32.590083+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.590083+0000","last_undegraded":"2024-05-14T01:24:32.590083+0000","last_fullsized":"2024-05-14T01:24:32.590083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.609599+0000","last_change":"2024-05-14T01:24:32.599604+0000","last_active":"2024-05-14T01:24:32.609599+0000","last_peered":"2024-05-14T01:24:32.609599+0000","last_clean":"2024-05-14T01:24:32.609599+0000","last_became_active":"2024-05-14T01:24:32.598939+0000","last_became_peered":"2024-05-14T01:24:32.598939+0000","last_unstale":"2024-05-14T01:24:32.609599+0000","last_undegraded":"2024-05-14T01:24:32.609599+0000","last_fullsized":"2024-05-14T01:24:32.609599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:45:33.606315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.611940+0000","last_change":"2024-05-14T01:24:32.611940+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.611940+0000","last_undegraded":"2024-05-14T01:24:32.611940+0000","last_fullsized":"2024-05-14T01:24:32.611940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.625384+0000","last_change":"2024-05-14T01:24:32.622632+0000","last_active":"2024-05-14T01:24:32.625384+0000","last_peered":"2024-05-14T01:24:32.625384+0000","last_clean":"2024-05-14T01:24:32.625384+0000","last_became_active":"2024-05-14T01:24:32.622340+0000","last_became_peered":"2024-05-14T01:24:32.622340+0000","last_unstale":"2024-05-14T01:24:32.625384+0000","last_undegraded":"2024-05-14T01:24:32.625384+0000","last_fullsized":"2024-05-14T01:24:32.625384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:03:58.243337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.590669+0000","last_change":"2024-05-14T01:24:32.590669+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.590669+0000","last_undegraded":"2024-05-14T01:24:32.590669+0000","last_fullsized":"2024-05-14T01:24:32.590669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.619764+0000","last_change":"2024-05-14T01:24:32.615997+0000","last_active":"2024-05-14T01:24:32.619764+0000","last_peered":"2024-05-14T01:24:32.619764+0000","last_clean":"2024-05-14T01:24:32.619764+0000","last_became_active":"2024-05-14T01:24:32.615650+0000","last_became_peered":"2024-05-14T01:24:32.615650+0000","last_unstale":"2024-05-14T01:24:32.619764+0000","last_undegraded":"2024-05-14T01:24:32.619764+0000","last_fullsized":"2024-05-14T01:24:32.619764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:18:20.146184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.605880+0000","last_change":"2024-05-14T01:24:32.605880+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.605880+0000","last_undegraded":"2024-05-14T01:24:32.605880+0000","last_fullsized":"2024-05-14T01:24:32.605880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.599270+0000","last_change":"2024-05-14T01:24:32.598174+0000","last_active":"2024-05-14T01:24:32.599270+0000","last_peered":"2024-05-14T01:24:32.599270+0000","last_clean":"2024-05-14T01:24:32.599270+0000","last_became_active":"2024-05-14T01:24:32.595656+0000","last_became_peered":"2024-05-14T01:24:32.595656+0000","last_unstale":"2024-05-14T01:24:32.599270+0000","last_undegraded":"2024-05-14T01:24:32.599270+0000","last_fullsized":"2024-05-14T01:24:32.599270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:28:29.191976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587378+0000","last_change":"2024-05-14T01:24:32.587378+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587378+0000","last_undegraded":"2024-05-14T01:24:32.587378+0000","last_fullsized":"2024-05-14T01:24:32.587378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.603719+0000","last_change":"2024-05-14T01:24:32.600486+0000","last_active":"2024-05-14T01:24:32.603719+0000","last_peered":"2024-05-14T01:24:32.603719+0000","last_clean":"2024-05-14T01:24:32.603719+0000","last_became_active":"2024-05-14T01:24:32.599524+0000","last_became_peered":"2024-05-14T01:24:32.599524+0000","last_unstale":"2024-05-14T01:24:32.603719+0000","last_undegraded":"2024-05-14T01:24:32.603719+0000","last_fullsized":"2024-05-14T01:24:32.603719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:03:43.259015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.584591+0000","last_change":"2024-05-14T01:24:32.584591+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.584591+0000","last_undegraded":"2024-05-14T01:24:32.584591+0000","last_fullsized":"2024-05-14T01:24:32.584591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.624826+0000","last_change":"2024-05-14T01:24:32.619963+0000","last_active":"2024-05-14T01:24:32.624826+0000","last_peered":"2024-05-14T01:24:32.624826+0000","last_clean":"2024-05-14T01:24:32.624826+0000","last_became_active":"2024-05-14T01:24:32.619603+0000","last_became_peered":"2024-05-14T01:24:32.619603+0000","last_unstale":"2024-05-14T01:24:32.624826+0000","last_undegraded":"2024-05-14T01:24:32.624826+0000","last_fullsized":"2024-05-14T01:24:32.624826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:10:08.387975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.589558+0000","last_change":"2024-05-14T01:24:32.589558+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.589558+0000","last_undegraded":"2024-05-14T01:24:32.589558+0000","last_fullsized":"2024-05-14T01:24:32.589558+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.624881+0000","last_change":"2024-05-14T01:24:32.619957+0000","last_active":"2024-05-14T01:24:32.624881+0000","last_peered":"2024-05-14T01:24:32.624881+0000","last_clean":"2024-05-14T01:24:32.624881+0000","last_became_active":"2024-05-14T01:24:32.619431+0000","last_became_peered":"2024-05-14T01:24:32.619431+0000","last_unstale":"2024-05-14T01:24:32.624881+0000","last_undegraded":"2024-05-14T01:24:32.624881+0000","last_fullsized":"2024-05-14T01:24:32.624881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:35:30.482169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.622961+0000","last_change":"2024-05-14T01:24:32.618571+0000","last_active":"2024-05-14T01:24:32.622961+0000","last_peered":"2024-05-14T01:24:32.622961+0000","last_clean":"2024-05-14T01:24:32.622961+0000","last_became_active":"2024-05-14T01:24:32.617821+0000","last_became_peered":"2024-05-14T01:24:32.617821+0000","last_unstale":"2024-05-14T01:24:32.622961+0000","last_undegraded":"2024-05-14T01:24:32.622961+0000","last_fullsized":"2024-05-14T01:24:32.622961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:27:57.390857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.593038+0000","last_change":"2024-05-14T01:24:32.593038+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.593038+0000","last_undegraded":"2024-05-14T01:24:32.593038+0000","last_fullsized":"2024-05-14T01:24:32.593038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.586498+0000","last_change":"2024-05-14T01:24:31.586498+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.586498+0000","last_undegraded":"2024-05-14T01:24:31.586498+0000","last_fullsized":"2024-05-14T01:24:31.586498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.610717+0000","last_change":"2024-05-14T01:24:32.610717+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.610717+0000","last_undegraded":"2024-05-14T01:24:32.610717+0000","last_fullsized":"2024-05-14T01:24:32.610717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.614515+0000","last_change":"2024-05-14T01:24:32.608635+0000","last_active":"2024-05-14T01:24:32.614515+0000","last_peered":"2024-05-14T01:24:32.614515+0000","last_clean":"2024-05-14T01:24:32.614515+0000","last_became_active":"2024-05-14T01:24:32.608351+0000","last_became_peered":"2024-05-14T01:24:32.608351+0000","last_unstale":"2024-05-14T01:24:32.614515+0000","last_undegraded":"2024-05-14T01:24:32.614515+0000","last_fullsized":"2024-05-14T01:24:32.614515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:18:20.146184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.620680+0000","last_change":"2024-05-14T01:23:25.487525+0000","last_active":"2024-05-14T01:24:32.620680+0000","last_peered":"2024-05-14T01:24:32.620680+0000","last_clean":"2024-05-14T01:24:32.620680+0000","last_became_active":"2024-05-14T01:23:25.485622+0000","last_became_peered":"2024-05-14T01:23:25.485622+0000","last_unstale":"2024-05-14T01:24:32.620680+0000","last_undegraded":"2024-05-14T01:24:32.620680+0000","last_fullsized":"2024-05-14T01:24:32.620680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_clean_scrub_stamp":"2024-05-14T01:23:24.138255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:26:23.884962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":942080,"data_stored":722483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":728750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":360448,"data_stored":138382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T01:24:37.967 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T01:24:38.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.140+0000 7fdfb5022640 1 Processor -- start 2024-05-14T01:24:38.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.140+0000 7fdfb5022640 1 -- start start 2024-05-14T01:24:38.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.140+0000 7fdfb5022640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdfb00cfbc0 0x7fdfb00716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:38.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.140+0000 7fdfb5022640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdfb00cb620 0x7fdfb0071c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:38.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.140+0000 7fdfb5022640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb0162a20 con 0x7fdfb00af6e0 2024-05-14T01:24:38.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.140+0000 7fdfb5022640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fdfb00afef0 con 0x7fdfb00cfbc0 2024-05-14T01:24:38.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.140+0000 7fdfb5022640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdfb0162ce0 con 0x7fdfb00cb620 2024-05-14T01:24:38.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.140+0000 7fdfaed9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdfb00cfbc0 0x7fdfb00716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:38.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.140+0000 7fdfaed9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdfb00cfbc0 0x7fdfb00716d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42738/0 (socket says 172.21.15.154:42738) 2024-05-14T01:24:38.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.140+0000 7fdfaed9d640 1 -- 172.21.15.154:0/166198822 learned_addr learned my addr 172.21.15.154:0/166198822 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:38.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.140+0000 7fdfaf59e640 1 --2- 172.21.15.154:0/166198822 >> v2:172.21.15.176:3300/0 conn(0x7fdfb00cb620 0x7fdfb0071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:38.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.140+0000 7fdfaed9d640 1 -- 172.21.15.154:0/166198822 >> v2:172.21.15.176:3300/0 conn(0x7fdfb00cb620 msgr2=0x7fdfb0071c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:38.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.140+0000 7fdfaed9d640 1 --2- 172.21.15.154:0/166198822 >> v2:172.21.15.176:3300/0 conn(0x7fdfb00cb620 0x7fdfb0071c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.140+0000 7fdfaed9d640 1 -- 172.21.15.154:0/166198822 >> v1:172.21.15.176:6789/0 conn(0x7fdfb00af6e0 legacy=0x7fdfb0166010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:38.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.140+0000 7fdfaed9d640 1 -- 172.21.15.154:0/166198822 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb0162fc0 con 0x7fdfb00cfbc0 2024-05-14T01:24:38.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.144+0000 7fdfaed9d640 1 --2- 172.21.15.154:0/166198822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb00cfbc0 0x7fdfb00716d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00caa50 tx=0x7fdfa001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa495de044417e9c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:38.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.144+0000 7fdfae59c640 1 -- 172.21.15.154:0/166198822 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00ab640 con 0x7fdfb00cfbc0 2024-05-14T01:24:38.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.144+0000 7fdfae59c640 1 -- 172.21.15.154:0/166198822 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa00b0070 con 0x7fdfb00cfbc0 2024-05-14T01:24:38.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.144+0000 7fdfae59c640 1 -- 172.21.15.154:0/166198822 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00aba00 con 0x7fdfb00cfbc0 2024-05-14T01:24:38.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.144+0000 7fdfb5022640 1 -- 172.21.15.154:0/166198822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb00cfbc0 msgr2=0x7fdfb00716d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:38.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.144+0000 7fdfb5022640 1 --2- 172.21.15.154:0/166198822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb00cfbc0 0x7fdfb00716d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00caa50 tx=0x7fdfa001c520 comp rx=0 tx=0).stop 2024-05-14T01:24:38.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.144+0000 7fdfb5022640 1 -- 172.21.15.154:0/166198822 shutdown_connections 2024-05-14T01:24:38.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.144+0000 7fdfb5022640 1 --2- 172.21.15.154:0/166198822 >> v2:172.21.15.176:3300/0 conn(0x7fdfb00cb620 0x7fdfb0071c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.144+0000 7fdfb5022640 1 --2- 172.21.15.154:0/166198822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb00cfbc0 0x7fdfb00716d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.144+0000 7fdfb5022640 1 -- 172.21.15.154:0/166198822 >> 172.21.15.154:0/166198822 conn(0x7fdfb00ccef0 msgr2=0x7fdfb00cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:38.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.144+0000 7fdfb5022640 1 -- 172.21.15.154:0/166198822 shutdown_connections 2024-05-14T01:24:38.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.144+0000 7fdfb5022640 1 -- 172.21.15.154:0/166198822 wait complete. 2024-05-14T01:24:38.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.144+0000 7fdfb5022640 1 Processor -- start 2024-05-14T01:24:38.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.144+0000 7fdfb5022640 1 -- start start 2024-05-14T01:24:38.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfb5022640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdfb00cb620 0x7fdfb00ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:38.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfb5022640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb00cfbc0 0x7fdfb0154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:38.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfb5022640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfb0155050 0x7fdfb0153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:38.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfb5022640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb00cf050 con 0x7fdfb00cfbc0 2024-05-14T01:24:38.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfb5022640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb0067f10 con 0x7fdfb0155050 2024-05-14T01:24:38.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfb5022640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb00cf1d0 con 0x7fdfb00cb620 2024-05-14T01:24:38.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfa659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb00cfbc0 0x7fdfb0154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:38.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfa659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb00cfbc0 0x7fdfb0154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42742/0 (socket says 172.21.15.154:42742) 2024-05-14T01:24:38.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfa659c640 1 -- 172.21.15.154:0/1482063637 learned_addr learned my addr 172.21.15.154:0/1482063637 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:38.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfaf59e640 1 --2- 172.21.15.154:0/1482063637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfb0155050 0x7fdfb0153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:38.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfaed9d640 1 --2- 172.21.15.154:0/1482063637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdfb00cb620 0x7fdfb00ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:38.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfa659c640 1 -- 172.21.15.154:0/1482063637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdfb00cb620 msgr2=0x7fdfb00ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:38.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfa659c640 1 --2- 172.21.15.154:0/1482063637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdfb00cb620 0x7fdfb00ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfa659c640 1 -- 172.21.15.154:0/1482063637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfb0155050 msgr2=0x7fdfb0153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:38.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfa659c640 1 --2- 172.21.15.154:0/1482063637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfb0155050 0x7fdfb0153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfa659c640 1 -- 172.21.15.154:0/1482063637 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb0155990 con 0x7fdfb00cfbc0 2024-05-14T01:24:38.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfaf59e640 1 --2- 172.21.15.154:0/1482063637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfb0155050 0x7fdfb0153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:38.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfa659c640 1 --2- 172.21.15.154:0/1482063637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb00cfbc0 0x7fdfb0154b10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800c430 tx=0x7fdf9800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:38.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfa7fff640 1 -- 172.21.15.154:0/1482063637 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf980052d0 con 0x7fdfb00cfbc0 2024-05-14T01:24:38.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfa7fff640 1 -- 172.21.15.154:0/1482063637 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf98005470 con 0x7fdfb00cfbc0 2024-05-14T01:24:38.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfb5022640 1 -- 172.21.15.154:0/1482063637 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb0155c70 con 0x7fdfb00cfbc0 2024-05-14T01:24:38.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfa7fff640 1 -- 172.21.15.154:0/1482063637 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf98007260 con 0x7fdfb00cfbc0 2024-05-14T01:24:38.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfb5022640 1 -- 172.21.15.154:0/1482063637 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb006d8d0 con 0x7fdfb00cfbc0 2024-05-14T01:24:38.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfb5022640 1 -- 172.21.15.154:0/1482063637 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb006dad0 con 0x7fdfb00cfbc0 2024-05-14T01:24:38.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfa7fff640 1 -- 172.21.15.154:0/1482063637 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdf98007400 con 0x7fdfb00cfbc0 2024-05-14T01:24:38.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfa7fff640 1 --2- 172.21.15.154:0/1482063637 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdf900678c0 0x7fdf90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:38.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfaed9d640 1 --2- 172.21.15.154:0/1482063637 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdf900678c0 0x7fdf90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:38.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfa7fff640 1 -- 172.21.15.154:0/1482063637 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fdf980851e0 con 0x7fdfb00cfbc0 2024-05-14T01:24:38.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.148+0000 7fdfaed9d640 1 --2- 172.21.15.154:0/1482063637 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdf900678c0 0x7fdf90069d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00af000 tx=0x7fdfa00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:38.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.152+0000 7fdfa7fff640 1 -- 172.21.15.154:0/1482063637 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fdfb006dad0 con 0x7fdfb00cfbc0 2024-05-14T01:24:38.298 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.308+0000 7fdfb5022640 1 -- 172.21.15.154:0/1482063637 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdfb0068360 con 0x7fdf900678c0 2024-05-14T01:24:38.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.320+0000 7fdfa7fff640 1 -- 172.21.15.154:0/1482063637 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245505 (secure 0 0 0) 0x7fdfb0068360 con 0x7fdf900678c0 2024-05-14T01:24:38.309 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:38.310 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-05-14T01:24:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.324+0000 7fdfb5022640 1 -- 172.21.15.154:0/1482063637 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdf900678c0 msgr2=0x7fdf90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.324+0000 7fdfb5022640 1 --2- 172.21.15.154:0/1482063637 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdf900678c0 0x7fdf90069d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00af000 tx=0x7fdfa00a7000 comp rx=0 tx=0).stop 2024-05-14T01:24:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.324+0000 7fdfb5022640 1 -- 172.21.15.154:0/1482063637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb00cfbc0 msgr2=0x7fdfb0154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.324+0000 7fdfb5022640 1 --2- 172.21.15.154:0/1482063637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb00cfbc0 0x7fdfb0154b10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800c430 tx=0x7fdf9800c8f0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.324+0000 7fdfb5022640 1 -- 172.21.15.154:0/1482063637 shutdown_connections 2024-05-14T01:24:38.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.324+0000 7fdfb5022640 1 --2- 172.21.15.154:0/1482063637 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdf900678c0 0x7fdf90069d80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.324+0000 7fdfb5022640 1 --2- 172.21.15.154:0/1482063637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfb0155050 0x7fdfb0153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.324+0000 7fdfb5022640 1 --2- 172.21.15.154:0/1482063637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb00cfbc0 0x7fdfb0154b10 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.324+0000 7fdfb5022640 1 --2- 172.21.15.154:0/1482063637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdfb00cb620 0x7fdfb00ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.324+0000 7fdfb5022640 1 -- 172.21.15.154:0/1482063637 >> 172.21.15.154:0/1482063637 conn(0x7fdfb00ccef0 msgr2=0x7fdfb0165c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:38.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.324+0000 7fdfb5022640 1 -- 172.21.15.154:0/1482063637 shutdown_connections 2024-05-14T01:24:38.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.324+0000 7fdfb5022640 1 -- 172.21.15.154:0/1482063637 wait complete. 2024-05-14T01:24:38.327 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-05-14T01:24:37.120073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224252,"kb_used_data":3928,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750468,"statfs":{"total":773094113280,"available":772864479232,"internally_reserved":0,"allocated":4022272,"data_stored":2262724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.544414"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587167+0000","last_change":"2024-05-14T01:24:32.587167+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587167+0000","last_undegraded":"2024-05-14T01:24:32.587167+0000","last_fullsized":"2024-05-14T01:24:32.587167+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.599284+0000","last_change":"2024-05-14T01:24:32.599284+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.599284+0000","last_undegraded":"2024-05-14T01:24:32.599284+0000","last_fullsized":"2024-05-14T01:24:32.599284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.604151+0000","last_change":"2024-05-14T01:24:32.604151+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.604151+0000","last_undegraded":"2024-05-14T01:24:32.604151+0000","last_fullsized":"2024-05-14T01:24:32.604151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.594638+0000","last_change":"2024-05-14T01:24:32.594638+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.594638+0000","last_undegraded":"2024-05-14T01:24:32.594638+0000","last_fullsized":"2024-05-14T01:24:32.594638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.604163+0000","last_change":"2024-05-14T01:24:32.604163+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.604163+0000","last_undegraded":"2024-05-14T01:24:32.604163+0000","last_fullsized":"2024-05-14T01:24:32.604163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.619361+0000","last_change":"2024-05-14T01:24:32.619361+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.619361+0000","last_undegraded":"2024-05-14T01:24:32.619361+0000","last_fullsized":"2024-05-14T01:24:32.619361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.594896+0000","last_change":"2024-05-14T01:24:32.594896+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.594896+0000","last_undegraded":"2024-05-14T01:24:32.594896+0000","last_fullsized":"2024-05-14T01:24:32.594896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603481+0000","last_change":"2024-05-14T01:24:32.603481+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603481+0000","last_undegraded":"2024-05-14T01:24:32.603481+0000","last_fullsized":"2024-05-14T01:24:32.603481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603829+0000","last_change":"2024-05-14T01:24:32.603829+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603829+0000","last_undegraded":"2024-05-14T01:24:32.603829+0000","last_fullsized":"2024-05-14T01:24:32.603829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.599753+0000","last_change":"2024-05-14T01:24:32.599753+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.599753+0000","last_undegraded":"2024-05-14T01:24:32.599753+0000","last_fullsized":"2024-05-14T01:24:32.599753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.594055+0000","last_change":"2024-05-14T01:24:32.594055+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.594055+0000","last_undegraded":"2024-05-14T01:24:32.594055+0000","last_fullsized":"2024-05-14T01:24:32.594055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.597522+0000","last_change":"2024-05-14T01:24:32.597522+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.597522+0000","last_undegraded":"2024-05-14T01:24:32.597522+0000","last_fullsized":"2024-05-14T01:24:32.597522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.601904+0000","last_change":"2024-05-14T01:24:32.601904+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.601904+0000","last_undegraded":"2024-05-14T01:24:32.601904+0000","last_fullsized":"2024-05-14T01:24:32.601904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.610800+0000","last_change":"2024-05-14T01:24:32.610800+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.610800+0000","last_undegraded":"2024-05-14T01:24:32.610800+0000","last_fullsized":"2024-05-14T01:24:32.610800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.593038+0000","last_change":"2024-05-14T01:24:32.593038+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.593038+0000","last_undegraded":"2024-05-14T01:24:32.593038+0000","last_fullsized":"2024-05-14T01:24:32.593038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.595452+0000","last_change":"2024-05-14T01:24:32.595452+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.595452+0000","last_undegraded":"2024-05-14T01:24:32.595452+0000","last_fullsized":"2024-05-14T01:24:32.595452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587363+0000","last_change":"2024-05-14T01:24:32.587363+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587363+0000","last_undegraded":"2024-05-14T01:24:32.587363+0000","last_fullsized":"2024-05-14T01:24:32.587363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587693+0000","last_change":"2024-05-14T01:24:32.587693+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587693+0000","last_undegraded":"2024-05-14T01:24:32.587693+0000","last_fullsized":"2024-05-14T01:24:32.587693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.595864+0000","last_change":"2024-05-14T01:24:32.595864+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.595864+0000","last_undegraded":"2024-05-14T01:24:32.595864+0000","last_fullsized":"2024-05-14T01:24:32.595864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.605029+0000","last_change":"2024-05-14T01:24:32.605029+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.605029+0000","last_undegraded":"2024-05-14T01:24:32.605029+0000","last_fullsized":"2024-05-14T01:24:32.605029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.604559+0000","last_change":"2024-05-14T01:24:32.604559+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.604559+0000","last_undegraded":"2024-05-14T01:24:32.604559+0000","last_fullsized":"2024-05-14T01:24:32.604559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.598735+0000","last_change":"2024-05-14T01:24:32.598735+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.598735+0000","last_undegraded":"2024-05-14T01:24:32.598735+0000","last_fullsized":"2024-05-14T01:24:32.598735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587360+0000","last_change":"2024-05-14T01:24:32.587360+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587360+0000","last_undegraded":"2024-05-14T01:24:32.587360+0000","last_fullsized":"2024-05-14T01:24:32.587360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.611370+0000","last_change":"2024-05-14T01:24:32.611370+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.611370+0000","last_undegraded":"2024-05-14T01:24:32.611370+0000","last_fullsized":"2024-05-14T01:24:32.611370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.585963+0000","last_change":"2024-05-14T01:24:32.585963+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.585963+0000","last_undegraded":"2024-05-14T01:24:32.585963+0000","last_fullsized":"2024-05-14T01:24:32.585963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.616332+0000","last_change":"2024-05-14T01:24:32.616332+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.616332+0000","last_undegraded":"2024-05-14T01:24:32.616332+0000","last_fullsized":"2024-05-14T01:24:32.616332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.589008+0000","last_change":"2024-05-14T01:24:32.589008+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.589008+0000","last_undegraded":"2024-05-14T01:24:32.589008+0000","last_fullsized":"2024-05-14T01:24:32.589008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.624605+0000","last_change":"2024-05-14T01:24:32.621045+0000","last_active":"2024-05-14T01:24:32.624605+0000","last_peered":"2024-05-14T01:24:32.624605+0000","last_clean":"2024-05-14T01:24:32.624605+0000","last_became_active":"2024-05-14T01:24:32.620438+0000","last_became_peered":"2024-05-14T01:24:32.620438+0000","last_unstale":"2024-05-14T01:24:32.624605+0000","last_undegraded":"2024-05-14T01:24:32.624605+0000","last_fullsized":"2024-05-14T01:24:32.624605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:35:30.482169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.586055+0000","last_change":"2024-05-14T01:24:32.586055+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.586055+0000","last_undegraded":"2024-05-14T01:24:32.586055+0000","last_fullsized":"2024-05-14T01:24:32.586055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.619340+0000","last_change":"2024-05-14T01:24:32.617319+0000","last_active":"2024-05-14T01:24:32.619340+0000","last_peered":"2024-05-14T01:24:32.619340+0000","last_clean":"2024-05-14T01:24:32.619340+0000","last_became_active":"2024-05-14T01:24:32.616699+0000","last_became_peered":"2024-05-14T01:24:32.616699+0000","last_unstale":"2024-05-14T01:24:32.619340+0000","last_undegraded":"2024-05-14T01:24:32.619340+0000","last_fullsized":"2024-05-14T01:24:32.619340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:30:59.119076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587346+0000","last_change":"2024-05-14T01:24:32.587346+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587346+0000","last_undegraded":"2024-05-14T01:24:32.587346+0000","last_fullsized":"2024-05-14T01:24:32.587346+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.583945+0000","last_change":"2024-05-14T01:24:31.583945+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.583945+0000","last_undegraded":"2024-05-14T01:24:31.583945+0000","last_fullsized":"2024-05-14T01:24:31.583945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.604027+0000","last_change":"2024-05-14T01:24:32.604027+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.604027+0000","last_undegraded":"2024-05-14T01:24:32.604027+0000","last_fullsized":"2024-05-14T01:24:32.604027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.602753+0000","last_change":"2024-05-14T01:24:32.599149+0000","last_active":"2024-05-14T01:24:32.602753+0000","last_peered":"2024-05-14T01:24:32.602753+0000","last_clean":"2024-05-14T01:24:32.602753+0000","last_became_active":"2024-05-14T01:24:32.598789+0000","last_became_peered":"2024-05-14T01:24:32.598789+0000","last_unstale":"2024-05-14T01:24:32.602753+0000","last_undegraded":"2024-05-14T01:24:32.602753+0000","last_fullsized":"2024-05-14T01:24:32.602753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:22:32.117284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603914+0000","last_change":"2024-05-14T01:24:32.603914+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603914+0000","last_undegraded":"2024-05-14T01:24:32.603914+0000","last_fullsized":"2024-05-14T01:24:32.603914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.607889+0000","last_change":"2024-05-14T01:24:32.605488+0000","last_active":"2024-05-14T01:24:32.607889+0000","last_peered":"2024-05-14T01:24:32.607889+0000","last_clean":"2024-05-14T01:24:32.607889+0000","last_became_active":"2024-05-14T01:24:32.604323+0000","last_became_peered":"2024-05-14T01:24:32.604323+0000","last_unstale":"2024-05-14T01:24:32.607889+0000","last_undegraded":"2024-05-14T01:24:32.607889+0000","last_fullsized":"2024-05-14T01:24:32.607889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:28:05.246816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.607441+0000","last_change":"2024-05-14T01:24:32.607441+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.607441+0000","last_undegraded":"2024-05-14T01:24:32.607441+0000","last_fullsized":"2024-05-14T01:24:32.607441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.613164+0000","last_change":"2024-05-14T01:24:32.607898+0000","last_active":"2024-05-14T01:24:32.613164+0000","last_peered":"2024-05-14T01:24:32.613164+0000","last_clean":"2024-05-14T01:24:32.613164+0000","last_became_active":"2024-05-14T01:24:32.606398+0000","last_became_peered":"2024-05-14T01:24:32.606398+0000","last_unstale":"2024-05-14T01:24:32.613164+0000","last_undegraded":"2024-05-14T01:24:32.613164+0000","last_fullsized":"2024-05-14T01:24:32.613164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:22:32.117284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.592132+0000","last_change":"2024-05-14T01:24:32.592132+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.592132+0000","last_undegraded":"2024-05-14T01:24:32.592132+0000","last_fullsized":"2024-05-14T01:24:32.592132+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.584852+0000","last_change":"2024-05-14T01:24:31.584852+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.584852+0000","last_undegraded":"2024-05-14T01:24:31.584852+0000","last_fullsized":"2024-05-14T01:24:31.584852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603406+0000","last_change":"2024-05-14T01:24:32.603406+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603406+0000","last_undegraded":"2024-05-14T01:24:32.603406+0000","last_fullsized":"2024-05-14T01:24:32.603406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.613113+0000","last_change":"2024-05-14T01:24:32.609292+0000","last_active":"2024-05-14T01:24:32.613113+0000","last_peered":"2024-05-14T01:24:32.613113+0000","last_clean":"2024-05-14T01:24:32.613113+0000","last_became_active":"2024-05-14T01:24:32.603873+0000","last_became_peered":"2024-05-14T01:24:32.603873+0000","last_unstale":"2024-05-14T01:24:32.613113+0000","last_undegraded":"2024-05-14T01:24:32.613113+0000","last_fullsized":"2024-05-14T01:24:32.613113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:55:08.731639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.609275+0000","last_change":"2024-05-14T01:24:32.609275+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.609275+0000","last_undegraded":"2024-05-14T01:24:32.609275+0000","last_fullsized":"2024-05-14T01:24:32.609275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.584140+0000","last_change":"2024-05-14T01:24:31.584140+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.584140+0000","last_undegraded":"2024-05-14T01:24:31.584140+0000","last_fullsized":"2024-05-14T01:24:31.584140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.602008+0000","last_change":"2024-05-14T01:24:32.600536+0000","last_active":"2024-05-14T01:24:32.602008+0000","last_peered":"2024-05-14T01:24:32.602008+0000","last_clean":"2024-05-14T01:24:32.602008+0000","last_became_active":"2024-05-14T01:24:32.600218+0000","last_became_peered":"2024-05-14T01:24:32.600218+0000","last_unstale":"2024-05-14T01:24:32.602008+0000","last_undegraded":"2024-05-14T01:24:32.602008+0000","last_fullsized":"2024-05-14T01:24:32.602008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:35:30.482169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.625303+0000","last_change":"2024-05-14T01:24:32.621948+0000","last_active":"2024-05-14T01:24:32.625303+0000","last_peered":"2024-05-14T01:24:32.625303+0000","last_clean":"2024-05-14T01:24:32.625303+0000","last_became_active":"2024-05-14T01:24:32.619217+0000","last_became_peered":"2024-05-14T01:24:32.619217+0000","last_unstale":"2024-05-14T01:24:32.625303+0000","last_undegraded":"2024-05-14T01:24:32.625303+0000","last_fullsized":"2024-05-14T01:24:32.625303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:12:41.013625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.600344+0000","last_change":"2024-05-14T01:24:32.600344+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.600344+0000","last_undegraded":"2024-05-14T01:24:32.600344+0000","last_fullsized":"2024-05-14T01:24:32.600344+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.585656+0000","last_change":"2024-05-14T01:24:31.585656+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.585656+0000","last_undegraded":"2024-05-14T01:24:31.585656+0000","last_fullsized":"2024-05-14T01:24:31.585656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603377+0000","last_change":"2024-05-14T01:24:32.603377+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603377+0000","last_undegraded":"2024-05-14T01:24:32.603377+0000","last_fullsized":"2024-05-14T01:24:32.603377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.606312+0000","last_change":"2024-05-14T01:24:32.597406+0000","last_active":"2024-05-14T01:24:32.606312+0000","last_peered":"2024-05-14T01:24:32.606312+0000","last_clean":"2024-05-14T01:24:32.606312+0000","last_became_active":"2024-05-14T01:24:32.596659+0000","last_became_peered":"2024-05-14T01:24:32.596659+0000","last_unstale":"2024-05-14T01:24:32.606312+0000","last_undegraded":"2024-05-14T01:24:32.606312+0000","last_fullsized":"2024-05-14T01:24:32.606312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:53:24.102472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.605306+0000","last_change":"2024-05-14T01:24:32.602252+0000","last_active":"2024-05-14T01:24:32.605306+0000","last_peered":"2024-05-14T01:24:32.605306+0000","last_clean":"2024-05-14T01:24:32.605306+0000","last_became_active":"2024-05-14T01:24:32.601892+0000","last_became_peered":"2024-05-14T01:24:32.601892+0000","last_unstale":"2024-05-14T01:24:32.605306+0000","last_undegraded":"2024-05-14T01:24:32.605306+0000","last_fullsized":"2024-05-14T01:24:32.605306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:28:29.191976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.615199+0000","last_change":"2024-05-14T01:24:32.615199+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.615199+0000","last_undegraded":"2024-05-14T01:24:32.615199+0000","last_fullsized":"2024-05-14T01:24:32.615199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.585239+0000","last_change":"2024-05-14T01:24:31.585239+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.585239+0000","last_undegraded":"2024-05-14T01:24:31.585239+0000","last_fullsized":"2024-05-14T01:24:31.585239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.584473+0000","last_change":"2024-05-14T01:24:32.584473+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.584473+0000","last_undegraded":"2024-05-14T01:24:32.584473+0000","last_fullsized":"2024-05-14T01:24:32.584473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.586108+0000","last_change":"2024-05-14T01:24:31.586108+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.586108+0000","last_undegraded":"2024-05-14T01:24:31.586108+0000","last_fullsized":"2024-05-14T01:24:31.586108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.589427+0000","last_change":"2024-05-14T01:24:32.589427+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.589427+0000","last_undegraded":"2024-05-14T01:24:32.589427+0000","last_fullsized":"2024-05-14T01:24:32.589427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.605352+0000","last_change":"2024-05-14T01:24:32.600443+0000","last_active":"2024-05-14T01:24:32.605352+0000","last_peered":"2024-05-14T01:24:32.605352+0000","last_clean":"2024-05-14T01:24:32.605352+0000","last_became_active":"2024-05-14T01:24:32.600055+0000","last_became_peered":"2024-05-14T01:24:32.600055+0000","last_unstale":"2024-05-14T01:24:32.605352+0000","last_undegraded":"2024-05-14T01:24:32.605352+0000","last_fullsized":"2024-05-14T01:24:32.605352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:14:21.154539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.613800+0000","last_change":"2024-05-14T01:24:32.613800+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.613800+0000","last_undegraded":"2024-05-14T01:24:32.613800+0000","last_fullsized":"2024-05-14T01:24:32.613800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.606647+0000","last_change":"2024-05-14T01:24:32.600044+0000","last_active":"2024-05-14T01:24:32.606647+0000","last_peered":"2024-05-14T01:24:32.606647+0000","last_clean":"2024-05-14T01:24:32.606647+0000","last_became_active":"2024-05-14T01:24:32.598727+0000","last_became_peered":"2024-05-14T01:24:32.598727+0000","last_unstale":"2024-05-14T01:24:32.606647+0000","last_undegraded":"2024-05-14T01:24:32.606647+0000","last_fullsized":"2024-05-14T01:24:32.606647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:52:21.925895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603413+0000","last_change":"2024-05-14T01:24:32.603413+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603413+0000","last_undegraded":"2024-05-14T01:24:32.603413+0000","last_fullsized":"2024-05-14T01:24:32.603413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.606374+0000","last_change":"2024-05-14T01:24:32.598165+0000","last_active":"2024-05-14T01:24:32.606374+0000","last_peered":"2024-05-14T01:24:32.606374+0000","last_clean":"2024-05-14T01:24:32.606374+0000","last_became_active":"2024-05-14T01:24:32.597345+0000","last_became_peered":"2024-05-14T01:24:32.597345+0000","last_unstale":"2024-05-14T01:24:32.606374+0000","last_undegraded":"2024-05-14T01:24:32.606374+0000","last_fullsized":"2024-05-14T01:24:32.606374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:46:09.858831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.591022+0000","last_change":"2024-05-14T01:24:32.591022+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.591022+0000","last_undegraded":"2024-05-14T01:24:32.591022+0000","last_fullsized":"2024-05-14T01:24:32.591022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.612349+0000","last_change":"2024-05-14T01:24:32.607306+0000","last_active":"2024-05-14T01:24:32.612349+0000","last_peered":"2024-05-14T01:24:32.612349+0000","last_clean":"2024-05-14T01:24:32.612349+0000","last_became_active":"2024-05-14T01:24:32.605320+0000","last_became_peered":"2024-05-14T01:24:32.605320+0000","last_unstale":"2024-05-14T01:24:32.612349+0000","last_undegraded":"2024-05-14T01:24:32.612349+0000","last_fullsized":"2024-05-14T01:24:32.612349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:37:33.536316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.592267+0000","last_change":"2024-05-14T01:24:32.592267+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.592267+0000","last_undegraded":"2024-05-14T01:24:32.592267+0000","last_fullsized":"2024-05-14T01:24:32.592267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.601557+0000","last_change":"2024-05-14T01:24:32.599796+0000","last_active":"2024-05-14T01:24:32.601557+0000","last_peered":"2024-05-14T01:24:32.601557+0000","last_clean":"2024-05-14T01:24:32.601557+0000","last_became_active":"2024-05-14T01:24:32.599365+0000","last_became_peered":"2024-05-14T01:24:32.599365+0000","last_unstale":"2024-05-14T01:24:32.601557+0000","last_undegraded":"2024-05-14T01:24:32.601557+0000","last_fullsized":"2024-05-14T01:24:32.601557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:18:20.146184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.591263+0000","last_change":"2024-05-14T01:24:32.591263+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.591263+0000","last_undegraded":"2024-05-14T01:24:32.591263+0000","last_fullsized":"2024-05-14T01:24:32.591263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.608077+0000","last_change":"2024-05-14T01:24:32.601347+0000","last_active":"2024-05-14T01:24:32.608077+0000","last_peered":"2024-05-14T01:24:32.608077+0000","last_clean":"2024-05-14T01:24:32.608077+0000","last_became_active":"2024-05-14T01:24:32.598291+0000","last_became_peered":"2024-05-14T01:24:32.598291+0000","last_unstale":"2024-05-14T01:24:32.608077+0000","last_undegraded":"2024-05-14T01:24:32.608077+0000","last_fullsized":"2024-05-14T01:24:32.608077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:28:29.191976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.590083+0000","last_change":"2024-05-14T01:24:32.590083+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.590083+0000","last_undegraded":"2024-05-14T01:24:32.590083+0000","last_fullsized":"2024-05-14T01:24:32.590083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.609599+0000","last_change":"2024-05-14T01:24:32.599604+0000","last_active":"2024-05-14T01:24:32.609599+0000","last_peered":"2024-05-14T01:24:32.609599+0000","last_clean":"2024-05-14T01:24:32.609599+0000","last_became_active":"2024-05-14T01:24:32.598939+0000","last_became_peered":"2024-05-14T01:24:32.598939+0000","last_unstale":"2024-05-14T01:24:32.609599+0000","last_undegraded":"2024-05-14T01:24:32.609599+0000","last_fullsized":"2024-05-14T01:24:32.609599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:45:33.606315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.611940+0000","last_change":"2024-05-14T01:24:32.611940+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.611940+0000","last_undegraded":"2024-05-14T01:24:32.611940+0000","last_fullsized":"2024-05-14T01:24:32.611940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.625384+0000","last_change":"2024-05-14T01:24:32.622632+0000","last_active":"2024-05-14T01:24:32.625384+0000","last_peered":"2024-05-14T01:24:32.625384+0000","last_clean":"2024-05-14T01:24:32.625384+0000","last_became_active":"2024-05-14T01:24:32.622340+0000","last_became_peered":"2024-05-14T01:24:32.622340+0000","last_unstale":"2024-05-14T01:24:32.625384+0000","last_undegraded":"2024-05-14T01:24:32.625384+0000","last_fullsized":"2024-05-14T01:24:32.625384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:03:58.243337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.590669+0000","last_change":"2024-05-14T01:24:32.590669+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.590669+0000","last_undegraded":"2024-05-14T01:24:32.590669+0000","last_fullsized":"2024-05-14T01:24:32.590669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.619764+0000","last_change":"2024-05-14T01:24:32.615997+0000","last_active":"2024-05-14T01:24:32.619764+0000","last_peered":"2024-05-14T01:24:32.619764+0000","last_clean":"2024-05-14T01:24:32.619764+0000","last_became_active":"2024-05-14T01:24:32.615650+0000","last_became_peered":"2024-05-14T01:24:32.615650+0000","last_unstale":"2024-05-14T01:24:32.619764+0000","last_undegraded":"2024-05-14T01:24:32.619764+0000","last_fullsized":"2024-05-14T01:24:32.619764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:18:20.146184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.605880+0000","last_change":"2024-05-14T01:24:32.605880+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.605880+0000","last_undegraded":"2024-05-14T01:24:32.605880+0000","last_fullsized":"2024-05-14T01:24:32.605880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.599270+0000","last_change":"2024-05-14T01:24:32.598174+0000","last_active":"2024-05-14T01:24:32.599270+0000","last_peered":"2024-05-14T01:24:32.599270+0000","last_clean":"2024-05-14T01:24:32.599270+0000","last_became_active":"2024-05-14T01:24:32.595656+0000","last_became_peered":"2024-05-14T01:24:32.595656+0000","last_unstale":"2024-05-14T01:24:32.599270+0000","last_undegraded":"2024-05-14T01:24:32.599270+0000","last_fullsized":"2024-05-14T01:24:32.599270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:28:29.191976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587378+0000","last_change":"2024-05-14T01:24:32.587378+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587378+0000","last_undegraded":"2024-05-14T01:24:32.587378+0000","last_fullsized":"2024-05-14T01:24:32.587378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.603719+0000","last_change":"2024-05-14T01:24:32.600486+0000","last_active":"2024-05-14T01:24:32.603719+0000","last_peered":"2024-05-14T01:24:32.603719+0000","last_clean":"2024-05-14T01:24:32.603719+0000","last_became_active":"2024-05-14T01:24:32.599524+0000","last_became_peered":"2024-05-14T01:24:32.599524+0000","last_unstale":"2024-05-14T01:24:32.603719+0000","last_undegraded":"2024-05-14T01:24:32.603719+0000","last_fullsized":"2024-05-14T01:24:32.603719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:03:43.259015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.584591+0000","last_change":"2024-05-14T01:24:32.584591+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.584591+0000","last_undegraded":"2024-05-14T01:24:32.584591+0000","last_fullsized":"2024-05-14T01:24:32.584591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.624826+0000","last_change":"2024-05-14T01:24:32.619963+0000","last_active":"2024-05-14T01:24:32.624826+0000","last_peered":"2024-05-14T01:24:32.624826+0000","last_clean":"2024-05-14T01:24:32.624826+0000","last_became_active":"2024-05-14T01:24:32.619603+0000","last_became_peered":"2024-05-14T01:24:32.619603+0000","last_unstale":"2024-05-14T01:24:32.624826+0000","last_undegraded":"2024-05-14T01:24:32.624826+0000","last_fullsized":"2024-05-14T01:24:32.624826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:10:08.387975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.589558+0000","last_change":"2024-05-14T01:24:32.589558+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.589558+0000","last_undegraded":"2024-05-14T01:24:32.589558+0000","last_fullsized":"2024-05-14T01:24:32.589558+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.624881+0000","last_change":"2024-05-14T01:24:32.619957+0000","last_active":"2024-05-14T01:24:32.624881+0000","last_peered":"2024-05-14T01:24:32.624881+0000","last_clean":"2024-05-14T01:24:32.624881+0000","last_became_active":"2024-05-14T01:24:32.619431+0000","last_became_peered":"2024-05-14T01:24:32.619431+0000","last_unstale":"2024-05-14T01:24:32.624881+0000","last_undegraded":"2024-05-14T01:24:32.624881+0000","last_fullsized":"2024-05-14T01:24:32.624881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:35:30.482169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.622961+0000","last_change":"2024-05-14T01:24:32.618571+0000","last_active":"2024-05-14T01:24:32.622961+0000","last_peered":"2024-05-14T01:24:32.622961+0000","last_clean":"2024-05-14T01:24:32.622961+0000","last_became_active":"2024-05-14T01:24:32.617821+0000","last_became_peered":"2024-05-14T01:24:32.617821+0000","last_unstale":"2024-05-14T01:24:32.622961+0000","last_undegraded":"2024-05-14T01:24:32.622961+0000","last_fullsized":"2024-05-14T01:24:32.622961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:27:57.390857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.593038+0000","last_change":"2024-05-14T01:24:32.593038+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.593038+0000","last_undegraded":"2024-05-14T01:24:32.593038+0000","last_fullsized":"2024-05-14T01:24:32.593038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.586498+0000","last_change":"2024-05-14T01:24:31.586498+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.586498+0000","last_undegraded":"2024-05-14T01:24:31.586498+0000","last_fullsized":"2024-05-14T01:24:31.586498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.610717+0000","last_change":"2024-05-14T01:24:32.610717+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.610717+0000","last_undegraded":"2024-05-14T01:24:32.610717+0000","last_fullsized":"2024-05-14T01:24:32.610717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.614515+0000","last_change":"2024-05-14T01:24:32.608635+0000","last_active":"2024-05-14T01:24:32.614515+0000","last_peered":"2024-05-14T01:24:32.614515+0000","last_clean":"2024-05-14T01:24:32.614515+0000","last_became_active":"2024-05-14T01:24:32.608351+0000","last_became_peered":"2024-05-14T01:24:32.608351+0000","last_unstale":"2024-05-14T01:24:32.614515+0000","last_undegraded":"2024-05-14T01:24:32.614515+0000","last_fullsized":"2024-05-14T01:24:32.614515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:18:20.146184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.620680+0000","last_change":"2024-05-14T01:23:25.487525+0000","last_active":"2024-05-14T01:24:32.620680+0000","last_peered":"2024-05-14T01:24:32.620680+0000","last_clean":"2024-05-14T01:24:32.620680+0000","last_became_active":"2024-05-14T01:23:25.485622+0000","last_became_peered":"2024-05-14T01:23:25.485622+0000","last_unstale":"2024-05-14T01:24:32.620680+0000","last_undegraded":"2024-05-14T01:24:32.620680+0000","last_fullsized":"2024-05-14T01:24:32.620680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_clean_scrub_stamp":"2024-05-14T01:23:24.138255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:26:23.884962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":942080,"data_stored":722483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":728750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":360448,"data_stored":138382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T01:24:38.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-05-14T01:24:38.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.587167+0000', 'last_change': '2024-05-14T01:24:32.587167+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.587167+0000', 'last_undegraded': '2024-05-14T01:24:32.587167+0000', 'last_fullsized': '2024-05-14T01:24:32.587167+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-14T01:24:38.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-05-14T01:24:38.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-14T01:24:32.573964+0000', 'last_change': '2024-05-14T01:24:32.573964+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.573964+0000', 'last_undegraded': '2024-05-14T01:24:32.573964+0000', 'last_fullsized': '2024-05-14T01:24:32.573964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-14T01:24:38.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-05-14T01:24:38.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.599284+0000', 'last_change': '2024-05-14T01:24:32.599284+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.599284+0000', 'last_undegraded': '2024-05-14T01:24:32.599284+0000', 'last_fullsized': '2024-05-14T01:24:32.599284+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T01:24:38.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-05-14T01:24:38.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.604151+0000', 'last_change': '2024-05-14T01:24:32.604151+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.604151+0000', 'last_undegraded': '2024-05-14T01:24:32.604151+0000', 'last_fullsized': '2024-05-14T01:24:32.604151+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-14T01:24:38.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-05-14T01:24:38.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.594638+0000', 'last_change': '2024-05-14T01:24:32.594638+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.594638+0000', 'last_undegraded': '2024-05-14T01:24:32.594638+0000', 'last_fullsized': '2024-05-14T01:24:32.594638+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-14T01:24:38.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-05-14T01:24:38.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-14T01:24:32.573964+0000', 'last_change': '2024-05-14T01:24:32.573964+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.573964+0000', 'last_undegraded': '2024-05-14T01:24:32.573964+0000', 'last_fullsized': '2024-05-14T01:24:32.573964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-14T01:24:38.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-05-14T01:24:38.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.604163+0000', 'last_change': '2024-05-14T01:24:32.604163+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.604163+0000', 'last_undegraded': '2024-05-14T01:24:32.604163+0000', 'last_fullsized': '2024-05-14T01:24:32.604163+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T01:24:38.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-05-14T01:24:38.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.619361+0000', 'last_change': '2024-05-14T01:24:32.619361+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.619361+0000', 'last_undegraded': '2024-05-14T01:24:32.619361+0000', 'last_fullsized': '2024-05-14T01:24:32.619361+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T01:24:38.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-05-14T01:24:38.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.594896+0000', 'last_change': '2024-05-14T01:24:32.594896+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.594896+0000', 'last_undegraded': '2024-05-14T01:24:32.594896+0000', 'last_fullsized': '2024-05-14T01:24:32.594896+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-14T01:24:38.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-05-14T01:24:38.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.603481+0000', 'last_change': '2024-05-14T01:24:32.603481+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.603481+0000', 'last_undegraded': '2024-05-14T01:24:32.603481+0000', 'last_fullsized': '2024-05-14T01:24:32.603481+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-14T01:24:38.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-05-14T01:24:38.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.603829+0000', 'last_change': '2024-05-14T01:24:32.603829+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.603829+0000', 'last_undegraded': '2024-05-14T01:24:32.603829+0000', 'last_fullsized': '2024-05-14T01:24:32.603829+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T01:24:38.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-05-14T01:24:38.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.599753+0000', 'last_change': '2024-05-14T01:24:32.599753+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.599753+0000', 'last_undegraded': '2024-05-14T01:24:32.599753+0000', 'last_fullsized': '2024-05-14T01:24:32.599753+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T01:24:38.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-05-14T01:24:38.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.594055+0000', 'last_change': '2024-05-14T01:24:32.594055+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.594055+0000', 'last_undegraded': '2024-05-14T01:24:32.594055+0000', 'last_fullsized': '2024-05-14T01:24:32.594055+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-14T01:24:38.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-05-14T01:24:38.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-14T01:24:32.573964+0000', 'last_change': '2024-05-14T01:24:32.573964+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.573964+0000', 'last_undegraded': '2024-05-14T01:24:32.573964+0000', 'last_fullsized': '2024-05-14T01:24:32.573964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-14T01:24:38.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-05-14T01:24:38.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.597522+0000', 'last_change': '2024-05-14T01:24:32.597522+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.597522+0000', 'last_undegraded': '2024-05-14T01:24:32.597522+0000', 'last_fullsized': '2024-05-14T01:24:32.597522+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T01:24:38.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-05-14T01:24:38.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.601904+0000', 'last_change': '2024-05-14T01:24:32.601904+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.601904+0000', 'last_undegraded': '2024-05-14T01:24:32.601904+0000', 'last_fullsized': '2024-05-14T01:24:32.601904+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T01:24:38.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-05-14T01:24:38.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.610800+0000', 'last_change': '2024-05-14T01:24:32.610800+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.610800+0000', 'last_undegraded': '2024-05-14T01:24:32.610800+0000', 'last_fullsized': '2024-05-14T01:24:32.610800+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T01:24:38.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-05-14T01:24:38.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-14T01:24:32.573964+0000', 'last_change': '2024-05-14T01:24:32.573964+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.573964+0000', 'last_undegraded': '2024-05-14T01:24:32.573964+0000', 'last_fullsized': '2024-05-14T01:24:32.573964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-14T01:24:38.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-05-14T01:24:38.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-14T01:24:32.573964+0000', 'last_change': '2024-05-14T01:24:32.573964+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.573964+0000', 'last_undegraded': '2024-05-14T01:24:32.573964+0000', 'last_fullsized': '2024-05-14T01:24:32.573964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-14T01:24:38.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-05-14T01:24:38.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.593038+0000', 'last_change': '2024-05-14T01:24:32.593038+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.593038+0000', 'last_undegraded': '2024-05-14T01:24:32.593038+0000', 'last_fullsized': '2024-05-14T01:24:32.593038+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-14T01:24:38.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-05-14T01:24:38.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.595452+0000', 'last_change': '2024-05-14T01:24:32.595452+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.595452+0000', 'last_undegraded': '2024-05-14T01:24:32.595452+0000', 'last_fullsized': '2024-05-14T01:24:32.595452+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-14T01:24:38.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-05-14T01:24:38.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.587363+0000', 'last_change': '2024-05-14T01:24:32.587363+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.587363+0000', 'last_undegraded': '2024-05-14T01:24:32.587363+0000', 'last_fullsized': '2024-05-14T01:24:32.587363+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-14T01:24:38.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-05-14T01:24:38.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.587693+0000', 'last_change': '2024-05-14T01:24:32.587693+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.587693+0000', 'last_undegraded': '2024-05-14T01:24:32.587693+0000', 'last_fullsized': '2024-05-14T01:24:32.587693+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-14T01:24:38.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-05-14T01:24:38.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.595864+0000', 'last_change': '2024-05-14T01:24:32.595864+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.595864+0000', 'last_undegraded': '2024-05-14T01:24:32.595864+0000', 'last_fullsized': '2024-05-14T01:24:32.595864+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T01:24:38.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-05-14T01:24:38.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.605029+0000', 'last_change': '2024-05-14T01:24:32.605029+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.605029+0000', 'last_undegraded': '2024-05-14T01:24:32.605029+0000', 'last_fullsized': '2024-05-14T01:24:32.605029+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-14T01:24:38.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-05-14T01:24:38.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-14T01:24:32.573964+0000', 'last_change': '2024-05-14T01:24:32.573964+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.573964+0000', 'last_undegraded': '2024-05-14T01:24:32.573964+0000', 'last_fullsized': '2024-05-14T01:24:32.573964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-14T01:24:38.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-05-14T01:24:38.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.604559+0000', 'last_change': '2024-05-14T01:24:32.604559+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.604559+0000', 'last_undegraded': '2024-05-14T01:24:32.604559+0000', 'last_fullsized': '2024-05-14T01:24:32.604559+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-14T01:24:38.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-05-14T01:24:38.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.598735+0000', 'last_change': '2024-05-14T01:24:32.598735+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.598735+0000', 'last_undegraded': '2024-05-14T01:24:32.598735+0000', 'last_fullsized': '2024-05-14T01:24:32.598735+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T01:24:38.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-05-14T01:24:38.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.587360+0000', 'last_change': '2024-05-14T01:24:32.587360+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.587360+0000', 'last_undegraded': '2024-05-14T01:24:32.587360+0000', 'last_fullsized': '2024-05-14T01:24:32.587360+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-14T01:24:38.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-05-14T01:24:38.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.611370+0000', 'last_change': '2024-05-14T01:24:32.611370+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.611370+0000', 'last_undegraded': '2024-05-14T01:24:32.611370+0000', 'last_fullsized': '2024-05-14T01:24:32.611370+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T01:24:38.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-05-14T01:24:38.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.585963+0000', 'last_change': '2024-05-14T01:24:32.585963+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.585963+0000', 'last_undegraded': '2024-05-14T01:24:32.585963+0000', 'last_fullsized': '2024-05-14T01:24:32.585963+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-14T01:24:38.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-05-14T01:24:38.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.616332+0000', 'last_change': '2024-05-14T01:24:32.616332+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.616332+0000', 'last_undegraded': '2024-05-14T01:24:32.616332+0000', 'last_fullsized': '2024-05-14T01:24:32.616332+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T01:24:38.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-05-14T01:24:38.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.589008+0000', 'last_change': '2024-05-14T01:24:32.589008+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.589008+0000', 'last_undegraded': '2024-05-14T01:24:32.589008+0000', 'last_fullsized': '2024-05-14T01:24:32.589008+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-14T01:24:38.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-05-14T01:24:38.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.586055+0000', 'last_change': '2024-05-14T01:24:32.586055+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.586055+0000', 'last_undegraded': '2024-05-14T01:24:32.586055+0000', 'last_fullsized': '2024-05-14T01:24:32.586055+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-14T01:24:38.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-05-14T01:24:38.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.587346+0000', 'last_change': '2024-05-14T01:24:32.587346+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.587346+0000', 'last_undegraded': '2024-05-14T01:24:32.587346+0000', 'last_fullsized': '2024-05-14T01:24:32.587346+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-14T01:24:38.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-05-14T01:24:38.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:31.583945+0000', 'last_change': '2024-05-14T01:24:31.583945+0000', 'last_active': '2024-05-14T01:24:31.565612+0000', 'last_peered': '2024-05-14T01:24:31.565612+0000', 'last_clean': '2024-05-14T01:24:31.565612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:31.583945+0000', 'last_undegraded': '2024-05-14T01:24:31.583945+0000', 'last_fullsized': '2024-05-14T01:24:31.583945+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-14T01:24:38.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-05-14T01:24:38.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.604027+0000', 'last_change': '2024-05-14T01:24:32.604027+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.604027+0000', 'last_undegraded': '2024-05-14T01:24:32.604027+0000', 'last_fullsized': '2024-05-14T01:24:32.604027+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-14T01:24:38.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-05-14T01:24:38.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.603914+0000', 'last_change': '2024-05-14T01:24:32.603914+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.603914+0000', 'last_undegraded': '2024-05-14T01:24:32.603914+0000', 'last_fullsized': '2024-05-14T01:24:32.603914+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T01:24:38.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-05-14T01:24:38.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.607441+0000', 'last_change': '2024-05-14T01:24:32.607441+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.607441+0000', 'last_undegraded': '2024-05-14T01:24:32.607441+0000', 'last_fullsized': '2024-05-14T01:24:32.607441+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T01:24:38.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-05-14T01:24:38.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.592132+0000', 'last_change': '2024-05-14T01:24:32.592132+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.592132+0000', 'last_undegraded': '2024-05-14T01:24:32.592132+0000', 'last_fullsized': '2024-05-14T01:24:32.592132+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-14T01:24:38.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-05-14T01:24:38.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:31.584852+0000', 'last_change': '2024-05-14T01:24:31.584852+0000', 'last_active': '2024-05-14T01:24:31.565612+0000', 'last_peered': '2024-05-14T01:24:31.565612+0000', 'last_clean': '2024-05-14T01:24:31.565612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:31.584852+0000', 'last_undegraded': '2024-05-14T01:24:31.584852+0000', 'last_fullsized': '2024-05-14T01:24:31.584852+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-14T01:24:38.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-05-14T01:24:38.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.603406+0000', 'last_change': '2024-05-14T01:24:32.603406+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.603406+0000', 'last_undegraded': '2024-05-14T01:24:32.603406+0000', 'last_fullsized': '2024-05-14T01:24:32.603406+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-14T01:24:38.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-05-14T01:24:38.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.609275+0000', 'last_change': '2024-05-14T01:24:32.609275+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.609275+0000', 'last_undegraded': '2024-05-14T01:24:32.609275+0000', 'last_fullsized': '2024-05-14T01:24:32.609275+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T01:24:38.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-05-14T01:24:38.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:31.584140+0000', 'last_change': '2024-05-14T01:24:31.584140+0000', 'last_active': '2024-05-14T01:24:31.565612+0000', 'last_peered': '2024-05-14T01:24:31.565612+0000', 'last_clean': '2024-05-14T01:24:31.565612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:31.584140+0000', 'last_undegraded': '2024-05-14T01:24:31.584140+0000', 'last_fullsized': '2024-05-14T01:24:31.584140+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-14T01:24:38.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-05-14T01:24:38.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-14T01:24:32.573964+0000', 'last_change': '2024-05-14T01:24:32.573964+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.573964+0000', 'last_undegraded': '2024-05-14T01:24:32.573964+0000', 'last_fullsized': '2024-05-14T01:24:32.573964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-14T01:24:38.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-05-14T01:24:38.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-14T01:24:32.573964+0000', 'last_change': '2024-05-14T01:24:32.573964+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.573964+0000', 'last_undegraded': '2024-05-14T01:24:32.573964+0000', 'last_fullsized': '2024-05-14T01:24:32.573964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-14T01:24:38.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-05-14T01:24:38.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.600344+0000', 'last_change': '2024-05-14T01:24:32.600344+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.600344+0000', 'last_undegraded': '2024-05-14T01:24:32.600344+0000', 'last_fullsized': '2024-05-14T01:24:32.600344+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T01:24:38.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-05-14T01:24:38.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:31.585656+0000', 'last_change': '2024-05-14T01:24:31.585656+0000', 'last_active': '2024-05-14T01:24:31.565612+0000', 'last_peered': '2024-05-14T01:24:31.565612+0000', 'last_clean': '2024-05-14T01:24:31.565612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:31.585656+0000', 'last_undegraded': '2024-05-14T01:24:31.585656+0000', 'last_fullsized': '2024-05-14T01:24:31.585656+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-14T01:24:38.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-05-14T01:24:38.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.603377+0000', 'last_change': '2024-05-14T01:24:32.603377+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.603377+0000', 'last_undegraded': '2024-05-14T01:24:32.603377+0000', 'last_fullsized': '2024-05-14T01:24:32.603377+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-14T01:24:38.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-05-14T01:24:38.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-14T01:24:32.573964+0000', 'last_change': '2024-05-14T01:24:32.573964+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.573964+0000', 'last_undegraded': '2024-05-14T01:24:32.573964+0000', 'last_fullsized': '2024-05-14T01:24:32.573964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-14T01:24:38.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-05-14T01:24:38.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.615199+0000', 'last_change': '2024-05-14T01:24:32.615199+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.615199+0000', 'last_undegraded': '2024-05-14T01:24:32.615199+0000', 'last_fullsized': '2024-05-14T01:24:32.615199+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T01:24:38.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-05-14T01:24:38.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:31.585239+0000', 'last_change': '2024-05-14T01:24:31.585239+0000', 'last_active': '2024-05-14T01:24:31.565612+0000', 'last_peered': '2024-05-14T01:24:31.565612+0000', 'last_clean': '2024-05-14T01:24:31.565612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:31.585239+0000', 'last_undegraded': '2024-05-14T01:24:31.585239+0000', 'last_fullsized': '2024-05-14T01:24:31.585239+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-14T01:24:38.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-05-14T01:24:38.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.584473+0000', 'last_change': '2024-05-14T01:24:32.584473+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.584473+0000', 'last_undegraded': '2024-05-14T01:24:32.584473+0000', 'last_fullsized': '2024-05-14T01:24:32.584473+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-14T01:24:38.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-05-14T01:24:38.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:31.586108+0000', 'last_change': '2024-05-14T01:24:31.586108+0000', 'last_active': '2024-05-14T01:24:31.565612+0000', 'last_peered': '2024-05-14T01:24:31.565612+0000', 'last_clean': '2024-05-14T01:24:31.565612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:31.586108+0000', 'last_undegraded': '2024-05-14T01:24:31.586108+0000', 'last_fullsized': '2024-05-14T01:24:31.586108+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-14T01:24:38.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-05-14T01:24:38.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.589427+0000', 'last_change': '2024-05-14T01:24:32.589427+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.589427+0000', 'last_undegraded': '2024-05-14T01:24:32.589427+0000', 'last_fullsized': '2024-05-14T01:24:32.589427+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-14T01:24:38.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-05-14T01:24:38.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.613800+0000', 'last_change': '2024-05-14T01:24:32.613800+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.613800+0000', 'last_undegraded': '2024-05-14T01:24:32.613800+0000', 'last_fullsized': '2024-05-14T01:24:32.613800+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T01:24:38.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-05-14T01:24:38.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.603413+0000', 'last_change': '2024-05-14T01:24:32.603413+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.603413+0000', 'last_undegraded': '2024-05-14T01:24:32.603413+0000', 'last_fullsized': '2024-05-14T01:24:32.603413+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-14T01:24:38.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-05-14T01:24:38.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.591022+0000', 'last_change': '2024-05-14T01:24:32.591022+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.591022+0000', 'last_undegraded': '2024-05-14T01:24:32.591022+0000', 'last_fullsized': '2024-05-14T01:24:32.591022+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-14T01:24:38.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-05-14T01:24:38.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.592267+0000', 'last_change': '2024-05-14T01:24:32.592267+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.592267+0000', 'last_undegraded': '2024-05-14T01:24:32.592267+0000', 'last_fullsized': '2024-05-14T01:24:32.592267+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-14T01:24:38.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-05-14T01:24:38.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.591263+0000', 'last_change': '2024-05-14T01:24:32.591263+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.591263+0000', 'last_undegraded': '2024-05-14T01:24:32.591263+0000', 'last_fullsized': '2024-05-14T01:24:32.591263+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-14T01:24:38.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-05-14T01:24:38.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.590083+0000', 'last_change': '2024-05-14T01:24:32.590083+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.590083+0000', 'last_undegraded': '2024-05-14T01:24:32.590083+0000', 'last_fullsized': '2024-05-14T01:24:32.590083+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-14T01:24:38.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-05-14T01:24:38.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.611940+0000', 'last_change': '2024-05-14T01:24:32.611940+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.611940+0000', 'last_undegraded': '2024-05-14T01:24:32.611940+0000', 'last_fullsized': '2024-05-14T01:24:32.611940+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T01:24:38.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-05-14T01:24:38.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.590669+0000', 'last_change': '2024-05-14T01:24:32.590669+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.590669+0000', 'last_undegraded': '2024-05-14T01:24:32.590669+0000', 'last_fullsized': '2024-05-14T01:24:32.590669+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-14T01:24:38.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-05-14T01:24:38.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.605880+0000', 'last_change': '2024-05-14T01:24:32.605880+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.605880+0000', 'last_undegraded': '2024-05-14T01:24:32.605880+0000', 'last_fullsized': '2024-05-14T01:24:32.605880+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T01:24:38.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-05-14T01:24:38.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.587378+0000', 'last_change': '2024-05-14T01:24:32.587378+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.587378+0000', 'last_undegraded': '2024-05-14T01:24:32.587378+0000', 'last_fullsized': '2024-05-14T01:24:32.587378+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-14T01:24:38.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-05-14T01:24:38.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.584591+0000', 'last_change': '2024-05-14T01:24:32.584591+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.584591+0000', 'last_undegraded': '2024-05-14T01:24:32.584591+0000', 'last_fullsized': '2024-05-14T01:24:32.584591+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-14T01:24:38.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-05-14T01:24:38.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.589558+0000', 'last_change': '2024-05-14T01:24:32.589558+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.589558+0000', 'last_undegraded': '2024-05-14T01:24:32.589558+0000', 'last_fullsized': '2024-05-14T01:24:32.589558+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-14T01:24:38.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-05-14T01:24:38.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-14T01:24:32.573964+0000', 'last_change': '2024-05-14T01:24:32.573964+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.573964+0000', 'last_undegraded': '2024-05-14T01:24:32.573964+0000', 'last_fullsized': '2024-05-14T01:24:32.573964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-14T01:24:38.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-05-14T01:24:38.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.593038+0000', 'last_change': '2024-05-14T01:24:32.593038+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.593038+0000', 'last_undegraded': '2024-05-14T01:24:32.593038+0000', 'last_fullsized': '2024-05-14T01:24:32.593038+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-14T01:24:38.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-05-14T01:24:38.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:31.586498+0000', 'last_change': '2024-05-14T01:24:31.586498+0000', 'last_active': '2024-05-14T01:24:31.565612+0000', 'last_peered': '2024-05-14T01:24:31.565612+0000', 'last_clean': '2024-05-14T01:24:31.565612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:31.586498+0000', 'last_undegraded': '2024-05-14T01:24:31.586498+0000', 'last_fullsized': '2024-05-14T01:24:31.586498+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:31.565612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-14T01:24:38.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-05-14T01:24:38.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-05-14T01:24:32.610717+0000', 'last_change': '2024-05-14T01:24:32.610717+0000', 'last_active': '2024-05-14T01:24:32.573964+0000', 'last_peered': '2024-05-14T01:24:32.573964+0000', 'last_clean': '2024-05-14T01:24:32.573964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T01:24:32.610717+0000', 'last_undegraded': '2024-05-14T01:24:32.610717+0000', 'last_fullsized': '2024-05-14T01:24:32.610717+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'last_clean_scrub_stamp': '2024-05-14T01:24:32.573964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T01:24:38.342 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-14T01:24:38.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.500+0000 7fdb9f108640 1 Processor -- start 2024-05-14T01:24:38.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.500+0000 7fdb9f108640 1 -- start start 2024-05-14T01:24:38.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.500+0000 7fdb9f108640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdb9815e830 0x7fdb980b7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:38.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.500+0000 7fdb9f108640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdb980b7c50 0x7fdb980b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:38.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.500+0000 7fdb9f108640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb980cf780 con 0x7fdb9815e450 2024-05-14T01:24:38.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.500+0000 7fdb9f108640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fdb98162510 con 0x7fdb9815e830 2024-05-14T01:24:38.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.500+0000 7fdb9f108640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdb980d25a0 con 0x7fdb980b7c50 2024-05-14T01:24:38.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.500+0000 7fdb97fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdb9815e830 0x7fdb980b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:38.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.500+0000 7fdb97fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdb9815e830 0x7fdb980b7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42754/0 (socket says 172.21.15.154:42754) 2024-05-14T01:24:38.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.500+0000 7fdb97fff640 1 -- 172.21.15.154:0/3723174411 learned_addr learned my addr 172.21.15.154:0/3723174411 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:38.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.500+0000 7fdb9d6a5640 1 --2- 172.21.15.154:0/3723174411 >> v2:172.21.15.176:3300/0 conn(0x7fdb980b7c50 0x7fdb980b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:38.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.500+0000 7fdb97fff640 1 -- 172.21.15.154:0/3723174411 >> v2:172.21.15.176:3300/0 conn(0x7fdb980b7c50 msgr2=0x7fdb980b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:38.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.500+0000 7fdb97fff640 1 --2- 172.21.15.154:0/3723174411 >> v2:172.21.15.176:3300/0 conn(0x7fdb980b7c50 0x7fdb980b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.500+0000 7fdb97fff640 1 -- 172.21.15.154:0/3723174411 >> v1:172.21.15.176:6789/0 conn(0x7fdb9815e450 legacy=0x7fdb980d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:38.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.500+0000 7fdb97fff640 1 -- 172.21.15.154:0/3723174411 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb980cfa60 con 0x7fdb9815e830 2024-05-14T01:24:38.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.504+0000 7fdb97fff640 1 --2- 172.21.15.154:0/3723174411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb9815e830 0x7fdb980b7710 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdb980d3fc0 tx=0x7fdb8c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75bb580ee674a27 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:38.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.504+0000 7fdb977fe640 1 -- 172.21.15.154:0/3723174411 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c0b0070 con 0x7fdb9815e830 2024-05-14T01:24:38.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.504+0000 7fdb977fe640 1 -- 172.21.15.154:0/3723174411 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb8c0ab600 con 0x7fdb9815e830 2024-05-14T01:24:38.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.504+0000 7fdb977fe640 1 -- 172.21.15.154:0/3723174411 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c0ab9d0 con 0x7fdb9815e830 2024-05-14T01:24:38.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.504+0000 7fdb9f108640 1 -- 172.21.15.154:0/3723174411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb9815e830 msgr2=0x7fdb980b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:38.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.504+0000 7fdb9f108640 1 --2- 172.21.15.154:0/3723174411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb9815e830 0x7fdb980b7710 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdb980d3fc0 tx=0x7fdb8c01c450 comp rx=0 tx=0).stop 2024-05-14T01:24:38.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.504+0000 7fdb9f108640 1 -- 172.21.15.154:0/3723174411 shutdown_connections 2024-05-14T01:24:38.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.504+0000 7fdb9f108640 1 --2- 172.21.15.154:0/3723174411 >> v2:172.21.15.176:3300/0 conn(0x7fdb980b7c50 0x7fdb980b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.504+0000 7fdb9f108640 1 --2- 172.21.15.154:0/3723174411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb9815e830 0x7fdb980b7710 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.504+0000 7fdb9f108640 1 -- 172.21.15.154:0/3723174411 >> 172.21.15.154:0/3723174411 conn(0x7fdb980d0c70 msgr2=0x7fdb980d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:38.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.504+0000 7fdb9f108640 1 -- 172.21.15.154:0/3723174411 shutdown_connections 2024-05-14T01:24:38.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.504+0000 7fdb9f108640 1 -- 172.21.15.154:0/3723174411 wait complete. 2024-05-14T01:24:38.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.504+0000 7fdb9f108640 1 Processor -- start 2024-05-14T01:24:38.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.504+0000 7fdb9f108640 1 -- start start 2024-05-14T01:24:38.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9f108640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb980b7c50 0x7fdb98152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:38.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9f108640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb9815e450 0x7fdb980c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:38.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9f108640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb9815e830 0x7fdb9815a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:38.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9f108640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9816b6a0 con 0x7fdb980b7c50 2024-05-14T01:24:38.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9f108640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9816b520 con 0x7fdb9815e450 2024-05-14T01:24:38.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9f108640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdb9816b820 con 0x7fdb9815e830 2024-05-14T01:24:38.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9cea4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb980b7c50 0x7fdb98152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:38.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9cea4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb980b7c50 0x7fdb98152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42764/0 (socket says 172.21.15.154:42764) 2024-05-14T01:24:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9cea4640 1 -- 172.21.15.154:0/167242226 learned_addr learned my addr 172.21.15.154:0/167242226 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb97fff640 1 --2- 172.21.15.154:0/167242226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb9815e450 0x7fdb980c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9d6a5640 1 --2- 172.21.15.154:0/167242226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb9815e830 0x7fdb9815a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9cea4640 1 -- 172.21.15.154:0/167242226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb9815e830 msgr2=0x7fdb9815a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9cea4640 1 --2- 172.21.15.154:0/167242226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb9815e830 0x7fdb9815a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9cea4640 1 -- 172.21.15.154:0/167242226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb9815e450 msgr2=0x7fdb980c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9cea4640 1 --2- 172.21.15.154:0/167242226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb9815e450 0x7fdb980c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9cea4640 1 -- 172.21.15.154:0/167242226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb98159340 con 0x7fdb980b7c50 2024-05-14T01:24:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb97fff640 1 --2- 172.21.15.154:0/167242226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb9815e450 0x7fdb980c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9cea4640 1 --2- 172.21.15.154:0/167242226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb980b7c50 0x7fdb98152820 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdb8800c450 tx=0x7fdb8800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb957fa640 1 -- 172.21.15.154:0/167242226 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb88012830 con 0x7fdb980b7c50 2024-05-14T01:24:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb957fa640 1 -- 172.21.15.154:0/167242226 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb88017070 con 0x7fdb980b7c50 2024-05-14T01:24:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb957fa640 1 -- 172.21.15.154:0/167242226 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb88012c30 con 0x7fdb980b7c50 2024-05-14T01:24:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9f108640 1 -- 172.21.15.154:0/167242226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb98159620 con 0x7fdb980b7c50 2024-05-14T01:24:38.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9f108640 1 -- 172.21.15.154:0/167242226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb9815bb60 con 0x7fdb980b7c50 2024-05-14T01:24:38.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb9f108640 1 -- 172.21.15.154:0/167242226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb9815bd60 con 0x7fdb980b7c50 2024-05-14T01:24:38.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb957fa640 1 -- 172.21.15.154:0/167242226 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdb8801c460 con 0x7fdb980b7c50 2024-05-14T01:24:38.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb957fa640 1 --2- 172.21.15.154:0/167242226 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdb840678c0 0x7fdb84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:38.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb957fa640 1 -- 172.21.15.154:0/167242226 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fdb88085ac0 con 0x7fdb980b7c50 2024-05-14T01:24:38.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.508+0000 7fdb97fff640 1 --2- 172.21.15.154:0/167242226 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdb840678c0 0x7fdb84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:38.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.512+0000 7fdb97fff640 1 --2- 172.21.15.154:0/167242226 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdb840678c0 0x7fdb84069d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0ad000 tx=0x7fdb8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:38.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.516+0000 7fdb957fa640 1 -- 172.21.15.154:0/167242226 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fdb9815bd60 con 0x7fdb980b7c50 2024-05-14T01:24:38.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.728+0000 7fdb9f108640 1 -- 172.21.15.154:0/167242226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fdb98075470 con 0x7fdb980b7c50 2024-05-14T01:24:38.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.728+0000 7fdb957fa640 1 -- 172.21.15.154:0/167242226 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1657 (secure 0 0 0) 0x7fdb88056600 con 0x7fdb980b7c50 2024-05-14T01:24:38.717 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:38.717 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":88,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1715649802,"num_in_osds":8,"osd_in_since":1715649792,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":61},{"state_name":"active+clean","count":26},{"state_name":"unknown","count":10}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":229634048,"bytes_avail":772864479232,"bytes_total":773094113280,"unknown_pgs_ratio":0.10309278219938278,"inactive_pgs_ratio":0.62886595726013184},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5124}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-05-14T01:24:25.117424+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-05-14T01:24:38.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.732+0000 7fdb9f108640 1 -- 172.21.15.154:0/167242226 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdb840678c0 msgr2=0x7fdb84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:38.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.732+0000 7fdb9f108640 1 --2- 172.21.15.154:0/167242226 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdb840678c0 0x7fdb84069d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0ad000 tx=0x7fdb8c008040 comp rx=0 tx=0).stop 2024-05-14T01:24:38.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.732+0000 7fdb9f108640 1 -- 172.21.15.154:0/167242226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb980b7c50 msgr2=0x7fdb98152820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:38.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.732+0000 7fdb9f108640 1 --2- 172.21.15.154:0/167242226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb980b7c50 0x7fdb98152820 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdb8800c450 tx=0x7fdb8800c910 comp rx=0 tx=0).stop 2024-05-14T01:24:38.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.732+0000 7fdb9f108640 1 -- 172.21.15.154:0/167242226 shutdown_connections 2024-05-14T01:24:38.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.732+0000 7fdb9f108640 1 --2- 172.21.15.154:0/167242226 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fdb840678c0 0x7fdb84069d80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.732+0000 7fdb9f108640 1 --2- 172.21.15.154:0/167242226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb9815e830 0x7fdb9815a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.732+0000 7fdb9f108640 1 --2- 172.21.15.154:0/167242226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb9815e450 0x7fdb980c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.732+0000 7fdb9f108640 1 --2- 172.21.15.154:0/167242226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb980b7c50 0x7fdb98152820 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.732+0000 7fdb9f108640 1 -- 172.21.15.154:0/167242226 >> 172.21.15.154:0/167242226 conn(0x7fdb980d0c70 msgr2=0x7fdb980cbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:38.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.732+0000 7fdb9f108640 1 -- 172.21.15.154:0/167242226 shutdown_connections 2024-05-14T01:24:38.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.732+0000 7fdb9f108640 1 -- 172.21.15.154:0/167242226 wait complete. 2024-05-14T01:24:38.735 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-14T01:24:38.735 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T01:24:38.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.852+0000 7f465f91e640 1 Processor -- start 2024-05-14T01:24:38.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.852+0000 7f465f91e640 1 -- start start 2024-05-14T01:24:38.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.852+0000 7f465f91e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46580cf520 0x7f46580d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:38.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.852+0000 7f465f91e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f465815e4e0 0x7f46580b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:38.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.852+0000 7f465f91e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46580d29f0 con 0x7f465815e100 2024-05-14T01:24:38.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.852+0000 7f465f91e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f46580d2cd0 con 0x7f465815e4e0 2024-05-14T01:24:38.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.852+0000 7f465f91e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f46580d2fb0 con 0x7f46580cf520 2024-05-14T01:24:38.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.852+0000 7f465debb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f465815e4e0 0x7f46580b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:38.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.852+0000 7f465debb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f465815e4e0 0x7f46580b9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42774/0 (socket says 172.21.15.154:42774) 2024-05-14T01:24:38.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.852+0000 7f465debb640 1 -- 172.21.15.154:0/2217773462 learned_addr learned my addr 172.21.15.154:0/2217773462 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:38.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.852+0000 7f465debb640 1 -- 172.21.15.154:0/2217773462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46580cf520 msgr2=0x7f46580d22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:38.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.852+0000 7f465ceb9640 1 --2- 172.21.15.154:0/2217773462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46580cf520 0x7f46580d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:38.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.852+0000 7f465debb640 1 --2- 172.21.15.154:0/2217773462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46580cf520 0x7f46580d22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.852+0000 7f465debb640 1 -- 172.21.15.154:0/2217773462 >> v1:172.21.15.176:6789/0 conn(0x7f465815e100 legacy=0x7f46580cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:38.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.852+0000 7f465debb640 1 -- 172.21.15.154:0/2217773462 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46580d3290 con 0x7f465815e4e0 2024-05-14T01:24:38.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.852+0000 7f465debb640 1 --2- 172.21.15.154:0/2217773462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465815e4e0 0x7f46580b9b20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4650009e50 tx=0x7f465001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1f25c35b545489 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:38.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f464ffff640 1 -- 172.21.15.154:0/2217773462 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46500b4070 con 0x7f465815e4e0 2024-05-14T01:24:38.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f464ffff640 1 -- 172.21.15.154:0/2217773462 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46500af400 con 0x7f465815e4e0 2024-05-14T01:24:38.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f464ffff640 1 -- 172.21.15.154:0/2217773462 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46500af7d0 con 0x7f465815e4e0 2024-05-14T01:24:38.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465f91e640 1 -- 172.21.15.154:0/2217773462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465815e4e0 msgr2=0x7f46580b9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:38.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465f91e640 1 --2- 172.21.15.154:0/2217773462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465815e4e0 0x7f46580b9b20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4650009e50 tx=0x7f465001f1e0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465f91e640 1 -- 172.21.15.154:0/2217773462 shutdown_connections 2024-05-14T01:24:38.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465f91e640 1 --2- 172.21.15.154:0/2217773462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465815e4e0 0x7f46580b9b20 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465f91e640 1 --2- 172.21.15.154:0/2217773462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46580cf520 0x7f46580d22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465f91e640 1 -- 172.21.15.154:0/2217773462 >> 172.21.15.154:0/2217773462 conn(0x7f46580b5b50 msgr2=0x7f46580b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:38.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465f91e640 1 -- 172.21.15.154:0/2217773462 shutdown_connections 2024-05-14T01:24:38.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465f91e640 1 -- 172.21.15.154:0/2217773462 wait complete. 2024-05-14T01:24:38.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465f91e640 1 Processor -- start 2024-05-14T01:24:38.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465f91e640 1 -- start start 2024-05-14T01:24:38.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465f91e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46580cf520 0x7f46580c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:38.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465f91e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f465815e100 0x7f4658161380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:38.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465f91e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465815e4e0 0x7f465815ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:38.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465f91e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f46580d3c10 con 0x7f465815e4e0 2024-05-14T01:24:38.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465f91e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f46580d3a90 con 0x7f465815e100 2024-05-14T01:24:38.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465f91e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f46581f7ae0 con 0x7f46580cf520 2024-05-14T01:24:38.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465debb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465815e4e0 0x7f465815ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:38.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465debb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465815e4e0 0x7f465815ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42788/0 (socket says 172.21.15.154:42788) 2024-05-14T01:24:38.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465debb640 1 -- 172.21.15.154:0/2192295246 learned_addr learned my addr 172.21.15.154:0/2192295246 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:38.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465debb640 1 -- 172.21.15.154:0/2192295246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46580cf520 msgr2=0x7f46580c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:38.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465debb640 1 --2- 172.21.15.154:0/2192295246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46580cf520 0x7f46580c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465debb640 1 -- 172.21.15.154:0/2192295246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f465815e100 msgr2=0x7f4658161380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:38.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465ceb9640 1 --2- 172.21.15.154:0/2192295246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f465815e100 0x7f4658161380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:38.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465debb640 1 --2- 172.21.15.154:0/2192295246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f465815e100 0x7f4658161380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:38.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465debb640 1 -- 172.21.15.154:0/2192295246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46580c77b0 con 0x7f465815e4e0 2024-05-14T01:24:38.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465debb640 1 --2- 172.21.15.154:0/2192295246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465815e4e0 0x7f465815ba10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f46500b2040 tx=0x7f465001bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:38.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f464dffb640 1 -- 172.21.15.154:0/2192295246 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46500b4040 con 0x7f465815e4e0 2024-05-14T01:24:38.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f464dffb640 1 -- 172.21.15.154:0/2192295246 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46500c0070 con 0x7f465815e4e0 2024-05-14T01:24:38.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f464dffb640 1 -- 172.21.15.154:0/2192295246 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4650009510 con 0x7f465815e4e0 2024-05-14T01:24:38.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465f91e640 1 -- 172.21.15.154:0/2192295246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46581f7d50 con 0x7f465815e4e0 2024-05-14T01:24:38.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.856+0000 7f465f91e640 1 -- 172.21.15.154:0/2192295246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46581f8310 con 0x7f465815e4e0 2024-05-14T01:24:38.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.860+0000 7f465f91e640 1 -- 172.21.15.154:0/2192295246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4658075470 con 0x7f465815e4e0 2024-05-14T01:24:38.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.860+0000 7f464dffb640 1 -- 172.21.15.154:0/2192295246 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f46500c5460 con 0x7f465815e4e0 2024-05-14T01:24:38.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.860+0000 7f464dffb640 1 --2- 172.21.15.154:0/2192295246 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f463c0678c0 0x7f463c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:38.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.860+0000 7f465d6ba640 1 --2- 172.21.15.154:0/2192295246 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f463c0678c0 0x7f463c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:38.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.860+0000 7f464dffb640 1 -- 172.21.15.154:0/2192295246 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f46501240c0 con 0x7f465815e4e0 2024-05-14T01:24:38.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.860+0000 7f465d6ba640 1 --2- 172.21.15.154:0/2192295246 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f463c0678c0 0x7f463c069d80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4654003cf0 tx=0x7f46540079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:38.864+0000 7f464dffb640 1 -- 172.21.15.154:0/2192295246 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f4650018d40 con 0x7f465815e4e0 2024-05-14T01:24:39.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:39.016+0000 7f465f91e640 1 -- 172.21.15.154:0/2192295246 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4658072090 con 0x7f463c0678c0 2024-05-14T01:24:39.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:39.024+0000 7f464dffb640 1 -- 172.21.15.154:0/2192295246 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245505 (secure 0 0 0) 0x7f4658072090 con 0x7f463c0678c0 2024-05-14T01:24:39.014 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:39.015 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-05-14T01:24:39.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:39.028+0000 7f465f91e640 1 -- 172.21.15.154:0/2192295246 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f463c0678c0 msgr2=0x7f463c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:39.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:39.028+0000 7f465f91e640 1 --2- 172.21.15.154:0/2192295246 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f463c0678c0 0x7f463c069d80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4654003cf0 tx=0x7f46540079c0 comp rx=0 tx=0).stop 2024-05-14T01:24:39.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:39.028+0000 7f465f91e640 1 -- 172.21.15.154:0/2192295246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465815e4e0 msgr2=0x7f465815ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:39.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:39.028+0000 7f465f91e640 1 --2- 172.21.15.154:0/2192295246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465815e4e0 0x7f465815ba10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f46500b2040 tx=0x7f465001bf80 comp rx=0 tx=0).stop 2024-05-14T01:24:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:39.028+0000 7f465f91e640 1 -- 172.21.15.154:0/2192295246 shutdown_connections 2024-05-14T01:24:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:39.028+0000 7f465f91e640 1 --2- 172.21.15.154:0/2192295246 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f463c0678c0 0x7f463c069d80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:39.028+0000 7f465f91e640 1 --2- 172.21.15.154:0/2192295246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465815e4e0 0x7f465815ba10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:39.028+0000 7f465f91e640 1 --2- 172.21.15.154:0/2192295246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f465815e100 0x7f4658161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:39.028+0000 7f465f91e640 1 --2- 172.21.15.154:0/2192295246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46580cf520 0x7f46580c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:39.028+0000 7f465f91e640 1 -- 172.21.15.154:0/2192295246 >> 172.21.15.154:0/2192295246 conn(0x7f46580b5b50 msgr2=0x7f46580b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:39.028+0000 7f465f91e640 1 -- 172.21.15.154:0/2192295246 shutdown_connections 2024-05-14T01:24:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:39.028+0000 7f465f91e640 1 -- 172.21.15.154:0/2192295246 wait complete. 2024-05-14T01:24:39.031 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-05-14T01:24:37.120073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224252,"kb_used_data":3928,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750468,"statfs":{"total":773094113280,"available":772864479232,"internally_reserved":0,"allocated":4022272,"data_stored":2262724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.544414"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587167+0000","last_change":"2024-05-14T01:24:32.587167+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587167+0000","last_undegraded":"2024-05-14T01:24:32.587167+0000","last_fullsized":"2024-05-14T01:24:32.587167+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.599284+0000","last_change":"2024-05-14T01:24:32.599284+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.599284+0000","last_undegraded":"2024-05-14T01:24:32.599284+0000","last_fullsized":"2024-05-14T01:24:32.599284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.604151+0000","last_change":"2024-05-14T01:24:32.604151+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.604151+0000","last_undegraded":"2024-05-14T01:24:32.604151+0000","last_fullsized":"2024-05-14T01:24:32.604151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.594638+0000","last_change":"2024-05-14T01:24:32.594638+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.594638+0000","last_undegraded":"2024-05-14T01:24:32.594638+0000","last_fullsized":"2024-05-14T01:24:32.594638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.604163+0000","last_change":"2024-05-14T01:24:32.604163+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.604163+0000","last_undegraded":"2024-05-14T01:24:32.604163+0000","last_fullsized":"2024-05-14T01:24:32.604163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.619361+0000","last_change":"2024-05-14T01:24:32.619361+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.619361+0000","last_undegraded":"2024-05-14T01:24:32.619361+0000","last_fullsized":"2024-05-14T01:24:32.619361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.594896+0000","last_change":"2024-05-14T01:24:32.594896+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.594896+0000","last_undegraded":"2024-05-14T01:24:32.594896+0000","last_fullsized":"2024-05-14T01:24:32.594896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603481+0000","last_change":"2024-05-14T01:24:32.603481+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603481+0000","last_undegraded":"2024-05-14T01:24:32.603481+0000","last_fullsized":"2024-05-14T01:24:32.603481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603829+0000","last_change":"2024-05-14T01:24:32.603829+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603829+0000","last_undegraded":"2024-05-14T01:24:32.603829+0000","last_fullsized":"2024-05-14T01:24:32.603829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.599753+0000","last_change":"2024-05-14T01:24:32.599753+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.599753+0000","last_undegraded":"2024-05-14T01:24:32.599753+0000","last_fullsized":"2024-05-14T01:24:32.599753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.594055+0000","last_change":"2024-05-14T01:24:32.594055+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.594055+0000","last_undegraded":"2024-05-14T01:24:32.594055+0000","last_fullsized":"2024-05-14T01:24:32.594055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.597522+0000","last_change":"2024-05-14T01:24:32.597522+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.597522+0000","last_undegraded":"2024-05-14T01:24:32.597522+0000","last_fullsized":"2024-05-14T01:24:32.597522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.601904+0000","last_change":"2024-05-14T01:24:32.601904+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.601904+0000","last_undegraded":"2024-05-14T01:24:32.601904+0000","last_fullsized":"2024-05-14T01:24:32.601904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.610800+0000","last_change":"2024-05-14T01:24:32.610800+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.610800+0000","last_undegraded":"2024-05-14T01:24:32.610800+0000","last_fullsized":"2024-05-14T01:24:32.610800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.593038+0000","last_change":"2024-05-14T01:24:32.593038+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.593038+0000","last_undegraded":"2024-05-14T01:24:32.593038+0000","last_fullsized":"2024-05-14T01:24:32.593038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.595452+0000","last_change":"2024-05-14T01:24:32.595452+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.595452+0000","last_undegraded":"2024-05-14T01:24:32.595452+0000","last_fullsized":"2024-05-14T01:24:32.595452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587363+0000","last_change":"2024-05-14T01:24:32.587363+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587363+0000","last_undegraded":"2024-05-14T01:24:32.587363+0000","last_fullsized":"2024-05-14T01:24:32.587363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587693+0000","last_change":"2024-05-14T01:24:32.587693+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587693+0000","last_undegraded":"2024-05-14T01:24:32.587693+0000","last_fullsized":"2024-05-14T01:24:32.587693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.595864+0000","last_change":"2024-05-14T01:24:32.595864+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.595864+0000","last_undegraded":"2024-05-14T01:24:32.595864+0000","last_fullsized":"2024-05-14T01:24:32.595864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.605029+0000","last_change":"2024-05-14T01:24:32.605029+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.605029+0000","last_undegraded":"2024-05-14T01:24:32.605029+0000","last_fullsized":"2024-05-14T01:24:32.605029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.604559+0000","last_change":"2024-05-14T01:24:32.604559+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.604559+0000","last_undegraded":"2024-05-14T01:24:32.604559+0000","last_fullsized":"2024-05-14T01:24:32.604559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.598735+0000","last_change":"2024-05-14T01:24:32.598735+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.598735+0000","last_undegraded":"2024-05-14T01:24:32.598735+0000","last_fullsized":"2024-05-14T01:24:32.598735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587360+0000","last_change":"2024-05-14T01:24:32.587360+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587360+0000","last_undegraded":"2024-05-14T01:24:32.587360+0000","last_fullsized":"2024-05-14T01:24:32.587360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.611370+0000","last_change":"2024-05-14T01:24:32.611370+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.611370+0000","last_undegraded":"2024-05-14T01:24:32.611370+0000","last_fullsized":"2024-05-14T01:24:32.611370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.585963+0000","last_change":"2024-05-14T01:24:32.585963+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.585963+0000","last_undegraded":"2024-05-14T01:24:32.585963+0000","last_fullsized":"2024-05-14T01:24:32.585963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.616332+0000","last_change":"2024-05-14T01:24:32.616332+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.616332+0000","last_undegraded":"2024-05-14T01:24:32.616332+0000","last_fullsized":"2024-05-14T01:24:32.616332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.589008+0000","last_change":"2024-05-14T01:24:32.589008+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.589008+0000","last_undegraded":"2024-05-14T01:24:32.589008+0000","last_fullsized":"2024-05-14T01:24:32.589008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.624605+0000","last_change":"2024-05-14T01:24:32.621045+0000","last_active":"2024-05-14T01:24:32.624605+0000","last_peered":"2024-05-14T01:24:32.624605+0000","last_clean":"2024-05-14T01:24:32.624605+0000","last_became_active":"2024-05-14T01:24:32.620438+0000","last_became_peered":"2024-05-14T01:24:32.620438+0000","last_unstale":"2024-05-14T01:24:32.624605+0000","last_undegraded":"2024-05-14T01:24:32.624605+0000","last_fullsized":"2024-05-14T01:24:32.624605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:35:30.482169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.586055+0000","last_change":"2024-05-14T01:24:32.586055+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.586055+0000","last_undegraded":"2024-05-14T01:24:32.586055+0000","last_fullsized":"2024-05-14T01:24:32.586055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.619340+0000","last_change":"2024-05-14T01:24:32.617319+0000","last_active":"2024-05-14T01:24:32.619340+0000","last_peered":"2024-05-14T01:24:32.619340+0000","last_clean":"2024-05-14T01:24:32.619340+0000","last_became_active":"2024-05-14T01:24:32.616699+0000","last_became_peered":"2024-05-14T01:24:32.616699+0000","last_unstale":"2024-05-14T01:24:32.619340+0000","last_undegraded":"2024-05-14T01:24:32.619340+0000","last_fullsized":"2024-05-14T01:24:32.619340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:30:59.119076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587346+0000","last_change":"2024-05-14T01:24:32.587346+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587346+0000","last_undegraded":"2024-05-14T01:24:32.587346+0000","last_fullsized":"2024-05-14T01:24:32.587346+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.583945+0000","last_change":"2024-05-14T01:24:31.583945+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.583945+0000","last_undegraded":"2024-05-14T01:24:31.583945+0000","last_fullsized":"2024-05-14T01:24:31.583945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.604027+0000","last_change":"2024-05-14T01:24:32.604027+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.604027+0000","last_undegraded":"2024-05-14T01:24:32.604027+0000","last_fullsized":"2024-05-14T01:24:32.604027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.602753+0000","last_change":"2024-05-14T01:24:32.599149+0000","last_active":"2024-05-14T01:24:32.602753+0000","last_peered":"2024-05-14T01:24:32.602753+0000","last_clean":"2024-05-14T01:24:32.602753+0000","last_became_active":"2024-05-14T01:24:32.598789+0000","last_became_peered":"2024-05-14T01:24:32.598789+0000","last_unstale":"2024-05-14T01:24:32.602753+0000","last_undegraded":"2024-05-14T01:24:32.602753+0000","last_fullsized":"2024-05-14T01:24:32.602753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:22:32.117284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603914+0000","last_change":"2024-05-14T01:24:32.603914+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603914+0000","last_undegraded":"2024-05-14T01:24:32.603914+0000","last_fullsized":"2024-05-14T01:24:32.603914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.607889+0000","last_change":"2024-05-14T01:24:32.605488+0000","last_active":"2024-05-14T01:24:32.607889+0000","last_peered":"2024-05-14T01:24:32.607889+0000","last_clean":"2024-05-14T01:24:32.607889+0000","last_became_active":"2024-05-14T01:24:32.604323+0000","last_became_peered":"2024-05-14T01:24:32.604323+0000","last_unstale":"2024-05-14T01:24:32.607889+0000","last_undegraded":"2024-05-14T01:24:32.607889+0000","last_fullsized":"2024-05-14T01:24:32.607889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:28:05.246816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.607441+0000","last_change":"2024-05-14T01:24:32.607441+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.607441+0000","last_undegraded":"2024-05-14T01:24:32.607441+0000","last_fullsized":"2024-05-14T01:24:32.607441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.613164+0000","last_change":"2024-05-14T01:24:32.607898+0000","last_active":"2024-05-14T01:24:32.613164+0000","last_peered":"2024-05-14T01:24:32.613164+0000","last_clean":"2024-05-14T01:24:32.613164+0000","last_became_active":"2024-05-14T01:24:32.606398+0000","last_became_peered":"2024-05-14T01:24:32.606398+0000","last_unstale":"2024-05-14T01:24:32.613164+0000","last_undegraded":"2024-05-14T01:24:32.613164+0000","last_fullsized":"2024-05-14T01:24:32.613164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:22:32.117284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.592132+0000","last_change":"2024-05-14T01:24:32.592132+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.592132+0000","last_undegraded":"2024-05-14T01:24:32.592132+0000","last_fullsized":"2024-05-14T01:24:32.592132+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.584852+0000","last_change":"2024-05-14T01:24:31.584852+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.584852+0000","last_undegraded":"2024-05-14T01:24:31.584852+0000","last_fullsized":"2024-05-14T01:24:31.584852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603406+0000","last_change":"2024-05-14T01:24:32.603406+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603406+0000","last_undegraded":"2024-05-14T01:24:32.603406+0000","last_fullsized":"2024-05-14T01:24:32.603406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.613113+0000","last_change":"2024-05-14T01:24:32.609292+0000","last_active":"2024-05-14T01:24:32.613113+0000","last_peered":"2024-05-14T01:24:32.613113+0000","last_clean":"2024-05-14T01:24:32.613113+0000","last_became_active":"2024-05-14T01:24:32.603873+0000","last_became_peered":"2024-05-14T01:24:32.603873+0000","last_unstale":"2024-05-14T01:24:32.613113+0000","last_undegraded":"2024-05-14T01:24:32.613113+0000","last_fullsized":"2024-05-14T01:24:32.613113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:55:08.731639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.609275+0000","last_change":"2024-05-14T01:24:32.609275+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.609275+0000","last_undegraded":"2024-05-14T01:24:32.609275+0000","last_fullsized":"2024-05-14T01:24:32.609275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.584140+0000","last_change":"2024-05-14T01:24:31.584140+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.584140+0000","last_undegraded":"2024-05-14T01:24:31.584140+0000","last_fullsized":"2024-05-14T01:24:31.584140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.602008+0000","last_change":"2024-05-14T01:24:32.600536+0000","last_active":"2024-05-14T01:24:32.602008+0000","last_peered":"2024-05-14T01:24:32.602008+0000","last_clean":"2024-05-14T01:24:32.602008+0000","last_became_active":"2024-05-14T01:24:32.600218+0000","last_became_peered":"2024-05-14T01:24:32.600218+0000","last_unstale":"2024-05-14T01:24:32.602008+0000","last_undegraded":"2024-05-14T01:24:32.602008+0000","last_fullsized":"2024-05-14T01:24:32.602008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:35:30.482169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.625303+0000","last_change":"2024-05-14T01:24:32.621948+0000","last_active":"2024-05-14T01:24:32.625303+0000","last_peered":"2024-05-14T01:24:32.625303+0000","last_clean":"2024-05-14T01:24:32.625303+0000","last_became_active":"2024-05-14T01:24:32.619217+0000","last_became_peered":"2024-05-14T01:24:32.619217+0000","last_unstale":"2024-05-14T01:24:32.625303+0000","last_undegraded":"2024-05-14T01:24:32.625303+0000","last_fullsized":"2024-05-14T01:24:32.625303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:12:41.013625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.600344+0000","last_change":"2024-05-14T01:24:32.600344+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.600344+0000","last_undegraded":"2024-05-14T01:24:32.600344+0000","last_fullsized":"2024-05-14T01:24:32.600344+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.585656+0000","last_change":"2024-05-14T01:24:31.585656+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.585656+0000","last_undegraded":"2024-05-14T01:24:31.585656+0000","last_fullsized":"2024-05-14T01:24:31.585656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603377+0000","last_change":"2024-05-14T01:24:32.603377+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603377+0000","last_undegraded":"2024-05-14T01:24:32.603377+0000","last_fullsized":"2024-05-14T01:24:32.603377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.606312+0000","last_change":"2024-05-14T01:24:32.597406+0000","last_active":"2024-05-14T01:24:32.606312+0000","last_peered":"2024-05-14T01:24:32.606312+0000","last_clean":"2024-05-14T01:24:32.606312+0000","last_became_active":"2024-05-14T01:24:32.596659+0000","last_became_peered":"2024-05-14T01:24:32.596659+0000","last_unstale":"2024-05-14T01:24:32.606312+0000","last_undegraded":"2024-05-14T01:24:32.606312+0000","last_fullsized":"2024-05-14T01:24:32.606312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:53:24.102472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.605306+0000","last_change":"2024-05-14T01:24:32.602252+0000","last_active":"2024-05-14T01:24:32.605306+0000","last_peered":"2024-05-14T01:24:32.605306+0000","last_clean":"2024-05-14T01:24:32.605306+0000","last_became_active":"2024-05-14T01:24:32.601892+0000","last_became_peered":"2024-05-14T01:24:32.601892+0000","last_unstale":"2024-05-14T01:24:32.605306+0000","last_undegraded":"2024-05-14T01:24:32.605306+0000","last_fullsized":"2024-05-14T01:24:32.605306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:28:29.191976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.615199+0000","last_change":"2024-05-14T01:24:32.615199+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.615199+0000","last_undegraded":"2024-05-14T01:24:32.615199+0000","last_fullsized":"2024-05-14T01:24:32.615199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.585239+0000","last_change":"2024-05-14T01:24:31.585239+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.585239+0000","last_undegraded":"2024-05-14T01:24:31.585239+0000","last_fullsized":"2024-05-14T01:24:31.585239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.584473+0000","last_change":"2024-05-14T01:24:32.584473+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.584473+0000","last_undegraded":"2024-05-14T01:24:32.584473+0000","last_fullsized":"2024-05-14T01:24:32.584473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.586108+0000","last_change":"2024-05-14T01:24:31.586108+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.586108+0000","last_undegraded":"2024-05-14T01:24:31.586108+0000","last_fullsized":"2024-05-14T01:24:31.586108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.589427+0000","last_change":"2024-05-14T01:24:32.589427+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.589427+0000","last_undegraded":"2024-05-14T01:24:32.589427+0000","last_fullsized":"2024-05-14T01:24:32.589427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.605352+0000","last_change":"2024-05-14T01:24:32.600443+0000","last_active":"2024-05-14T01:24:32.605352+0000","last_peered":"2024-05-14T01:24:32.605352+0000","last_clean":"2024-05-14T01:24:32.605352+0000","last_became_active":"2024-05-14T01:24:32.600055+0000","last_became_peered":"2024-05-14T01:24:32.600055+0000","last_unstale":"2024-05-14T01:24:32.605352+0000","last_undegraded":"2024-05-14T01:24:32.605352+0000","last_fullsized":"2024-05-14T01:24:32.605352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:14:21.154539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.613800+0000","last_change":"2024-05-14T01:24:32.613800+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.613800+0000","last_undegraded":"2024-05-14T01:24:32.613800+0000","last_fullsized":"2024-05-14T01:24:32.613800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.606647+0000","last_change":"2024-05-14T01:24:32.600044+0000","last_active":"2024-05-14T01:24:32.606647+0000","last_peered":"2024-05-14T01:24:32.606647+0000","last_clean":"2024-05-14T01:24:32.606647+0000","last_became_active":"2024-05-14T01:24:32.598727+0000","last_became_peered":"2024-05-14T01:24:32.598727+0000","last_unstale":"2024-05-14T01:24:32.606647+0000","last_undegraded":"2024-05-14T01:24:32.606647+0000","last_fullsized":"2024-05-14T01:24:32.606647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:52:21.925895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.603413+0000","last_change":"2024-05-14T01:24:32.603413+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.603413+0000","last_undegraded":"2024-05-14T01:24:32.603413+0000","last_fullsized":"2024-05-14T01:24:32.603413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.606374+0000","last_change":"2024-05-14T01:24:32.598165+0000","last_active":"2024-05-14T01:24:32.606374+0000","last_peered":"2024-05-14T01:24:32.606374+0000","last_clean":"2024-05-14T01:24:32.606374+0000","last_became_active":"2024-05-14T01:24:32.597345+0000","last_became_peered":"2024-05-14T01:24:32.597345+0000","last_unstale":"2024-05-14T01:24:32.606374+0000","last_undegraded":"2024-05-14T01:24:32.606374+0000","last_fullsized":"2024-05-14T01:24:32.606374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:46:09.858831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.591022+0000","last_change":"2024-05-14T01:24:32.591022+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.591022+0000","last_undegraded":"2024-05-14T01:24:32.591022+0000","last_fullsized":"2024-05-14T01:24:32.591022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.612349+0000","last_change":"2024-05-14T01:24:32.607306+0000","last_active":"2024-05-14T01:24:32.612349+0000","last_peered":"2024-05-14T01:24:32.612349+0000","last_clean":"2024-05-14T01:24:32.612349+0000","last_became_active":"2024-05-14T01:24:32.605320+0000","last_became_peered":"2024-05-14T01:24:32.605320+0000","last_unstale":"2024-05-14T01:24:32.612349+0000","last_undegraded":"2024-05-14T01:24:32.612349+0000","last_fullsized":"2024-05-14T01:24:32.612349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:37:33.536316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.592267+0000","last_change":"2024-05-14T01:24:32.592267+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.592267+0000","last_undegraded":"2024-05-14T01:24:32.592267+0000","last_fullsized":"2024-05-14T01:24:32.592267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.601557+0000","last_change":"2024-05-14T01:24:32.599796+0000","last_active":"2024-05-14T01:24:32.601557+0000","last_peered":"2024-05-14T01:24:32.601557+0000","last_clean":"2024-05-14T01:24:32.601557+0000","last_became_active":"2024-05-14T01:24:32.599365+0000","last_became_peered":"2024-05-14T01:24:32.599365+0000","last_unstale":"2024-05-14T01:24:32.601557+0000","last_undegraded":"2024-05-14T01:24:32.601557+0000","last_fullsized":"2024-05-14T01:24:32.601557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:18:20.146184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.591263+0000","last_change":"2024-05-14T01:24:32.591263+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.591263+0000","last_undegraded":"2024-05-14T01:24:32.591263+0000","last_fullsized":"2024-05-14T01:24:32.591263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.608077+0000","last_change":"2024-05-14T01:24:32.601347+0000","last_active":"2024-05-14T01:24:32.608077+0000","last_peered":"2024-05-14T01:24:32.608077+0000","last_clean":"2024-05-14T01:24:32.608077+0000","last_became_active":"2024-05-14T01:24:32.598291+0000","last_became_peered":"2024-05-14T01:24:32.598291+0000","last_unstale":"2024-05-14T01:24:32.608077+0000","last_undegraded":"2024-05-14T01:24:32.608077+0000","last_fullsized":"2024-05-14T01:24:32.608077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:28:29.191976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.590083+0000","last_change":"2024-05-14T01:24:32.590083+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.590083+0000","last_undegraded":"2024-05-14T01:24:32.590083+0000","last_fullsized":"2024-05-14T01:24:32.590083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.609599+0000","last_change":"2024-05-14T01:24:32.599604+0000","last_active":"2024-05-14T01:24:32.609599+0000","last_peered":"2024-05-14T01:24:32.609599+0000","last_clean":"2024-05-14T01:24:32.609599+0000","last_became_active":"2024-05-14T01:24:32.598939+0000","last_became_peered":"2024-05-14T01:24:32.598939+0000","last_unstale":"2024-05-14T01:24:32.609599+0000","last_undegraded":"2024-05-14T01:24:32.609599+0000","last_fullsized":"2024-05-14T01:24:32.609599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:45:33.606315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.611940+0000","last_change":"2024-05-14T01:24:32.611940+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.611940+0000","last_undegraded":"2024-05-14T01:24:32.611940+0000","last_fullsized":"2024-05-14T01:24:32.611940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.625384+0000","last_change":"2024-05-14T01:24:32.622632+0000","last_active":"2024-05-14T01:24:32.625384+0000","last_peered":"2024-05-14T01:24:32.625384+0000","last_clean":"2024-05-14T01:24:32.625384+0000","last_became_active":"2024-05-14T01:24:32.622340+0000","last_became_peered":"2024-05-14T01:24:32.622340+0000","last_unstale":"2024-05-14T01:24:32.625384+0000","last_undegraded":"2024-05-14T01:24:32.625384+0000","last_fullsized":"2024-05-14T01:24:32.625384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:03:58.243337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.590669+0000","last_change":"2024-05-14T01:24:32.590669+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.590669+0000","last_undegraded":"2024-05-14T01:24:32.590669+0000","last_fullsized":"2024-05-14T01:24:32.590669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.619764+0000","last_change":"2024-05-14T01:24:32.615997+0000","last_active":"2024-05-14T01:24:32.619764+0000","last_peered":"2024-05-14T01:24:32.619764+0000","last_clean":"2024-05-14T01:24:32.619764+0000","last_became_active":"2024-05-14T01:24:32.615650+0000","last_became_peered":"2024-05-14T01:24:32.615650+0000","last_unstale":"2024-05-14T01:24:32.619764+0000","last_undegraded":"2024-05-14T01:24:32.619764+0000","last_fullsized":"2024-05-14T01:24:32.619764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:18:20.146184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.605880+0000","last_change":"2024-05-14T01:24:32.605880+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.605880+0000","last_undegraded":"2024-05-14T01:24:32.605880+0000","last_fullsized":"2024-05-14T01:24:32.605880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.599270+0000","last_change":"2024-05-14T01:24:32.598174+0000","last_active":"2024-05-14T01:24:32.599270+0000","last_peered":"2024-05-14T01:24:32.599270+0000","last_clean":"2024-05-14T01:24:32.599270+0000","last_became_active":"2024-05-14T01:24:32.595656+0000","last_became_peered":"2024-05-14T01:24:32.595656+0000","last_unstale":"2024-05-14T01:24:32.599270+0000","last_undegraded":"2024-05-14T01:24:32.599270+0000","last_fullsized":"2024-05-14T01:24:32.599270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:28:29.191976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.587378+0000","last_change":"2024-05-14T01:24:32.587378+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.587378+0000","last_undegraded":"2024-05-14T01:24:32.587378+0000","last_fullsized":"2024-05-14T01:24:32.587378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.603719+0000","last_change":"2024-05-14T01:24:32.600486+0000","last_active":"2024-05-14T01:24:32.603719+0000","last_peered":"2024-05-14T01:24:32.603719+0000","last_clean":"2024-05-14T01:24:32.603719+0000","last_became_active":"2024-05-14T01:24:32.599524+0000","last_became_peered":"2024-05-14T01:24:32.599524+0000","last_unstale":"2024-05-14T01:24:32.603719+0000","last_undegraded":"2024-05-14T01:24:32.603719+0000","last_fullsized":"2024-05-14T01:24:32.603719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:03:43.259015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.584591+0000","last_change":"2024-05-14T01:24:32.584591+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.584591+0000","last_undegraded":"2024-05-14T01:24:32.584591+0000","last_fullsized":"2024-05-14T01:24:32.584591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.624826+0000","last_change":"2024-05-14T01:24:32.619963+0000","last_active":"2024-05-14T01:24:32.624826+0000","last_peered":"2024-05-14T01:24:32.624826+0000","last_clean":"2024-05-14T01:24:32.624826+0000","last_became_active":"2024-05-14T01:24:32.619603+0000","last_became_peered":"2024-05-14T01:24:32.619603+0000","last_unstale":"2024-05-14T01:24:32.624826+0000","last_undegraded":"2024-05-14T01:24:32.624826+0000","last_fullsized":"2024-05-14T01:24:32.624826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:10:08.387975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.589558+0000","last_change":"2024-05-14T01:24:32.589558+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.589558+0000","last_undegraded":"2024-05-14T01:24:32.589558+0000","last_fullsized":"2024-05-14T01:24:32.589558+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.624881+0000","last_change":"2024-05-14T01:24:32.619957+0000","last_active":"2024-05-14T01:24:32.624881+0000","last_peered":"2024-05-14T01:24:32.624881+0000","last_clean":"2024-05-14T01:24:32.624881+0000","last_became_active":"2024-05-14T01:24:32.619431+0000","last_became_peered":"2024-05-14T01:24:32.619431+0000","last_unstale":"2024-05-14T01:24:32.624881+0000","last_undegraded":"2024-05-14T01:24:32.624881+0000","last_fullsized":"2024-05-14T01:24:32.624881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:35:30.482169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-14T01:24:32.573964+0000","last_change":"2024-05-14T01:24:32.573964+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.573964+0000","last_undegraded":"2024-05-14T01:24:32.573964+0000","last_fullsized":"2024-05-14T01:24:32.573964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.622961+0000","last_change":"2024-05-14T01:24:32.618571+0000","last_active":"2024-05-14T01:24:32.622961+0000","last_peered":"2024-05-14T01:24:32.622961+0000","last_clean":"2024-05-14T01:24:32.622961+0000","last_became_active":"2024-05-14T01:24:32.617821+0000","last_became_peered":"2024-05-14T01:24:32.617821+0000","last_unstale":"2024-05-14T01:24:32.622961+0000","last_undegraded":"2024-05-14T01:24:32.622961+0000","last_fullsized":"2024-05-14T01:24:32.622961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:27:57.390857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.593038+0000","last_change":"2024-05-14T01:24:32.593038+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.593038+0000","last_undegraded":"2024-05-14T01:24:32.593038+0000","last_fullsized":"2024-05-14T01:24:32.593038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-14T01:24:31.586498+0000","last_change":"2024-05-14T01:24:31.586498+0000","last_active":"2024-05-14T01:24:31.565612+0000","last_peered":"2024-05-14T01:24:31.565612+0000","last_clean":"2024-05-14T01:24:31.565612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:31.586498+0000","last_undegraded":"2024-05-14T01:24:31.586498+0000","last_fullsized":"2024-05-14T01:24:31.586498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-05-14T01:24:32.610717+0000","last_change":"2024-05-14T01:24:32.610717+0000","last_active":"2024-05-14T01:24:32.573964+0000","last_peered":"2024-05-14T01:24:32.573964+0000","last_clean":"2024-05-14T01:24:32.573964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T01:24:32.610717+0000","last_undegraded":"2024-05-14T01:24:32.610717+0000","last_fullsized":"2024-05-14T01:24:32.610717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.614515+0000","last_change":"2024-05-14T01:24:32.608635+0000","last_active":"2024-05-14T01:24:32.614515+0000","last_peered":"2024-05-14T01:24:32.614515+0000","last_clean":"2024-05-14T01:24:32.614515+0000","last_became_active":"2024-05-14T01:24:32.608351+0000","last_became_peered":"2024-05-14T01:24:32.608351+0000","last_unstale":"2024-05-14T01:24:32.614515+0000","last_undegraded":"2024-05-14T01:24:32.614515+0000","last_fullsized":"2024-05-14T01:24:32.614515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:18:20.146184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-14T01:24:32.620680+0000","last_change":"2024-05-14T01:23:25.487525+0000","last_active":"2024-05-14T01:24:32.620680+0000","last_peered":"2024-05-14T01:24:32.620680+0000","last_clean":"2024-05-14T01:24:32.620680+0000","last_became_active":"2024-05-14T01:23:25.485622+0000","last_became_peered":"2024-05-14T01:23:25.485622+0000","last_unstale":"2024-05-14T01:24:32.620680+0000","last_undegraded":"2024-05-14T01:24:32.620680+0000","last_fullsized":"2024-05-14T01:24:32.620680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_clean_scrub_stamp":"2024-05-14T01:23:24.138255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:26:23.884962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":942080,"data_stored":722483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":728750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":360448,"data_stored":138382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T01:24:42.035 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T01:24:42.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.176+0000 7f2c63d4f640 1 Processor -- start 2024-05-14T01:24:42.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.176+0000 7f2c63d4f640 1 -- start start 2024-05-14T01:24:42.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.180+0000 7f2c63d4f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2c5c13ede0 0x7f2c5c1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.180+0000 7f2c63d4f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c5c0cf100 con 0x7f2c5c0cea50 2024-05-14T01:24:42.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.180+0000 7f2c63d4f640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c5c0cf3e0 con 0x7f2c5c141b30 2024-05-14T01:24:42.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.180+0000 7f2c63d4f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2c5c0ceee0 con 0x7f2c5c13ede0 2024-05-14T01:24:42.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.180+0000 7f2c61aeb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2c5c13ede0 0x7f2c5c1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.180+0000 7f2c61aeb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2c5c13ede0 0x7f2c5c1415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42800/0 (socket says 172.21.15.154:42800) 2024-05-14T01:24:42.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.180+0000 7f2c622ec640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2c5c0cea50 0x7f2c5c06d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37612/0 (socket says 172.21.15.154:37612) 2024-05-14T01:24:42.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.180+0000 7f2c61aeb640 1 -- 172.21.15.154:0/309081240 learned_addr learned my addr 172.21.15.154:0/309081240 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:42.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.180+0000 7f2c60ae9640 1 -- 172.21.15.154:0/309081240 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3339715173 0 0) 0x7f2c5c0cf100 con 0x7f2c5c0cea50 2024-05-14T01:24:42.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.180+0000 7f2c60ae9640 1 -- 172.21.15.154:0/309081240 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c48003530 con 0x7f2c5c0cea50 2024-05-14T01:24:42.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.180+0000 7f2c61aeb640 1 -- 172.21.15.154:0/309081240 >> v1:172.21.15.176:6789/0 conn(0x7f2c5c141b30 legacy=0x7f2c5c0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.180+0000 7f2c61aeb640 1 -- 172.21.15.154:0/309081240 >> v1:172.21.15.154:6789/0 conn(0x7f2c5c0cea50 legacy=0x7f2c5c06d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.180+0000 7f2c61aeb640 1 -- 172.21.15.154:0/309081240 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5c06cc80 con 0x7f2c5c13ede0 2024-05-14T01:24:42.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.180+0000 7f2c61aeb640 1 --2- 172.21.15.154:0/309081240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5c13ede0 0x7f2c5c1415f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2c580098a0 tx=0x7f2c5801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2cdd11da1bf202 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:42.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.180+0000 7f2c60ae9640 1 -- 172.21.15.154:0/309081240 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c580b0070 con 0x7f2c5c13ede0 2024-05-14T01:24:42.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.180+0000 7f2c60ae9640 1 -- 172.21.15.154:0/309081240 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c580ab600 con 0x7f2c5c13ede0 2024-05-14T01:24:42.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.180+0000 7f2c60ae9640 1 -- 172.21.15.154:0/309081240 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c580ab9b0 con 0x7f2c5c13ede0 2024-05-14T01:24:42.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c63d4f640 1 -- 172.21.15.154:0/309081240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5c13ede0 msgr2=0x7f2c5c1415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c63d4f640 1 --2- 172.21.15.154:0/309081240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5c13ede0 0x7f2c5c1415f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2c580098a0 tx=0x7f2c5801c540 comp rx=0 tx=0).stop 2024-05-14T01:24:42.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c63d4f640 1 -- 172.21.15.154:0/309081240 shutdown_connections 2024-05-14T01:24:42.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c63d4f640 1 --2- 172.21.15.154:0/309081240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5c13ede0 0x7f2c5c1415f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c63d4f640 1 -- 172.21.15.154:0/309081240 >> 172.21.15.154:0/309081240 conn(0x7f2c5c0b1850 msgr2=0x7f2c5c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:42.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c63d4f640 1 -- 172.21.15.154:0/309081240 shutdown_connections 2024-05-14T01:24:42.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c63d4f640 1 -- 172.21.15.154:0/309081240 wait complete. 2024-05-14T01:24:42.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c63d4f640 1 Processor -- start 2024-05-14T01:24:42.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c63d4f640 1 -- start start 2024-05-14T01:24:42.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c63d4f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5c0cea50 0x7f2c5c139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c63d4f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c5c13ede0 0x7f2c5c15c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c63d4f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c5c141b30 0x7f2c5c15c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c63d4f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c06e730 con 0x7f2c5c0cea50 2024-05-14T01:24:42.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c63d4f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c06e5b0 con 0x7f2c5c13ede0 2024-05-14T01:24:42.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c63d4f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2c5c169db0 con 0x7f2c5c141b30 2024-05-14T01:24:42.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c61aeb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5c0cea50 0x7f2c5c139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c61aeb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5c0cea50 0x7f2c5c139cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42810/0 (socket says 172.21.15.154:42810) 2024-05-14T01:24:42.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c61aeb640 1 -- 172.21.15.154:0/288176191 learned_addr learned my addr 172.21.15.154:0/288176191 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:42.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c612ea640 1 --2- 172.21.15.154:0/288176191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c5c13ede0 0x7f2c5c15c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c622ec640 1 --2- 172.21.15.154:0/288176191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c5c141b30 0x7f2c5c15c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c61aeb640 1 -- 172.21.15.154:0/288176191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c5c141b30 msgr2=0x7f2c5c15c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c61aeb640 1 --2- 172.21.15.154:0/288176191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c5c141b30 0x7f2c5c15c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c61aeb640 1 -- 172.21.15.154:0/288176191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c5c13ede0 msgr2=0x7f2c5c15c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c61aeb640 1 --2- 172.21.15.154:0/288176191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c5c13ede0 0x7f2c5c15c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c61aeb640 1 -- 172.21.15.154:0/288176191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5c0724c0 con 0x7f2c5c0cea50 2024-05-14T01:24:42.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c61aeb640 1 --2- 172.21.15.154:0/288176191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5c0cea50 0x7f2c5c139cc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2c58019150 tx=0x7f2c5801ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:42.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c527fc640 1 -- 172.21.15.154:0/288176191 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c580b0040 con 0x7f2c5c0cea50 2024-05-14T01:24:42.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c527fc640 1 -- 172.21.15.154:0/288176191 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c580ab9b0 con 0x7f2c5c0cea50 2024-05-14T01:24:42.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c63d4f640 1 -- 172.21.15.154:0/288176191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c5c0727a0 con 0x7f2c5c0cea50 2024-05-14T01:24:42.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c527fc640 1 -- 172.21.15.154:0/288176191 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c580abd80 con 0x7f2c5c0cea50 2024-05-14T01:24:42.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.184+0000 7f2c63d4f640 1 -- 172.21.15.154:0/288176191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c5c165610 con 0x7f2c5c0cea50 2024-05-14T01:24:42.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.188+0000 7f2c63d4f640 1 -- 172.21.15.154:0/288176191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c5c075470 con 0x7f2c5c0cea50 2024-05-14T01:24:42.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.188+0000 7f2c527fc640 1 -- 172.21.15.154:0/288176191 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2c580ab4c0 con 0x7f2c5c0cea50 2024-05-14T01:24:42.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.188+0000 7f2c527fc640 1 --2- 172.21.15.154:0/288176191 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2c400678c0 0x7f2c40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.188+0000 7f2c527fc640 1 -- 172.21.15.154:0/288176191 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2c5811f990 con 0x7f2c5c0cea50 2024-05-14T01:24:42.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.188+0000 7f2c612ea640 1 --2- 172.21.15.154:0/288176191 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2c400678c0 0x7f2c40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.188+0000 7f2c612ea640 1 --2- 172.21.15.154:0/288176191 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2c400678c0 0x7f2c40069d80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c007fd0 tx=0x7f2c4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:42.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.192+0000 7f2c527fc640 1 -- 172.21.15.154:0/288176191 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f2c580b8020 con 0x7f2c5c0cea50 2024-05-14T01:24:42.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.352+0000 7f2c63d4f640 1 -- 172.21.15.154:0/288176191 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c5c06f180 con 0x7f2c400678c0 2024-05-14T01:24:42.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.364+0000 7f2c527fc640 1 -- 172.21.15.154:0/288176191 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251951 (secure 0 0 0) 0x7f2c5c06f180 con 0x7f2c400678c0 2024-05-14T01:24:42.353 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:42.355 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-05-14T01:24:42.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.368+0000 7f2c63d4f640 1 -- 172.21.15.154:0/288176191 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2c400678c0 msgr2=0x7f2c40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.368+0000 7f2c63d4f640 1 --2- 172.21.15.154:0/288176191 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2c400678c0 0x7f2c40069d80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c007fd0 tx=0x7f2c4c009040 comp rx=0 tx=0).stop 2024-05-14T01:24:42.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.368+0000 7f2c63d4f640 1 -- 172.21.15.154:0/288176191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5c0cea50 msgr2=0x7f2c5c139cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.368+0000 7f2c63d4f640 1 --2- 172.21.15.154:0/288176191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5c0cea50 0x7f2c5c139cc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2c58019150 tx=0x7f2c5801ad80 comp rx=0 tx=0).stop 2024-05-14T01:24:42.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.368+0000 7f2c63d4f640 1 -- 172.21.15.154:0/288176191 shutdown_connections 2024-05-14T01:24:42.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.368+0000 7f2c63d4f640 1 --2- 172.21.15.154:0/288176191 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f2c400678c0 0x7f2c40069d80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.368+0000 7f2c63d4f640 1 --2- 172.21.15.154:0/288176191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c5c141b30 0x7f2c5c15c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.368+0000 7f2c63d4f640 1 --2- 172.21.15.154:0/288176191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c5c13ede0 0x7f2c5c15c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.368+0000 7f2c63d4f640 1 --2- 172.21.15.154:0/288176191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5c0cea50 0x7f2c5c139cc0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.368+0000 7f2c63d4f640 1 -- 172.21.15.154:0/288176191 >> 172.21.15.154:0/288176191 conn(0x7f2c5c0b1850 msgr2=0x7f2c5c15b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:42.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.368+0000 7f2c63d4f640 1 -- 172.21.15.154:0/288176191 shutdown_connections 2024-05-14T01:24:42.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.368+0000 7f2c63d4f640 1 -- 172.21.15.154:0/288176191 wait complete. 2024-05-14T01:24:42.372 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-05-14T01:24:41.121396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224588,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750132,"statfs":{"total":773094113280,"available":772864135168,"internally_reserved":0,"allocated":4333568,"data_stored":2397212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002396"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.644923+0000","last_change":"2024-05-14T01:24:33.674331+0000","last_active":"2024-05-14T01:24:34.644923+0000","last_peered":"2024-05-14T01:24:34.644923+0000","last_clean":"2024-05-14T01:24:34.644923+0000","last_became_active":"2024-05-14T01:24:33.673843+0000","last_became_peered":"2024-05-14T01:24:33.673843+0000","last_unstale":"2024-05-14T01:24:34.644923+0000","last_undegraded":"2024-05-14T01:24:34.644923+0000","last_fullsized":"2024-05-14T01:24:34.644923+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:26:30.283558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.640616+0000","last_change":"2024-05-14T01:24:33.633708+0000","last_active":"2024-05-14T01:24:34.640616+0000","last_peered":"2024-05-14T01:24:34.640616+0000","last_clean":"2024-05-14T01:24:34.640616+0000","last_became_active":"2024-05-14T01:24:33.633361+0000","last_became_peered":"2024-05-14T01:24:33.633361+0000","last_unstale":"2024-05-14T01:24:34.640616+0000","last_undegraded":"2024-05-14T01:24:34.640616+0000","last_fullsized":"2024-05-14T01:24:34.640616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:50:46.032705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883951+0000","last_change":"2024-05-14T01:24:33.672519+0000","last_active":"2024-05-14T01:24:34.883951+0000","last_peered":"2024-05-14T01:24:34.883951+0000","last_clean":"2024-05-14T01:24:34.883951+0000","last_became_active":"2024-05-14T01:24:33.671540+0000","last_became_peered":"2024-05-14T01:24:33.671540+0000","last_unstale":"2024-05-14T01:24:34.883951+0000","last_undegraded":"2024-05-14T01:24:34.883951+0000","last_fullsized":"2024-05-14T01:24:34.883951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:32:38.308393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883989+0000","last_change":"2024-05-14T01:24:33.662099+0000","last_active":"2024-05-14T01:24:34.883989+0000","last_peered":"2024-05-14T01:24:34.883989+0000","last_clean":"2024-05-14T01:24:34.883989+0000","last_became_active":"2024-05-14T01:24:33.661882+0000","last_became_peered":"2024-05-14T01:24:33.661882+0000","last_unstale":"2024-05-14T01:24:34.883989+0000","last_undegraded":"2024-05-14T01:24:34.883989+0000","last_fullsized":"2024-05-14T01:24:34.883989+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:03:01.245480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.884053+0000","last_change":"2024-05-14T01:24:33.639991+0000","last_active":"2024-05-14T01:24:34.884053+0000","last_peered":"2024-05-14T01:24:34.884053+0000","last_clean":"2024-05-14T01:24:34.884053+0000","last_became_active":"2024-05-14T01:24:33.639426+0000","last_became_peered":"2024-05-14T01:24:33.639426+0000","last_unstale":"2024-05-14T01:24:34.884053+0000","last_undegraded":"2024-05-14T01:24:34.884053+0000","last_fullsized":"2024-05-14T01:24:34.884053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:10:09.396326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.640127+0000","last_change":"2024-05-14T01:24:33.669299+0000","last_active":"2024-05-14T01:24:34.640127+0000","last_peered":"2024-05-14T01:24:34.640127+0000","last_clean":"2024-05-14T01:24:34.640127+0000","last_became_active":"2024-05-14T01:24:33.668991+0000","last_became_peered":"2024-05-14T01:24:33.668991+0000","last_unstale":"2024-05-14T01:24:34.640127+0000","last_undegraded":"2024-05-14T01:24:34.640127+0000","last_fullsized":"2024-05-14T01:24:34.640127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:32:38.308393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.643830+0000","last_change":"2024-05-14T01:24:33.638098+0000","last_active":"2024-05-14T01:24:34.643830+0000","last_peered":"2024-05-14T01:24:34.643830+0000","last_clean":"2024-05-14T01:24:34.643830+0000","last_became_active":"2024-05-14T01:24:33.636906+0000","last_became_peered":"2024-05-14T01:24:33.636906+0000","last_unstale":"2024-05-14T01:24:34.643830+0000","last_undegraded":"2024-05-14T01:24:34.643830+0000","last_fullsized":"2024-05-14T01:24:34.643830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:11:20.629791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.642739+0000","last_change":"2024-05-14T01:24:33.648475+0000","last_active":"2024-05-14T01:24:34.642739+0000","last_peered":"2024-05-14T01:24:34.642739+0000","last_clean":"2024-05-14T01:24:34.642739+0000","last_became_active":"2024-05-14T01:24:33.647735+0000","last_became_peered":"2024-05-14T01:24:33.647735+0000","last_unstale":"2024-05-14T01:24:34.642739+0000","last_undegraded":"2024-05-14T01:24:34.642739+0000","last_fullsized":"2024-05-14T01:24:34.642739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:12:16.989881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.885580+0000","last_change":"2024-05-14T01:24:33.649078+0000","last_active":"2024-05-14T01:24:34.885580+0000","last_peered":"2024-05-14T01:24:34.885580+0000","last_clean":"2024-05-14T01:24:34.885580+0000","last_became_active":"2024-05-14T01:24:33.647925+0000","last_became_peered":"2024-05-14T01:24:33.647925+0000","last_unstale":"2024-05-14T01:24:34.885580+0000","last_undegraded":"2024-05-14T01:24:34.885580+0000","last_fullsized":"2024-05-14T01:24:34.885580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:54:20.643861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.885048+0000","last_change":"2024-05-14T01:24:33.653826+0000","last_active":"2024-05-14T01:24:34.885048+0000","last_peered":"2024-05-14T01:24:34.885048+0000","last_clean":"2024-05-14T01:24:34.885048+0000","last_became_active":"2024-05-14T01:24:33.653510+0000","last_became_peered":"2024-05-14T01:24:33.653510+0000","last_unstale":"2024-05-14T01:24:34.885048+0000","last_undegraded":"2024-05-14T01:24:34.885048+0000","last_fullsized":"2024-05-14T01:24:34.885048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:17:14.820709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.644339+0000","last_change":"2024-05-14T01:24:33.643522+0000","last_active":"2024-05-14T01:24:34.644339+0000","last_peered":"2024-05-14T01:24:34.644339+0000","last_clean":"2024-05-14T01:24:34.644339+0000","last_became_active":"2024-05-14T01:24:33.642777+0000","last_became_peered":"2024-05-14T01:24:33.642777+0000","last_unstale":"2024-05-14T01:24:34.644339+0000","last_undegraded":"2024-05-14T01:24:34.644339+0000","last_fullsized":"2024-05-14T01:24:34.644339+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:05:09.210363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883650+0000","last_change":"2024-05-14T01:24:33.672725+0000","last_active":"2024-05-14T01:24:34.883650+0000","last_peered":"2024-05-14T01:24:34.883650+0000","last_clean":"2024-05-14T01:24:34.883650+0000","last_became_active":"2024-05-14T01:24:33.672142+0000","last_became_peered":"2024-05-14T01:24:33.672142+0000","last_unstale":"2024-05-14T01:24:34.883650+0000","last_undegraded":"2024-05-14T01:24:34.883650+0000","last_fullsized":"2024-05-14T01:24:34.883650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:21:31.040864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.884409+0000","last_change":"2024-05-14T01:24:33.647610+0000","last_active":"2024-05-14T01:24:34.884409+0000","last_peered":"2024-05-14T01:24:34.884409+0000","last_clean":"2024-05-14T01:24:34.884409+0000","last_became_active":"2024-05-14T01:24:33.647148+0000","last_became_peered":"2024-05-14T01:24:33.647148+0000","last_unstale":"2024-05-14T01:24:34.884409+0000","last_undegraded":"2024-05-14T01:24:34.884409+0000","last_fullsized":"2024-05-14T01:24:34.884409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:31:08.045054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.640101+0000","last_change":"2024-05-14T01:24:33.645891+0000","last_active":"2024-05-14T01:24:34.640101+0000","last_peered":"2024-05-14T01:24:34.640101+0000","last_clean":"2024-05-14T01:24:34.640101+0000","last_became_active":"2024-05-14T01:24:33.642841+0000","last_became_peered":"2024-05-14T01:24:33.642841+0000","last_unstale":"2024-05-14T01:24:34.640101+0000","last_undegraded":"2024-05-14T01:24:34.640101+0000","last_fullsized":"2024-05-14T01:24:34.640101+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:20:22.777064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.882923+0000","last_change":"2024-05-14T01:24:33.665632+0000","last_active":"2024-05-14T01:24:34.882923+0000","last_peered":"2024-05-14T01:24:34.882923+0000","last_clean":"2024-05-14T01:24:34.882923+0000","last_became_active":"2024-05-14T01:24:33.665069+0000","last_became_peered":"2024-05-14T01:24:33.665069+0000","last_unstale":"2024-05-14T01:24:34.882923+0000","last_undegraded":"2024-05-14T01:24:34.882923+0000","last_fullsized":"2024-05-14T01:24:34.882923+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:06:27.070725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.644016+0000","last_change":"2024-05-14T01:24:33.654315+0000","last_active":"2024-05-14T01:24:34.644016+0000","last_peered":"2024-05-14T01:24:34.644016+0000","last_clean":"2024-05-14T01:24:34.644016+0000","last_became_active":"2024-05-14T01:24:33.653581+0000","last_became_peered":"2024-05-14T01:24:33.653581+0000","last_unstale":"2024-05-14T01:24:34.644016+0000","last_undegraded":"2024-05-14T01:24:34.644016+0000","last_fullsized":"2024-05-14T01:24:34.644016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:24:20.403407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.645319+0000","last_change":"2024-05-14T01:24:33.637083+0000","last_active":"2024-05-14T01:24:34.645319+0000","last_peered":"2024-05-14T01:24:34.645319+0000","last_clean":"2024-05-14T01:24:34.645319+0000","last_became_active":"2024-05-14T01:24:33.636265+0000","last_became_peered":"2024-05-14T01:24:33.636265+0000","last_unstale":"2024-05-14T01:24:34.645319+0000","last_undegraded":"2024-05-14T01:24:34.645319+0000","last_fullsized":"2024-05-14T01:24:34.645319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:50:46.032705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.640497+0000","last_change":"2024-05-14T01:24:33.646474+0000","last_active":"2024-05-14T01:24:34.640497+0000","last_peered":"2024-05-14T01:24:34.640497+0000","last_clean":"2024-05-14T01:24:34.640497+0000","last_became_active":"2024-05-14T01:24:33.646148+0000","last_became_peered":"2024-05-14T01:24:33.646148+0000","last_unstale":"2024-05-14T01:24:34.640497+0000","last_undegraded":"2024-05-14T01:24:34.640497+0000","last_fullsized":"2024-05-14T01:24:34.640497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:05:09.210363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.640310+0000","last_change":"2024-05-14T01:24:33.646972+0000","last_active":"2024-05-14T01:24:34.640310+0000","last_peered":"2024-05-14T01:24:34.640310+0000","last_clean":"2024-05-14T01:24:34.640310+0000","last_became_active":"2024-05-14T01:24:33.646332+0000","last_became_peered":"2024-05-14T01:24:33.646332+0000","last_unstale":"2024-05-14T01:24:34.640310+0000","last_undegraded":"2024-05-14T01:24:34.640310+0000","last_fullsized":"2024-05-14T01:24:34.640310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:11:20.629791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.882681+0000","last_change":"2024-05-14T01:24:33.669424+0000","last_active":"2024-05-14T01:24:34.882681+0000","last_peered":"2024-05-14T01:24:34.882681+0000","last_clean":"2024-05-14T01:24:34.882681+0000","last_became_active":"2024-05-14T01:24:33.669131+0000","last_became_peered":"2024-05-14T01:24:33.669131+0000","last_unstale":"2024-05-14T01:24:34.882681+0000","last_undegraded":"2024-05-14T01:24:34.882681+0000","last_fullsized":"2024-05-14T01:24:34.882681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:28:30.200327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883888+0000","last_change":"2024-05-14T01:24:33.631127+0000","last_active":"2024-05-14T01:24:34.883888+0000","last_peered":"2024-05-14T01:24:34.883888+0000","last_clean":"2024-05-14T01:24:34.883888+0000","last_became_active":"2024-05-14T01:24:33.629848+0000","last_became_peered":"2024-05-14T01:24:33.629848+0000","last_unstale":"2024-05-14T01:24:34.883888+0000","last_undegraded":"2024-05-14T01:24:34.883888+0000","last_fullsized":"2024-05-14T01:24:34.883888+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:28:27.494270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.884098+0000","last_change":"2024-05-14T01:24:33.658148+0000","last_active":"2024-05-14T01:24:34.884098+0000","last_peered":"2024-05-14T01:24:34.884098+0000","last_clean":"2024-05-14T01:24:34.884098+0000","last_became_active":"2024-05-14T01:24:33.657393+0000","last_became_peered":"2024-05-14T01:24:33.657393+0000","last_unstale":"2024-05-14T01:24:34.884098+0000","last_undegraded":"2024-05-14T01:24:34.884098+0000","last_fullsized":"2024-05-14T01:24:34.884098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:28:57.234074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.882096+0000","last_change":"2024-05-14T01:24:33.630793+0000","last_active":"2024-05-14T01:24:34.882096+0000","last_peered":"2024-05-14T01:24:34.882096+0000","last_clean":"2024-05-14T01:24:34.882096+0000","last_became_active":"2024-05-14T01:24:33.630013+0000","last_became_peered":"2024-05-14T01:24:33.630013+0000","last_unstale":"2024-05-14T01:24:34.882096+0000","last_undegraded":"2024-05-14T01:24:34.882096+0000","last_fullsized":"2024-05-14T01:24:34.882096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:26:30.283558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.882689+0000","last_change":"2024-05-14T01:24:33.666383+0000","last_active":"2024-05-14T01:24:34.882689+0000","last_peered":"2024-05-14T01:24:34.882689+0000","last_clean":"2024-05-14T01:24:34.882689+0000","last_became_active":"2024-05-14T01:24:33.665331+0000","last_became_peered":"2024-05-14T01:24:33.665331+0000","last_unstale":"2024-05-14T01:24:34.882689+0000","last_undegraded":"2024-05-14T01:24:34.882689+0000","last_fullsized":"2024-05-14T01:24:34.882689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:24:16.634679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.885601+0000","last_change":"2024-05-14T01:24:33.639479+0000","last_active":"2024-05-14T01:24:34.885601+0000","last_peered":"2024-05-14T01:24:34.885601+0000","last_clean":"2024-05-14T01:24:34.885601+0000","last_became_active":"2024-05-14T01:24:33.639184+0000","last_became_peered":"2024-05-14T01:24:33.639184+0000","last_unstale":"2024-05-14T01:24:34.885601+0000","last_undegraded":"2024-05-14T01:24:34.885601+0000","last_fullsized":"2024-05-14T01:24:34.885601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:30.338470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.640576+0000","last_change":"2024-05-14T01:24:33.636461+0000","last_active":"2024-05-14T01:24:34.640576+0000","last_peered":"2024-05-14T01:24:34.640576+0000","last_clean":"2024-05-14T01:24:34.640576+0000","last_became_active":"2024-05-14T01:24:33.636022+0000","last_became_peered":"2024-05-14T01:24:33.636022+0000","last_unstale":"2024-05-14T01:24:34.640576+0000","last_undegraded":"2024-05-14T01:24:34.640576+0000","last_fullsized":"2024-05-14T01:24:34.640576+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:30:47.956851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.884601+0000","last_change":"2024-05-14T01:24:33.662943+0000","last_active":"2024-05-14T01:24:34.884601+0000","last_peered":"2024-05-14T01:24:34.884601+0000","last_clean":"2024-05-14T01:24:34.884601+0000","last_became_active":"2024-05-14T01:24:33.662661+0000","last_became_peered":"2024-05-14T01:24:33.662661+0000","last_unstale":"2024-05-14T01:24:34.884601+0000","last_undegraded":"2024-05-14T01:24:34.884601+0000","last_fullsized":"2024-05-14T01:24:34.884601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:24:16.634679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883657+0000","last_change":"2024-05-14T01:24:33.669699+0000","last_active":"2024-05-14T01:24:34.883657+0000","last_peered":"2024-05-14T01:24:34.883657+0000","last_clean":"2024-05-14T01:24:34.883657+0000","last_became_active":"2024-05-14T01:24:33.668900+0000","last_became_peered":"2024-05-14T01:24:33.668900+0000","last_unstale":"2024-05-14T01:24:34.883657+0000","last_undegraded":"2024-05-14T01:24:34.883657+0000","last_fullsized":"2024-05-14T01:24:34.883657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:12:16.989881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.884560+0000","last_change":"2024-05-14T01:24:33.655754+0000","last_active":"2024-05-14T01:24:34.884560+0000","last_peered":"2024-05-14T01:24:34.884560+0000","last_clean":"2024-05-14T01:24:34.884560+0000","last_became_active":"2024-05-14T01:24:33.655053+0000","last_became_peered":"2024-05-14T01:24:33.655053+0000","last_unstale":"2024-05-14T01:24:34.884560+0000","last_undegraded":"2024-05-14T01:24:34.884560+0000","last_fullsized":"2024-05-14T01:24:34.884560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:26:30.283558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.643085+0000","last_change":"2024-05-14T01:24:33.637885+0000","last_active":"2024-05-14T01:24:34.643085+0000","last_peered":"2024-05-14T01:24:34.643085+0000","last_clean":"2024-05-14T01:24:34.643085+0000","last_became_active":"2024-05-14T01:24:33.636763+0000","last_became_peered":"2024-05-14T01:24:33.636763+0000","last_unstale":"2024-05-14T01:24:34.643085+0000","last_undegraded":"2024-05-14T01:24:34.643085+0000","last_fullsized":"2024-05-14T01:24:34.643085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:30:47.956851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.643563+0000","last_change":"2024-05-14T01:24:33.647684+0000","last_active":"2024-05-14T01:24:34.643563+0000","last_peered":"2024-05-14T01:24:34.643563+0000","last_clean":"2024-05-14T01:24:34.643563+0000","last_became_active":"2024-05-14T01:24:33.644549+0000","last_became_peered":"2024-05-14T01:24:33.644549+0000","last_unstale":"2024-05-14T01:24:34.643563+0000","last_undegraded":"2024-05-14T01:24:34.643563+0000","last_fullsized":"2024-05-14T01:24:34.643563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:57:37.746698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.644668+0000","last_change":"2024-05-14T01:24:33.652182+0000","last_active":"2024-05-14T01:24:34.644668+0000","last_peered":"2024-05-14T01:24:34.644668+0000","last_clean":"2024-05-14T01:24:34.644668+0000","last_became_active":"2024-05-14T01:24:33.650591+0000","last_became_peered":"2024-05-14T01:24:33.650591+0000","last_unstale":"2024-05-14T01:24:34.644668+0000","last_undegraded":"2024-05-14T01:24:34.644668+0000","last_fullsized":"2024-05-14T01:24:34.644668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:48.918352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883275+0000","last_change":"2024-05-14T01:24:33.630566+0000","last_active":"2024-05-14T01:24:34.883275+0000","last_peered":"2024-05-14T01:24:34.883275+0000","last_clean":"2024-05-14T01:24:34.883275+0000","last_became_active":"2024-05-14T01:24:33.629881+0000","last_became_peered":"2024-05-14T01:24:33.629881+0000","last_unstale":"2024-05-14T01:24:34.883275+0000","last_undegraded":"2024-05-14T01:24:34.883275+0000","last_fullsized":"2024-05-14T01:24:34.883275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:49:59.274777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.645269+0000","last_change":"2024-05-14T01:24:32.621045+0000","last_active":"2024-05-14T01:24:34.645269+0000","last_peered":"2024-05-14T01:24:34.645269+0000","last_clean":"2024-05-14T01:24:34.645269+0000","last_became_active":"2024-05-14T01:24:32.620438+0000","last_became_peered":"2024-05-14T01:24:32.620438+0000","last_unstale":"2024-05-14T01:24:34.645269+0000","last_undegraded":"2024-05-14T01:24:34.645269+0000","last_fullsized":"2024-05-14T01:24:34.645269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:31:07.036702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.645353+0000","last_change":"2024-05-14T01:24:33.641609+0000","last_active":"2024-05-14T01:24:34.645353+0000","last_peered":"2024-05-14T01:24:34.645353+0000","last_clean":"2024-05-14T01:24:34.645353+0000","last_became_active":"2024-05-14T01:24:33.640815+0000","last_became_peered":"2024-05-14T01:24:33.640815+0000","last_unstale":"2024-05-14T01:24:34.645353+0000","last_undegraded":"2024-05-14T01:24:34.645353+0000","last_fullsized":"2024-05-14T01:24:34.645353+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:50:05.787468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883413+0000","last_change":"2024-05-14T01:24:32.617319+0000","last_active":"2024-05-14T01:24:34.883413+0000","last_peered":"2024-05-14T01:24:34.883413+0000","last_clean":"2024-05-14T01:24:34.883413+0000","last_became_active":"2024-05-14T01:24:32.616699+0000","last_became_peered":"2024-05-14T01:24:32.616699+0000","last_unstale":"2024-05-14T01:24:34.883413+0000","last_undegraded":"2024-05-14T01:24:34.883413+0000","last_fullsized":"2024-05-14T01:24:34.883413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:12:41.013625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.885079+0000","last_change":"2024-05-14T01:24:33.657926+0000","last_active":"2024-05-14T01:24:34.885079+0000","last_peered":"2024-05-14T01:24:34.885079+0000","last_clean":"2024-05-14T01:24:34.885079+0000","last_became_active":"2024-05-14T01:24:33.657174+0000","last_became_peered":"2024-05-14T01:24:33.657174+0000","last_unstale":"2024-05-14T01:24:34.885079+0000","last_undegraded":"2024-05-14T01:24:34.885079+0000","last_fullsized":"2024-05-14T01:24:34.885079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:50:05.787468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.640364+0000","last_change":"2024-05-14T01:24:32.597078+0000","last_active":"2024-05-14T01:24:34.640364+0000","last_peered":"2024-05-14T01:24:34.640364+0000","last_clean":"2024-05-14T01:24:34.640364+0000","last_became_active":"2024-05-14T01:24:32.596692+0000","last_became_peered":"2024-05-14T01:24:32.596692+0000","last_unstale":"2024-05-14T01:24:34.640364+0000","last_undegraded":"2024-05-14T01:24:34.640364+0000","last_fullsized":"2024-05-14T01:24:34.640364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:28:56.225722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.884768+0000","last_change":"2024-05-14T01:24:33.662896+0000","last_active":"2024-05-14T01:24:34.884768+0000","last_peered":"2024-05-14T01:24:34.884768+0000","last_clean":"2024-05-14T01:24:34.884768+0000","last_became_active":"2024-05-14T01:24:33.662619+0000","last_became_peered":"2024-05-14T01:24:33.662619+0000","last_unstale":"2024-05-14T01:24:34.884768+0000","last_undegraded":"2024-05-14T01:24:34.884768+0000","last_fullsized":"2024-05-14T01:24:34.884768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:06:27.070725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883078+0000","last_change":"2024-05-14T01:24:32.599149+0000","last_active":"2024-05-14T01:24:34.883078+0000","last_peered":"2024-05-14T01:24:34.883078+0000","last_clean":"2024-05-14T01:24:34.883078+0000","last_became_active":"2024-05-14T01:24:32.598789+0000","last_became_peered":"2024-05-14T01:24:32.598789+0000","last_unstale":"2024-05-14T01:24:34.883078+0000","last_undegraded":"2024-05-14T01:24:34.883078+0000","last_fullsized":"2024-05-14T01:24:34.883078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:55:08.731639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.643332+0000","last_change":"2024-05-14T01:24:33.660659+0000","last_active":"2024-05-14T01:24:34.643332+0000","last_peered":"2024-05-14T01:24:34.643332+0000","last_clean":"2024-05-14T01:24:34.643332+0000","last_became_active":"2024-05-14T01:24:33.659984+0000","last_became_peered":"2024-05-14T01:24:33.659984+0000","last_unstale":"2024-05-14T01:24:34.643332+0000","last_undegraded":"2024-05-14T01:24:34.643332+0000","last_fullsized":"2024-05-14T01:24:34.643332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:32:38.308393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.884616+0000","last_change":"2024-05-14T01:24:32.605488+0000","last_active":"2024-05-14T01:24:34.884616+0000","last_peered":"2024-05-14T01:24:34.884616+0000","last_clean":"2024-05-14T01:24:34.884616+0000","last_became_active":"2024-05-14T01:24:32.604323+0000","last_became_peered":"2024-05-14T01:24:32.604323+0000","last_unstale":"2024-05-14T01:24:34.884616+0000","last_undegraded":"2024-05-14T01:24:34.884616+0000","last_fullsized":"2024-05-14T01:24:34.884616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:21.484788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883135+0000","last_change":"2024-05-14T01:24:33.669984+0000","last_active":"2024-05-14T01:24:34.883135+0000","last_peered":"2024-05-14T01:24:34.883135+0000","last_clean":"2024-05-14T01:24:34.883135+0000","last_became_active":"2024-05-14T01:24:33.669318+0000","last_became_peered":"2024-05-14T01:24:33.669318+0000","last_unstale":"2024-05-14T01:24:34.883135+0000","last_undegraded":"2024-05-14T01:24:34.883135+0000","last_fullsized":"2024-05-14T01:24:34.883135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:17:14.820709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.884235+0000","last_change":"2024-05-14T01:24:32.607898+0000","last_active":"2024-05-14T01:24:34.884235+0000","last_peered":"2024-05-14T01:24:34.884235+0000","last_clean":"2024-05-14T01:24:34.884235+0000","last_became_active":"2024-05-14T01:24:32.606398+0000","last_became_peered":"2024-05-14T01:24:32.606398+0000","last_unstale":"2024-05-14T01:24:34.884235+0000","last_undegraded":"2024-05-14T01:24:34.884235+0000","last_fullsized":"2024-05-14T01:24:34.884235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:32:37.352775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883263+0000","last_change":"2024-05-14T01:24:33.651797+0000","last_active":"2024-05-14T01:24:34.883263+0000","last_peered":"2024-05-14T01:24:34.883263+0000","last_clean":"2024-05-14T01:24:34.883263+0000","last_became_active":"2024-05-14T01:24:33.650914+0000","last_became_peered":"2024-05-14T01:24:33.650914+0000","last_unstale":"2024-05-14T01:24:34.883263+0000","last_undegraded":"2024-05-14T01:24:34.883263+0000","last_fullsized":"2024-05-14T01:24:34.883263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:57:37.746698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.640158+0000","last_change":"2024-05-14T01:24:32.598152+0000","last_active":"2024-05-14T01:24:34.640158+0000","last_peered":"2024-05-14T01:24:34.640158+0000","last_clean":"2024-05-14T01:24:34.640158+0000","last_became_active":"2024-05-14T01:24:32.597780+0000","last_became_peered":"2024-05-14T01:24:32.597780+0000","last_unstale":"2024-05-14T01:24:34.640158+0000","last_undegraded":"2024-05-14T01:24:34.640158+0000","last_fullsized":"2024-05-14T01:24:34.640158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:32:00.076584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.882880+0000","last_change":"2024-05-14T01:24:33.672944+0000","last_active":"2024-05-14T01:24:34.882880+0000","last_peered":"2024-05-14T01:24:34.882880+0000","last_clean":"2024-05-14T01:24:34.882880+0000","last_became_active":"2024-05-14T01:24:33.672638+0000","last_became_peered":"2024-05-14T01:24:33.672638+0000","last_unstale":"2024-05-14T01:24:34.882880+0000","last_undegraded":"2024-05-14T01:24:34.882880+0000","last_fullsized":"2024-05-14T01:24:34.882880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:54:20.643861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883537+0000","last_change":"2024-05-14T01:24:32.609292+0000","last_active":"2024-05-14T01:24:34.883537+0000","last_peered":"2024-05-14T01:24:34.883537+0000","last_clean":"2024-05-14T01:24:34.883537+0000","last_became_active":"2024-05-14T01:24:32.603873+0000","last_became_peered":"2024-05-14T01:24:32.603873+0000","last_unstale":"2024-05-14T01:24:34.883537+0000","last_undegraded":"2024-05-14T01:24:34.883537+0000","last_fullsized":"2024-05-14T01:24:34.883537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:14:21.154539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.884343+0000","last_change":"2024-05-14T01:24:33.667775+0000","last_active":"2024-05-14T01:24:34.884343+0000","last_peered":"2024-05-14T01:24:34.884343+0000","last_clean":"2024-05-14T01:24:34.884343+0000","last_became_active":"2024-05-14T01:24:33.667167+0000","last_became_peered":"2024-05-14T01:24:33.667167+0000","last_unstale":"2024-05-14T01:24:34.884343+0000","last_undegraded":"2024-05-14T01:24:34.884343+0000","last_fullsized":"2024-05-14T01:24:34.884343+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:11:20.629791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.640583+0000","last_change":"2024-05-14T01:24:32.617162+0000","last_active":"2024-05-14T01:24:34.640583+0000","last_peered":"2024-05-14T01:24:34.640583+0000","last_clean":"2024-05-14T01:24:34.640583+0000","last_became_active":"2024-05-14T01:24:32.616852+0000","last_became_peered":"2024-05-14T01:24:32.616852+0000","last_unstale":"2024-05-14T01:24:34.640583+0000","last_undegraded":"2024-05-14T01:24:34.640583+0000","last_fullsized":"2024-05-14T01:24:34.640583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:26:29.275207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.640534+0000","last_change":"2024-05-14T01:24:33.642010+0000","last_active":"2024-05-14T01:24:34.640534+0000","last_peered":"2024-05-14T01:24:34.640534+0000","last_clean":"2024-05-14T01:24:34.640534+0000","last_became_active":"2024-05-14T01:24:33.641390+0000","last_became_peered":"2024-05-14T01:24:33.641390+0000","last_unstale":"2024-05-14T01:24:34.640534+0000","last_undegraded":"2024-05-14T01:24:34.640534+0000","last_fullsized":"2024-05-14T01:24:34.640534+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:48.918352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883585+0000","last_change":"2024-05-14T01:24:32.600536+0000","last_active":"2024-05-14T01:24:34.883585+0000","last_peered":"2024-05-14T01:24:34.883585+0000","last_clean":"2024-05-14T01:24:34.883585+0000","last_became_active":"2024-05-14T01:24:32.600218+0000","last_became_peered":"2024-05-14T01:24:32.600218+0000","last_unstale":"2024-05-14T01:24:34.883585+0000","last_undegraded":"2024-05-14T01:24:34.883585+0000","last_fullsized":"2024-05-14T01:24:34.883585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:42:47.538725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.640464+0000","last_change":"2024-05-14T01:24:33.635667+0000","last_active":"2024-05-14T01:24:34.640464+0000","last_peered":"2024-05-14T01:24:34.640464+0000","last_clean":"2024-05-14T01:24:34.640464+0000","last_became_active":"2024-05-14T01:24:33.635292+0000","last_became_peered":"2024-05-14T01:24:33.635292+0000","last_unstale":"2024-05-14T01:24:34.640464+0000","last_undegraded":"2024-05-14T01:24:34.640464+0000","last_fullsized":"2024-05-14T01:24:34.640464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:24:20.403407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883878+0000","last_change":"2024-05-14T01:24:32.621948+0000","last_active":"2024-05-14T01:24:34.883878+0000","last_peered":"2024-05-14T01:24:34.883878+0000","last_clean":"2024-05-14T01:24:34.883878+0000","last_became_active":"2024-05-14T01:24:32.619217+0000","last_became_peered":"2024-05-14T01:24:32.619217+0000","last_unstale":"2024-05-14T01:24:34.883878+0000","last_undegraded":"2024-05-14T01:24:34.883878+0000","last_fullsized":"2024-05-14T01:24:34.883878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:32:00.076584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883609+0000","last_change":"2024-05-14T01:24:33.672931+0000","last_active":"2024-05-14T01:24:34.883609+0000","last_peered":"2024-05-14T01:24:34.883609+0000","last_clean":"2024-05-14T01:24:34.883609+0000","last_became_active":"2024-05-14T01:24:33.671408+0000","last_became_peered":"2024-05-14T01:24:33.671408+0000","last_unstale":"2024-05-14T01:24:34.883609+0000","last_undegraded":"2024-05-14T01:24:34.883609+0000","last_fullsized":"2024-05-14T01:24:34.883609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:25:30.338470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.640265+0000","last_change":"2024-05-14T01:24:32.597195+0000","last_active":"2024-05-14T01:24:34.640265+0000","last_peered":"2024-05-14T01:24:34.640265+0000","last_clean":"2024-05-14T01:24:34.640265+0000","last_became_active":"2024-05-14T01:24:32.596867+0000","last_became_peered":"2024-05-14T01:24:32.596867+0000","last_unstale":"2024-05-14T01:24:34.640265+0000","last_undegraded":"2024-05-14T01:24:34.640265+0000","last_fullsized":"2024-05-14T01:24:34.640265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:28:26.485918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.882939+0000","last_change":"2024-05-14T01:24:33.672881+0000","last_active":"2024-05-14T01:24:34.882939+0000","last_peered":"2024-05-14T01:24:34.882939+0000","last_clean":"2024-05-14T01:24:34.882939+0000","last_became_active":"2024-05-14T01:24:33.672615+0000","last_became_peered":"2024-05-14T01:24:33.672615+0000","last_unstale":"2024-05-14T01:24:34.882939+0000","last_undegraded":"2024-05-14T01:24:34.882939+0000","last_fullsized":"2024-05-14T01:24:34.882939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:53:39.468672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.884847+0000","last_change":"2024-05-14T01:24:32.597406+0000","last_active":"2024-05-14T01:24:34.884847+0000","last_peered":"2024-05-14T01:24:34.884847+0000","last_clean":"2024-05-14T01:24:34.884847+0000","last_became_active":"2024-05-14T01:24:32.596659+0000","last_became_peered":"2024-05-14T01:24:32.596659+0000","last_unstale":"2024-05-14T01:24:34.884847+0000","last_undegraded":"2024-05-14T01:24:34.884847+0000","last_fullsized":"2024-05-14T01:24:34.884847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:28:47.785768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.640363+0000","last_change":"2024-05-14T01:24:33.636298+0000","last_active":"2024-05-14T01:24:34.640363+0000","last_peered":"2024-05-14T01:24:34.640363+0000","last_clean":"2024-05-14T01:24:34.640363+0000","last_became_active":"2024-05-14T01:24:33.635452+0000","last_became_peered":"2024-05-14T01:24:33.635452+0000","last_unstale":"2024-05-14T01:24:34.640363+0000","last_undegraded":"2024-05-14T01:24:34.640363+0000","last_fullsized":"2024-05-14T01:24:34.640363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:11:50.001796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883338+0000","last_change":"2024-05-14T01:24:32.602252+0000","last_active":"2024-05-14T01:24:34.883338+0000","last_peered":"2024-05-14T01:24:34.883338+0000","last_clean":"2024-05-14T01:24:34.883338+0000","last_became_active":"2024-05-14T01:24:32.601892+0000","last_became_peered":"2024-05-14T01:24:32.601892+0000","last_unstale":"2024-05-14T01:24:34.883338+0000","last_undegraded":"2024-05-14T01:24:34.883338+0000","last_fullsized":"2024-05-14T01:24:34.883338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:10:08.387975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.643267+0000","last_change":"2024-05-14T01:24:33.652736+0000","last_active":"2024-05-14T01:24:34.643267+0000","last_peered":"2024-05-14T01:24:34.643267+0000","last_clean":"2024-05-14T01:24:34.643267+0000","last_became_active":"2024-05-14T01:24:33.651483+0000","last_became_peered":"2024-05-14T01:24:33.651483+0000","last_unstale":"2024-05-14T01:24:34.643267+0000","last_undegraded":"2024-05-14T01:24:34.643267+0000","last_fullsized":"2024-05-14T01:24:34.643267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:21:31.040864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.639954+0000","last_change":"2024-05-14T01:24:32.615432+0000","last_active":"2024-05-14T01:24:34.639954+0000","last_peered":"2024-05-14T01:24:34.639954+0000","last_clean":"2024-05-14T01:24:34.639954+0000","last_became_active":"2024-05-14T01:24:32.615072+0000","last_became_peered":"2024-05-14T01:24:32.615072+0000","last_unstale":"2024-05-14T01:24:34.639954+0000","last_undegraded":"2024-05-14T01:24:34.639954+0000","last_fullsized":"2024-05-14T01:24:34.639954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:42:47.538725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.643980+0000","last_change":"2024-05-14T01:24:33.641797+0000","last_active":"2024-05-14T01:24:34.643980+0000","last_peered":"2024-05-14T01:24:34.643980+0000","last_clean":"2024-05-14T01:24:34.643980+0000","last_became_active":"2024-05-14T01:24:33.641048+0000","last_became_peered":"2024-05-14T01:24:33.641048+0000","last_unstale":"2024-05-14T01:24:34.643980+0000","last_undegraded":"2024-05-14T01:24:34.643980+0000","last_fullsized":"2024-05-14T01:24:34.643980+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:28:27.494270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.639884+0000","last_change":"2024-05-14T01:24:32.595994+0000","last_active":"2024-05-14T01:24:34.639884+0000","last_peered":"2024-05-14T01:24:34.639884+0000","last_clean":"2024-05-14T01:24:34.639884+0000","last_became_active":"2024-05-14T01:24:32.595730+0000","last_became_peered":"2024-05-14T01:24:32.595730+0000","last_unstale":"2024-05-14T01:24:34.639884+0000","last_undegraded":"2024-05-14T01:24:34.639884+0000","last_fullsized":"2024-05-14T01:24:34.639884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T03:57:36.738346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.885415+0000","last_change":"2024-05-14T01:24:33.675433+0000","last_active":"2024-05-14T01:24:34.885415+0000","last_peered":"2024-05-14T01:24:34.885415+0000","last_clean":"2024-05-14T01:24:34.885415+0000","last_became_active":"2024-05-14T01:24:33.674941+0000","last_became_peered":"2024-05-14T01:24:33.674941+0000","last_unstale":"2024-05-14T01:24:34.885415+0000","last_undegraded":"2024-05-14T01:24:34.885415+0000","last_fullsized":"2024-05-14T01:24:34.885415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T01:49:59.274777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.886071+0000","last_change":"2024-05-14T01:24:32.600443+0000","last_active":"2024-05-14T01:24:34.886071+0000","last_peered":"2024-05-14T01:24:34.886071+0000","last_clean":"2024-05-14T01:24:34.886071+0000","last_became_active":"2024-05-14T01:24:32.600055+0000","last_became_peered":"2024-05-14T01:24:32.600055+0000","last_unstale":"2024-05-14T01:24:34.886071+0000","last_undegraded":"2024-05-14T01:24:34.886071+0000","last_fullsized":"2024-05-14T01:24:34.886071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:03:58.243337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.884291+0000","last_change":"2024-05-14T01:24:33.672456+0000","last_active":"2024-05-14T01:24:34.884291+0000","last_peered":"2024-05-14T01:24:34.884291+0000","last_clean":"2024-05-14T01:24:34.884291+0000","last_became_active":"2024-05-14T01:24:33.671949+0000","last_became_peered":"2024-05-14T01:24:33.671949+0000","last_unstale":"2024-05-14T01:24:34.884291+0000","last_undegraded":"2024-05-14T01:24:34.884291+0000","last_fullsized":"2024-05-14T01:24:34.884291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:20:22.777064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.885381+0000","last_change":"2024-05-14T01:24:32.600044+0000","last_active":"2024-05-14T01:24:34.885381+0000","last_peered":"2024-05-14T01:24:34.885381+0000","last_clean":"2024-05-14T01:24:34.885381+0000","last_became_active":"2024-05-14T01:24:32.598727+0000","last_became_peered":"2024-05-14T01:24:32.598727+0000","last_unstale":"2024-05-14T01:24:34.885381+0000","last_undegraded":"2024-05-14T01:24:34.885381+0000","last_fullsized":"2024-05-14T01:24:34.885381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:18:20.146184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.884140+0000","last_change":"2024-05-14T01:24:33.660132+0000","last_active":"2024-05-14T01:24:34.884140+0000","last_peered":"2024-05-14T01:24:34.884140+0000","last_clean":"2024-05-14T01:24:34.884140+0000","last_became_active":"2024-05-14T01:24:33.659845+0000","last_became_peered":"2024-05-14T01:24:33.659845+0000","last_unstale":"2024-05-14T01:24:34.884140+0000","last_undegraded":"2024-05-14T01:24:34.884140+0000","last_fullsized":"2024-05-14T01:24:34.884140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:52:21.195533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.885309+0000","last_change":"2024-05-14T01:24:32.598165+0000","last_active":"2024-05-14T01:24:34.885309+0000","last_peered":"2024-05-14T01:24:34.885309+0000","last_clean":"2024-05-14T01:24:34.885309+0000","last_became_active":"2024-05-14T01:24:32.597345+0000","last_became_peered":"2024-05-14T01:24:32.597345+0000","last_unstale":"2024-05-14T01:24:34.885309+0000","last_undegraded":"2024-05-14T01:24:34.885309+0000","last_fullsized":"2024-05-14T01:24:34.885309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:25:45.269383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883378+0000","last_change":"2024-05-14T01:24:33.640525+0000","last_active":"2024-05-14T01:24:34.883378+0000","last_peered":"2024-05-14T01:24:34.883378+0000","last_clean":"2024-05-14T01:24:34.883378+0000","last_became_active":"2024-05-14T01:24:33.640181+0000","last_became_peered":"2024-05-14T01:24:33.640181+0000","last_unstale":"2024-05-14T01:24:34.883378+0000","last_undegraded":"2024-05-14T01:24:34.883378+0000","last_fullsized":"2024-05-14T01:24:34.883378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:35:31.490520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.884842+0000","last_change":"2024-05-14T01:24:32.607306+0000","last_active":"2024-05-14T01:24:34.884842+0000","last_peered":"2024-05-14T01:24:34.884842+0000","last_clean":"2024-05-14T01:24:34.884842+0000","last_became_active":"2024-05-14T01:24:32.605320+0000","last_became_peered":"2024-05-14T01:24:32.605320+0000","last_unstale":"2024-05-14T01:24:34.884842+0000","last_undegraded":"2024-05-14T01:24:34.884842+0000","last_fullsized":"2024-05-14T01:24:34.884842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:31:39.535555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883642+0000","last_change":"2024-05-14T01:24:33.641040+0000","last_active":"2024-05-14T01:24:34.883642+0000","last_peered":"2024-05-14T01:24:34.883642+0000","last_clean":"2024-05-14T01:24:34.883642+0000","last_became_active":"2024-05-14T01:24:33.640639+0000","last_became_peered":"2024-05-14T01:24:33.640639+0000","last_unstale":"2024-05-14T01:24:34.883642+0000","last_undegraded":"2024-05-14T01:24:34.883642+0000","last_fullsized":"2024-05-14T01:24:34.883642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:31:00.127428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.884131+0000","last_change":"2024-05-14T01:24:32.599796+0000","last_active":"2024-05-14T01:24:34.884131+0000","last_peered":"2024-05-14T01:24:34.884131+0000","last_clean":"2024-05-14T01:24:34.884131+0000","last_became_active":"2024-05-14T01:24:32.599365+0000","last_became_peered":"2024-05-14T01:24:32.599365+0000","last_unstale":"2024-05-14T01:24:34.884131+0000","last_undegraded":"2024-05-14T01:24:34.884131+0000","last_fullsized":"2024-05-14T01:24:34.884131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:31:07.036702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.884759+0000","last_change":"2024-05-14T01:24:33.639738+0000","last_active":"2024-05-14T01:24:34.884759+0000","last_peered":"2024-05-14T01:24:34.884759+0000","last_clean":"2024-05-14T01:24:34.884759+0000","last_became_active":"2024-05-14T01:24:33.639059+0000","last_became_peered":"2024-05-14T01:24:33.639059+0000","last_unstale":"2024-05-14T01:24:34.884759+0000","last_undegraded":"2024-05-14T01:24:34.884759+0000","last_fullsized":"2024-05-14T01:24:34.884759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:12:42.021977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.644875+0000","last_change":"2024-05-14T01:24:32.601347+0000","last_active":"2024-05-14T01:24:34.644875+0000","last_peered":"2024-05-14T01:24:34.644875+0000","last_clean":"2024-05-14T01:24:34.644875+0000","last_became_active":"2024-05-14T01:24:32.598291+0000","last_became_peered":"2024-05-14T01:24:32.598291+0000","last_unstale":"2024-05-14T01:24:34.644875+0000","last_undegraded":"2024-05-14T01:24:34.644875+0000","last_fullsized":"2024-05-14T01:24:34.644875+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:30:59.119076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.882797+0000","last_change":"2024-05-14T01:24:33.639435+0000","last_active":"2024-05-14T01:24:34.882797+0000","last_peered":"2024-05-14T01:24:34.882797+0000","last_clean":"2024-05-14T01:24:34.882797+0000","last_became_active":"2024-05-14T01:24:33.639040+0000","last_became_peered":"2024-05-14T01:24:33.639040+0000","last_unstale":"2024-05-14T01:24:34.882797+0000","last_undegraded":"2024-05-14T01:24:34.882797+0000","last_fullsized":"2024-05-14T01:24:34.882797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:18:21.154536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883046+0000","last_change":"2024-05-14T01:24:32.599604+0000","last_active":"2024-05-14T01:24:34.883046+0000","last_peered":"2024-05-14T01:24:34.883046+0000","last_clean":"2024-05-14T01:24:34.883046+0000","last_became_active":"2024-05-14T01:24:32.598939+0000","last_became_peered":"2024-05-14T01:24:32.598939+0000","last_unstale":"2024-05-14T01:24:34.883046+0000","last_undegraded":"2024-05-14T01:24:34.883046+0000","last_fullsized":"2024-05-14T01:24:34.883046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:03:43.259015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.643431+0000","last_change":"2024-05-14T01:24:33.638091+0000","last_active":"2024-05-14T01:24:34.643431+0000","last_peered":"2024-05-14T01:24:34.643431+0000","last_clean":"2024-05-14T01:24:34.643431+0000","last_became_active":"2024-05-14T01:24:33.636578+0000","last_became_peered":"2024-05-14T01:24:33.636578+0000","last_unstale":"2024-05-14T01:24:34.643431+0000","last_undegraded":"2024-05-14T01:24:34.643431+0000","last_fullsized":"2024-05-14T01:24:34.643431+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:20:22.777064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.882508+0000","last_change":"2024-05-14T01:24:32.622632+0000","last_active":"2024-05-14T01:24:34.882508+0000","last_peered":"2024-05-14T01:24:34.882508+0000","last_clean":"2024-05-14T01:24:34.882508+0000","last_became_active":"2024-05-14T01:24:32.622340+0000","last_became_peered":"2024-05-14T01:24:32.622340+0000","last_unstale":"2024-05-14T01:24:34.882508+0000","last_undegraded":"2024-05-14T01:24:34.882508+0000","last_fullsized":"2024-05-14T01:24:34.882508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:42:47.538725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.882381+0000","last_change":"2024-05-14T01:24:33.673015+0000","last_active":"2024-05-14T01:24:34.882381+0000","last_peered":"2024-05-14T01:24:34.882381+0000","last_clean":"2024-05-14T01:24:34.882381+0000","last_became_active":"2024-05-14T01:24:33.672700+0000","last_became_peered":"2024-05-14T01:24:33.672700+0000","last_unstale":"2024-05-14T01:24:34.882381+0000","last_undegraded":"2024-05-14T01:24:34.882381+0000","last_fullsized":"2024-05-14T01:24:34.882381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:03:44.267367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.886408+0000","last_change":"2024-05-14T01:24:32.615997+0000","last_active":"2024-05-14T01:24:34.886408+0000","last_peered":"2024-05-14T01:24:34.886408+0000","last_clean":"2024-05-14T01:24:34.886408+0000","last_became_active":"2024-05-14T01:24:32.615650+0000","last_became_peered":"2024-05-14T01:24:32.615650+0000","last_unstale":"2024-05-14T01:24:34.886408+0000","last_undegraded":"2024-05-14T01:24:34.886408+0000","last_fullsized":"2024-05-14T01:24:34.886408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:42:47.538725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.884445+0000","last_change":"2024-05-14T01:24:33.669541+0000","last_active":"2024-05-14T01:24:34.884445+0000","last_peered":"2024-05-14T01:24:34.884445+0000","last_clean":"2024-05-14T01:24:34.884445+0000","last_became_active":"2024-05-14T01:24:33.668748+0000","last_became_peered":"2024-05-14T01:24:33.668748+0000","last_unstale":"2024-05-14T01:24:34.884445+0000","last_undegraded":"2024-05-14T01:24:34.884445+0000","last_fullsized":"2024-05-14T01:24:34.884445+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:11:50.001796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883812+0000","last_change":"2024-05-14T01:24:32.598174+0000","last_active":"2024-05-14T01:24:34.883812+0000","last_peered":"2024-05-14T01:24:34.883812+0000","last_clean":"2024-05-14T01:24:34.883812+0000","last_became_active":"2024-05-14T01:24:32.595656+0000","last_became_peered":"2024-05-14T01:24:32.595656+0000","last_unstale":"2024-05-14T01:24:34.883812+0000","last_undegraded":"2024-05-14T01:24:34.883812+0000","last_fullsized":"2024-05-14T01:24:34.883812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:32:00.076584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.882639+0000","last_change":"2024-05-14T01:24:33.642183+0000","last_active":"2024-05-14T01:24:34.882639+0000","last_peered":"2024-05-14T01:24:34.882639+0000","last_clean":"2024-05-14T01:24:34.882639+0000","last_became_active":"2024-05-14T01:24:33.641791+0000","last_became_peered":"2024-05-14T01:24:33.641791+0000","last_unstale":"2024-05-14T01:24:34.882639+0000","last_undegraded":"2024-05-14T01:24:34.882639+0000","last_fullsized":"2024-05-14T01:24:34.882639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:50:05.787468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.884388+0000","last_change":"2024-05-14T01:24:32.600486+0000","last_active":"2024-05-14T01:24:34.884388+0000","last_peered":"2024-05-14T01:24:34.884388+0000","last_clean":"2024-05-14T01:24:34.884388+0000","last_became_active":"2024-05-14T01:24:32.599524+0000","last_became_peered":"2024-05-14T01:24:32.599524+0000","last_unstale":"2024-05-14T01:24:34.884388+0000","last_undegraded":"2024-05-14T01:24:34.884388+0000","last_fullsized":"2024-05-14T01:24:34.884388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:12:41.013625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.644783+0000","last_change":"2024-05-14T01:24:33.629421+0000","last_active":"2024-05-14T01:24:34.644783+0000","last_peered":"2024-05-14T01:24:34.644783+0000","last_clean":"2024-05-14T01:24:34.644783+0000","last_became_active":"2024-05-14T01:24:33.628547+0000","last_became_peered":"2024-05-14T01:24:33.628547+0000","last_unstale":"2024-05-14T01:24:34.644783+0000","last_undegraded":"2024-05-14T01:24:34.644783+0000","last_fullsized":"2024-05-14T01:24:34.644783+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T02:28:57.234074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.884373+0000","last_change":"2024-05-14T01:24:32.619963+0000","last_active":"2024-05-14T01:24:34.884373+0000","last_peered":"2024-05-14T01:24:34.884373+0000","last_clean":"2024-05-14T01:24:34.884373+0000","last_became_active":"2024-05-14T01:24:32.619603+0000","last_became_peered":"2024-05-14T01:24:32.619603+0000","last_unstale":"2024-05-14T01:24:34.884373+0000","last_undegraded":"2024-05-14T01:24:34.884373+0000","last_fullsized":"2024-05-14T01:24:34.884373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:03:58.243337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883999+0000","last_change":"2024-05-14T01:24:33.636462+0000","last_active":"2024-05-14T01:24:34.883999+0000","last_peered":"2024-05-14T01:24:34.883999+0000","last_clean":"2024-05-14T01:24:34.883999+0000","last_became_active":"2024-05-14T01:24:33.634389+0000","last_became_peered":"2024-05-14T01:24:33.634389+0000","last_unstale":"2024-05-14T01:24:34.883999+0000","last_undegraded":"2024-05-14T01:24:34.883999+0000","last_fullsized":"2024-05-14T01:24:34.883999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:54:20.643861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883578+0000","last_change":"2024-05-14T01:24:32.619957+0000","last_active":"2024-05-14T01:24:34.883578+0000","last_peered":"2024-05-14T01:24:34.883578+0000","last_clean":"2024-05-14T01:24:34.883578+0000","last_became_active":"2024-05-14T01:24:32.619431+0000","last_became_peered":"2024-05-14T01:24:32.619431+0000","last_unstale":"2024-05-14T01:24:34.883578+0000","last_undegraded":"2024-05-14T01:24:34.883578+0000","last_fullsized":"2024-05-14T01:24:34.883578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T07:31:07.036702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.639842+0000","last_change":"2024-05-14T01:24:33.645607+0000","last_active":"2024-05-14T01:24:34.639842+0000","last_peered":"2024-05-14T01:24:34.639842+0000","last_clean":"2024-05-14T01:24:34.639842+0000","last_became_active":"2024-05-14T01:24:33.640847+0000","last_became_peered":"2024-05-14T01:24:33.640847+0000","last_unstale":"2024-05-14T01:24:34.639842+0000","last_undegraded":"2024-05-14T01:24:34.639842+0000","last_fullsized":"2024-05-14T01:24:34.639842+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T05:21:31.040864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883303+0000","last_change":"2024-05-14T01:24:32.618571+0000","last_active":"2024-05-14T01:24:34.883303+0000","last_peered":"2024-05-14T01:24:34.883303+0000","last_clean":"2024-05-14T01:24:34.883303+0000","last_became_active":"2024-05-14T01:24:32.617821+0000","last_became_peered":"2024-05-14T01:24:32.617821+0000","last_unstale":"2024-05-14T01:24:34.883303+0000","last_undegraded":"2024-05-14T01:24:34.883303+0000","last_fullsized":"2024-05-14T01:24:34.883303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:28:29.191976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.883154+0000","last_change":"2024-05-14T01:24:33.655380+0000","last_active":"2024-05-14T01:24:34.883154+0000","last_peered":"2024-05-14T01:24:34.883154+0000","last_clean":"2024-05-14T01:24:34.883154+0000","last_became_active":"2024-05-14T01:24:33.654642+0000","last_became_peered":"2024-05-14T01:24:33.654642+0000","last_unstale":"2024-05-14T01:24:34.883154+0000","last_undegraded":"2024-05-14T01:24:34.883154+0000","last_fullsized":"2024-05-14T01:24:34.883154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:10:54.940098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.639781+0000","last_change":"2024-05-14T01:24:32.621056+0000","last_active":"2024-05-14T01:24:34.639781+0000","last_peered":"2024-05-14T01:24:34.639781+0000","last_clean":"2024-05-14T01:24:34.639781+0000","last_became_active":"2024-05-14T01:24:32.620782+0000","last_became_peered":"2024-05-14T01:24:32.620782+0000","last_unstale":"2024-05-14T01:24:34.639781+0000","last_undegraded":"2024-05-14T01:24:34.639781+0000","last_fullsized":"2024-05-14T01:24:34.639781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T06:10:53.931746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.643924+0000","last_change":"2024-05-14T01:24:33.643733+0000","last_active":"2024-05-14T01:24:34.643924+0000","last_peered":"2024-05-14T01:24:34.643924+0000","last_clean":"2024-05-14T01:24:34.643924+0000","last_became_active":"2024-05-14T01:24:33.642920+0000","last_became_peered":"2024-05-14T01:24:33.642920+0000","last_unstale":"2024-05-14T01:24:34.643924+0000","last_undegraded":"2024-05-14T01:24:34.643924+0000","last_fullsized":"2024-05-14T01:24:34.643924+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:32.573964+0000","last_clean_scrub_stamp":"2024-05-14T01:24:32.573964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:11:50.001796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.644400+0000","last_change":"2024-05-14T01:24:32.608635+0000","last_active":"2024-05-14T01:24:34.644400+0000","last_peered":"2024-05-14T01:24:34.644400+0000","last_clean":"2024-05-14T01:24:34.644400+0000","last_became_active":"2024-05-14T01:24:32.608351+0000","last_became_peered":"2024-05-14T01:24:32.608351+0000","last_unstale":"2024-05-14T01:24:34.644400+0000","last_undegraded":"2024-05-14T01:24:34.644400+0000","last_fullsized":"2024-05-14T01:24:34.644400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:24:31.565612+0000","last_clean_scrub_stamp":"2024-05-14T01:24:31.565612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T08:10:08.387975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":195,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T01:24:34.644266+0000","last_change":"2024-05-14T01:23:25.487525+0000","last_active":"2024-05-14T01:24:34.644266+0000","last_peered":"2024-05-14T01:24:34.644266+0000","last_clean":"2024-05-14T01:24:34.644266+0000","last_became_active":"2024-05-14T01:23:25.485622+0000","last_became_peered":"2024-05-14T01:23:25.485622+0000","last_unstale":"2024-05-14T01:24:34.644266+0000","last_undegraded":"2024-05-14T01:24:34.644266+0000","last_fullsized":"2024-05-14T01:24:34.644266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_clean_scrub_stamp":"2024-05-14T01:23:24.138255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:26:23.884962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":153091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":978944,"data_stored":741825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":741915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":152073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":152129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":153091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":151527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T01:24:42.376 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-14T01:24:42.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-14T01:24:42.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.560+0000 7f81c0ca3640 1 Processor -- start 2024-05-14T01:24:42.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.560+0000 7f81c0ca3640 1 -- start start 2024-05-14T01:24:42.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.560+0000 7f81c0ca3640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f81bc0d0b70 0x7f81bc166ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.560+0000 7f81c0ca3640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81bc0cec80 con 0x7f81bc06ecf0 2024-05-14T01:24:42.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.560+0000 7f81c0ca3640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81bc15fbf0 con 0x7f81bc159c60 2024-05-14T01:24:42.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.560+0000 7f81c0ca3640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f81bc160800 con 0x7f81bc0d0b70 2024-05-14T01:24:42.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.560+0000 7f81b3fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f81bc06ecf0 0x7f81bc0d0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37618/0 (socket says 172.21.15.154:37618) 2024-05-14T01:24:42.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81b3fff640 1 -- 172.21.15.154:0/1109886805 learned_addr learned my addr 172.21.15.154:0/1109886805 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:42.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81bad9d640 1 --2- 172.21.15.154:0/1109886805 >> v2:172.21.15.176:3300/0 conn(0x7f81bc0d0b70 0x7f81bc166ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81b9d9b640 1 -- 172.21.15.154:0/1109886805 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 365426746 0 0) 0x7f81bc0cec80 con 0x7f81bc06ecf0 2024-05-14T01:24:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81b9d9b640 1 -- 172.21.15.154:0/1109886805 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81a8003530 con 0x7f81bc06ecf0 2024-05-14T01:24:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81b9d9b640 1 -- 172.21.15.154:0/1109886805 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1990545736 0 0) 0x7f81a8003530 con 0x7f81bc06ecf0 2024-05-14T01:24:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81b9d9b640 1 -- 172.21.15.154:0/1109886805 >> v2:172.21.15.176:3300/0 conn(0x7f81bc0d0b70 msgr2=0x7f81bc166ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81b9d9b640 1 --2- 172.21.15.154:0/1109886805 >> v2:172.21.15.176:3300/0 conn(0x7f81bc0d0b70 0x7f81bc166ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81b9d9b640 1 -- 172.21.15.154:0/1109886805 >> v1:172.21.15.176:6789/0 conn(0x7f81bc159c60 legacy=0x7f81bc15cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81b9d9b640 1 -- 172.21.15.154:0/1109886805 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81bc15fed0 con 0x7f81bc06ecf0 2024-05-14T01:24:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81b9d9b640 1 -- 172.21.15.154:0/1109886805 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f81a4001680 con 0x7f81bc06ecf0 2024-05-14T01:24:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81b9d9b640 1 -- 172.21.15.154:0/1109886805 >> v1:172.21.15.154:6789/0 conn(0x7f81bc06ecf0 legacy=0x7f81bc0d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81b9d9b640 1 --2- 172.21.15.154:0/1109886805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81a8003a10 0x7f81a8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81b9d9b640 1 --2- 172.21.15.154:0/1109886805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81a8004810 0x7f81a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81b9d9b640 1 --2- 172.21.15.154:0/1109886805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81a80051d0 0x7f81a800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81b9d9b640 1 -- 172.21.15.154:0/1109886805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc160800 con 0x7f81a80051d0 2024-05-14T01:24:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81b9d9b640 1 -- 172.21.15.154:0/1109886805 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f81a800c0d0 con 0x7f81a8003a10 2024-05-14T01:24:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81b9d9b640 1 -- 172.21.15.154:0/1109886805 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f81a800c2d0 con 0x7f81a8004810 2024-05-14T01:24:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81bad9d640 1 --2- 172.21.15.154:0/1109886805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81a80051d0 0x7f81a800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81ba59c640 1 --2- 172.21.15.154:0/1109886805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81a8003a10 0x7f81a8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81b3fff640 1 --2- 172.21.15.154:0/1109886805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81a8004810 0x7f81a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81bad9d640 1 -- 172.21.15.154:0/1109886805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81a8004810 msgr2=0x7f81a8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:42.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81bad9d640 1 --2- 172.21.15.154:0/1109886805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81a8004810 0x7f81a8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81bad9d640 1 -- 172.21.15.154:0/1109886805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81a8003a10 msgr2=0x7f81a8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:42.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81bad9d640 1 --2- 172.21.15.154:0/1109886805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81a8003a10 0x7f81a8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.564+0000 7f81bad9d640 1 -- 172.21.15.154:0/1109886805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a8003530 con 0x7f81a80051d0 2024-05-14T01:24:42.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81bad9d640 1 -- 172.21.15.154:0/1109886805 reap_dead start 2024-05-14T01:24:42.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81bad9d640 1 --2- 172.21.15.154:0/1109886805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81a80051d0 0x7f81a800b9d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009f90 tx=0x7f81b401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689a59eb38a2f278 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:42.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81b9d9b640 1 -- 172.21.15.154:0/1109886805 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4009c10 con 0x7f81a80051d0 2024-05-14T01:24:42.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81b9d9b640 1 -- 172.21.15.154:0/1109886805 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b40a5c90 con 0x7f81a80051d0 2024-05-14T01:24:42.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81b9d9b640 1 -- 172.21.15.154:0/1109886805 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4003be0 con 0x7f81a80051d0 2024-05-14T01:24:42.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81c0ca3640 1 -- 172.21.15.154:0/1109886805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81a80051d0 msgr2=0x7f81a800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81c0ca3640 1 --2- 172.21.15.154:0/1109886805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81a80051d0 0x7f81a800b9d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009f90 tx=0x7f81b401cc80 comp rx=0 tx=0).stop 2024-05-14T01:24:42.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81c0ca3640 1 -- 172.21.15.154:0/1109886805 shutdown_connections 2024-05-14T01:24:42.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81c0ca3640 1 --2- 172.21.15.154:0/1109886805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81a80051d0 0x7f81a800b9d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81c0ca3640 1 -- 172.21.15.154:0/1109886805 >> 172.21.15.154:0/1109886805 conn(0x7f81bc0b21b0 msgr2=0x7f81bc0b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:42.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81c0ca3640 1 -- 172.21.15.154:0/1109886805 shutdown_connections 2024-05-14T01:24:42.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81c0ca3640 1 -- 172.21.15.154:0/1109886805 wait complete. 2024-05-14T01:24:42.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81c0ca3640 1 Processor -- start 2024-05-14T01:24:42.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81c0ca3640 1 -- start start 2024-05-14T01:24:42.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81c0ca3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81a80051d0 0x7f81bc0b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81c0ca3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81bc0b4960 0x7f81bc14cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81c0ca3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81bc0ae8d0 0x7f81bc0aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81c0ca3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc0d0460 con 0x7f81bc0ae8d0 2024-05-14T01:24:42.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81c0ca3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc160490 con 0x7f81bc0b4960 2024-05-14T01:24:42.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81c0ca3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f81bc0d05e0 con 0x7f81a80051d0 2024-05-14T01:24:42.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.568+0000 7f81bad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81bc0ae8d0 0x7f81bc0aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81bad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81bc0ae8d0 0x7f81bc0aed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42816/0 (socket says 172.21.15.154:42816) 2024-05-14T01:24:42.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81bad9d640 1 -- 172.21.15.154:0/2820862599 learned_addr learned my addr 172.21.15.154:0/2820862599 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:42.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81ba59c640 1 --2- 172.21.15.154:0/2820862599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81a80051d0 0x7f81bc0b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81b3fff640 1 --2- 172.21.15.154:0/2820862599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81bc0b4960 0x7f81bc14cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81bad9d640 1 -- 172.21.15.154:0/2820862599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81a80051d0 msgr2=0x7f81bc0b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81bad9d640 1 --2- 172.21.15.154:0/2820862599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81a80051d0 0x7f81bc0b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81bad9d640 1 -- 172.21.15.154:0/2820862599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81bc0b4960 msgr2=0x7f81bc14cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81bad9d640 1 --2- 172.21.15.154:0/2820862599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81bc0b4960 0x7f81bc14cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81bad9d640 1 -- 172.21.15.154:0/2820862599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81bc0c5550 con 0x7f81bc0ae8d0 2024-05-14T01:24:42.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81b3fff640 1 --2- 172.21.15.154:0/2820862599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81bc0b4960 0x7f81bc14cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:42.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81bad9d640 1 --2- 172.21.15.154:0/2820862599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81bc0ae8d0 0x7f81bc0aed10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f81b401d520 tx=0x7f81b4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:42.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81b2ffd640 1 -- 172.21.15.154:0/2820862599 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b40a5a90 con 0x7f81bc0ae8d0 2024-05-14T01:24:42.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81b2ffd640 1 -- 172.21.15.154:0/2820862599 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b40a6e50 con 0x7f81bc0ae8d0 2024-05-14T01:24:42.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81b2ffd640 1 -- 172.21.15.154:0/2820862599 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4004470 con 0x7f81bc0ae8d0 2024-05-14T01:24:42.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81c0ca3640 1 -- 172.21.15.154:0/2820862599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81bc0c5830 con 0x7f81bc0ae8d0 2024-05-14T01:24:42.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81c0ca3640 1 -- 172.21.15.154:0/2820862599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81bc0c5df0 con 0x7f81bc0ae8d0 2024-05-14T01:24:42.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81c0ca3640 1 -- 172.21.15.154:0/2820862599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81bc075470 con 0x7f81bc0ae8d0 2024-05-14T01:24:42.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81b2ffd640 1 -- 172.21.15.154:0/2820862599 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f81b40c0020 con 0x7f81bc0ae8d0 2024-05-14T01:24:42.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81b2ffd640 1 --2- 172.21.15.154:0/2820862599 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f819c0678c0 0x7f819c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81ba59c640 1 --2- 172.21.15.154:0/2820862599 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f819c0678c0 0x7f819c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81b2ffd640 1 -- 172.21.15.154:0/2820862599 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f81b4120a50 con 0x7f81bc0ae8d0 2024-05-14T01:24:42.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.572+0000 7f81ba59c640 1 --2- 172.21.15.154:0/2820862599 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f819c0678c0 0x7f819c069d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f81ac000c10 tx=0x7f81ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:42.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.576+0000 7f81b2ffd640 1 -- 172.21.15.154:0/2820862599 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f81b40c7020 con 0x7f81bc0ae8d0 2024-05-14T01:24:42.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.800+0000 7f81c0ca3640 1 -- 172.21.15.154:0/2820862599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f81bc0b4ec0 con 0x7f81bc0ae8d0 2024-05-14T01:24:42.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.804+0000 7f81b2ffd640 1 -- 172.21.15.154:0/2820862599 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f81b4016990 con 0x7f81bc0ae8d0 2024-05-14T01:24:42.794 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2024-05-14T01:24:42.794 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDcvEJmzNwUJhAAZcH888XeSsgDX/xMggOZcg== 2024-05-14T01:24:42.795 INFO:teuthology.orchestra.run.smithi154.stdout: caps mds = "allow" 2024-05-14T01:24:42.795 INFO:teuthology.orchestra.run.smithi154.stdout: caps mon = "allow r" 2024-05-14T01:24:42.795 INFO:teuthology.orchestra.run.smithi154.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-14T01:24:42.795 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2024-05-14T01:24:42.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.808+0000 7f81c0ca3640 1 -- 172.21.15.154:0/2820862599 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f819c0678c0 msgr2=0x7f819c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.808+0000 7f81c0ca3640 1 --2- 172.21.15.154:0/2820862599 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f819c0678c0 0x7f819c069d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f81ac000c10 tx=0x7f81ac009040 comp rx=0 tx=0).stop 2024-05-14T01:24:42.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.808+0000 7f81c0ca3640 1 -- 172.21.15.154:0/2820862599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81bc0ae8d0 msgr2=0x7f81bc0aed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.808+0000 7f81c0ca3640 1 --2- 172.21.15.154:0/2820862599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81bc0ae8d0 0x7f81bc0aed10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f81b401d520 tx=0x7f81b4009750 comp rx=0 tx=0).stop 2024-05-14T01:24:42.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.808+0000 7f81c0ca3640 1 -- 172.21.15.154:0/2820862599 shutdown_connections 2024-05-14T01:24:42.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.808+0000 7f81c0ca3640 1 --2- 172.21.15.154:0/2820862599 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f819c0678c0 0x7f819c069d80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.808+0000 7f81c0ca3640 1 --2- 172.21.15.154:0/2820862599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81bc0ae8d0 0x7f81bc0aed10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.808+0000 7f81c0ca3640 1 --2- 172.21.15.154:0/2820862599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81bc0b4960 0x7f81bc14cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.808+0000 7f81c0ca3640 1 --2- 172.21.15.154:0/2820862599 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81a80051d0 0x7f81bc0b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.808+0000 7f81c0ca3640 1 -- 172.21.15.154:0/2820862599 >> 172.21.15.154:0/2820862599 conn(0x7f81bc0b21b0 msgr2=0x7f81bc0b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:42.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.808+0000 7f81c0ca3640 1 -- 172.21.15.154:0/2820862599 shutdown_connections 2024-05-14T01:24:42.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.808+0000 7f81c0ca3640 1 -- 172.21.15.154:0/2820862599 wait complete. 2024-05-14T01:24:42.814 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T01:24:42.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81cef4f640 1 Processor -- start 2024-05-14T01:24:42.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81cef4f640 1 -- start start 2024-05-14T01:24:42.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81cef4f640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f81c813ede0 0x7f81c81415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81cef4f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81c80cf100 con 0x7f81c80cea50 2024-05-14T01:24:42.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81cef4f640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81c80cf3e0 con 0x7f81c8141b30 2024-05-14T01:24:42.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81cef4f640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f81c80ceee0 con 0x7f81c813ede0 2024-05-14T01:24:42.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81cd4ec640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f81c80cea50 0x7f81c806d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37632/0 (socket says 172.21.15.154:37632) 2024-05-14T01:24:42.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81cd4ec640 1 -- 172.21.15.154:0/2122766110 learned_addr learned my addr 172.21.15.154:0/2122766110 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:42.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81c77fe640 1 -- 172.21.15.154:0/2122766110 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2039004986 0 0) 0x7f81c80cf100 con 0x7f81c80cea50 2024-05-14T01:24:42.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81ccceb640 1 --2- 172.21.15.154:0/2122766110 >> v2:172.21.15.176:3300/0 conn(0x7f81c813ede0 0x7f81c81415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81c77fe640 1 -- 172.21.15.154:0/2122766110 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81b0003530 con 0x7f81c80cea50 2024-05-14T01:24:42.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81c77fe640 1 -- 172.21.15.154:0/2122766110 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2435822235 0 0) 0x7f81b0003530 con 0x7f81c80cea50 2024-05-14T01:24:42.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81c77fe640 1 -- 172.21.15.154:0/2122766110 >> v2:172.21.15.176:3300/0 conn(0x7f81c813ede0 msgr2=0x7f81c81415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:42.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81c77fe640 1 --2- 172.21.15.154:0/2122766110 >> v2:172.21.15.176:3300/0 conn(0x7f81c813ede0 0x7f81c81415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81c77fe640 1 -- 172.21.15.154:0/2122766110 >> v1:172.21.15.176:6789/0 conn(0x7f81c8141b30 legacy=0x7f81c80ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81c77fe640 1 -- 172.21.15.154:0/2122766110 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c806cc80 con 0x7f81c80cea50 2024-05-14T01:24:42.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81c77fe640 1 -- 172.21.15.154:0/2122766110 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f81c0001a00 con 0x7f81c80cea50 2024-05-14T01:24:42.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81c77fe640 1 -- 172.21.15.154:0/2122766110 >> v1:172.21.15.154:6789/0 conn(0x7f81c80cea50 legacy=0x7f81c806d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81c77fe640 1 --2- 172.21.15.154:0/2122766110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b00039c0 0x7f81b0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81c77fe640 1 --2- 172.21.15.154:0/2122766110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81b0004810 0x7f81b0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81c77fe640 1 --2- 172.21.15.154:0/2122766110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81b00051d0 0x7f81b000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81c77fe640 1 -- 172.21.15.154:0/2122766110 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81c80ceee0 con 0x7f81b00039c0 2024-05-14T01:24:42.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81c77fe640 1 -- 172.21.15.154:0/2122766110 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f81b000c120 con 0x7f81b00051d0 2024-05-14T01:24:42.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81c77fe640 1 -- 172.21.15.154:0/2122766110 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f81b000c320 con 0x7f81b0004810 2024-05-14T01:24:42.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81ccceb640 1 --2- 172.21.15.154:0/2122766110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b00039c0 0x7f81b0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81cd4ec640 1 --2- 172.21.15.154:0/2122766110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81b00051d0 0x7f81b000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81c7fff640 1 --2- 172.21.15.154:0/2122766110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81b0004810 0x7f81b0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81ccceb640 1 -- 172.21.15.154:0/2122766110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81b0004810 msgr2=0x7f81b0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:42.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81ccceb640 1 --2- 172.21.15.154:0/2122766110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81b0004810 0x7f81b0004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81ccceb640 1 -- 172.21.15.154:0/2122766110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81b00051d0 msgr2=0x7f81b000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:42.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81ccceb640 1 --2- 172.21.15.154:0/2122766110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81b00051d0 0x7f81b000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81ccceb640 1 -- 172.21.15.154:0/2122766110 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b0003530 con 0x7f81b00039c0 2024-05-14T01:24:42.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.944+0000 7f81cd4ec640 1 -- 172.21.15.154:0/2122766110 reap_dead start 2024-05-14T01:24:42.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.948+0000 7f81ccceb640 1 --2- 172.21.15.154:0/2122766110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b00039c0 0x7f81b0003de0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f81b800ba30 tx=0x7f81b801c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce8f27acf6bca55 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:42.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.948+0000 7f81c77fe640 1 -- 172.21.15.154:0/2122766110 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b80b2070 con 0x7f81b00039c0 2024-05-14T01:24:42.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.948+0000 7f81c77fe640 1 -- 172.21.15.154:0/2122766110 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b80ad410 con 0x7f81b00039c0 2024-05-14T01:24:42.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.948+0000 7f81c77fe640 1 -- 172.21.15.154:0/2122766110 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b800b600 con 0x7f81b00039c0 2024-05-14T01:24:42.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.948+0000 7f81cef4f640 1 -- 172.21.15.154:0/2122766110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b00039c0 msgr2=0x7f81b0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.948+0000 7f81cef4f640 1 --2- 172.21.15.154:0/2122766110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b00039c0 0x7f81b0003de0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f81b800ba30 tx=0x7f81b801c6a0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.948+0000 7f81cef4f640 1 -- 172.21.15.154:0/2122766110 shutdown_connections 2024-05-14T01:24:42.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.948+0000 7f81cef4f640 1 --2- 172.21.15.154:0/2122766110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b00039c0 0x7f81b0003de0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.948+0000 7f81cef4f640 1 -- 172.21.15.154:0/2122766110 >> 172.21.15.154:0/2122766110 conn(0x7f81c80b1850 msgr2=0x7f81c80b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:42.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.948+0000 7f81cef4f640 1 -- 172.21.15.154:0/2122766110 shutdown_connections 2024-05-14T01:24:42.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.948+0000 7f81cef4f640 1 -- 172.21.15.154:0/2122766110 wait complete. 2024-05-14T01:24:42.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.948+0000 7f81cef4f640 1 Processor -- start 2024-05-14T01:24:42.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.948+0000 7f81cef4f640 1 -- start start 2024-05-14T01:24:42.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81cef4f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81b00039c0 0x7f81c813dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81cef4f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81c8144990 0x7f81c8144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81cef4f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c815a8b0 0x7f81c815ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81cef4f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81c8160210 con 0x7f81c815a8b0 2024-05-14T01:24:42.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81cef4f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f81c806cff0 con 0x7f81b00039c0 2024-05-14T01:24:42.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81cef4f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f81c8160390 con 0x7f81c8144990 2024-05-14T01:24:42.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81cd4ec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c815a8b0 0x7f81c815ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81cd4ec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c815a8b0 0x7f81c815ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42828/0 (socket says 172.21.15.154:42828) 2024-05-14T01:24:42.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81cd4ec640 1 -- 172.21.15.154:0/2629446369 learned_addr learned my addr 172.21.15.154:0/2629446369 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:42.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81ccceb640 1 --2- 172.21.15.154:0/2629446369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81b00039c0 0x7f81c813dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81c7fff640 1 --2- 172.21.15.154:0/2629446369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81c8144990 0x7f81c8144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81cd4ec640 1 -- 172.21.15.154:0/2629446369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81c8144990 msgr2=0x7f81c8144e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81cd4ec640 1 --2- 172.21.15.154:0/2629446369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81c8144990 0x7f81c8144e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81cd4ec640 1 -- 172.21.15.154:0/2629446369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81b00039c0 msgr2=0x7f81c813dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:42.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81cd4ec640 1 --2- 172.21.15.154:0/2629446369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81b00039c0 0x7f81c813dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:42.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81cd4ec640 1 -- 172.21.15.154:0/2629446369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c815b680 con 0x7f81c815a8b0 2024-05-14T01:24:42.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81ccceb640 1 --2- 172.21.15.154:0/2629446369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81b00039c0 0x7f81c813dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:42.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81cd4ec640 1 --2- 172.21.15.154:0/2629446369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c815a8b0 0x7f81c815ad30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f81c80d0cb0 tx=0x7f81c0007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:42.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81c57fa640 1 -- 172.21.15.154:0/2629446369 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c000e980 con 0x7f81c815a8b0 2024-05-14T01:24:42.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81c57fa640 1 -- 172.21.15.154:0/2629446369 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c000eb20 con 0x7f81c815a8b0 2024-05-14T01:24:42.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81c57fa640 1 -- 172.21.15.154:0/2629446369 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c000ed10 con 0x7f81c815a8b0 2024-05-14T01:24:42.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81cef4f640 1 -- 172.21.15.154:0/2629446369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c815b960 con 0x7f81c815a8b0 2024-05-14T01:24:42.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81cef4f640 1 -- 172.21.15.154:0/2629446369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c815b270 con 0x7f81c815a8b0 2024-05-14T01:24:42.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81cef4f640 1 -- 172.21.15.154:0/2629446369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81c8075470 con 0x7f81c815a8b0 2024-05-14T01:24:42.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81c57fa640 1 -- 172.21.15.154:0/2629446369 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f81c001a020 con 0x7f81c815a8b0 2024-05-14T01:24:42.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81c57fa640 1 --2- 172.21.15.154:0/2629446369 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f81b40678f0 0x7f81b4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:42.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81c57fa640 1 -- 172.21.15.154:0/2629446369 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f81c00854e0 con 0x7f81c815a8b0 2024-05-14T01:24:42.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81ccceb640 1 --2- 172.21.15.154:0/2629446369 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f81b40678f0 0x7f81b4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:42.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.952+0000 7f81ccceb640 1 --2- 172.21.15.154:0/2629446369 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f81b40678f0 0x7f81b4069db0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f81b80af000 tx=0x7f81b80046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:42.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:42.956+0000 7f81c57fa640 1 -- 172.21.15.154:0/2629446369 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f81c0021020 con 0x7f81c815a8b0 2024-05-14T01:24:43.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.144+0000 7f81cef4f640 1 -- 172.21.15.154:0/2629446369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81c8156560 con 0x7f81c815a8b0 2024-05-14T01:24:43.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.144+0000 7f81c57fa640 1 -- 172.21.15.154:0/2629446369 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5190 (secure 0 0 0) 0x7f81c00560b0 con 0x7f81c815a8b0 2024-05-14T01:24:43.134 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:24:43.134 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3153095738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3153095738},{"type":"v1","addr":"172.21.15.176:6835","nonce":3153095738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1660216913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":1660216913},{"type":"v1","addr":"172.21.15.176:6834","nonce":1660216913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1431439777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1431439777},{"type":"v1","addr":"172.21.15.154:6837","nonce":1431439777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T01:24:32.952086+0000","modified":"2024-05-14T01:24:36.000491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5124":{"gid":5124,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6836/848393842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":848393842},{"type":"v1","addr":"172.21.15.154:6836","nonce":848393842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5124,"qdb_cluster":[5124]},"id":2}]} 2024-05-14T01:24:43.134 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 17 2024-05-14T01:24:43.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.148+0000 7f81cef4f640 1 -- 172.21.15.154:0/2629446369 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f81b40678f0 msgr2=0x7f81b4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:43.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.148+0000 7f81cef4f640 1 --2- 172.21.15.154:0/2629446369 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f81b40678f0 0x7f81b4069db0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f81b80af000 tx=0x7f81b80046d0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.148+0000 7f81cef4f640 1 -- 172.21.15.154:0/2629446369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c815a8b0 msgr2=0x7f81c815ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.148+0000 7f81cef4f640 1 --2- 172.21.15.154:0/2629446369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c815a8b0 0x7f81c815ad30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f81c80d0cb0 tx=0x7f81c0007af0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.148+0000 7f81cef4f640 1 -- 172.21.15.154:0/2629446369 shutdown_connections 2024-05-14T01:24:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.148+0000 7f81cef4f640 1 --2- 172.21.15.154:0/2629446369 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f81b40678f0 0x7f81b4069db0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.148+0000 7f81cef4f640 1 --2- 172.21.15.154:0/2629446369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c815a8b0 0x7f81c815ad30 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.148+0000 7f81cef4f640 1 --2- 172.21.15.154:0/2629446369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81c8144990 0x7f81c8144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.148+0000 7f81cef4f640 1 --2- 172.21.15.154:0/2629446369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81b00039c0 0x7f81c813dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.148+0000 7f81cef4f640 1 -- 172.21.15.154:0/2629446369 >> 172.21.15.154:0/2629446369 conn(0x7f81c80b1850 msgr2=0x7f81c80b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.148+0000 7f81cef4f640 1 -- 172.21.15.154:0/2629446369 shutdown_connections 2024-05-14T01:24:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.148+0000 7f81cef4f640 1 -- 172.21.15.154:0/2629446369 wait complete. 2024-05-14T01:24:43.554 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-14T01:24:32.952086+0000', 'modified': '2024-05-14T01:24:36.000491+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5124}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5124': {'gid': 5124, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6836/848393842', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 848393842}, {'type': 'v1', 'addr': '172.21.15.154:6836', 'nonce': 848393842}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5124, 'qdb_cluster': [5124]} 2024-05-14T01:24:43.555 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-14T01:24:43.555 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-14T01:24:43.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.692+0000 7fa7ec592640 1 Processor -- start 2024-05-14T01:24:43.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.692+0000 7fa7ec592640 1 -- start start 2024-05-14T01:24:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.692+0000 7fa7ec592640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e413ede0 0x7fa7e41415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.692+0000 7fa7ec592640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa7e4141b30 0x7fa7e40ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.692+0000 7fa7ec592640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7e40cf100 con 0x7fa7e40ce880 2024-05-14T01:24:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.692+0000 7fa7ec592640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa7e4141f90 con 0x7fa7e4141b30 2024-05-14T01:24:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.692+0000 7fa7ec592640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa7e406cff0 con 0x7fa7e413ede0 2024-05-14T01:24:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.692+0000 7fa7eab2f640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa7e40ce880 0x7fa7e415fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37646/0 (socket says 172.21.15.154:37646) 2024-05-14T01:24:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.692+0000 7fa7eab2f640 1 -- 172.21.15.154:0/2413257846 learned_addr learned my addr 172.21.15.154:0/2413257846 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:24:43.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.692+0000 7fa7e9b2d640 1 --2- 172.21.15.154:0/2413257846 >> v2:172.21.15.176:3300/0 conn(0x7fa7e4141b30 0x7fa7e40ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.692+0000 7fa7ea32e640 1 --2- 172.21.15.154:0/2413257846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e413ede0 0x7fa7e41415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 -- 172.21.15.154:0/2413257846 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1991325694 0 0) 0x7fa7e40cf100 con 0x7fa7e40ce880 2024-05-14T01:24:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 -- 172.21.15.154:0/2413257846 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7d0003530 con 0x7fa7e40ce880 2024-05-14T01:24:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 -- 172.21.15.154:0/2413257846 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2692213621 0 0) 0x7fa7d0003530 con 0x7fa7e40ce880 2024-05-14T01:24:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 -- 172.21.15.154:0/2413257846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e413ede0 msgr2=0x7fa7e41415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 --2- 172.21.15.154:0/2413257846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e413ede0 0x7fa7e41415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 -- 172.21.15.154:0/2413257846 >> v2:172.21.15.176:3300/0 conn(0x7fa7e4141b30 msgr2=0x7fa7e40ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 --2- 172.21.15.154:0/2413257846 >> v2:172.21.15.176:3300/0 conn(0x7fa7e4141b30 0x7fa7e40ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 -- 172.21.15.154:0/2413257846 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e40cf3e0 con 0x7fa7e40ce880 2024-05-14T01:24:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 -- 172.21.15.154:0/2413257846 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fa7dc001a00 con 0x7fa7e40ce880 2024-05-14T01:24:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 -- 172.21.15.154:0/2413257846 >> v1:172.21.15.154:6789/0 conn(0x7fa7e40ce880 legacy=0x7fa7e415fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 --2- 172.21.15.154:0/2413257846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e413ede0 0x7fa7d00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 --2- 172.21.15.154:0/2413257846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d0003f40 0x7fa7d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 --2- 172.21.15.154:0/2413257846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d0004d50 0x7fa7d00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 -- 172.21.15.154:0/2413257846 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e406cff0 con 0x7fa7d0004d50 2024-05-14T01:24:43.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 -- 172.21.15.154:0/2413257846 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d000b9d0 con 0x7fa7d0003f40 2024-05-14T01:24:43.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 -- 172.21.15.154:0/2413257846 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa7d000bb50 con 0x7fa7e413ede0 2024-05-14T01:24:43.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7eab2f640 1 --2- 172.21.15.154:0/2413257846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d0004d50 0x7fa7d00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e9b2d640 1 --2- 172.21.15.154:0/2413257846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d0003f40 0x7fa7d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7ea32e640 1 --2- 172.21.15.154:0/2413257846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e413ede0 0x7fa7d00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7eab2f640 1 -- 172.21.15.154:0/2413257846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e413ede0 msgr2=0x7fa7d00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:43.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7eab2f640 1 --2- 172.21.15.154:0/2413257846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e413ede0 0x7fa7d00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7eab2f640 1 -- 172.21.15.154:0/2413257846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d0003f40 msgr2=0x7fa7d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:43.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7eab2f640 1 --2- 172.21.15.154:0/2413257846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d0003f40 0x7fa7d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7eab2f640 1 -- 172.21.15.154:0/2413257846 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d0003530 con 0x7fa7d0004d50 2024-05-14T01:24:43.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7eab2f640 1 --2- 172.21.15.154:0/2413257846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d0004d50 0x7fa7d00051d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc00a880 tx=0x7fa7dc01d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f41cc70d4a4a608 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:43.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 -- 172.21.15.154:0/2413257846 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc00a4a0 con 0x7fa7d0004d50 2024-05-14T01:24:43.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 -- 172.21.15.154:0/2413257846 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7dc0ad650 con 0x7fa7d0004d50 2024-05-14T01:24:43.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7e932c640 1 -- 172.21.15.154:0/2413257846 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc0ada40 con 0x7fa7d0004d50 2024-05-14T01:24:43.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7ec592640 1 -- 172.21.15.154:0/2413257846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d0004d50 msgr2=0x7fa7d00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:43.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7ec592640 1 --2- 172.21.15.154:0/2413257846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d0004d50 0x7fa7d00051d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc00a880 tx=0x7fa7dc01d340 comp rx=0 tx=0).stop 2024-05-14T01:24:43.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7eab2f640 1 -- 172.21.15.154:0/2413257846 reap_dead start 2024-05-14T01:24:43.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7ec592640 1 -- 172.21.15.154:0/2413257846 shutdown_connections 2024-05-14T01:24:43.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7ec592640 1 -- 172.21.15.154:0/2413257846 >> 172.21.15.154:0/2413257846 conn(0x7fa7e40b1850 msgr2=0x7fa7e40b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:43.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.696+0000 7fa7ec592640 1 -- 172.21.15.154:0/2413257846 shutdown_connections 2024-05-14T01:24:43.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ec592640 1 -- 172.21.15.154:0/2413257846 wait complete. 2024-05-14T01:24:43.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ec592640 1 Processor -- start 2024-05-14T01:24:43.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ec592640 1 -- start start 2024-05-14T01:24:43.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ec592640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7e413a300 0x7fa7e415c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ec592640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e415c990 0x7fa7e415db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ec592640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e415e080 0x7fa7e41f79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ec592640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e413f1c0 con 0x7fa7e413a300 2024-05-14T01:24:43.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ec592640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e40cf6c0 con 0x7fa7e415c990 2024-05-14T01:24:43.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ec592640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa7e40cece0 con 0x7fa7e415e080 2024-05-14T01:24:43.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ea32e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7e413a300 0x7fa7e415c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ea32e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7e413a300 0x7fa7e415c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42844/0 (socket says 172.21.15.154:42844) 2024-05-14T01:24:43.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ea32e640 1 -- 172.21.15.154:0/1573869186 learned_addr learned my addr 172.21.15.154:0/1573869186 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:43.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7eab2f640 1 --2- 172.21.15.154:0/1573869186 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e415e080 0x7fa7e41f79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7e9b2d640 1 --2- 172.21.15.154:0/1573869186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e415c990 0x7fa7e415db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ea32e640 1 -- 172.21.15.154:0/1573869186 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e415e080 msgr2=0x7fa7e41f79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:43.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ea32e640 1 --2- 172.21.15.154:0/1573869186 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e415e080 0x7fa7e41f79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ea32e640 1 -- 172.21.15.154:0/1573869186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e415c990 msgr2=0x7fa7e415db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:43.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ea32e640 1 --2- 172.21.15.154:0/1573869186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e415c990 0x7fa7e415db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ea32e640 1 -- 172.21.15.154:0/1573869186 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e415d010 con 0x7fa7e413a300 2024-05-14T01:24:43.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7e9b2d640 1 --2- 172.21.15.154:0/1573869186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e415c990 0x7fa7e415db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:43.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7eab2f640 1 --2- 172.21.15.154:0/1573869186 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e415e080 0x7fa7e41f79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:24:43.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ea32e640 1 --2- 172.21.15.154:0/1573869186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7e413a300 0x7fa7e415c450 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00115e0 tx=0x7fa7e0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:43.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7daffd640 1 -- 172.21.15.154:0/1573869186 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e000f8f0 con 0x7fa7e413a300 2024-05-14T01:24:43.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7daffd640 1 -- 172.21.15.154:0/1573869186 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e000fa90 con 0x7fa7e413a300 2024-05-14T01:24:43.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ec592640 1 -- 172.21.15.154:0/1573869186 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7e415d2f0 con 0x7fa7e413a300 2024-05-14T01:24:43.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7daffd640 1 -- 172.21.15.154:0/1573869186 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e000fe40 con 0x7fa7e413a300 2024-05-14T01:24:43.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.700+0000 7fa7ec592640 1 -- 172.21.15.154:0/1573869186 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7e413a6e0 con 0x7fa7e413a300 2024-05-14T01:24:43.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7daffd640 1 -- 172.21.15.154:0/1573869186 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa7e0015460 con 0x7fa7e413a300 2024-05-14T01:24:43.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7daffd640 1 --2- 172.21.15.154:0/1573869186 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa7c80678c0 0x7fa7c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7daffd640 1 -- 172.21.15.154:0/1573869186 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa7e0086770 con 0x7fa7e413a300 2024-05-14T01:24:43.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7e9b2d640 1 --2- 172.21.15.154:0/1573869186 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa7c80678c0 0x7fa7c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7e9b2d640 1 --2- 172.21.15.154:0/1573869186 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa7c80678c0 0x7fa7c8069d80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa7e413e3b0 tx=0x7fa7d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ef70c000 1 Processor -- start 2024-05-14T01:24:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ef70c000 1 -- start start 2024-05-14T01:24:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ef70c000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564210556370 0x564210556750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ef70c000 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564210556c90 0x564210509e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ef70c000 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56421050a340 0x56421050a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ef70c000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564210359c20 con 0x564210556370 2024-05-14T01:24:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ef70c000 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5642102f6a80 con 0x56421050a340 2024-05-14T01:24:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ef70c000 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564210355be0 con 0x564210556c90 2024-05-14T01:24:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ea32e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564210556370 0x564210556750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ea32e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564210556370 0x564210556750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42860/0 (socket says 172.21.15.154:42860) 2024-05-14T01:24:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ea32e640 1 -- 172.21.15.154:0/2475513720 learned_addr learned my addr 172.21.15.154:0/2475513720 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7e9b2d640 1 --2- 172.21.15.154:0/2475513720 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564210556c90 0x564210509e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7eab2f640 1 --2- 172.21.15.154:0/2475513720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56421050a340 0x56421050a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ea32e640 1 -- 172.21.15.154:0/2475513720 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564210556c90 msgr2=0x564210509e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:43.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ea32e640 1 --2- 172.21.15.154:0/2475513720 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564210556c90 0x564210509e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ea32e640 1 -- 172.21.15.154:0/2475513720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56421050a340 msgr2=0x56421050a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:43.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ea32e640 1 --2- 172.21.15.154:0/2475513720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56421050a340 0x56421050a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ea32e640 1 -- 172.21.15.154:0/2475513720 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642102e0b20 con 0x564210556370 2024-05-14T01:24:43.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7eab2f640 1 --2- 172.21.15.154:0/2475513720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56421050a340 0x56421050a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:43.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ea32e640 1 --2- 172.21.15.154:0/2475513720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564210556370 0x564210556750 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0052f70 tx=0x7fa7e0056bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667a7f074e6afe62 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:43.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7c7fff640 1 -- 172.21.15.154:0/2475513720 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0084d10 con 0x564210556370 2024-05-14T01:24:43.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7c7fff640 1 -- 172.21.15.154:0/2475513720 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e0053180 con 0x564210556370 2024-05-14T01:24:43.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7c7fff640 1 -- 172.21.15.154:0/2475513720 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0056fb0 con 0x564210556370 2024-05-14T01:24:43.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ef70c000 1 -- 172.21.15.154:0/2475513720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564210556370 msgr2=0x564210556750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:43.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/2475513720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564210556370 0x564210556750 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0052f70 tx=0x7fa7e0056bd0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ef70c000 1 -- 172.21.15.154:0/2475513720 shutdown_connections 2024-05-14T01:24:43.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/2475513720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56421050a340 0x56421050a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/2475513720 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564210556c90 0x564210509e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/2475513720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564210556370 0x564210556750 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.704+0000 7fa7ef70c000 1 -- 172.21.15.154:0/2475513720 >> 172.21.15.154:0/2475513720 conn(0x5642103f3df0 msgr2=0x564210539330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:43.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 1 -- 172.21.15.154:0/2475513720 shutdown_connections 2024-05-14T01:24:43.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 1 -- 172.21.15.154:0/2475513720 wait complete. 2024-05-14T01:24:43.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 1 -- start start 2024-05-14T01:24:43.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 1 Processor -- start 2024-05-14T01:24:43.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56421050a340 0x564210511fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564210556370 0x564210512500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564210556c90 0x56421053b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564210317000 con 0x56421050a340 2024-05-14T01:24:43.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56421031ca70 con 0x564210556c90 2024-05-14T01:24:43.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564210358b10 con 0x564210556370 2024-05-14T01:24:43.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 10 client.0 _ll_register_callbacks cb 0x5642104f7aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T01:24:43.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ea32e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56421050a340 0x564210511fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ea32e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56421050a340 0x564210511fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42870/0 (socket says 172.21.15.154:42870) 2024-05-14T01:24:43.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ea32e640 1 -- 172.21.15.154:0/998995085 learned_addr learned my addr 172.21.15.154:0/998995085 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:43.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7e9b2d640 1 --2- 172.21.15.154:0/998995085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564210556370 0x564210512500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7eab2f640 1 --2- 172.21.15.154:0/998995085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564210556c90 0x56421053b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ea32e640 1 -- 172.21.15.154:0/998995085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564210556370 msgr2=0x564210512500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:43.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ea32e640 1 --2- 172.21.15.154:0/998995085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564210556370 0x564210512500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ea32e640 1 -- 172.21.15.154:0/998995085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564210556c90 msgr2=0x56421053b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:43.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ea32e640 1 --2- 172.21.15.154:0/998995085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564210556c90 0x56421053b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ea32e640 1 -- 172.21.15.154:0/998995085 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642102e1e80 con 0x56421050a340 2024-05-14T01:24:43.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7eab2f640 1 --2- 172.21.15.154:0/998995085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564210556c90 0x56421053b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:43.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ea32e640 1 --2- 172.21.15.154:0/998995085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56421050a340 0x564210511fc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0054dc0 tx=0x7fa7e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8a9f155b7dcfd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:43.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-14T01:24:43.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7c57fa640 1 -- 172.21.15.154:0/998995085 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e005f460 con 0x56421050a340 2024-05-14T01:24:43.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7c57fa640 1 -- 172.21.15.154:0/998995085 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa7e0055f60 con 0x56421050a340 2024-05-14T01:24:43.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 1 -- 172.21.15.154:0/998995085 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7e0053180 con 0x56421050a340 2024-05-14T01:24:43.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7c57fa640 1 -- 172.21.15.154:0/998995085 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fa7e0056180 con 0x56421050a340 2024-05-14T01:24:43.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 10 client.5337 fetch_fsmap learned FSMap version 17 2024-05-14T01:24:43.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 1 -- 172.21.15.154:0/998995085 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x564210326760 con 0x56421050a340 2024-05-14T01:24:43.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7c57fa640 1 -- 172.21.15.154:0/998995085 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e0053180 con 0x56421050a340 2024-05-14T01:24:43.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7c57fa640 1 -- 172.21.15.154:0/998995085 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7fa7e005d0b0 con 0x56421050a340 2024-05-14T01:24:43.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 10 client.5337 fetch_fsmap finished waiting for FSMap version 17 2024-05-14T01:24:43.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 10 client.5337 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-14T01:24:43.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 20 client.5337 populate_metadata read hostname 'smithi154' 2024-05-14T01:24:43.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/998995085 >> [v2:172.21.15.154:6834/848393842,v1:172.21.15.154:6836/848393842] conn(0x56421053bfc0 0x564210568630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 4 client.5337 mds_command: new command op to 5124 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T01:24:43.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 1 -- 172.21.15.154:0/998995085 --> [v2:172.21.15.154:6834/848393842,v1:172.21.15.154:6836/848393842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642102f4ab0 con 0x56421053bfc0 2024-05-14T01:24:43.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7e9b2d640 1 --2- 172.21.15.154:0/998995085 >> [v2:172.21.15.154:6834/848393842,v1:172.21.15.154:6836/848393842] conn(0x56421053bfc0 0x564210568630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7c57fa640 10 client.5337 ms_handle_connect on v2:172.21.15.154:6834/848393842 2024-05-14T01:24:43.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7e9b2d640 1 --2- 172.21.15.154:0/998995085 >> [v2:172.21.15.154:6834/848393842,v1:172.21.15.154:6836/848393842] conn(0x56421053bfc0 0x564210568630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=295ce21efc8fe7b0 server_cookie=73482a5cc08b9461 in_seq=0 out_seq=0 2024-05-14T01:24:43.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7c57fa640 1 -- 172.21.15.154:0/998995085 <== mds.0 v2:172.21.15.154:6834/848393842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5642102f4ab0 con 0x56421053bfc0 2024-05-14T01:24:43.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7c57fa640 10 client.5337 handle_command_reply: tid=0 2024-05-14T01:24:43.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.708+0000 7fa7ef70c000 1 client.5337 shutdown 2024-05-14T01:24:43.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.712+0000 7fa7ef70c000 1 -- 172.21.15.154:0/998995085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56421050a340 msgr2=0x564210511fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:43.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.712+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/998995085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56421050a340 0x564210511fc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0054dc0 tx=0x7fa7e0017000 comp rx=0 tx=0).stop 2024-05-14T01:24:43.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.712+0000 7fa7ef70c000 1 -- 172.21.15.154:0/998995085 shutdown_connections 2024-05-14T01:24:43.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.712+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/998995085 >> [v2:172.21.15.154:6834/848393842,v1:172.21.15.154:6836/848393842] conn(0x56421053bfc0 0x564210568630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.712+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/998995085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564210556c90 0x56421053b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.712+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/998995085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564210556370 0x564210512500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.712+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/998995085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56421050a340 0x564210511fc0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.712+0000 7fa7c57fa640 0 client.5337 ms_handle_reset on v2:172.21.15.154:6834/848393842 2024-05-14T01:24:43.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.712+0000 7fa7ef70c000 1 -- 172.21.15.154:0/998995085 >> 172.21.15.154:0/998995085 conn(0x5642103f3df0 msgr2=0x564210509500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:43.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.712+0000 7fa7ef70c000 1 -- 172.21.15.154:0/998995085 shutdown_connections 2024-05-14T01:24:43.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.712+0000 7fa7ef70c000 1 -- 172.21.15.154:0/998995085 wait complete. 2024-05-14T01:24:43.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.712+0000 7fa7ef70c000 20 client.5337 trim_cache size 0 max 16384 2024-05-14T01:24:43.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7ef70c000 1 Processor -- start 2024-05-14T01:24:43.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7ef70c000 1 -- start start 2024-05-14T01:24:43.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7ef70c000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56421050a340 0x5642105096c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7ef70c000 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564210556370 0x564210508560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7ef70c000 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564210556c90 0x564210508aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7ef70c000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e41fffe0 con 0x56421050a340 2024-05-14T01:24:43.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7ef70c000 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e40aea10 con 0x564210556370 2024-05-14T01:24:43.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7ef70c000 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa7e40af060 con 0x564210556c90 2024-05-14T01:24:43.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7ea32e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56421050a340 0x5642105096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7ea32e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56421050a340 0x5642105096c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42882/0 (socket says 172.21.15.154:42882) 2024-05-14T01:24:43.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7ea32e640 1 -- 172.21.15.154:0/1205745427 learned_addr learned my addr 172.21.15.154:0/1205745427 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:43.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7e9b2d640 1 --2- 172.21.15.154:0/1205745427 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564210556370 0x564210508560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7ea32e640 1 -- 172.21.15.154:0/1205745427 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564210556c90 msgr2=0x564210508aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:43.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7ea32e640 1 --2- 172.21.15.154:0/1205745427 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564210556c90 0x564210508aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7ea32e640 1 -- 172.21.15.154:0/1205745427 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564210556370 msgr2=0x564210508560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:43.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7ea32e640 1 --2- 172.21.15.154:0/1205745427 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564210556370 0x564210508560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7ea32e640 1 -- 172.21.15.154:0/1205745427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642103b2d10 con 0x56421050a340 2024-05-14T01:24:43.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7ea32e640 1 --2- 172.21.15.154:0/1205745427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56421050a340 0x5642105096c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00572e0 tx=0x7fa7e0080040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445e423e7f266e4b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:43.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7c77fe640 1 -- 172.21.15.154:0/1205745427 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0053180 con 0x56421050a340 2024-05-14T01:24:43.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7c77fe640 1 -- 172.21.15.154:0/1205745427 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e005d0c0 con 0x56421050a340 2024-05-14T01:24:43.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.728+0000 7fa7c77fe640 1 -- 172.21.15.154:0/1205745427 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e005f460 con 0x56421050a340 2024-05-14T01:24:43.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 -- 172.21.15.154:0/1205745427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56421050a340 msgr2=0x5642105096c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:43.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/1205745427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56421050a340 0x5642105096c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00572e0 tx=0x7fa7e0080040 comp rx=0 tx=0).stop 2024-05-14T01:24:43.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 -- 172.21.15.154:0/1205745427 shutdown_connections 2024-05-14T01:24:43.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/1205745427 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564210556c90 0x564210508aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/1205745427 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564210556370 0x564210508560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/1205745427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56421050a340 0x5642105096c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 -- 172.21.15.154:0/1205745427 >> 172.21.15.154:0/1205745427 conn(0x5642103f3df0 msgr2=0x564210512460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:43.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 -- 172.21.15.154:0/1205745427 shutdown_connections 2024-05-14T01:24:43.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 -- 172.21.15.154:0/1205745427 wait complete. 2024-05-14T01:24:43.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 -- start start 2024-05-14T01:24:43.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 Processor -- start 2024-05-14T01:24:43.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56421050a340 0x56421056bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564210556370 0x564210569680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564210556c90 0x564210569bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56421040d2b0 con 0x564210556c90 2024-05-14T01:24:43.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564210317000 con 0x564210556370 2024-05-14T01:24:43.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56421030dc40 con 0x56421050a340 2024-05-14T01:24:43.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 10 client.0 _ll_register_callbacks cb 0x7fa7e0057210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T01:24:43.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7eab2f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564210556c90 0x564210569bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7eab2f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564210556c90 0x564210569bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42898/0 (socket says 172.21.15.154:42898) 2024-05-14T01:24:43.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7eab2f640 1 -- 172.21.15.154:0/3262979177 learned_addr learned my addr 172.21.15.154:0/3262979177 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:43.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7e9b2d640 1 --2- 172.21.15.154:0/3262979177 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564210556370 0x564210569680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ea32e640 1 --2- 172.21.15.154:0/3262979177 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56421050a340 0x56421056bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7eab2f640 1 -- 172.21.15.154:0/3262979177 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56421050a340 msgr2=0x56421056bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:43.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7eab2f640 1 --2- 172.21.15.154:0/3262979177 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56421050a340 0x56421056bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7eab2f640 1 -- 172.21.15.154:0/3262979177 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564210556370 msgr2=0x564210569680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:43.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7eab2f640 1 --2- 172.21.15.154:0/3262979177 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564210556370 0x564210569680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7eab2f640 1 -- 172.21.15.154:0/3262979177 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642102e8b60 con 0x564210556c90 2024-05-14T01:24:43.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ea32e640 1 --2- 172.21.15.154:0/3262979177 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56421050a340 0x56421056bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T01:24:43.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7eab2f640 1 --2- 172.21.15.154:0/3262979177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564210556c90 0x564210569bc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc01d170 tx=0x7fa7dc01a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78936f314c863cbc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:43.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-14T01:24:43.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7c57fa640 1 -- 172.21.15.154:0/3262979177 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc0bb060 con 0x564210556c90 2024-05-14T01:24:43.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7c57fa640 1 -- 172.21.15.154:0/3262979177 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa7dc00a4a0 con 0x564210556c90 2024-05-14T01:24:43.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 -- 172.21.15.154:0/3262979177 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7e005d0c0 con 0x564210556c90 2024-05-14T01:24:43.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7c57fa640 1 -- 172.21.15.154:0/3262979177 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fa7dc0011d0 con 0x564210556c90 2024-05-14T01:24:43.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 10 client.5343 fetch_fsmap learned FSMap version 17 2024-05-14T01:24:43.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 -- 172.21.15.154:0/3262979177 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5642102ffed0 con 0x564210556c90 2024-05-14T01:24:43.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7c57fa640 1 -- 172.21.15.154:0/3262979177 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e005d0c0 con 0x564210556c90 2024-05-14T01:24:43.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7c57fa640 1 -- 172.21.15.154:0/3262979177 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7fa7dc0017c0 con 0x564210556c90 2024-05-14T01:24:43.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 10 client.5343 fetch_fsmap finished waiting for FSMap version 17 2024-05-14T01:24:43.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 10 client.5343 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-14T01:24:43.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 20 client.5343 populate_metadata read hostname 'smithi154' 2024-05-14T01:24:43.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/3262979177 >> [v2:172.21.15.154:6834/848393842,v1:172.21.15.154:6836/848393842] conn(0x5642105cc620 0x56421056a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 4 client.5343 mds_command: new command op to 5124 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T01:24:43.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 -- 172.21.15.154:0/3262979177 --> [v2:172.21.15.154:6834/848393842,v1:172.21.15.154:6836/848393842] -- command(tid 0: {"prefix": "status"}) -- 0x564210367350 con 0x5642105cc620 2024-05-14T01:24:43.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ea32e640 1 --2- 172.21.15.154:0/3262979177 >> [v2:172.21.15.154:6834/848393842,v1:172.21.15.154:6836/848393842] conn(0x5642105cc620 0x56421056a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7c57fa640 10 client.5343 ms_handle_connect on v2:172.21.15.154:6834/848393842 2024-05-14T01:24:43.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ea32e640 1 --2- 172.21.15.154:0/3262979177 >> [v2:172.21.15.154:6834/848393842,v1:172.21.15.154:6836/848393842] conn(0x5642105cc620 0x56421056a860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c82dcb6c4c586f0a server_cookie=660421919a60d972 in_seq=0 out_seq=0 2024-05-14T01:24:43.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7c57fa640 1 -- 172.21.15.154:0/3262979177 <== mds.0 v2:172.21.15.154:6834/848393842 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x564210367350 con 0x5642105cc620 2024-05-14T01:24:43.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7c57fa640 10 client.5343 handle_command_reply: tid=0 2024-05-14T01:24:43.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 client.5343 shutdown 2024-05-14T01:24:43.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 -- 172.21.15.154:0/3262979177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564210556c90 msgr2=0x564210569bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:43.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/3262979177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564210556c90 0x564210569bc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc01d170 tx=0x7fa7dc01a140 comp rx=0 tx=0).stop 2024-05-14T01:24:43.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 -- 172.21.15.154:0/3262979177 shutdown_connections 2024-05-14T01:24:43.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/3262979177 >> [v2:172.21.15.154:6834/848393842,v1:172.21.15.154:6836/848393842] conn(0x5642105cc620 0x56421056a860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/3262979177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564210556c90 0x564210569bc0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7c57fa640 0 client.5343 ms_handle_reset on v2:172.21.15.154:6834/848393842 2024-05-14T01:24:43.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/3262979177 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564210556370 0x564210569680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 --2- 172.21.15.154:0/3262979177 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56421050a340 0x56421056bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 -- 172.21.15.154:0/3262979177 >> 172.21.15.154:0/3262979177 conn(0x5642103f3df0 msgr2=0x5642105630d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:43.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 -- 172.21.15.154:0/3262979177 shutdown_connections 2024-05-14T01:24:43.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.732+0000 7fa7ef70c000 1 -- 172.21.15.154:0/3262979177 wait complete. 2024-05-14T01:24:43.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.736+0000 7fa7ef70c000 20 client.5343 trim_cache size 0 max 16384 2024-05-14T01:24:43.730 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-14T01:24:43.730 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "ed6da4f4-feae-4641-a379-d93fb409ad95", 2024-05-14T01:24:43.730 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2024-05-14T01:24:43.730 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 5124, 2024-05-14T01:24:43.730 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2024-05-14T01:24:43.730 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2024-05-14T01:24:43.730 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2024-05-14T01:24:43.730 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 10.106468404999999, 2024-05-14T01:24:43.730 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 17, 2024-05-14T01:24:43.730 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 34, 2024-05-14T01:24:43.730 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 34, 2024-05-14T01:24:43.730 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 17.054940945999999 2024-05-14T01:24:43.731 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-14T01:24:43.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.736+0000 7fa7ec592640 1 -- 172.21.15.154:0/1573869186 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa7c80678c0 msgr2=0x7fa7c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:43.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.736+0000 7fa7ec592640 1 --2- 172.21.15.154:0/1573869186 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa7c80678c0 0x7fa7c8069d80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa7e413e3b0 tx=0x7fa7d4008040 comp rx=0 tx=0).stop 2024-05-14T01:24:43.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.736+0000 7fa7ec592640 1 -- 172.21.15.154:0/1573869186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7e413a300 msgr2=0x7fa7e415c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:43.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.736+0000 7fa7ec592640 1 --2- 172.21.15.154:0/1573869186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7e413a300 0x7fa7e415c450 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00115e0 tx=0x7fa7e0011aa0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.736+0000 7fa7ec592640 1 -- 172.21.15.154:0/1573869186 shutdown_connections 2024-05-14T01:24:43.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.736+0000 7fa7ec592640 1 --2- 172.21.15.154:0/1573869186 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa7c80678c0 0x7fa7c8069d80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.736+0000 7fa7ec592640 1 --2- 172.21.15.154:0/1573869186 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e415e080 0x7fa7e41f79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.736+0000 7fa7ec592640 1 --2- 172.21.15.154:0/1573869186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e415c990 0x7fa7e415db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.736+0000 7fa7ec592640 1 --2- 172.21.15.154:0/1573869186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7e413a300 0x7fa7e415c450 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.736+0000 7fa7ec592640 1 -- 172.21.15.154:0/1573869186 >> 172.21.15.154:0/1573869186 conn(0x7fa7e40b1850 msgr2=0x7fa7e415b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:43.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.736+0000 7fa7ec592640 1 -- 172.21.15.154:0/1573869186 shutdown_connections 2024-05-14T01:24:43.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.736+0000 7fa7ec592640 1 -- 172.21.15.154:0/1573869186 wait complete. 2024-05-14T01:24:43.739 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T01:24:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.852+0000 7fb095d97640 1 Processor -- start 2024-05-14T01:24:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.852+0000 7fb095d97640 1 -- start start 2024-05-14T01:24:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.852+0000 7fb095d97640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb0900716d0 0x7fb090071b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.852+0000 7fb095d97640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb0900ce140 0x7fb0900ce550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.852+0000 7fb095d97640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0900cb1d0 con 0x7fb090154b80 2024-05-14T01:24:43.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.852+0000 7fb095d97640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb09015ad00 con 0x7fb0900716d0 2024-05-14T01:24:43.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.852+0000 7fb095d97640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb09015afe0 con 0x7fb0900ce140 2024-05-14T01:24:43.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.852+0000 7fb08effd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb0900716d0 0x7fb090071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.852+0000 7fb08effd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb0900716d0 0x7fb090071b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42908/0 (socket says 172.21.15.154:42908) 2024-05-14T01:24:43.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.852+0000 7fb08effd640 1 -- 172.21.15.154:0/817777138 learned_addr learned my addr 172.21.15.154:0/817777138 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:43.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.852+0000 7fb08ffff640 1 --2- 172.21.15.154:0/817777138 >> v2:172.21.15.176:3300/0 conn(0x7fb0900ce140 0x7fb0900ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.852+0000 7fb08effd640 1 -- 172.21.15.154:0/817777138 >> v2:172.21.15.176:3300/0 conn(0x7fb0900ce140 msgr2=0x7fb0900ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:43.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.852+0000 7fb08effd640 1 --2- 172.21.15.154:0/817777138 >> v2:172.21.15.176:3300/0 conn(0x7fb0900ce140 0x7fb0900ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.852+0000 7fb08effd640 1 -- 172.21.15.154:0/817777138 >> v1:172.21.15.176:6789/0 conn(0x7fb090154b80 legacy=0x7fb0900caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:24:43.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.852+0000 7fb08effd640 1 -- 172.21.15.154:0/817777138 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb09015b2c0 con 0x7fb0900716d0 2024-05-14T01:24:43.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb08effd640 1 --2- 172.21.15.154:0/817777138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0900716d0 0x7fb090071b80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb0900d0010 tx=0x7fb07801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332b1f655b88bba0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:43.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb08e7fc640 1 -- 172.21.15.154:0/817777138 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0780b0070 con 0x7fb0900716d0 2024-05-14T01:24:43.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb08e7fc640 1 -- 172.21.15.154:0/817777138 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0780ab600 con 0x7fb0900716d0 2024-05-14T01:24:43.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb08e7fc640 1 -- 172.21.15.154:0/817777138 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0780ab9d0 con 0x7fb0900716d0 2024-05-14T01:24:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb095d97640 1 -- 172.21.15.154:0/817777138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0900716d0 msgr2=0x7fb090071b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb095d97640 1 --2- 172.21.15.154:0/817777138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0900716d0 0x7fb090071b80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb0900d0010 tx=0x7fb07801c4e0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb095d97640 1 -- 172.21.15.154:0/817777138 shutdown_connections 2024-05-14T01:24:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb095d97640 1 --2- 172.21.15.154:0/817777138 >> v2:172.21.15.176:3300/0 conn(0x7fb0900ce140 0x7fb0900ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb095d97640 1 --2- 172.21.15.154:0/817777138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0900716d0 0x7fb090071b80 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb095d97640 1 -- 172.21.15.154:0/817777138 >> 172.21.15.154:0/817777138 conn(0x7fb0900ccef0 msgr2=0x7fb0900cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb095d97640 1 -- 172.21.15.154:0/817777138 shutdown_connections 2024-05-14T01:24:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb095d97640 1 -- 172.21.15.154:0/817777138 wait complete. 2024-05-14T01:24:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb095d97640 1 Processor -- start 2024-05-14T01:24:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb095d97640 1 -- start start 2024-05-14T01:24:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb095d97640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0900716d0 0x7fb090152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb095d97640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0900ce140 0x7fb0901f6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb095d97640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb090154b80 0x7fb09015e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb095d97640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb090072960 con 0x7fb090154b80 2024-05-14T01:24:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb095d97640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb0900727e0 con 0x7fb0900ce140 2024-05-14T01:24:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb095d97640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb0900cea90 con 0x7fb0900716d0 2024-05-14T01:24:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.856+0000 7fb08ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb090154b80 0x7fb09015e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb08ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb090154b80 0x7fb09015e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42910/0 (socket says 172.21.15.154:42910) 2024-05-14T01:24:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb08ffff640 1 -- 172.21.15.154:0/710841802 learned_addr learned my addr 172.21.15.154:0/710841802 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:24:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb08effd640 1 --2- 172.21.15.154:0/710841802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0900ce140 0x7fb0901f6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb08f7fe640 1 --2- 172.21.15.154:0/710841802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0900716d0 0x7fb090152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb08ffff640 1 -- 172.21.15.154:0/710841802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0900716d0 msgr2=0x7fb090152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:43.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb08ffff640 1 --2- 172.21.15.154:0/710841802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0900716d0 0x7fb090152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb08ffff640 1 -- 172.21.15.154:0/710841802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0900ce140 msgr2=0x7fb0901f6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:43.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb08ffff640 1 --2- 172.21.15.154:0/710841802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0900ce140 0x7fb0901f6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:43.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb08ffff640 1 -- 172.21.15.154:0/710841802 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb09015d280 con 0x7fb090154b80 2024-05-14T01:24:43.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb08ffff640 1 --2- 172.21.15.154:0/710841802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb090154b80 0x7fb09015e400 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb08000d580 tx=0x7fb08000da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:43.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb087fff640 1 -- 172.21.15.154:0/710841802 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0800125f0 con 0x7fb090154b80 2024-05-14T01:24:43.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb087fff640 1 -- 172.21.15.154:0/710841802 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb080019070 con 0x7fb090154b80 2024-05-14T01:24:43.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb087fff640 1 -- 172.21.15.154:0/710841802 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0800129d0 con 0x7fb090154b80 2024-05-14T01:24:43.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb095d97640 1 -- 172.21.15.154:0/710841802 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb09015d920 con 0x7fb090154b80 2024-05-14T01:24:43.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb095d97640 1 -- 172.21.15.154:0/710841802 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb09015dee0 con 0x7fb090154b80 2024-05-14T01:24:43.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb095d97640 1 -- 172.21.15.154:0/710841802 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb090068360 con 0x7fb090154b80 2024-05-14T01:24:43.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb087fff640 1 -- 172.21.15.154:0/710841802 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb080012b70 con 0x7fb090154b80 2024-05-14T01:24:43.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb087fff640 1 --2- 172.21.15.154:0/710841802 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb0700678c0 0x7fb070069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:24:43.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb08f7fe640 1 --2- 172.21.15.154:0/710841802 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb0700678c0 0x7fb070069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:24:43.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb087fff640 1 -- 172.21.15.154:0/710841802 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb080086080 con 0x7fb090154b80 2024-05-14T01:24:43.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.860+0000 7fb08f7fe640 1 --2- 172.21.15.154:0/710841802 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb0700678c0 0x7fb070069d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb088007bf0 tx=0x7fb088007240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:24:43.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:43.864+0000 7fb087fff640 1 -- 172.21.15.154:0/710841802 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb080056bd0 con 0x7fb090154b80 2024-05-14T01:24:44.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:44.056+0000 7fb095d97640 1 -- 172.21.15.154:0/710841802 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb09006d3b0 con 0x7fb090154b80 2024-05-14T01:24:44.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:44.060+0000 7fb087fff640 1 -- 172.21.15.154:0/710841802 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7fb0800564d0 con 0x7fb090154b80 2024-05-14T01:24:44.047 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-14T01:24:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:44.060+0000 7fb095d97640 1 -- 172.21.15.154:0/710841802 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb0700678c0 msgr2=0x7fb070069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:44.060+0000 7fb095d97640 1 --2- 172.21.15.154:0/710841802 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb0700678c0 0x7fb070069d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb088007bf0 tx=0x7fb088007240 comp rx=0 tx=0).stop 2024-05-14T01:24:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:44.060+0000 7fb095d97640 1 -- 172.21.15.154:0/710841802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb090154b80 msgr2=0x7fb09015e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:24:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:44.060+0000 7fb095d97640 1 --2- 172.21.15.154:0/710841802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb090154b80 0x7fb09015e400 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb08000d580 tx=0x7fb08000da40 comp rx=0 tx=0).stop 2024-05-14T01:24:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:44.060+0000 7fb095d97640 1 -- 172.21.15.154:0/710841802 shutdown_connections 2024-05-14T01:24:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:44.060+0000 7fb095d97640 1 --2- 172.21.15.154:0/710841802 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb0700678c0 0x7fb070069d80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:44.060+0000 7fb095d97640 1 --2- 172.21.15.154:0/710841802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb090154b80 0x7fb09015e400 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:44.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:44.060+0000 7fb095d97640 1 --2- 172.21.15.154:0/710841802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0900ce140 0x7fb0901f6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:44.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:44.060+0000 7fb095d97640 1 --2- 172.21.15.154:0/710841802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0900716d0 0x7fb090152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:24:44.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:44.060+0000 7fb095d97640 1 -- 172.21.15.154:0/710841802 >> 172.21.15.154:0/710841802 conn(0x7fb0900ccef0 msgr2=0x7fb0900b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:24:44.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:44.060+0000 7fb095d97640 1 -- 172.21.15.154:0/710841802 shutdown_connections 2024-05-14T01:24:44.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:44.060+0000 7fb095d97640 1 -- 172.21.15.154:0/710841802 wait complete. 2024-05-14T01:24:44.063 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-14T01:24:44.064 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T01:24:44.064 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-05-14T01:24:44.064 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-14T01:24:44.064 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-14T01:24:44.064 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-14T01:24:44.064 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T01:24:44.064 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T01:24:44.064 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-14T01:24:44.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:44.064 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-05-14T01:24:44.070 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T01:24:44.070 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T01:24:44.071 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T01:24:44.071 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:24:44.071 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-05-14T01:24:44.071 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:24:44.071 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-14T01:24:44.071 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:24:44.071 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-05-14T01:24:44.071 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-14T01:24:44.071 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:24:44.071 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-05-14T01:24:44.071 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-14T01:24:44.071 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:24:44.071 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T01:24:44.071 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:24:44.071 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-14T01:24:44.071 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42418sec preferred_lft 42418sec 2024-05-14T01:24:44.072 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2024-05-14T01:24:44.072 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:24:44.072 INFO:teuthology.orchestra.run.smithi154.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-14T01:24:44.072 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 02:42:d7:5b:6a:85 brd ff:ff:ff:ff:ff:ff 2024-05-14T01:24:44.072 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-14T01:24:44.072 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:24:44.072 INFO:teuthology.orchestra.run.smithi154.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T01:24:44.072 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-14T01:24:44.072 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-14T01:24:44.072 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:24:44.072 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-14T01:24:44.072 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:24:44.072 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-14T01:24:44.072 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:24:44.072 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-14T01:24:44.073 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:24:44.073 INFO:teuthology.orchestra.run.smithi154.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-14T01:24:44.073 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T01:24:44.073 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-14T01:24:44.073 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-05-14T01:24:44.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:44.073 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T01:24:44.123 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-05-14T01:24:44.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:44.124 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-05-14T01:24:44.174 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-05-14T01:24:44.174 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T01:24:44.174 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-14T01:24:44.174 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-14T01:24:44.174 INFO:teuthology.orchestra.run.smithi154.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-14T01:24:44.174 INFO:teuthology.orchestra.run.smithi154.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-14T01:24:44.174 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-14T01:24:44.174 INFO:teuthology.orchestra.run.smithi154.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-14T01:24:44.174 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-14T01:24:44.174 INFO:teuthology.orchestra.run.smithi154.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-14T01:24:44.175 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T01:24:44.175 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T01:24:44.175 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-05-14T01:24:44.175 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-14T01:24:44.175 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-14T01:24:44.175 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-14T01:24:44.175 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-05-14T01:24:44.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T01:24:44.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:24:44.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:44.292 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-05-14T01:24:44.339 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-14T01:24:44.339 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-14T01:24:44.340 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-14T01:24:44.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:44.340 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-05-14T01:24:44.395 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-14T01:24:44.395 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T01:24:44.396 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-14T01:24:44.443 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-14T01:24:44.443 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T01:24:44.443 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-14T01:24:44.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2024-05-14T01:24:44.549 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T01:24:44.596 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2024-05-14T01:24:44.596 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2024-05-14T01:24:44.596 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2024-05-14T01:24:44.596 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2024-05-14T01:24:44.596 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2024-05-14T01:24:44.597 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2024-05-14T01:24:44.597 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2024-05-14T01:24:44.597 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2024-05-14T01:24:44.597 INFO:teuthology.orchestra.run.smithi154.stdout:/run/lock 2024-05-14T01:24:44.597 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2024-05-14T01:24:44.597 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2024-05-14T01:24:44.597 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2024-05-14T01:24:44.597 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T01:24:44.597 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2024-05-14T01:24:44.597 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2024-05-14T01:24:44.597 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2024-05-14T01:24:44.597 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2024-05-14T01:24:44.597 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/fs/nfsd 2024-05-14T01:24:44.597 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2024-05-14T01:24:44.597 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2024-05-14T01:24:44.598 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysusers.service 2024-05-14T01:24:44.598 INFO:teuthology.orchestra.run.smithi154.stdout:/run/rpc_pipefs 2024-05-14T01:24:44.598 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2024-05-14T01:24:44.598 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2024-05-14T01:24:44.598 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T01:24:44.598 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T01:24:44.598 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T01:24:44.598 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T01:24:44.598 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2024-05-14T01:24:44.598 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:24:44.598 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:24:44.598 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T01:24:44.599 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T01:24:44.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:44.600 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2024-05-14T01:24:44.652 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-14T01:24:44.652 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-14T01:24:44.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2024-05-14T01:24:44.710 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T01:24:44.759 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2024-05-14T01:24:44.759 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2024-05-14T01:24:44.759 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2024-05-14T01:24:44.759 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2024-05-14T01:24:44.759 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2024-05-14T01:24:44.760 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2024-05-14T01:24:44.760 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2024-05-14T01:24:44.760 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2024-05-14T01:24:44.760 INFO:teuthology.orchestra.run.smithi154.stdout:/run/lock 2024-05-14T01:24:44.760 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2024-05-14T01:24:44.760 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2024-05-14T01:24:44.760 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2024-05-14T01:24:44.760 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T01:24:44.760 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2024-05-14T01:24:44.760 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2024-05-14T01:24:44.760 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2024-05-14T01:24:44.760 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2024-05-14T01:24:44.760 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/fs/nfsd 2024-05-14T01:24:44.761 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2024-05-14T01:24:44.761 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2024-05-14T01:24:44.761 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysusers.service 2024-05-14T01:24:44.761 INFO:teuthology.orchestra.run.smithi154.stdout:/run/rpc_pipefs 2024-05-14T01:24:44.761 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2024-05-14T01:24:44.761 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2024-05-14T01:24:44.761 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T01:24:44.761 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T01:24:44.761 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T01:24:44.761 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T01:24:44.761 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2024-05-14T01:24:44.761 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:24:44.761 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:24:44.761 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T01:24:44.762 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T01:24:44.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:44.763 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2024-05-14T01:24:44.774 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi154.stderr:2024-05-14T01:24:44.784+0000 7f2eb65d7580 -1 init, newargv = 0x564f76781010 newargc=15 2024-05-14T01:24:44.774 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi154.stderr:ceph-fuse[38049]: starting ceph client 2024-05-14T01:24:44.779 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi154.stderr:ceph-fuse[38049]: starting fuse 2024-05-14T01:24:45.880 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2024-05-14T01:24:45.896 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T01:24:45.944 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2024-05-14T01:24:45.944 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2024-05-14T01:24:45.944 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2024-05-14T01:24:45.944 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2024-05-14T01:24:45.944 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2024-05-14T01:24:45.944 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2024-05-14T01:24:45.944 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2024-05-14T01:24:45.945 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2024-05-14T01:24:45.945 INFO:teuthology.orchestra.run.smithi154.stdout:/run/lock 2024-05-14T01:24:45.945 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2024-05-14T01:24:45.945 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2024-05-14T01:24:45.945 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2024-05-14T01:24:45.945 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T01:24:45.945 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2024-05-14T01:24:45.945 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2024-05-14T01:24:45.945 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2024-05-14T01:24:45.945 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2024-05-14T01:24:45.945 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/fs/nfsd 2024-05-14T01:24:45.945 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2024-05-14T01:24:45.945 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2024-05-14T01:24:45.945 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysusers.service 2024-05-14T01:24:45.946 INFO:teuthology.orchestra.run.smithi154.stdout:/run/rpc_pipefs 2024-05-14T01:24:45.946 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2024-05-14T01:24:45.946 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2024-05-14T01:24:45.946 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T01:24:45.946 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T01:24:45.946 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T01:24:45.946 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T01:24:45.946 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2024-05-14T01:24:45.946 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:24:45.946 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T01:24:45.946 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T01:24:45.946 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T01:24:45.946 INFO:teuthology.orchestra.run.smithi154.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-14T01:24:45.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:45.947 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2024-05-14T01:24:45.995 INFO:teuthology.orchestra.run.smithi154.stdout:45 2024-05-14T01:24:45.996 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-05-14T01:24:45.996 DEBUG:teuthology.orchestra.run.smithi154:> sudo stdin-killer -- python3 -c ' 2024-05-14T01:24:45.996 DEBUG:teuthology.orchestra.run.smithi154:> import glob 2024-05-14T01:24:45.996 DEBUG:teuthology.orchestra.run.smithi154:> import re 2024-05-14T01:24:45.996 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-05-14T01:24:45.996 DEBUG:teuthology.orchestra.run.smithi154:> import subprocess 2024-05-14T01:24:45.996 DEBUG:teuthology.orchestra.run.smithi154:> 2024-05-14T01:24:45.996 DEBUG:teuthology.orchestra.run.smithi154:> def _find_admin_socket(client_name): 2024-05-14T01:24:45.996 DEBUG:teuthology.orchestra.run.smithi154:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-14T01:24:45.996 DEBUG:teuthology.orchestra.run.smithi154:> files = glob.glob(asok_path) 2024-05-14T01:24:45.996 DEBUG:teuthology.orchestra.run.smithi154:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-14T01:24:45.996 DEBUG:teuthology.orchestra.run.smithi154:> 2024-05-14T01:24:45.996 DEBUG:teuthology.orchestra.run.smithi154:> # Given a non-glob path, it better be there 2024-05-14T01:24:45.996 DEBUG:teuthology.orchestra.run.smithi154:> if "*" not in asok_path: 2024-05-14T01:24:45.997 DEBUG:teuthology.orchestra.run.smithi154:> assert(len(files) == 1) 2024-05-14T01:24:45.997 DEBUG:teuthology.orchestra.run.smithi154:> return files[0] 2024-05-14T01:24:45.997 DEBUG:teuthology.orchestra.run.smithi154:> 2024-05-14T01:24:45.997 DEBUG:teuthology.orchestra.run.smithi154:> for f in files: 2024-05-14T01:24:45.997 DEBUG:teuthology.orchestra.run.smithi154:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-14T01:24:45.997 DEBUG:teuthology.orchestra.run.smithi154:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-14T01:24:45.997 DEBUG:teuthology.orchestra.run.smithi154:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-14T01:24:45.997 DEBUG:teuthology.orchestra.run.smithi154:> contents = proc_f.read() 2024-05-14T01:24:45.997 DEBUG:teuthology.orchestra.run.smithi154:> if mountpoint in contents: 2024-05-14T01:24:45.997 DEBUG:teuthology.orchestra.run.smithi154:> return f 2024-05-14T01:24:45.997 DEBUG:teuthology.orchestra.run.smithi154:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-14T01:24:45.997 DEBUG:teuthology.orchestra.run.smithi154:> 2024-05-14T01:24:45.997 DEBUG:teuthology.orchestra.run.smithi154:> print(_find_admin_socket("client.0")) 2024-05-14T01:24:45.997 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-05-14T01:24:46.120 INFO:teuthology.orchestra.run.smithi154.stdout:/var/run/ceph/ceph-client.0.38049.asok 2024-05-14T01:24:46.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:24:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T01:24:46.132 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.38049.asok 2024-05-14T01:24:46.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:46.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.38049.asok status 2024-05-14T01:24:46.291 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-14T01:24:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: "metadata": { 2024-05-14T01:24:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_sha1": "2ba596c3826798bb3a2f22bc9b02848b92dbe579", 2024-05-14T01:24:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 19.0.0-2569-g2ba596c3 (2ba596c3826798bb3a2f22bc9b02848b92dbe579) squid (dev)", 2024-05-14T01:24:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: "entity_id": "0", 2024-05-14T01:24:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: "hostname": "smithi154", 2024-05-14T01:24:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-14T01:24:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: "pid": "38049", 2024-05-14T01:24:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: "root": "/" 2024-05-14T01:24:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_count": 0, 2024-05-14T01:24:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_pinned_count": 0, 2024-05-14T01:24:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 5355, 2024-05-14T01:24:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "inst": { 2024-05-14T01:24:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "name": { 2024-05-14T01:24:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "client", 2024-05-14T01:24:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "num": 5355 2024-05-14T01:24:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2024-05-14T01:24:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2024-05-14T01:24:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.1:0", 2024-05-14T01:24:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 3658177252 2024-05-14T01:24:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-14T01:24:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2024-05-14T01:24:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2024-05-14T01:24:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.1:0", 2024-05-14T01:24:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 3658177252 2024-05-14T01:24:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-14T01:24:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: "inst_str": "client.5355 192.168.0.1:0/3658177252", 2024-05-14T01:24:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: "addr_str": "192.168.0.1:0/3658177252", 2024-05-14T01:24:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: "inode_count": 1, 2024-05-14T01:24:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_epoch": 17, 2024-05-14T01:24:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch": 34, 2024-05-14T01:24:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch_barrier": 0, 2024-05-14T01:24:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: "blocklisted": false, 2024-05-14T01:24:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs" 2024-05-14T01:24:46.293 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-14T01:24:46.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:46.305 DEBUG:teuthology.orchestra.run.smithi154:> stat --file-system '--printf=%T 2024-05-14T01:24:46.305 DEBUG:teuthology.orchestra.run.smithi154:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-14T01:24:46.311 INFO:teuthology.orchestra.run.smithi154.stdout:fuseblk 2024-05-14T01:24:46.311 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-14T01:24:46.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:46.311 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-14T01:24:46.365 DEBUG:teuthology.orchestra.run.smithi154:> mktemp -d --suffix=xfstests-dev 2024-05-14T01:24:46.411 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.E8tkN6FrZCxfstests-dev 2024-05-14T01:24:46.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:46.411 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.E8tkN6FrZCxfstests-dev) 2024-05-14T01:24:46.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:46.470 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.E8tkN6FrZCxfstests-dev) 2024-05-14T01:24:46.526 INFO:teuthology.orchestra.run.smithi154.stderr:Cloning into '/tmp/tmp.E8tkN6FrZCxfstests-dev'... 2024-05-14T01:24:47.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:47.324 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-05-14T01:24:47.377 DEBUG:teuthology.orchestra.run.smithi154:> mktemp -d --suffix=test 2024-05-14T01:24:47.424 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.v73wnydYBctest 2024-05-14T01:24:47.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:24:47.424 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-05-14T01:24:47.476 DEBUG:teuthology.orchestra.run.smithi154:> mktemp -d --suffix=scratch 2024-05-14T01:24:47.523 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.XeZpfah5PBscratch 2024-05-14T01:24:47.523 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2024-05-14T01:24:47.524 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc git indent libacl1-dev libaio-dev libcap-dev libgdbm-dev libtool libtool-bin liburing-dev libuuid1 lvm2 make psmisc python3 quota sed uuid-dev uuid-runtime xfsprogs sqlite3 exfatprogs f2fs-tools ocfs2-tools udftools xfsdump xfslibs-dev 2024-05-14T01:24:47.634 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-05-14T01:24:47.842 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-05-14T01:24:47.843 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-05-14T01:24:48.040 INFO:teuthology.orchestra.run.smithi154.stdout:acl is already the newest version (2.3.1-1). 2024-05-14T01:24:48.041 INFO:teuthology.orchestra.run.smithi154.stdout:acl set to manually installed. 2024-05-14T01:24:48.041 INFO:teuthology.orchestra.run.smithi154.stdout:attr is already the newest version (1:2.5.1-1build1). 2024-05-14T01:24:48.041 INFO:teuthology.orchestra.run.smithi154.stdout:automake is already the newest version (1:1.16.5-1.3). 2024-05-14T01:24:48.041 INFO:teuthology.orchestra.run.smithi154.stdout:bc is already the newest version (1.07.1-3build1). 2024-05-14T01:24:48.041 INFO:teuthology.orchestra.run.smithi154.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2024-05-14T01:24:48.041 INFO:teuthology.orchestra.run.smithi154.stdout:gcc set to manually installed. 2024-05-14T01:24:48.041 INFO:teuthology.orchestra.run.smithi154.stdout:libacl1-dev is already the newest version (2.3.1-1). 2024-05-14T01:24:48.041 INFO:teuthology.orchestra.run.smithi154.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2024-05-14T01:24:48.041 INFO:teuthology.orchestra.run.smithi154.stdout:libtool is already the newest version (2.4.6-15build2). 2024-05-14T01:24:48.041 INFO:teuthology.orchestra.run.smithi154.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-14T01:24:48.041 INFO:teuthology.orchestra.run.smithi154.stdout:lvm2 is already the newest version (2.03.11-2.1ubuntu4). 2024-05-14T01:24:48.041 INFO:teuthology.orchestra.run.smithi154.stdout:make is already the newest version (4.3-4.1build1). 2024-05-14T01:24:48.041 INFO:teuthology.orchestra.run.smithi154.stdout:make set to manually installed. 2024-05-14T01:24:48.041 INFO:teuthology.orchestra.run.smithi154.stdout:psmisc is already the newest version (23.4-2build3). 2024-05-14T01:24:48.042 INFO:teuthology.orchestra.run.smithi154.stdout:quota is already the newest version (4.06-1build2). 2024-05-14T01:24:48.042 INFO:teuthology.orchestra.run.smithi154.stdout:sed is already the newest version (4.8-1ubuntu2). 2024-05-14T01:24:48.042 INFO:teuthology.orchestra.run.smithi154.stdout:xfsdump is already the newest version (3.1.9+0+nmu2). 2024-05-14T01:24:48.042 INFO:teuthology.orchestra.run.smithi154.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-14T01:24:48.042 INFO:teuthology.orchestra.run.smithi154.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2024-05-14T01:24:48.042 INFO:teuthology.orchestra.run.smithi154.stdout:dbench is already the newest version (4.0-2build1). 2024-05-14T01:24:48.042 INFO:teuthology.orchestra.run.smithi154.stdout:dump is already the newest version (0.4b47-3). 2024-05-14T01:24:48.042 INFO:teuthology.orchestra.run.smithi154.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2024-05-14T01:24:48.042 INFO:teuthology.orchestra.run.smithi154.stdout:git is already the newest version (1:2.34.1-1ubuntu1.10). 2024-05-14T01:24:48.042 INFO:teuthology.orchestra.run.smithi154.stdout:indent is already the newest version (2.2.12-1ubuntu0.22.04.1). 2024-05-14T01:24:48.043 INFO:teuthology.orchestra.run.smithi154.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3.4). 2024-05-14T01:24:48.043 INFO:teuthology.orchestra.run.smithi154.stdout:python3 is already the newest version (3.10.6-1~22.04). 2024-05-14T01:24:48.043 INFO:teuthology.orchestra.run.smithi154.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3.4). 2024-05-14T01:24:48.043 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-05-14T01:24:48.043 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2024-05-14T01:24:48.043 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2-dev libpython2-stdlib libpython2.7 libpython2.7-dev 2024-05-14T01:24:48.043 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7-minimal libpython2.7-stdlib linux-image-5.4.0-135-generic 2024-05-14T01:24:48.044 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-5.4.0-135-generic python2 python2-dev python2-minimal 2024-05-14T01:24:48.044 INFO:teuthology.orchestra.run.smithi154.stdout: python2.7 python2.7-dev python2.7-minimal 2024-05-14T01:24:48.044 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-14T01:24:48.044 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-05-14T01:24:48.044 INFO:teuthology.orchestra.run.smithi154.stdout: libcap2 libcmap4 libcorosync-common4 libdlm3 libpmemblk1 libqb100 2024-05-14T01:24:48.044 INFO:teuthology.orchestra.run.smithi154.stdout: libsqlite3-0 2024-05-14T01:24:48.044 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-05-14T01:24:48.045 INFO:teuthology.orchestra.run.smithi154.stdout: gnuplot gfio python-scipy gawk-doc sqlite3-doc dvd+rw-tools udfclient 2024-05-14T01:24:48.078 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-05-14T01:24:48.079 INFO:teuthology.orchestra.run.smithi154.stdout: exfatprogs f2fs-tools fio libcap-dev libcmap4 libcorosync-common4 libdlm3 2024-05-14T01:24:48.080 INFO:teuthology.orchestra.run.smithi154.stdout: libgdbm-dev libpmemblk1 libqb100 liburing-dev ocfs2-tools sqlite3 udftools 2024-05-14T01:24:48.080 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages will be upgraded: 2024-05-14T01:24:48.082 INFO:teuthology.orchestra.run.smithi154.stdout: gawk libcap2 libsqlite3-0 uuid-runtime 2024-05-14T01:24:48.262 INFO:teuthology.orchestra.run.smithi154.stdout:4 upgraded, 14 newly installed, 0 to remove and 299 not upgraded. 2024-05-14T01:24:48.263 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 7,314 kB of archives. 2024-05-14T01:24:48.263 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 14.2 MB of additional disk space will be used. 2024-05-14T01:24:48.263 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-runtime amd64 2.37.2-4ubuntu3.4 [32.0 kB] 2024-05-14T01:24:48.457 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gawk amd64 1:5.1.0-1ubuntu0.1 [447 kB] 2024-05-14T01:24:48.783 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcorosync-common4 amd64 3.1.6-1ubuntu1 [7,322 B] 2024-05-14T01:24:48.784 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqb100 amd64 2.0.4-1ubuntu0.2 [74.2 kB] 2024-05-14T01:24:48.801 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcmap4 amd64 3.1.6-1ubuntu1 [10.4 kB] 2024-05-14T01:24:48.802 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libdlm3 amd64 4.1.1-1build1 [14.4 kB] 2024-05-14T01:24:48.806 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 ocfs2-tools amd64 1.8.7-1build1 [646 kB] 2024-05-14T01:24:48.896 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap2 amd64 1:2.44-1ubuntu0.22.04.1 [18.3 kB] 2024-05-14T01:24:48.897 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsqlite3-0 amd64 3.37.2-2ubuntu0.3 [641 kB] 2024-05-14T01:24:48.948 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 exfatprogs amd64 1.1.3-1 [40.3 kB] 2024-05-14T01:24:48.950 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 f2fs-tools amd64 1.14.0-2build1 [169 kB] 2024-05-14T01:24:49.124 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2024-05-14T01:24:49.418 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2024-05-14T01:24:49.924 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap-dev amd64 1:2.44-1ubuntu0.22.04.1 [39.4 kB] 2024-05-14T01:24:49.925 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2024-05-14T01:24:49.928 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liburing-dev amd64 2.1-2build1 [51.8 kB] 2024-05-14T01:24:49.929 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.3 [768 kB] 2024-05-14T01:24:49.949 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 udftools amd64 2.3-1 [125 kB] 2024-05-14T01:24:50.256 INFO:teuthology.orchestra.run.smithi154.stderr:debconf: unable to initialize frontend: Dialog 2024-05-14T01:24:50.256 INFO:teuthology.orchestra.run.smithi154.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-05-14T01:24:50.256 INFO:teuthology.orchestra.run.smithi154.stderr:debconf: falling back to frontend: Readline 2024-05-14T01:24:50.268 INFO:teuthology.orchestra.run.smithi154.stderr:debconf: unable to initialize frontend: Readline 2024-05-14T01:24:50.268 INFO:teuthology.orchestra.run.smithi154.stderr:debconf: (This frontend requires a controlling tty.) 2024-05-14T01:24:50.268 INFO:teuthology.orchestra.run.smithi154.stderr:debconf: falling back to frontend: Teletype 2024-05-14T01:24:50.272 INFO:teuthology.orchestra.run.smithi154.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-05-14T01:24:50.306 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 7,314 kB in 2s (3,924 kB/s) 2024-05-14T01:24:50.604 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176781 files and directories currently installed.) 2024-05-14T01:24:50.609 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../0-uuid-runtime_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-14T01:24:50.725 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking uuid-runtime (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-14T01:24:51.177 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../1-gawk_1%3a5.1.0-1ubuntu0.1_amd64.deb ... 2024-05-14T01:24:51.324 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking gawk (1:5.1.0-1ubuntu0.1) over (1:5.1.0-1build3) ... 2024-05-14T01:24:51.818 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcorosync-common4:amd64. 2024-05-14T01:24:51.848 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../2-libcorosync-common4_3.1.6-1ubuntu1_amd64.deb ... 2024-05-14T01:24:51.910 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2024-05-14T01:24:52.230 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqb100:amd64. 2024-05-14T01:24:52.259 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../3-libqb100_2.0.4-1ubuntu0.2_amd64.deb ... 2024-05-14T01:24:52.305 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2024-05-14T01:24:52.642 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcmap4:amd64. 2024-05-14T01:24:52.671 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../4-libcmap4_3.1.6-1ubuntu1_amd64.deb ... 2024-05-14T01:24:52.708 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcmap4:amd64 (3.1.6-1ubuntu1) ... 2024-05-14T01:24:53.029 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libdlm3:amd64. 2024-05-14T01:24:53.057 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../5-libdlm3_4.1.1-1build1_amd64.deb ... 2024-05-14T01:24:53.095 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libdlm3:amd64 (4.1.1-1build1) ... 2024-05-14T01:24:53.574 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ocfs2-tools. 2024-05-14T01:24:53.603 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../6-ocfs2-tools_1.8.7-1build1_amd64.deb ... 2024-05-14T01:24:53.649 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ocfs2-tools (1.8.7-1build1) ... 2024-05-14T01:24:54.083 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../7-libcap2_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2024-05-14T01:24:54.188 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) over (1:2.44-1build3) ... 2024-05-14T01:24:54.534 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2024-05-14T01:24:54.995 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176855 files and directories currently installed.) 2024-05-14T01:24:55.000 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../0-libsqlite3-0_3.37.2-2ubuntu0.3_amd64.deb ... 2024-05-14T01:24:55.130 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) over (3.37.2-2ubuntu0.1) ... 2024-05-14T01:24:55.476 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package exfatprogs. 2024-05-14T01:24:55.493 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../1-exfatprogs_1.1.3-1_amd64.deb ... 2024-05-14T01:24:55.534 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking exfatprogs (1.1.3-1) ... 2024-05-14T01:24:55.796 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package f2fs-tools. 2024-05-14T01:24:55.825 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../2-f2fs-tools_1.14.0-2build1_amd64.deb ... 2024-05-14T01:24:55.905 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking f2fs-tools (1.14.0-2build1) ... 2024-05-14T01:24:56.234 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libpmemblk1:amd64. 2024-05-14T01:24:56.262 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../3-libpmemblk1_1.11.1-3build1_amd64.deb ... 2024-05-14T01:24:56.300 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2024-05-14T01:24:56.620 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package fio. 2024-05-14T01:24:56.649 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../4-fio_3.28-1_amd64.deb ... 2024-05-14T01:24:56.687 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking fio (3.28-1) ... 2024-05-14T01:24:57.166 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcap-dev:amd64. 2024-05-14T01:24:57.195 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../5-libcap-dev_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2024-05-14T01:24:57.241 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2024-05-14T01:24:57.513 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2024-05-14T01:24:57.541 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../6-libgdbm-dev_1.23-1_amd64.deb ... 2024-05-14T01:24:57.580 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2024-05-14T01:24:57.892 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liburing-dev:amd64. 2024-05-14T01:24:57.920 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../7-liburing-dev_2.1-2build1_amd64.deb ... 2024-05-14T01:24:57.958 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liburing-dev:amd64 (2.1-2build1) ... 2024-05-14T01:24:58.220 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package sqlite3. 2024-05-14T01:24:58.237 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../8-sqlite3_3.37.2-2ubuntu0.3_amd64.deb ... 2024-05-14T01:24:58.278 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.3) ... 2024-05-14T01:24:58.649 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package udftools. 2024-05-14T01:24:58.677 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../9-udftools_2.3-1_amd64.deb ... 2024-05-14T01:24:58.726 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking udftools (2.3-1) ... 2024-05-14T01:24:59.031 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up exfatprogs (1.1.3-1) ... 2024-05-14T01:24:59.129 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up gawk (1:5.1.0-1ubuntu0.1) ... 2024-05-14T01:24:59.365 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up f2fs-tools (1.14.0-2build1) ... 2024-05-14T01:24:59.491 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) ... 2024-05-14T01:24:59.617 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2024-05-14T01:24:59.743 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2024-05-14T01:24:59.869 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2024-05-14T01:24:59.995 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up uuid-runtime (2.37.2-4ubuntu3.4) ... 2024-05-14T01:25:00.872 INFO:teuthology.orchestra.run.smithi154.stdout:uuidd.service is a disabled or a static unit not running, not starting it. 2024-05-14T01:25:00.922 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up udftools (2.3-1) ... 2024-05-14T01:25:01.274 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libdlm3:amd64 (4.1.1-1build1) ... 2024-05-14T01:25:01.400 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2024-05-14T01:25:01.526 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2024-05-14T01:25:01.635 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.3) ... 2024-05-14T01:25:01.745 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liburing-dev:amd64 (2.1-2build1) ... 2024-05-14T01:25:01.863 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcmap4:amd64 (3.1.6-1ubuntu1) ... 2024-05-14T01:25:01.989 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up fio (3.28-1) ... 2024-05-14T01:25:02.465 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ocfs2-tools (1.8.7-1build1) ... 2024-05-14T01:25:02.732 INFO:teuthology.orchestra.run.smithi154.stdout:debconf: unable to initialize frontend: Dialog 2024-05-14T01:25:02.732 INFO:teuthology.orchestra.run.smithi154.stdout:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-05-14T01:25:02.732 INFO:teuthology.orchestra.run.smithi154.stdout:debconf: falling back to frontend: Readline 2024-05-14T01:25:03.461 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for initramfs-tools (0.140ubuntu13.1) ... 2024-05-14T01:25:03.564 INFO:teuthology.orchestra.run.smithi154.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-107-generic 2024-05-14T01:25:04.067 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:25:04.069 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:25:21.711 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-14T01:25:21.845 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-14T01:25:23.256 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-14T01:25:23.764 DEBUG:teuthology.orchestra.run.smithi154:> sudo useradd -m fsgqa 2024-05-14T01:25:23.773 INFO:teuthology.orchestra.run.smithi154.stderr:useradd: user 'fsgqa' already exists 2024-05-14T01:25:23.773 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-05-14T01:25:23.774 DEBUG:teuthology.orchestra.run.smithi154:> sudo groupadd fsgqa 2024-05-14T01:25:23.824 INFO:teuthology.orchestra.run.smithi154.stderr:groupadd: group 'fsgqa' already exists 2024-05-14T01:25:23.825 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-05-14T01:25:23.825 DEBUG:teuthology.orchestra.run.smithi154:> sudo useradd fsgqa2 2024-05-14T01:25:24.242 DEBUG:teuthology.orchestra.run.smithi154:> sudo useradd 123456-fsgqa 2024-05-14T01:25:24.646 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-05-14T01:25:24.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.783+0000 7f65b7d46640 1 Processor -- start 2024-05-14T01:25:24.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.783+0000 7f65b7d46640 1 -- start start 2024-05-14T01:25:24.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b7d46640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65b0144760 0x7f65b006e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:25:24.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b7d46640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b0144b40 con 0x7f65b00b3530 2024-05-14T01:25:24.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b7d46640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b00b3a40 con 0x7f65b015bae0 2024-05-14T01:25:24.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b7d46640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f65b00b4650 con 0x7f65b0144760 2024-05-14T01:25:24.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b52e1640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f65b00b3530 0x7f65b015b3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41374/0 (socket says 172.21.15.154:41374) 2024-05-14T01:25:24.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b52e1640 1 -- 172.21.15.154:0/2739302199 learned_addr learned my addr 172.21.15.154:0/2739302199 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T01:25:24.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b5ae2640 1 --2- 172.21.15.154:0/2739302199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65b0144760 0x7f65b006e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:25:24.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b4ae0640 1 -- 172.21.15.154:0/2739302199 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2071586551 0 0) 0x7f65b0144b40 con 0x7f65b00b3530 2024-05-14T01:25:24.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b4ae0640 1 -- 172.21.15.154:0/2739302199 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f659c005740 con 0x7f65b00b3530 2024-05-14T01:25:24.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b4ae0640 1 -- 172.21.15.154:0/2739302199 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1364591869 0 0) 0x7f659c005740 con 0x7f65b00b3530 2024-05-14T01:25:24.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b4ae0640 1 -- 172.21.15.154:0/2739302199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65b0144760 msgr2=0x7f65b006e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:25:24.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b4ae0640 1 --2- 172.21.15.154:0/2739302199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65b0144760 0x7f65b006e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:25:24.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b4ae0640 1 -- 172.21.15.154:0/2739302199 >> v1:172.21.15.176:6789/0 conn(0x7f65b015bae0 legacy=0x7f65b015c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:25:24.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b4ae0640 1 -- 172.21.15.154:0/2739302199 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b00b3d20 con 0x7f65b00b3530 2024-05-14T01:25:24.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b4ae0640 1 -- 172.21.15.154:0/2739302199 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f65a0001680 con 0x7f65b00b3530 2024-05-14T01:25:24.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b4ae0640 1 -- 172.21.15.154:0/2739302199 >> v1:172.21.15.154:6789/0 conn(0x7f65b00b3530 legacy=0x7f65b015b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:25:24.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b4ae0640 1 --2- 172.21.15.154:0/2739302199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f659c005c00 0x7f659c006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:25:24.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b4ae0640 1 --2- 172.21.15.154:0/2739302199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65b0144760 0x7f659c006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:25:24.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b4ae0640 1 --2- 172.21.15.154:0/2739302199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f659c006f60 0x7f659c0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:25:24.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b4ae0640 1 -- 172.21.15.154:0/2739302199 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65b00b4650 con 0x7f659c006f60 2024-05-14T01:25:24.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b4ae0640 1 -- 172.21.15.154:0/2739302199 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f659c00dc90 con 0x7f659c005c00 2024-05-14T01:25:24.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b4ae0640 1 -- 172.21.15.154:0/2739302199 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f659c00de90 con 0x7f65b0144760 2024-05-14T01:25:24.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b62e3640 1 --2- 172.21.15.154:0/2739302199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f659c006f60 0x7f659c0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:25:24.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b52e1640 1 --2- 172.21.15.154:0/2739302199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65b0144760 0x7f659c006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:25:24.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b5ae2640 1 --2- 172.21.15.154:0/2739302199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f659c005c00 0x7f659c006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:25:24.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b62e3640 1 -- 172.21.15.154:0/2739302199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65b0144760 msgr2=0x7f659c006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:25:24.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b62e3640 1 --2- 172.21.15.154:0/2739302199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65b0144760 0x7f659c006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:25:24.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b62e3640 1 -- 172.21.15.154:0/2739302199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f659c005c00 msgr2=0x7f659c006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:25:24.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b62e3640 1 --2- 172.21.15.154:0/2739302199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f659c005c00 0x7f659c006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:25:24.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b62e3640 1 -- 172.21.15.154:0/2739302199 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f659c005740 con 0x7f659c006f60 2024-05-14T01:25:24.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.787+0000 7f65b5ae2640 1 --2- 172.21.15.154:0/2739302199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f659c005c00 0x7f659c006020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:25:24.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b62e3640 1 --2- 172.21.15.154:0/2739302199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f659c006f60 0x7f659c0073e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f65a8001e40 tx=0x7f65a801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6228d6084555a33e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:25:24.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b4ae0640 1 -- 172.21.15.154:0/2739302199 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8001a90 con 0x7f659c006f60 2024-05-14T01:25:24.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b4ae0640 1 -- 172.21.15.154:0/2739302199 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a8003b80 con 0x7f659c006f60 2024-05-14T01:25:24.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b4ae0640 1 -- 172.21.15.154:0/2739302199 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8005080 con 0x7f659c006f60 2024-05-14T01:25:24.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b7d46640 1 -- 172.21.15.154:0/2739302199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f659c006f60 msgr2=0x7f659c0073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:25:24.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b7d46640 1 --2- 172.21.15.154:0/2739302199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f659c006f60 0x7f659c0073e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f65a8001e40 tx=0x7f65a801c760 comp rx=0 tx=0).stop 2024-05-14T01:25:24.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b62e3640 1 -- 172.21.15.154:0/2739302199 reap_dead start 2024-05-14T01:25:24.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b7d46640 1 -- 172.21.15.154:0/2739302199 shutdown_connections 2024-05-14T01:25:24.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b7d46640 1 -- 172.21.15.154:0/2739302199 >> 172.21.15.154:0/2739302199 conn(0x7f65b00b1850 msgr2=0x7f65b00b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:25:24.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b7d46640 1 -- 172.21.15.154:0/2739302199 shutdown_connections 2024-05-14T01:25:24.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b7d46640 1 -- 172.21.15.154:0/2739302199 wait complete. 2024-05-14T01:25:24.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b7d46640 1 Processor -- start 2024-05-14T01:25:24.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b7d46640 1 -- start start 2024-05-14T01:25:24.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b7d46640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f659c006f60 0x7f65b013e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:25:24.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b7d46640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65b013f880 0x7f65b0136cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:25:24.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b7d46640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65b0142a50 0x7f65b0142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:25:24.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b7d46640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65b006e680 con 0x7f65b013f880 2024-05-14T01:25:24.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b7d46640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f65b00b42e0 con 0x7f65b0142a50 2024-05-14T01:25:24.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b7d46640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f65b006e800 con 0x7f659c006f60 2024-05-14T01:25:24.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b52e1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65b013f880 0x7f65b0136cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:25:24.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b52e1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65b013f880 0x7f65b0136cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44532/0 (socket says 172.21.15.154:44532) 2024-05-14T01:25:24.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b52e1640 1 -- 172.21.15.154:0/855003575 learned_addr learned my addr 172.21.15.154:0/855003575 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:25:24.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.791+0000 7f65b5ae2640 1 --2- 172.21.15.154:0/855003575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f659c006f60 0x7f65b013e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:25:24.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65b62e3640 1 --2- 172.21.15.154:0/855003575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65b0142a50 0x7f65b0142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:25:24.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65b52e1640 1 -- 172.21.15.154:0/855003575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f659c006f60 msgr2=0x7f65b013e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:25:24.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65b52e1640 1 --2- 172.21.15.154:0/855003575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f659c006f60 0x7f65b013e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:25:24.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65b52e1640 1 -- 172.21.15.154:0/855003575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65b0142a50 msgr2=0x7f65b0142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:25:24.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65b52e1640 1 --2- 172.21.15.154:0/855003575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65b0142a50 0x7f65b0142ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:25:24.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65b52e1640 1 -- 172.21.15.154:0/855003575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b01f85c0 con 0x7f65b013f880 2024-05-14T01:25:24.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65b5ae2640 1 --2- 172.21.15.154:0/855003575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f659c006f60 0x7f65b013e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:25:24.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65b52e1640 1 --2- 172.21.15.154:0/855003575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65b013f880 0x7f65b0136cf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f65a00072f0 tx=0x7f65a00077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:25:24.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65a67fc640 1 -- 172.21.15.154:0/855003575 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a001a070 con 0x7f65b013f880 2024-05-14T01:25:24.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65a67fc640 1 -- 172.21.15.154:0/855003575 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a000f9c0 con 0x7f65b013f880 2024-05-14T01:25:24.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65b7d46640 1 -- 172.21.15.154:0/855003575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b00cee30 con 0x7f65b013f880 2024-05-14T01:25:24.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65a67fc640 1 -- 172.21.15.154:0/855003575 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a000fdb0 con 0x7f65b013f880 2024-05-14T01:25:24.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65b7d46640 1 -- 172.21.15.154:0/855003575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b013fce0 con 0x7f65b013f880 2024-05-14T01:25:24.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65b7d46640 1 -- 172.21.15.154:0/855003575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65b0075470 con 0x7f65b013f880 2024-05-14T01:25:24.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65a67fc640 1 -- 172.21.15.154:0/855003575 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f65a001d070 con 0x7f65b013f880 2024-05-14T01:25:24.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65a67fc640 1 --2- 172.21.15.154:0/855003575 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f65940678c0 0x7f6594069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:25:24.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65a67fc640 1 -- 172.21.15.154:0/855003575 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f65a0085660 con 0x7f65b013f880 2024-05-14T01:25:24.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65b5ae2640 1 --2- 172.21.15.154:0/855003575 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f65940678c0 0x7f6594069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:25:24.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.795+0000 7f65b5ae2640 1 --2- 172.21.15.154:0/855003575 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f65940678c0 0x7f6594069d80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009af0 tx=0x7f65ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:25:24.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:24.799+0000 7f65a67fc640 1 -- 172.21.15.154:0/855003575 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f65a00561a0 con 0x7f65b013f880 2024-05-14T01:25:25.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.019+0000 7f65b7d46640 1 -- 172.21.15.154:0/855003575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f65b006d250 con 0x7f65b013f880 2024-05-14T01:25:25.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.019+0000 7f65a67fc640 1 -- 172.21.15.154:0/855003575 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1289 (secure 0 0 0) 0x7f65a0055aa0 con 0x7f65b013f880 2024-05-14T01:25:25.011 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:25:25.011 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","modified":"2024-05-14T01:22:35.540307Z","created":"2024-05-14T01:22:35.540307Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:3300","nonce":0},{"type":"v1","addr":"172.21.15.176:6789","nonce":0}]},"addr":"172.21.15.176:6789/0","public_addr":"172.21.15.176:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:3301","nonce":0},{"type":"v1","addr":"172.21.15.176:6790","nonce":0}]},"addr":"172.21.15.176:6790/0","public_addr":"172.21.15.176:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-14T01:25:25.011 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-14T01:25:25.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.023+0000 7f65b7d46640 1 -- 172.21.15.154:0/855003575 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f65940678c0 msgr2=0x7f6594069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:25:25.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.023+0000 7f65b7d46640 1 --2- 172.21.15.154:0/855003575 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f65940678c0 0x7f6594069d80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009af0 tx=0x7f65ac008040 comp rx=0 tx=0).stop 2024-05-14T01:25:25.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.023+0000 7f65b7d46640 1 -- 172.21.15.154:0/855003575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65b013f880 msgr2=0x7f65b0136cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:25:25.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.023+0000 7f65b7d46640 1 --2- 172.21.15.154:0/855003575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65b013f880 0x7f65b0136cf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f65a00072f0 tx=0x7f65a00077b0 comp rx=0 tx=0).stop 2024-05-14T01:25:25.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.023+0000 7f65b7d46640 1 -- 172.21.15.154:0/855003575 shutdown_connections 2024-05-14T01:25:25.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.023+0000 7f65b7d46640 1 --2- 172.21.15.154:0/855003575 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f65940678c0 0x7f6594069d80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:25:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.023+0000 7f65b7d46640 1 --2- 172.21.15.154:0/855003575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65b0142a50 0x7f65b0142ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:25:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.023+0000 7f65b7d46640 1 --2- 172.21.15.154:0/855003575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65b013f880 0x7f65b0136cf0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:25:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.023+0000 7f65b7d46640 1 --2- 172.21.15.154:0/855003575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f659c006f60 0x7f65b013e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:25:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.023+0000 7f65b7d46640 1 -- 172.21.15.154:0/855003575 >> 172.21.15.154:0/855003575 conn(0x7f65b00b1850 msgr2=0x7f65b015c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:25:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.023+0000 7f65b7d46640 1 -- 172.21.15.154:0/855003575 shutdown_connections 2024-05-14T01:25:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.023+0000 7f65b7d46640 1 -- 172.21.15.154:0/855003575 wait complete. 2024-05-14T01:25:25.030 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2024-05-14T01:25:25.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.163+0000 7ff82f8b2640 1 Processor -- start 2024-05-14T01:25:25.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.163+0000 7ff82f8b2640 1 -- start start 2024-05-14T01:25:25.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.163+0000 7ff82f8b2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff828144760 0x7ff82806e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:25:25.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.163+0000 7ff82f8b2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff82815bae0 0x7ff82815c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:25:25.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.163+0000 7ff82f8b2640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff828144b40 con 0x7ff8280b3530 2024-05-14T01:25:25.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.163+0000 7ff82f8b2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff8280b4650 con 0x7ff82815bae0 2024-05-14T01:25:25.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.163+0000 7ff82f8b2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff8280b3a40 con 0x7ff828144760 2024-05-14T01:25:25.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.163+0000 7ff82de4f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff82815bae0 0x7ff82815c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:25:25.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.163+0000 7ff82de4f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff82815bae0 0x7ff82815c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44536/0 (socket says 172.21.15.154:44536) 2024-05-14T01:25:25.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.163+0000 7ff82de4f640 1 -- 172.21.15.154:0/2492160764 learned_addr learned my addr 172.21.15.154:0/2492160764 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:25:25.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.163+0000 7ff82d64e640 1 --2- 172.21.15.154:0/2492160764 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff828144760 0x7ff82806e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:25:25.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.163+0000 7ff82de4f640 1 -- 172.21.15.154:0/2492160764 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff828144760 msgr2=0x7ff82806e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T01:25:25.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.163+0000 7ff82de4f640 1 --2- 172.21.15.154:0/2492160764 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff828144760 0x7ff82806e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:25:25.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.163+0000 7ff82de4f640 1 -- 172.21.15.154:0/2492160764 >> v1:172.21.15.176:6789/0 conn(0x7ff8280b3530 legacy=0x7ff82815b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:25:25.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.163+0000 7ff82de4f640 1 -- 172.21.15.154:0/2492160764 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8280b3d20 con 0x7ff82815bae0 2024-05-14T01:25:25.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.167+0000 7ff82de4f640 1 --2- 172.21.15.154:0/2492160764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff82815bae0 0x7ff82815c5e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff82000d150 tx=0x7ff82001ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a8046cd4d7d1ee server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:25:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.167+0000 7ff81ffff640 1 -- 172.21.15.154:0/2492160764 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8200a7cf0 con 0x7ff82815bae0 2024-05-14T01:25:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.167+0000 7ff81ffff640 1 -- 172.21.15.154:0/2492160764 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff82000b0d0 con 0x7ff82815bae0 2024-05-14T01:25:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.167+0000 7ff81ffff640 1 -- 172.21.15.154:0/2492160764 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff820009600 con 0x7ff82815bae0 2024-05-14T01:25:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.167+0000 7ff82f8b2640 1 -- 172.21.15.154:0/2492160764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff82815bae0 msgr2=0x7ff82815c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:25:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.167+0000 7ff82f8b2640 1 --2- 172.21.15.154:0/2492160764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff82815bae0 0x7ff82815c5e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff82000d150 tx=0x7ff82001ec00 comp rx=0 tx=0).stop 2024-05-14T01:25:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.167+0000 7ff82f8b2640 1 -- 172.21.15.154:0/2492160764 shutdown_connections 2024-05-14T01:25:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.167+0000 7ff82f8b2640 1 --2- 172.21.15.154:0/2492160764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff82815bae0 0x7ff82815c5e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:25:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.167+0000 7ff82f8b2640 1 --2- 172.21.15.154:0/2492160764 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff828144760 0x7ff82806e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:25:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.167+0000 7ff82f8b2640 1 -- 172.21.15.154:0/2492160764 >> 172.21.15.154:0/2492160764 conn(0x7ff8280b1850 msgr2=0x7ff8280b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:25:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.167+0000 7ff82f8b2640 1 -- 172.21.15.154:0/2492160764 shutdown_connections 2024-05-14T01:25:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.167+0000 7ff82f8b2640 1 -- 172.21.15.154:0/2492160764 wait complete. 2024-05-14T01:25:25.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.167+0000 7ff82f8b2640 1 Processor -- start 2024-05-14T01:25:25.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.167+0000 7ff82f8b2640 1 -- start start 2024-05-14T01:25:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82f8b2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8280b3530 0x7ff8280cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:25:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82f8b2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff828144760 0x7ff82813ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:25:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82f8b2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff82815bae0 0x7ff8281413b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:25:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82f8b2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff82815d4b0 con 0x7ff828144760 2024-05-14T01:25:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82f8b2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff82815d330 con 0x7ff82815bae0 2024-05-14T01:25:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82f8b2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff82815d630 con 0x7ff8280b3530 2024-05-14T01:25:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82ce4d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff828144760 0x7ff82813ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:25:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82ce4d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff828144760 0x7ff82813ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44538/0 (socket says 172.21.15.154:44538) 2024-05-14T01:25:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82ce4d640 1 -- 172.21.15.154:0/3672111865 learned_addr learned my addr 172.21.15.154:0/3672111865 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T01:25:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82de4f640 1 --2- 172.21.15.154:0/3672111865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff82815bae0 0x7ff8281413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:25:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82d64e640 1 --2- 172.21.15.154:0/3672111865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8280b3530 0x7ff8280cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:25:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82ce4d640 1 -- 172.21.15.154:0/3672111865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8280b3530 msgr2=0x7ff8280cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:25:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82ce4d640 1 --2- 172.21.15.154:0/3672111865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8280b3530 0x7ff8280cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:25:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82ce4d640 1 -- 172.21.15.154:0/3672111865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff82815bae0 msgr2=0x7ff8281413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:25:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82ce4d640 1 --2- 172.21.15.154:0/3672111865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff82815bae0 0x7ff8281413b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:25:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82ce4d640 1 -- 172.21.15.154:0/3672111865 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8281418f0 con 0x7ff828144760 2024-05-14T01:25:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82de4f640 1 --2- 172.21.15.154:0/3672111865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff82815bae0 0x7ff8281413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T01:25:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82ce4d640 1 --2- 172.21.15.154:0/3672111865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff828144760 0x7ff82813ee30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff81800c500 tx=0x7ff81800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:25:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff81dffb640 1 -- 172.21.15.154:0/3672111865 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8180052d0 con 0x7ff828144760 2024-05-14T01:25:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff81dffb640 1 -- 172.21.15.154:0/3672111865 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff818005470 con 0x7ff828144760 2024-05-14T01:25:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82f8b2640 1 -- 172.21.15.154:0/3672111865 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff82813f4f0 con 0x7ff828144760 2024-05-14T01:25:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff81dffb640 1 -- 172.21.15.154:0/3672111865 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff818012830 con 0x7ff828144760 2024-05-14T01:25:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82f8b2640 1 -- 172.21.15.154:0/3672111865 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff82813fab0 con 0x7ff828144760 2024-05-14T01:25:25.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82f8b2640 1 -- 172.21.15.154:0/3672111865 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff828075470 con 0x7ff828144760 2024-05-14T01:25:25.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff81dffb640 1 -- 172.21.15.154:0/3672111865 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff8180129d0 con 0x7ff828144760 2024-05-14T01:25:25.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff81dffb640 1 --2- 172.21.15.154:0/3672111865 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff80c0678f0 0x7ff80c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T01:25:25.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82d64e640 1 --2- 172.21.15.154:0/3672111865 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff80c0678f0 0x7ff80c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T01:25:25.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff81dffb640 1 -- 172.21.15.154:0/3672111865 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff818085880 con 0x7ff828144760 2024-05-14T01:25:25.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.171+0000 7ff82d64e640 1 --2- 172.21.15.154:0/3672111865 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff80c0678f0 0x7ff80c069db0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff82400b9d0 tx=0x7ff824008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T01:25:25.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.175+0000 7ff81dffb640 1 -- 172.21.15.154:0/3672111865 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7ff8180182b0 con 0x7ff828144760 2024-05-14T01:25:25.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.395+0000 7ff82f8b2640 1 -- 172.21.15.154:0/3672111865 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) -- 0x7ff82813d450 con 0x7ff828144760 2024-05-14T01:25:25.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.395+0000 7ff81dffb640 1 -- 172.21.15.154:0/3672111865 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v13) ==== 82+0+151 (secure 0 0 0) 0x7ff8180563d0 con 0x7ff828144760 2024-05-14T01:25:25.385 INFO:teuthology.orchestra.run.smithi154.stdout:[client.admin] 2024-05-14T01:25:25.385 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDbvEJmQ9l1LRAABeMGc0scqErBIHQoFrtWcQ== 2024-05-14T01:25:25.385 INFO:teuthology.orchestra.run.smithi154.stdout: caps mds = "allow *" 2024-05-14T01:25:25.385 INFO:teuthology.orchestra.run.smithi154.stdout: caps mgr = "allow *" 2024-05-14T01:25:25.385 INFO:teuthology.orchestra.run.smithi154.stdout: caps mon = "allow *" 2024-05-14T01:25:25.385 INFO:teuthology.orchestra.run.smithi154.stdout: caps osd = "allow *" 2024-05-14T01:25:25.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.399+0000 7ff82f8b2640 1 -- 172.21.15.154:0/3672111865 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff80c0678f0 msgr2=0x7ff80c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:25:25.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.399+0000 7ff82f8b2640 1 --2- 172.21.15.154:0/3672111865 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff80c0678f0 0x7ff80c069db0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff82400b9d0 tx=0x7ff824008040 comp rx=0 tx=0).stop 2024-05-14T01:25:25.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.399+0000 7ff82f8b2640 1 -- 172.21.15.154:0/3672111865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff828144760 msgr2=0x7ff82813ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T01:25:25.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.399+0000 7ff82f8b2640 1 --2- 172.21.15.154:0/3672111865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff828144760 0x7ff82813ee30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff81800c500 tx=0x7ff81800c9c0 comp rx=0 tx=0).stop 2024-05-14T01:25:25.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.399+0000 7ff82f8b2640 1 -- 172.21.15.154:0/3672111865 shutdown_connections 2024-05-14T01:25:25.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.399+0000 7ff82f8b2640 1 --2- 172.21.15.154:0/3672111865 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff80c0678f0 0x7ff80c069db0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:25:25.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.399+0000 7ff82f8b2640 1 --2- 172.21.15.154:0/3672111865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff82815bae0 0x7ff8281413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:25:25.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.399+0000 7ff82f8b2640 1 --2- 172.21.15.154:0/3672111865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff828144760 0x7ff82813ee30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:25:25.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.399+0000 7ff82f8b2640 1 --2- 172.21.15.154:0/3672111865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8280b3530 0x7ff8280cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T01:25:25.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.399+0000 7ff82f8b2640 1 -- 172.21.15.154:0/3672111865 >> 172.21.15.154:0/3672111865 conn(0x7ff8280b1850 msgr2=0x7ff82813dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T01:25:25.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.399+0000 7ff82f8b2640 1 -- 172.21.15.154:0/3672111865 shutdown_connections 2024-05-14T01:25:25.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T01:25:25.399+0000 7ff82f8b2640 1 -- 172.21.15.154:0/3672111865 wait complete. 2024-05-14T01:25:25.406 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-05-14T01:25:25.411 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.lAcQzRNRRS 2024-05-14T01:25:25.411 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:25:25.412 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/tmp/tmp.lAcQzRNRRS 2024-05-14T01:25:25.460 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:25:25.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/tmp/tmp.E8tkN6FrZCxfstests-dev/local.config 2024-05-14T01:25:25.515 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.v73wnydYBctest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.XeZpfah5PBscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.154:6789 -k /tmp/tmp.lAcQzRNRRS --client_mountpoint /test" 2024-05-14T01:25:25.516 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T01:25:25.516 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/tmp/tmp.E8tkN6FrZCxfstests-dev/ceph.exclude 2024-05-14T01:25:25.572 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo make) 2024-05-14T01:25:25.631 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize -cfi 2024-05-14T01:25:25.901 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: putting auxiliary files in '.'. 2024-05-14T01:25:25.901 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: copying file './config.guess' 2024-05-14T01:25:25.905 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: copying file './config.sub' 2024-05-14T01:25:25.917 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: copying file './install-sh' 2024-05-14T01:25:25.923 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: copying file './ltmain.sh' 2024-05-14T01:25:25.943 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-05-14T01:25:25.943 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-05-14T01:25:25.958 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-05-14T01:25:25.964 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-05-14T01:25:25.969 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-05-14T01:25:25.975 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-05-14T01:25:25.980 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-05-14T01:25:25.981 INFO:teuthology.orchestra.run.smithi154.stdout:cp include/install-sh . 2024-05-14T01:25:25.982 INFO:teuthology.orchestra.run.smithi154.stdout:aclocal -I m4 2024-05-14T01:25:27.055 INFO:teuthology.orchestra.run.smithi154.stdout:autoheader 2024-05-14T01:25:27.417 INFO:teuthology.orchestra.run.smithi154.stdout:autoconf 2024-05-14T01:25:27.802 INFO:teuthology.orchestra.run.smithi154.stdout:./configure \ 2024-05-14T01:25:27.802 INFO:teuthology.orchestra.run.smithi154.stdout: --libexecdir=/usr/lib \ 2024-05-14T01:25:27.802 INFO:teuthology.orchestra.run.smithi154.stdout: --exec_prefix=/var/lib 2024-05-14T01:25:28.236 INFO:teuthology.orchestra.run.smithi154.stdout:checking build system type... x86_64-pc-linux-gnu 2024-05-14T01:25:28.236 INFO:teuthology.orchestra.run.smithi154.stdout:checking host system type... x86_64-pc-linux-gnu 2024-05-14T01:25:28.273 INFO:teuthology.orchestra.run.smithi154.stdout:checking how to print strings... printf 2024-05-14T01:25:28.273 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gcc... gcc 2024-05-14T01:25:28.455 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether the C compiler works... yes 2024-05-14T01:25:28.456 INFO:teuthology.orchestra.run.smithi154.stdout:checking for C compiler default output file name... a.out 2024-05-14T01:25:28.498 INFO:teuthology.orchestra.run.smithi154.stdout:checking for suffix of executables... 2024-05-14T01:25:28.564 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether we are cross compiling... no 2024-05-14T01:25:28.587 INFO:teuthology.orchestra.run.smithi154.stdout:checking for suffix of object files... o 2024-05-14T01:25:28.603 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether the compiler supports GNU C... yes 2024-05-14T01:25:28.620 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether gcc accepts -g... yes 2024-05-14T01:25:28.768 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gcc option to enable C11 features... none needed 2024-05-14T01:25:28.773 INFO:teuthology.orchestra.run.smithi154.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-05-14T01:25:28.776 INFO:teuthology.orchestra.run.smithi154.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-05-14T01:25:28.778 INFO:teuthology.orchestra.run.smithi154.stdout:checking for egrep... /usr/bin/grep -E 2024-05-14T01:25:28.780 INFO:teuthology.orchestra.run.smithi154.stdout:checking for fgrep... /usr/bin/grep -F 2024-05-14T01:25:28.785 INFO:teuthology.orchestra.run.smithi154.stdout:checking for ld used by gcc... /usr/bin/ld 2024-05-14T01:25:28.787 INFO:teuthology.orchestra.run.smithi154.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-05-14T01:25:28.797 INFO:teuthology.orchestra.run.smithi154.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-05-14T01:25:28.819 INFO:teuthology.orchestra.run.smithi154.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-05-14T01:25:28.819 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether ln -s works... yes 2024-05-14T01:25:28.825 INFO:teuthology.orchestra.run.smithi154.stdout:checking the maximum length of command line arguments... 1572864 2024-05-14T01:25:28.829 INFO:teuthology.orchestra.run.smithi154.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-05-14T01:25:28.829 INFO:teuthology.orchestra.run.smithi154.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-05-14T01:25:28.829 INFO:teuthology.orchestra.run.smithi154.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-05-14T01:25:28.830 INFO:teuthology.orchestra.run.smithi154.stdout:checking for objdump... objdump 2024-05-14T01:25:28.830 INFO:teuthology.orchestra.run.smithi154.stdout:checking how to recognize dependent libraries... pass_all 2024-05-14T01:25:28.831 INFO:teuthology.orchestra.run.smithi154.stdout:checking for dlltool... no 2024-05-14T01:25:28.831 INFO:teuthology.orchestra.run.smithi154.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-05-14T01:25:28.831 INFO:teuthology.orchestra.run.smithi154.stdout:checking for ar... ar 2024-05-14T01:25:28.860 INFO:teuthology.orchestra.run.smithi154.stdout:checking for archiver @FILE support... @ 2024-05-14T01:25:28.861 INFO:teuthology.orchestra.run.smithi154.stdout:checking for strip... strip 2024-05-14T01:25:28.861 INFO:teuthology.orchestra.run.smithi154.stdout:checking for ranlib... ranlib 2024-05-14T01:25:28.861 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gawk... gawk 2024-05-14T01:25:28.931 INFO:teuthology.orchestra.run.smithi154.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-05-14T01:25:28.932 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sysroot... no 2024-05-14T01:25:28.936 INFO:teuthology.orchestra.run.smithi154.stdout:checking for a working dd... /usr/bin/dd 2024-05-14T01:25:28.940 INFO:teuthology.orchestra.run.smithi154.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-05-14T01:25:28.955 INFO:teuthology.orchestra.run.smithi154.stdout:checking for mt... mt 2024-05-14T01:25:28.979 INFO:teuthology.orchestra.run.smithi154.stdout:checking if mt is a manifest tool... no 2024-05-14T01:25:29.001 INFO:teuthology.orchestra.run.smithi154.stdout:checking for stdio.h... yes 2024-05-14T01:25:29.073 INFO:teuthology.orchestra.run.smithi154.stdout:checking for stdlib.h... yes 2024-05-14T01:25:29.106 INFO:teuthology.orchestra.run.smithi154.stdout:checking for string.h... yes 2024-05-14T01:25:29.136 INFO:teuthology.orchestra.run.smithi154.stdout:checking for inttypes.h... yes 2024-05-14T01:25:29.161 INFO:teuthology.orchestra.run.smithi154.stdout:checking for stdint.h... yes 2024-05-14T01:25:29.186 INFO:teuthology.orchestra.run.smithi154.stdout:checking for strings.h... yes 2024-05-14T01:25:29.217 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/stat.h... yes 2024-05-14T01:25:29.243 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/types.h... yes 2024-05-14T01:25:29.282 INFO:teuthology.orchestra.run.smithi154.stdout:checking for unistd.h... yes 2024-05-14T01:25:29.319 INFO:teuthology.orchestra.run.smithi154.stdout:checking for dlfcn.h... yes 2024-05-14T01:25:29.321 INFO:teuthology.orchestra.run.smithi154.stdout:checking for objdir... .libs 2024-05-14T01:25:29.401 INFO:teuthology.orchestra.run.smithi154.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-05-14T01:25:29.401 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-05-14T01:25:29.416 INFO:teuthology.orchestra.run.smithi154.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-05-14T01:25:29.625 INFO:teuthology.orchestra.run.smithi154.stdout:checking if gcc static flag -static works... yes 2024-05-14T01:25:29.651 INFO:teuthology.orchestra.run.smithi154.stdout:checking if gcc supports -c -o file.o... yes 2024-05-14T01:25:29.651 INFO:teuthology.orchestra.run.smithi154.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-05-14T01:25:29.661 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-05-14T01:25:29.685 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether -lc should be explicitly linked in... no 2024-05-14T01:25:29.759 INFO:teuthology.orchestra.run.smithi154.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-05-14T01:25:29.759 INFO:teuthology.orchestra.run.smithi154.stdout:checking how to hardcode library paths into programs... immediate 2024-05-14T01:25:29.769 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether stripping libraries is possible... yes 2024-05-14T01:25:29.770 INFO:teuthology.orchestra.run.smithi154.stdout:checking if libtool supports shared libraries... yes 2024-05-14T01:25:29.770 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether to build shared libraries... yes 2024-05-14T01:25:29.770 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether to build static libraries... yes 2024-05-14T01:25:29.778 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gcc... (cached) gcc 2024-05-14T01:25:29.804 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether the compiler supports GNU C... (cached) yes 2024-05-14T01:25:29.805 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-14T01:25:29.805 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gcc option to enable C11 features... (cached) none needed 2024-05-14T01:25:29.805 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gmake... /usr/bin/gmake 2024-05-14T01:25:29.805 INFO:teuthology.orchestra.run.smithi154.stderr:./configure: line 12753: test: $(SHELL): binary operator expected 2024-05-14T01:25:29.806 INFO:teuthology.orchestra.run.smithi154.stdout:checking for tar... /bin/tar 2024-05-14T01:25:29.806 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gzip... /bin/gzip 2024-05-14T01:25:29.817 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether gcc -MM is supported... yes 2024-05-14T01:25:29.818 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sort... /bin/sort 2024-05-14T01:25:29.818 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether ln -s works... yes 2024-05-14T01:25:29.818 INFO:teuthology.orchestra.run.smithi154.stdout:checking for rpm... no 2024-05-14T01:25:29.854 INFO:teuthology.orchestra.run.smithi154.stdout:checking for assert.h... yes 2024-05-14T01:25:29.889 INFO:teuthology.orchestra.run.smithi154.stdout:checking for bstring.h... no 2024-05-14T01:25:29.924 INFO:teuthology.orchestra.run.smithi154.stdout:checking for libgen.h... yes 2024-05-14T01:25:29.982 INFO:teuthology.orchestra.run.smithi154.stdout:checking for dirent.h... yes 2024-05-14T01:25:30.074 INFO:teuthology.orchestra.run.smithi154.stdout:checking for errno.h... yes 2024-05-14T01:25:30.114 INFO:teuthology.orchestra.run.smithi154.stdout:checking for malloc.h... yes 2024-05-14T01:25:30.153 INFO:teuthology.orchestra.run.smithi154.stdout:checking for uuid.h... no 2024-05-14T01:25:30.193 INFO:teuthology.orchestra.run.smithi154.stdout:checking for uuid/uuid.h... yes 2024-05-14T01:25:30.230 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/uuid.h... no 2024-05-14T01:25:30.267 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/file.h... yes 2024-05-14T01:25:30.299 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/fcntl.h... yes 2024-05-14T01:25:30.334 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/syssgi.h... no 2024-05-14T01:25:30.387 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/param.h... yes 2024-05-14T01:25:30.387 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/stat.h... (cached) yes 2024-05-14T01:25:30.425 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/statvfs.h... yes 2024-05-14T01:25:30.456 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/time.h... yes 2024-05-14T01:25:30.497 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/ioctl.h... yes 2024-05-14T01:25:30.535 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/wait.h... yes 2024-05-14T01:25:30.535 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/types.h... (cached) yes 2024-05-14T01:25:30.535 INFO:teuthology.orchestra.run.smithi154.stdout:checking for strings.h... (cached) yes 2024-05-14T01:25:30.567 INFO:teuthology.orchestra.run.smithi154.stdout:checking for err.h... yes 2024-05-14T01:25:30.596 INFO:teuthology.orchestra.run.smithi154.stdout:checking for linux/falloc.h... yes 2024-05-14T01:25:30.627 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/fs/xfs_fsops.h... no 2024-05-14T01:25:30.658 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/fs/xfs_itable.h... no 2024-05-14T01:25:30.688 INFO:teuthology.orchestra.run.smithi154.stdout:checking for xfs/platform_defs.h... no 2024-05-14T01:25:30.719 INFO:teuthology.orchestra.run.smithi154.stdout:checking for btrfs/ioctl.h... no 2024-05-14T01:25:30.748 INFO:teuthology.orchestra.run.smithi154.stdout:checking for cifs/ioctl.h... no 2024-05-14T01:25:30.778 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/mman.h... yes 2024-05-14T01:25:30.809 INFO:teuthology.orchestra.run.smithi154.stdout:checking for linux/ext4.h... no 2024-05-14T01:25:30.824 INFO:teuthology.orchestra.run.smithi154.stdout:checking for xfs/xfs_log_format.h... no 2024-05-14T01:25:30.863 INFO:teuthology.orchestra.run.smithi154.stdout:checking for uuid_compare... no 2024-05-14T01:25:30.896 INFO:teuthology.orchestra.run.smithi154.stdout:checking for uuid_compare in -luuid... yes 2024-05-14T01:25:30.997 INFO:teuthology.orchestra.run.smithi154.stdout:checking for xfs/xfs.h... yes 2024-05-14T01:25:31.015 INFO:teuthology.orchestra.run.smithi154.stdout:checking for xfs/libxfs.h... no 2024-05-14T01:25:31.061 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2024-05-14T01:25:31.081 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether xlog_assign_lsn is declared... no 2024-05-14T01:25:31.126 INFO:teuthology.orchestra.run.smithi154.stdout:checking for xfs/xqm.h... yes 2024-05-14T01:25:31.188 INFO:teuthology.orchestra.run.smithi154.stdout:checking xfsctl from xfs/xfs.h... ok 2024-05-14T01:25:31.219 INFO:teuthology.orchestra.run.smithi154.stdout:checking for xfs/handle.h... yes 2024-05-14T01:25:31.256 INFO:teuthology.orchestra.run.smithi154.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-05-14T01:25:31.299 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/acl.h... yes 2024-05-14T01:25:31.333 INFO:teuthology.orchestra.run.smithi154.stdout:checking for acl/libacl.h... yes 2024-05-14T01:25:31.367 INFO:teuthology.orchestra.run.smithi154.stdout:checking for acl_init in -lacl... yes 2024-05-14T01:25:31.399 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gdbm-ndbm.h... no 2024-05-14T01:25:31.428 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gdbm/ndbm.h... no 2024-05-14T01:25:31.457 INFO:teuthology.orchestra.run.smithi154.stdout:checking for ndbm.h... no 2024-05-14T01:25:31.490 INFO:teuthology.orchestra.run.smithi154.stdout:checking for libaio.h... yes 2024-05-14T01:25:31.535 INFO:teuthology.orchestra.run.smithi154.stdout:checking for liburing.h... yes 2024-05-14T01:25:31.571 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/capability.h... yes 2024-05-14T01:25:31.602 INFO:teuthology.orchestra.run.smithi154.stdout:checking for linux/fiemap.h... yes 2024-05-14T01:25:31.638 INFO:teuthology.orchestra.run.smithi154.stdout:checking for fallocate... yes 2024-05-14T01:25:31.674 INFO:teuthology.orchestra.run.smithi154.stdout:checking for open_by_handle_at... yes 2024-05-14T01:25:31.704 INFO:teuthology.orchestra.run.smithi154.stdout:checking for linux/fs.h... yes 2024-05-14T01:25:31.734 INFO:teuthology.orchestra.run.smithi154.stdout:checking for btrfsutil.h... no 2024-05-14T01:25:31.774 INFO:teuthology.orchestra.run.smithi154.stdout:checking for copy_file_range... yes 2024-05-14T01:25:31.814 INFO:teuthology.orchestra.run.smithi154.stdout:checking for SEEK_DATA... yes 2024-05-14T01:25:31.871 INFO:teuthology.orchestra.run.smithi154.stdout:checking for BMV_OF_SHARED... yes 2024-05-14T01:25:31.920 INFO:teuthology.orchestra.run.smithi154.stdout:checking for nftw... yes 2024-05-14T01:25:31.960 INFO:teuthology.orchestra.run.smithi154.stdout:checking for RLIMIT_NOFILE... yes 2024-05-14T01:25:32.000 INFO:teuthology.orchestra.run.smithi154.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-05-14T01:25:32.035 INFO:teuthology.orchestra.run.smithi154.stdout:checking for FICLONE... yes 2024-05-14T01:25:32.071 INFO:teuthology.orchestra.run.smithi154.stdout:checking for renameat2... yes 2024-05-14T01:25:32.107 INFO:teuthology.orchestra.run.smithi154.stdout:checking for reallocarray... yes 2024-05-14T01:25:32.137 INFO:teuthology.orchestra.run.smithi154.stdout:checking for struct mount_attr... yes 2024-05-14T01:25:32.192 INFO:teuthology.orchestra.run.smithi154.stdout:checking for struct btrfs_qgroup_limit... yes 2024-05-14T01:25:32.228 INFO:teuthology.orchestra.run.smithi154.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-05-14T01:25:32.263 INFO:teuthology.orchestra.run.smithi154.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-05-14T01:25:32.297 INFO:teuthology.orchestra.run.smithi154.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-05-14T01:25:32.331 INFO:teuthology.orchestra.run.smithi154.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-05-14T01:25:32.365 INFO:teuthology.orchestra.run.smithi154.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-05-14T01:25:32.400 INFO:teuthology.orchestra.run.smithi154.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-05-14T01:25:32.434 INFO:teuthology.orchestra.run.smithi154.stdout:checking for linux/btrfs.h... yes 2024-05-14T01:25:32.469 INFO:teuthology.orchestra.run.smithi154.stdout:checking for linux/btrfs_tree.h... yes 2024-05-14T01:25:32.487 INFO:teuthology.orchestra.run.smithi154.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-05-14T01:25:32.512 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-05-14T01:25:32.529 INFO:teuthology.orchestra.run.smithi154.stdout:configure: creating ./config.status 2024-05-14T01:25:32.885 INFO:teuthology.orchestra.run.smithi154.stdout:config.status: creating include/builddefs 2024-05-14T01:25:32.895 INFO:teuthology.orchestra.run.smithi154.stdout:config.status: creating include/config.h 2024-05-14T01:25:32.904 INFO:teuthology.orchestra.run.smithi154.stdout:config.status: executing libtool commands 2024-05-14T01:25:32.944 INFO:teuthology.orchestra.run.smithi154.stdout:Building include 2024-05-14T01:25:32.947 INFO:teuthology.orchestra.run.smithi154.stdout:Building lib 2024-05-14T01:25:32.950 INFO:teuthology.orchestra.run.smithi154.stdout: [LTDEP] 2024-05-14T01:25:33.088 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] dataascii.lo 2024-05-14T01:25:33.189 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] databin.lo 2024-05-14T01:25:33.333 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] datapid.lo 2024-05-14T01:25:33.428 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] file_lock.lo 2024-05-14T01:25:33.577 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] forker.lo 2024-05-14T01:25:33.722 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] pattern.lo 2024-05-14T01:25:33.830 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] open_flags.lo 2024-05-14T01:25:33.971 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] random_range.lo 2024-05-14T01:25:34.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:25:34.202 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:25:34.217 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] string_to_tokens.lo 2024-05-14T01:25:34.303 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] str_to_bytes.lo 2024-05-14T01:25:34.425 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] tlibio.lo 2024-05-14T01:25:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] write_log.lo 2024-05-14T01:25:34.759 INFO:teuthology.orchestra.run.smithi154.stderr:write_log.c: In function 'wlog_record_write': 2024-05-14T01:25:34.759 INFO:teuthology.orchestra.run.smithi154.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:34.759 INFO:teuthology.orchestra.run.smithi154.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2024-05-14T01:25:34.759 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:34.759 INFO:teuthology.orchestra.run.smithi154.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:34.760 INFO:teuthology.orchestra.run.smithi154.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2024-05-14T01:25:34.760 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:34.953 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] random.lo 2024-05-14T01:25:35.056 INFO:teuthology.orchestra.run.smithi154.stdout: [LD] 2024-05-14T01:25:35.126 INFO:teuthology.orchestra.run.smithi154.stdout:Building ltp 2024-05-14T01:25:35.129 INFO:teuthology.orchestra.run.smithi154.stdout: [DEP] 2024-05-14T01:25:35.268 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] doio 2024-05-14T01:25:35.967 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fsstress 2024-05-14T01:25:37.434 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fsx 2024-05-14T01:25:38.201 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] growfiles 2024-05-14T01:25:38.725 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] iogen 2024-05-14T01:25:38.847 INFO:teuthology.orchestra.run.smithi154.stderr:iogen.c: In function 'main': 2024-05-14T01:25:38.847 INFO:teuthology.orchestra.run.smithi154.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:38.847 INFO:teuthology.orchestra.run.smithi154.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2024-05-14T01:25:38.847 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:38.850 INFO:teuthology.orchestra.run.smithi154.stderr:iogen.c: In function 'parse_cmdline': 2024-05-14T01:25:38.850 INFO:teuthology.orchestra.run.smithi154.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:38.850 INFO:teuthology.orchestra.run.smithi154.stderr: 1535 | getcwd(fptr->f_path, 2024-05-14T01:25:38.850 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:38.850 INFO:teuthology.orchestra.run.smithi154.stderr: 1536 | sizeof(fptr->f_path)-1); 2024-05-14T01:25:38.851 INFO:teuthology.orchestra.run.smithi154.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:39.137 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-stress 2024-05-14T01:25:39.243 INFO:teuthology.orchestra.run.smithi154.stderr:aio-stress.c: In function 'setup_shared_mem': 2024-05-14T01:25:39.243 INFO:teuthology.orchestra.run.smithi154.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:39.243 INFO:teuthology.orchestra.run.smithi154.stderr: 1013 | ftruncate(fd, total_ram); 2024-05-14T01:25:39.243 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:39.550 INFO:teuthology.orchestra.run.smithi154.stdout:Building src 2024-05-14T01:25:39.555 INFO:teuthology.orchestra.run.smithi154.stdout: [DEP] 2024-05-14T01:25:41.676 INFO:teuthology.orchestra.run.smithi154.stdout: [DEP] 2024-05-14T01:25:41.708 INFO:teuthology.orchestra.run.smithi154.stdout: [DEP] 2024-05-14T01:25:41.716 INFO:teuthology.orchestra.run.smithi154.stdout: [DEP] 2024-05-14T01:25:41.968 INFO:teuthology.orchestra.run.smithi154.stdout: [DEP] 2024-05-14T01:25:41.995 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] dirstress 2024-05-14T01:25:42.246 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fill 2024-05-14T01:25:42.390 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fill2 2024-05-14T01:25:42.628 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] getpagesize 2024-05-14T01:25:42.748 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] holes 2024-05-14T01:25:42.948 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] lstat64 2024-05-14T01:25:43.134 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] nametest 2024-05-14T01:25:43.267 INFO:teuthology.orchestra.run.smithi154.stderr:nametest.c: In function 'main': 2024-05-14T01:25:43.268 INFO:teuthology.orchestra.run.smithi154.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:43.268 INFO:teuthology.orchestra.run.smithi154.stderr: 236 | write(1, "\n", 1); 2024-05-14T01:25:43.268 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~ 2024-05-14T01:25:43.268 INFO:teuthology.orchestra.run.smithi154.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:43.268 INFO:teuthology.orchestra.run.smithi154.stderr: 238 | write(1, ".", 1); 2024-05-14T01:25:43.268 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~ 2024-05-14T01:25:43.268 INFO:teuthology.orchestra.run.smithi154.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:43.268 INFO:teuthology.orchestra.run.smithi154.stderr: 288 | write(1, ".", 1); 2024-05-14T01:25:43.268 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~ 2024-05-14T01:25:43.395 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] permname 2024-05-14T01:25:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] randholes 2024-05-14T01:25:43.843 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] runas 2024-05-14T01:25:44.024 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] truncfile 2024-05-14T01:25:44.205 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] usemem 2024-05-14T01:25:44.344 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] mmapcat 2024-05-14T01:25:44.461 INFO:teuthology.orchestra.run.smithi154.stderr:mmapcat.c: In function 'main': 2024-05-14T01:25:44.461 INFO:teuthology.orchestra.run.smithi154.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:44.461 INFO:teuthology.orchestra.run.smithi154.stderr: 29 | write(1,ptr2,ptr - ptr2); 2024-05-14T01:25:44.462 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:44.496 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] append_reader 2024-05-14T01:25:44.638 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] append_writer 2024-05-14T01:25:44.785 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] dirperf 2024-05-14T01:25:45.004 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] metaperf 2024-05-14T01:25:45.116 INFO:teuthology.orchestra.run.smithi154.stderr:metaperf.c: In function 'crfiles': 2024-05-14T01:25:45.116 INFO:teuthology.orchestra.run.smithi154.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:45.116 INFO:teuthology.orchestra.run.smithi154.stderr: 166 | write(fd, buf, fsize); 2024-05-14T01:25:45.116 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:45.118 INFO:teuthology.orchestra.run.smithi154.stderr:metaperf.c: In function 't_linkun': 2024-05-14T01:25:45.118 INFO:teuthology.orchestra.run.smithi154.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:45.118 INFO:teuthology.orchestra.run.smithi154.stderr: 454 | link("a", *fnp); 2024-05-14T01:25:45.118 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~ 2024-05-14T01:25:45.118 INFO:teuthology.orchestra.run.smithi154.stderr:metaperf.c: In function 't_chown': 2024-05-14T01:25:45.118 INFO:teuthology.orchestra.run.smithi154.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:45.118 INFO:teuthology.orchestra.run.smithi154.stderr: 404 | chown(*fnp, 2, -1); 2024-05-14T01:25:45.118 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:45.118 INFO:teuthology.orchestra.run.smithi154.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:45.118 INFO:teuthology.orchestra.run.smithi154.stderr: 406 | chown(*fnp, 1, -1); 2024-05-14T01:25:45.118 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:45.118 INFO:teuthology.orchestra.run.smithi154.stderr:metaperf.c: In function 'i_chown': 2024-05-14T01:25:45.119 INFO:teuthology.orchestra.run.smithi154.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:45.119 INFO:teuthology.orchestra.run.smithi154.stderr: 291 | chown(*fnp, 1, -1); 2024-05-14T01:25:45.119 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:45.119 INFO:teuthology.orchestra.run.smithi154.stderr:metaperf.c: In function 'main': 2024-05-14T01:25:45.119 INFO:teuthology.orchestra.run.smithi154.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:45.119 INFO:teuthology.orchestra.run.smithi154.stderr: 152 | chdir(".."); 2024-05-14T01:25:45.119 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~ 2024-05-14T01:25:45.289 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] devzero 2024-05-14T01:25:45.465 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] feature 2024-05-14T01:25:45.693 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] alloc 2024-05-14T01:25:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:alloc.c: In function 'main': 2024-05-14T01:25:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:45.818 INFO:teuthology.orchestra.run.smithi154.stderr: 247 | mkstemp(tmpfile); 2024-05-14T01:25:45.818 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~ 2024-05-14T01:25:45.912 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fault 2024-05-14T01:25:46.078 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fstest 2024-05-14T01:25:46.336 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_access_root 2024-05-14T01:25:46.450 INFO:teuthology.orchestra.run.smithi154.stderr:t_access_root.c: In function 'main': 2024-05-14T01:25:46.450 INFO:teuthology.orchestra.run.smithi154.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:46.450 INFO:teuthology.orchestra.run.smithi154.stderr: 55 | system(cmd); 2024-05-14T01:25:46.450 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~ 2024-05-14T01:25:46.491 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] godown 2024-05-14T01:25:46.658 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] resvtest 2024-05-14T01:25:46.839 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] writemod 2024-05-14T01:25:46.973 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] writev_on_pagefault 2024-05-14T01:25:47.121 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] makeextents 2024-05-14T01:25:47.302 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] itrash 2024-05-14T01:25:47.451 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] rename 2024-05-14T01:25:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] multi_open_unlink 2024-05-14T01:25:47.743 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] unwritten_sync 2024-05-14T01:25:47.918 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] genhashnames 2024-05-14T01:25:48.103 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_holes 2024-05-14T01:25:48.248 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mmap_writev 2024-05-14T01:25:48.392 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_truncate_cmtime 2024-05-14T01:25:48.546 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] dirhash_collide 2024-05-14T01:25:48.734 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_rename_overwrite 2024-05-14T01:25:48.861 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] holetest 2024-05-14T01:25:48.969 INFO:teuthology.orchestra.run.smithi154.stderr:holetest.c: In function 'pt_write_marker': 2024-05-14T01:25:48.969 INFO:teuthology.orchestra.run.smithi154.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:48.969 INFO:teuthology.orchestra.run.smithi154.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2024-05-14T01:25:48.969 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:49.081 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_truncate_self 2024-05-14T01:25:49.207 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] af_unix 2024-05-14T01:25:49.344 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mmap_stale_pmd 2024-05-14T01:25:49.439 INFO:teuthology.orchestra.run.smithi154.stderr:t_mmap_stale_pmd.c: In function 'main': 2024-05-14T01:25:49.439 INFO:teuthology.orchestra.run.smithi154.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:49.439 INFO:teuthology.orchestra.run.smithi154.stderr: 42 | ftruncate(fd, 0); 2024-05-14T01:25:49.439 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~ 2024-05-14T01:25:49.440 INFO:teuthology.orchestra.run.smithi154.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:49.440 INFO:teuthology.orchestra.run.smithi154.stderr: 43 | ftruncate(fd, MiB(4)); 2024-05-14T01:25:49.440 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:49.440 INFO:teuthology.orchestra.run.smithi154.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:49.440 INFO:teuthology.orchestra.run.smithi154.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2024-05-14T01:25:49.440 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:49.476 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mmap_cow_race 2024-05-14T01:25:49.571 INFO:teuthology.orchestra.run.smithi154.stderr:t_mmap_cow_race.c: In function 'main': 2024-05-14T01:25:49.571 INFO:teuthology.orchestra.run.smithi154.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:49.571 INFO:teuthology.orchestra.run.smithi154.stderr: 61 | ftruncate(fd, 0); 2024-05-14T01:25:49.571 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~ 2024-05-14T01:25:49.571 INFO:teuthology.orchestra.run.smithi154.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:49.571 INFO:teuthology.orchestra.run.smithi154.stderr: 62 | ftruncate(fd, MiB(2)); 2024-05-14T01:25:49.571 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:49.615 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mmap_fallocate 2024-05-14T01:25:49.756 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fsync-err 2024-05-14T01:25:49.923 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mmap_write_ro 2024-05-14T01:25:50.051 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_ext4_dax_journal_corruption 2024-05-14T01:25:50.140 INFO:teuthology.orchestra.run.smithi154.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2024-05-14T01:25:50.140 INFO:teuthology.orchestra.run.smithi154.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:50.140 INFO:teuthology.orchestra.run.smithi154.stderr: 61 | ftruncate(fd, 0); 2024-05-14T01:25:50.140 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~ 2024-05-14T01:25:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_ext4_dax_inline_corruption 2024-05-14T01:25:50.311 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_ofd_locks 2024-05-14T01:25:50.484 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mmap_collision 2024-05-14T01:25:50.674 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] mmap-write-concurrent 2024-05-14T01:25:50.839 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_get_file_time 2024-05-14T01:25:50.974 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_create_short_dirs 2024-05-14T01:25:51.125 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_create_long_dirs 2024-05-14T01:25:51.276 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_enospc 2024-05-14T01:25:51.483 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mmap_writev_overlap 2024-05-14T01:25:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] checkpoint_journal 2024-05-14T01:25:51.797 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] mmap-rw-fault 2024-05-14T01:25:51.963 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] allocstale 2024-05-14T01:25:52.125 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mmap_cow_memory_failure 2024-05-14T01:25:52.305 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fake-dump-rootino 2024-05-14T01:25:52.455 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] dio-buf-fault 2024-05-14T01:25:52.602 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] rewinddir-test 2024-05-14T01:25:52.760 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] readdir-while-renames 2024-05-14T01:25:52.915 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] xfsctl 2024-05-14T01:25:53.103 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] bstat 2024-05-14T01:25:53.313 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mtab 2024-05-14T01:25:53.421 INFO:teuthology.orchestra.run.smithi154.stderr:t_mtab.c: In function 'update_mtab': 2024-05-14T01:25:53.421 INFO:teuthology.orchestra.run.smithi154.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:53.421 INFO:teuthology.orchestra.run.smithi154.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2024-05-14T01:25:53.421 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:53.502 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] getdevicesize 2024-05-14T01:25:53.642 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] preallo_rw_pattern_reader 2024-05-14T01:25:53.748 INFO:teuthology.orchestra.run.smithi154.stderr:In file included from preallo_rw_pattern_reader.c:2: 2024-05-14T01:25:53.748 INFO:teuthology.orchestra.run.smithi154.stderr:iopat.c: In function 'main': 2024-05-14T01:25:53.748 INFO:teuthology.orchestra.run.smithi154.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:53.748 INFO:teuthology.orchestra.run.smithi154.stderr: 38 | read(fd, &x, 1048576); 2024-05-14T01:25:53.748 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:53.780 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] preallo_rw_pattern_writer 2024-05-14T01:25:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:In file included from preallo_rw_pattern_writer.c:2: 2024-05-14T01:25:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:iopat.c: In function 'main': 2024-05-14T01:25:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:53.892 INFO:teuthology.orchestra.run.smithi154.stderr: 34 | write(fd, &x, 1048576); 2024-05-14T01:25:53.892 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:53.926 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] ftrunc 2024-05-14T01:25:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] trunc 2024-05-14T01:25:54.235 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fs_perms 2024-05-14T01:25:54.346 INFO:teuthology.orchestra.run.smithi154.stderr:fs_perms.c: In function 'main': 2024-05-14T01:25:54.346 INFO:teuthology.orchestra.run.smithi154.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:54.347 INFO:teuthology.orchestra.run.smithi154.stderr: 54 | system("rm -f test.file"); 2024-05-14T01:25:54.347 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:54.347 INFO:teuthology.orchestra.run.smithi154.stderr:fs_perms.c: In function 'testsetup': 2024-05-14T01:25:54.347 INFO:teuthology.orchestra.run.smithi154.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:54.347 INFO:teuthology.orchestra.run.smithi154.stderr: 67 | system("cp testx.file test.file"); 2024-05-14T01:25:54.347 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:54.347 INFO:teuthology.orchestra.run.smithi154.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:54.347 INFO:teuthology.orchestra.run.smithi154.stderr: 69 | chown("test.file",cuserId,cgroupId); 2024-05-14T01:25:54.347 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:54.347 INFO:teuthology.orchestra.run.smithi154.stderr:fs_perms.c: In function 'testfperm': 2024-05-14T01:25:54.347 INFO:teuthology.orchestra.run.smithi154.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:54.348 INFO:teuthology.orchestra.run.smithi154.stderr: 123 | seteuid(0); 2024-05-14T01:25:54.348 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~ 2024-05-14T01:25:54.348 INFO:teuthology.orchestra.run.smithi154.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:54.348 INFO:teuthology.orchestra.run.smithi154.stderr: 124 | setegid(0); 2024-05-14T01:25:54.348 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~ 2024-05-14T01:25:54.397 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] testx 2024-05-14T01:25:54.510 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] looptest 2024-05-14T01:25:54.695 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] locktest 2024-05-14T01:25:55.021 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] unwritten_mmap 2024-05-14T01:25:55.189 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] bulkstat_unlink_test 2024-05-14T01:25:55.308 INFO:teuthology.orchestra.run.smithi154.stderr:bulkstat_unlink_test.c: In function 'main': 2024-05-14T01:25:55.309 INFO:teuthology.orchestra.run.smithi154.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:55.309 INFO:teuthology.orchestra.run.smithi154.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2024-05-14T01:25:55.309 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:55.309 INFO:teuthology.orchestra.run.smithi154.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:55.309 INFO:teuthology.orchestra.run.smithi154.stderr: 178 | system(fname); 2024-05-14T01:25:55.309 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~ 2024-05-14T01:25:55.394 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] deduperace 2024-05-14T01:25:55.596 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] bulkstat_unlink_test_modified 2024-05-14T01:25:55.706 INFO:teuthology.orchestra.run.smithi154.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2024-05-14T01:25:55.706 INFO:teuthology.orchestra.run.smithi154.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:55.706 INFO:teuthology.orchestra.run.smithi154.stderr: 83 | write(fd, fname, sizeof(fname)); 2024-05-14T01:25:55.706 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:55.707 INFO:teuthology.orchestra.run.smithi154.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:55.707 INFO:teuthology.orchestra.run.smithi154.stderr: 139 | write(fd, fname, sizeof(fname)); 2024-05-14T01:25:55.707 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:55.707 INFO:teuthology.orchestra.run.smithi154.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:55.707 INFO:teuthology.orchestra.run.smithi154.stderr: 185 | system(fname); 2024-05-14T01:25:55.707 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~ 2024-05-14T01:25:55.789 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_dir_offset 2024-05-14T01:25:55.932 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_futimens 2024-05-14T01:25:56.055 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_immutable 2024-05-14T01:25:56.179 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c: In function 'create_test_area': 2024-05-14T01:25:56.179 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.179 INFO:teuthology.orchestra.run.smithi154.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2024-05-14T01:25:56.179 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.179 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.179 INFO:teuthology.orchestra.run.smithi154.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2024-05-14T01:25:56.179 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.180 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c: In function 'remove_test_area': 2024-05-14T01:25:56.180 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.180 INFO:teuthology.orchestra.run.smithi154.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2024-05-14T01:25:56.180 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.181 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.181 INFO:teuthology.orchestra.run.smithi154.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2024-05-14T01:25:56.181 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.181 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.181 INFO:teuthology.orchestra.run.smithi154.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2024-05-14T01:25:56.181 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.181 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.181 INFO:teuthology.orchestra.run.smithi154.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2024-05-14T01:25:56.181 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.181 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.181 INFO:teuthology.orchestra.run.smithi154.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2024-05-14T01:25:56.181 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.181 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.181 INFO:teuthology.orchestra.run.smithi154.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2024-05-14T01:25:56.182 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.183 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c: In function 'check_test_area': 2024-05-14T01:25:56.183 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.183 INFO:teuthology.orchestra.run.smithi154.stderr: 1788 | asprintf(&path, "%s/", dir); 2024-05-14T01:25:56.183 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.183 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.183 INFO:teuthology.orchestra.run.smithi154.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2024-05-14T01:25:56.183 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.183 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.183 INFO:teuthology.orchestra.run.smithi154.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2024-05-14T01:25:56.183 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.184 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.184 INFO:teuthology.orchestra.run.smithi154.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2024-05-14T01:25:56.184 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.184 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.184 INFO:teuthology.orchestra.run.smithi154.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2024-05-14T01:25:56.184 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.184 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.184 INFO:teuthology.orchestra.run.smithi154.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2024-05-14T01:25:56.184 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.184 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.184 INFO:teuthology.orchestra.run.smithi154.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2024-05-14T01:25:56.184 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.184 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.184 INFO:teuthology.orchestra.run.smithi154.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2024-05-14T01:25:56.184 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.185 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.185 INFO:teuthology.orchestra.run.smithi154.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2024-05-14T01:25:56.185 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.187 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c: In function 'test_immutable': 2024-05-14T01:25:56.187 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.187 INFO:teuthology.orchestra.run.smithi154.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2024-05-14T01:25:56.187 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.187 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.187 INFO:teuthology.orchestra.run.smithi154.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2024-05-14T01:25:56.187 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.187 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.187 INFO:teuthology.orchestra.run.smithi154.stderr: 408 | chown(path, 0, 0); 2024-05-14T01:25:56.187 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.187 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.188 INFO:teuthology.orchestra.run.smithi154.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2024-05-14T01:25:56.188 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.188 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.188 INFO:teuthology.orchestra.run.smithi154.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2024-05-14T01:25:56.188 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.188 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.188 INFO:teuthology.orchestra.run.smithi154.stderr: 553 | chown(path, 0, 0); 2024-05-14T01:25:56.188 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.188 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.188 INFO:teuthology.orchestra.run.smithi154.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2024-05-14T01:25:56.188 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.188 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.188 INFO:teuthology.orchestra.run.smithi154.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2024-05-14T01:25:56.188 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.189 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.189 INFO:teuthology.orchestra.run.smithi154.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2024-05-14T01:25:56.189 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.189 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.189 INFO:teuthology.orchestra.run.smithi154.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2024-05-14T01:25:56.189 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.189 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.189 INFO:teuthology.orchestra.run.smithi154.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2024-05-14T01:25:56.189 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.189 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.189 INFO:teuthology.orchestra.run.smithi154.stderr: 653 | chown(path, 0, 0); 2024-05-14T01:25:56.189 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.189 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.189 INFO:teuthology.orchestra.run.smithi154.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2024-05-14T01:25:56.190 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.190 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.190 INFO:teuthology.orchestra.run.smithi154.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2024-05-14T01:25:56.190 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.190 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.190 INFO:teuthology.orchestra.run.smithi154.stderr: 705 | chown(path, 0, 0); 2024-05-14T01:25:56.190 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.190 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.190 INFO:teuthology.orchestra.run.smithi154.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2024-05-14T01:25:56.190 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.193 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c: In function 'test_append': 2024-05-14T01:25:56.193 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.193 INFO:teuthology.orchestra.run.smithi154.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2024-05-14T01:25:56.193 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.193 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.193 INFO:teuthology.orchestra.run.smithi154.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2024-05-14T01:25:56.193 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.193 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.193 INFO:teuthology.orchestra.run.smithi154.stderr: 1051 | chown(path, 0, 0); 2024-05-14T01:25:56.193 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.193 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.193 INFO:teuthology.orchestra.run.smithi154.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2024-05-14T01:25:56.194 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.194 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.194 INFO:teuthology.orchestra.run.smithi154.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2024-05-14T01:25:56.194 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.194 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.194 INFO:teuthology.orchestra.run.smithi154.stderr: 1516 | chown(path, 0, 0); 2024-05-14T01:25:56.194 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.194 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.194 INFO:teuthology.orchestra.run.smithi154.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2024-05-14T01:25:56.194 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.194 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.194 INFO:teuthology.orchestra.run.smithi154.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2024-05-14T01:25:56.194 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.195 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.195 INFO:teuthology.orchestra.run.smithi154.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2024-05-14T01:25:56.195 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.195 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.195 INFO:teuthology.orchestra.run.smithi154.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2024-05-14T01:25:56.195 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.195 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.195 INFO:teuthology.orchestra.run.smithi154.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2024-05-14T01:25:56.195 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.195 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.195 INFO:teuthology.orchestra.run.smithi154.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2024-05-14T01:25:56.195 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.195 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.195 INFO:teuthology.orchestra.run.smithi154.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2024-05-14T01:25:56.196 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.196 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.196 INFO:teuthology.orchestra.run.smithi154.stderr: 1618 | chown(path, 0, 0); 2024-05-14T01:25:56.196 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.196 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.196 INFO:teuthology.orchestra.run.smithi154.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2024-05-14T01:25:56.196 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.196 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.196 INFO:teuthology.orchestra.run.smithi154.stderr: 1644 | chown(path, 0, 0); 2024-05-14T01:25:56.196 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.196 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.196 INFO:teuthology.orchestra.run.smithi154.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2024-05-14T01:25:56.196 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.196 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.196 INFO:teuthology.orchestra.run.smithi154.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2024-05-14T01:25:56.196 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.197 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.197 INFO:teuthology.orchestra.run.smithi154.stderr: 1692 | chown(path, 0, 0); 2024-05-14T01:25:56.197 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.197 INFO:teuthology.orchestra.run.smithi154.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.197 INFO:teuthology.orchestra.run.smithi154.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2024-05-14T01:25:56.197 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.769 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] stale_handle 2024-05-14T01:25:56.899 INFO:teuthology.orchestra.run.smithi154.stderr:stale_handle.c: In function 'main': 2024-05-14T01:25:56.899 INFO:teuthology.orchestra.run.smithi154.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:56.899 INFO:teuthology.orchestra.run.smithi154.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2024-05-14T01:25:56.899 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:56.954 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] pwrite_mmap_blocked 2024-05-14T01:25:57.102 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_dir_offset2 2024-05-14T01:25:57.285 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] seek_sanity_test 2024-05-14T01:25:57.406 INFO:teuthology.orchestra.run.smithi154.stderr:seek_sanity_test.c: In function 'test18': 2024-05-14T01:25:57.407 INFO:teuthology.orchestra.run.smithi154.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:57.407 INFO:teuthology.orchestra.run.smithi154.stderr: 460 | ftruncate(fd, 0); 2024-05-14T01:25:57.407 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~ 2024-05-14T01:25:57.409 INFO:teuthology.orchestra.run.smithi154.stderr:seek_sanity_test.c: In function 'test_basic_support': 2024-05-14T01:25:57.409 INFO:teuthology.orchestra.run.smithi154.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:57.409 INFO:teuthology.orchestra.run.smithi154.stderr: 1207 | ftruncate(fd, 0); 2024-05-14T01:25:57.409 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~ 2024-05-14T01:25:57.409 INFO:teuthology.orchestra.run.smithi154.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:57.409 INFO:teuthology.orchestra.run.smithi154.stderr: 1256 | ftruncate(fd, 0); 2024-05-14T01:25:57.409 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~ 2024-05-14T01:25:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2024-05-14T01:25:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:57.410 INFO:teuthology.orchestra.run.smithi154.stderr: 88 | ftruncate(fd, 0); 2024-05-14T01:25:57.410 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~ 2024-05-14T01:25:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:57.410 INFO:teuthology.orchestra.run.smithi154.stderr: 89 | pwrite(fd, "a", 1, offset); 2024-05-14T01:25:57.411 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:57.411 INFO:teuthology.orchestra.run.smithi154.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:57.411 INFO:teuthology.orchestra.run.smithi154.stderr: 98 | ftruncate(fd, 0); 2024-05-14T01:25:57.411 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~ 2024-05-14T01:25:57.411 INFO:teuthology.orchestra.run.smithi154.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:57.411 INFO:teuthology.orchestra.run.smithi154.stderr: 99 | pwrite(fd, "a", 1, offset); 2024-05-14T01:25:57.411 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:57.745 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] seek_copy_test 2024-05-14T01:25:57.919 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_readdir_1 2024-05-14T01:25:58.026 INFO:teuthology.orchestra.run.smithi154.stderr:t_readdir_1.c: In function 'main': 2024-05-14T01:25:58.026 INFO:teuthology.orchestra.run.smithi154.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:58.026 INFO:teuthology.orchestra.run.smithi154.stderr: 30 | read(fd, buf, 100); 2024-05-14T01:25:58.026 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:58.061 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_readdir_2 2024-05-14T01:25:58.190 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fsync-tester 2024-05-14T01:25:58.284 INFO:teuthology.orchestra.run.smithi154.stderr:fsync-tester.c: In function 'main': 2024-05-14T01:25:58.285 INFO:teuthology.orchestra.run.smithi154.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:58.285 INFO:teuthology.orchestra.run.smithi154.stderr: 391 | read(fd, &seed, sizeof(seed)); 2024-05-14T01:25:58.285 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:58.285 INFO:teuthology.orchestra.run.smithi154.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:58.285 INFO:teuthology.orchestra.run.smithi154.stderr: 541 | system("reboot -fn"); 2024-05-14T01:25:58.285 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:58.285 INFO:teuthology.orchestra.run.smithi154.stderr:fsync-tester.c: In function 'drop_all_caches': 2024-05-14T01:25:58.285 INFO:teuthology.orchestra.run.smithi154.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:58.286 INFO:teuthology.orchestra.run.smithi154.stderr: 90 | write(fd, value, sizeof(value)-1); 2024-05-14T01:25:58.286 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:58.430 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] nsexec 2024-05-14T01:25:58.614 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] cloner 2024-05-14T01:25:58.778 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] renameat2 2024-05-14T01:25:58.931 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_getcwd 2024-05-14T01:25:59.043 INFO:teuthology.orchestra.run.smithi154.stderr:t_getcwd.c: In function 'test_getcwd': 2024-05-14T01:25:59.044 INFO:teuthology.orchestra.run.smithi154.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:25:59.044 INFO:teuthology.orchestra.run.smithi154.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2024-05-14T01:25:59.044 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:25:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] e4compact 2024-05-14T01:25:59.282 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] test-nextquota 2024-05-14T01:25:59.454 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] punch-alternating 2024-05-14T01:25:59.633 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] attr-list-by-handle-cursor-test 2024-05-14T01:25:59.796 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] listxattr 2024-05-14T01:25:59.935 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] dio-interleaved 2024-05-14T01:26:00.097 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_dir_type 2024-05-14T01:26:00.244 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] dio-invalidate-cache 2024-05-14T01:26:00.344 INFO:teuthology.orchestra.run.smithi154.stderr:dio-invalidate-cache.c: In function 'main': 2024-05-14T01:26:00.345 INFO:teuthology.orchestra.run.smithi154.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:26:00.345 INFO:teuthology.orchestra.run.smithi154.stderr: 286 | write(fd, buf, blksz * nr_child); 2024-05-14T01:26:00.345 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:26:00.442 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] stat_test 2024-05-14T01:26:00.759 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_encrypted_d_revalidate 2024-05-14T01:26:00.921 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] attr_replace_test 2024-05-14T01:26:01.075 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] swapon 2024-05-14T01:26:01.231 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] mkswap 2024-05-14T01:26:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_attr_corruption 2024-05-14T01:26:01.524 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_open_tmpfiles 2024-05-14T01:26:01.704 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fscrypt-crypt-util 2024-05-14T01:26:02.385 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] bulkstat_null_ocount 2024-05-14T01:26:02.517 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] splice-test 2024-05-14T01:26:02.693 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] chprojid_fail 2024-05-14T01:26:02.846 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] detached_mounts_propagation 2024-05-14T01:26:03.032 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] ext4_resize 2024-05-14T01:26:03.172 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_readdir_3 2024-05-14T01:26:03.361 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] splice2pipe 2024-05-14T01:26:03.472 INFO:teuthology.orchestra.run.smithi154.stderr:splice2pipe.c: In function 'prepare_pipe': 2024-05-14T01:26:03.472 INFO:teuthology.orchestra.run.smithi154.stderr:splice2pipe.c:57:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:26:03.472 INFO:teuthology.orchestra.run.smithi154.stderr: 57 | write(p[1], buffer, n); 2024-05-14T01:26:03.472 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:26:03.472 INFO:teuthology.orchestra.run.smithi154.stderr:splice2pipe.c:65:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:26:03.473 INFO:teuthology.orchestra.run.smithi154.stderr: 65 | read(p[0], buffer, n); 2024-05-14T01:26:03.473 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:26:03.527 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] uuid_ioctl 2024-05-14T01:26:03.675 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_snapshot_deleted_subvolume 2024-05-14T01:26:03.828 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fiemap-fault 2024-05-14T01:26:03.986 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fiemap-tester 2024-05-14T01:26:04.254 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:26:04.256 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:26:04.260 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_stripealign 2024-05-14T01:26:04.399 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] open_by_handle 2024-05-14T01:26:04.649 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mmap_dio 2024-05-14T01:26:04.813 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] uring_read_fault 2024-05-14T01:26:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] xfsfind 2024-05-14T01:26:05.181 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_reflink_read_race 2024-05-14T01:26:05.377 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fssum 2024-05-14T01:26:05.846 INFO:teuthology.orchestra.run.smithi154.stdout:Building log-writes 2024-05-14T01:26:05.855 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] replay-log 2024-05-14T01:26:06.196 INFO:teuthology.orchestra.run.smithi154.stdout:Building perf 2024-05-14T01:26:06.201 INFO:teuthology.orchestra.run.smithi154.stdout:Building aio-dio-regress 2024-05-14T01:26:06.210 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aiocp 2024-05-14T01:26:06.444 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-append-write-fallocate-race 2024-05-14T01:26:06.617 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-append-write-read-race 2024-05-14T01:26:06.799 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-cow-race 2024-05-14T01:26:06.949 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-cycle-write 2024-05-14T01:26:07.052 INFO:teuthology.orchestra.run.smithi154.stderr:aio-dio-cycle-write.c: In function 'init_test': 2024-05-14T01:26:07.052 INFO:teuthology.orchestra.run.smithi154.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:26:07.053 INFO:teuthology.orchestra.run.smithi154.stderr: 83 | ftruncate(fd, buf_size); 2024-05-14T01:26:07.053 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:26:07.143 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-eof-race 2024-05-14T01:26:07.339 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-extend-stat 2024-05-14T01:26:07.501 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-fcntl-race 2024-05-14T01:26:07.663 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-hole-filling-race 2024-05-14T01:26:07.808 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-invalidate-failure 2024-05-14T01:26:07.966 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-invalidate-readahead 2024-05-14T01:26:08.137 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aiodio_sparse2 2024-05-14T01:26:08.241 INFO:teuthology.orchestra.run.smithi154.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2024-05-14T01:26:08.241 INFO:teuthology.orchestra.run.smithi154.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:26:08.241 INFO:teuthology.orchestra.run.smithi154.stderr: 111 | ftruncate(fd, filesize); 2024-05-14T01:26:08.241 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2024-05-14T01:26:08.241 INFO:teuthology.orchestra.run.smithi154.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2024-05-14T01:26:08.242 INFO:teuthology.orchestra.run.smithi154.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-05-14T01:26:08.242 INFO:teuthology.orchestra.run.smithi154.stderr: 274 | ftruncate(fd, size); 2024-05-14T01:26:08.242 INFO:teuthology.orchestra.run.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-14T01:26:08.365 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-subblock-eof-read 2024-05-14T01:26:08.520 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-write-verify 2024-05-14T01:26:08.731 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-05-14T01:26:08.857 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-05-14T01:26:08.983 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-last-ref-held-by-io 2024-05-14T01:26:09.157 INFO:teuthology.orchestra.run.smithi154.stdout:Building vfs 2024-05-14T01:26:09.162 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] vfstest 2024-05-14T01:26:13.278 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] mount-idmapped 2024-05-14T01:26:13.730 INFO:teuthology.orchestra.run.smithi154.stdout:Building m4 2024-05-14T01:26:13.736 INFO:teuthology.orchestra.run.smithi154.stdout:Building common 2024-05-14T01:26:13.740 INFO:teuthology.orchestra.run.smithi154.stdout:Building tests 2024-05-14T01:26:13.747 INFO:teuthology.orchestra.run.smithi154.stdout:Building btrfs 2024-05-14T01:26:13.753 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/btrfs/group.list 2024-05-14T01:26:13.819 INFO:teuthology.orchestra.run.smithi154.stdout:Building ceph 2024-05-14T01:26:13.825 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/ceph/group.list 2024-05-14T01:26:13.841 INFO:teuthology.orchestra.run.smithi154.stdout:Building cifs 2024-05-14T01:26:13.847 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/cifs/group.list 2024-05-14T01:26:13.860 INFO:teuthology.orchestra.run.smithi154.stdout:Building ext4 2024-05-14T01:26:13.866 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/ext4/group.list 2024-05-14T01:26:13.905 INFO:teuthology.orchestra.run.smithi154.stdout:Building f2fs 2024-05-14T01:26:13.910 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/f2fs/group.list 2024-05-14T01:26:13.928 INFO:teuthology.orchestra.run.smithi154.stdout:Building generic 2024-05-14T01:26:13.935 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/generic/group.list 2024-05-14T01:26:14.039 INFO:teuthology.orchestra.run.smithi154.stdout:Building nfs 2024-05-14T01:26:14.045 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/nfs/group.list 2024-05-14T01:26:14.060 INFO:teuthology.orchestra.run.smithi154.stdout:Building ocfs2 2024-05-14T01:26:14.066 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/ocfs2/group.list 2024-05-14T01:26:14.082 INFO:teuthology.orchestra.run.smithi154.stdout:Building overlay 2024-05-14T01:26:14.087 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/overlay/group.list 2024-05-14T01:26:14.132 INFO:teuthology.orchestra.run.smithi154.stdout:Building perf 2024-05-14T01:26:14.138 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/perf/group.list 2024-05-14T01:26:14.152 INFO:teuthology.orchestra.run.smithi154.stdout:Building selftest 2024-05-14T01:26:14.158 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/selftest/group.list 2024-05-14T01:26:14.172 INFO:teuthology.orchestra.run.smithi154.stdout:Building shared 2024-05-14T01:26:14.179 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/shared/group.list 2024-05-14T01:26:14.198 INFO:teuthology.orchestra.run.smithi154.stdout:Building tmpfs 2024-05-14T01:26:14.203 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/tmpfs/group.list 2024-05-14T01:26:14.217 INFO:teuthology.orchestra.run.smithi154.stdout:Building udf 2024-05-14T01:26:14.223 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/udf/group.list 2024-05-14T01:26:14.234 INFO:teuthology.orchestra.run.smithi154.stdout:Building xfs 2024-05-14T01:26:14.241 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/xfs/group.list 2024-05-14T01:26:14.351 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo make install) 2024-05-14T01:26:14.376 INFO:teuthology.orchestra.run.smithi154.stdout:Building include 2024-05-14T01:26:14.380 INFO:teuthology.orchestra.run.smithi154.stdout:Building lib 2024-05-14T01:26:14.384 INFO:teuthology.orchestra.run.smithi154.stdout:Building ltp 2024-05-14T01:26:14.388 INFO:teuthology.orchestra.run.smithi154.stdout:Building src 2024-05-14T01:26:14.426 INFO:teuthology.orchestra.run.smithi154.stdout:Building log-writes 2024-05-14T01:26:14.429 INFO:teuthology.orchestra.run.smithi154.stdout:Building perf 2024-05-14T01:26:14.433 INFO:teuthology.orchestra.run.smithi154.stdout:Building aio-dio-regress 2024-05-14T01:26:14.437 INFO:teuthology.orchestra.run.smithi154.stdout:Building vfs 2024-05-14T01:26:14.441 INFO:teuthology.orchestra.run.smithi154.stdout:Building m4 2024-05-14T01:26:14.445 INFO:teuthology.orchestra.run.smithi154.stdout:Building common 2024-05-14T01:26:14.448 INFO:teuthology.orchestra.run.smithi154.stdout:Building tests 2024-05-14T01:26:14.454 INFO:teuthology.orchestra.run.smithi154.stdout:Building btrfs 2024-05-14T01:26:14.460 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/btrfs/group.list 2024-05-14T01:26:14.524 INFO:teuthology.orchestra.run.smithi154.stdout:Building ceph 2024-05-14T01:26:14.529 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/ceph/group.list 2024-05-14T01:26:14.545 INFO:teuthology.orchestra.run.smithi154.stdout:Building cifs 2024-05-14T01:26:14.550 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/cifs/group.list 2024-05-14T01:26:14.563 INFO:teuthology.orchestra.run.smithi154.stdout:Building ext4 2024-05-14T01:26:14.569 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/ext4/group.list 2024-05-14T01:26:14.610 INFO:teuthology.orchestra.run.smithi154.stdout:Building f2fs 2024-05-14T01:26:14.615 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/f2fs/group.list 2024-05-14T01:26:14.634 INFO:teuthology.orchestra.run.smithi154.stdout:Building generic 2024-05-14T01:26:14.641 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/generic/group.list 2024-05-14T01:26:14.754 INFO:teuthology.orchestra.run.smithi154.stdout:Building nfs 2024-05-14T01:26:14.760 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/nfs/group.list 2024-05-14T01:26:14.778 INFO:teuthology.orchestra.run.smithi154.stdout:Building ocfs2 2024-05-14T01:26:14.783 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/ocfs2/group.list 2024-05-14T01:26:14.799 INFO:teuthology.orchestra.run.smithi154.stdout:Building overlay 2024-05-14T01:26:14.806 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/overlay/group.list 2024-05-14T01:26:14.848 INFO:teuthology.orchestra.run.smithi154.stdout:Building perf 2024-05-14T01:26:14.853 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/perf/group.list 2024-05-14T01:26:14.865 INFO:teuthology.orchestra.run.smithi154.stdout:Building selftest 2024-05-14T01:26:14.870 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/selftest/group.list 2024-05-14T01:26:14.884 INFO:teuthology.orchestra.run.smithi154.stdout:Building shared 2024-05-14T01:26:14.889 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/shared/group.list 2024-05-14T01:26:14.906 INFO:teuthology.orchestra.run.smithi154.stdout:Building tmpfs 2024-05-14T01:26:14.912 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/tmpfs/group.list 2024-05-14T01:26:14.925 INFO:teuthology.orchestra.run.smithi154.stdout:Building udf 2024-05-14T01:26:14.930 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/udf/group.list 2024-05-14T01:26:14.942 INFO:teuthology.orchestra.run.smithi154.stdout:Building xfs 2024-05-14T01:26:14.948 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/xfs/group.list 2024-05-14T01:26:15.052 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-05-14T01:26:15.055 INFO:teuthology.orchestra.run.smithi154.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-14T01:26:15.055 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-05-14T01:26:15.058 INFO:teuthology.orchestra.run.smithi154.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-14T01:26:15.058 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-05-14T01:26:15.062 INFO:teuthology.orchestra.run.smithi154.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-05-14T01:26:15.073 INFO:teuthology.orchestra.run.smithi154.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-05-14T01:26:15.158 INFO:teuthology.orchestra.run.smithi154.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-05-14T01:26:15.168 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-05-14T01:26:15.188 INFO:teuthology.orchestra.run.smithi154.stdout:Building log-writes 2024-05-14T01:26:15.192 INFO:teuthology.orchestra.run.smithi154.stdout:Building perf 2024-05-14T01:26:15.196 INFO:teuthology.orchestra.run.smithi154.stdout:Building aio-dio-regress 2024-05-14T01:26:15.201 INFO:teuthology.orchestra.run.smithi154.stdout:Building vfs 2024-05-14T01:26:15.204 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake -C log-writes install 2024-05-14T01:26:15.206 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-05-14T01:26:15.216 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-05-14T01:26:15.225 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake -C perf install 2024-05-14T01:26:15.228 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-05-14T01:26:15.237 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-05-14T01:26:15.259 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-05-14T01:26:15.262 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-05-14T01:26:15.272 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-05-14T01:26:15.328 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake -C vfs install 2024-05-14T01:26:15.330 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-05-14T01:26:15.340 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-05-14T01:26:15.356 INFO:teuthology.orchestra.run.smithi154.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-05-14T01:26:15.367 INFO:teuthology.orchestra.run.smithi154.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-fault fiemap-tester t_stripealign open_by_handle t_mmap_dio uring_read_fault xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-05-14T01:26:16.930 INFO:teuthology.orchestra.run.smithi154.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-05-14T01:26:17.058 INFO:teuthology.orchestra.run.smithi154.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-05-14T01:26:17.087 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-05-14T01:26:17.090 INFO:teuthology.orchestra.run.smithi154.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-14T01:26:17.090 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-05-14T01:26:17.092 INFO:teuthology.orchestra.run.smithi154.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-05-14T01:26:17.103 INFO:teuthology.orchestra.run.smithi154.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-05-14T01:26:17.250 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-05-14T01:26:17.252 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/btrfs/ install 2024-05-14T01:26:17.259 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/btrfs/group.list 2024-05-14T01:26:17.326 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-05-14T01:26:17.337 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 313 314 315 316 317 318 320 330 /var/lib/xfstests/tests/btrfs 2024-05-14T01:26:18.314 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-05-14T01:26:18.327 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 313.out 314.out 315.out 316.out 317.out 318.out 320.out 330.out /var/lib/xfstests/tests/btrfs 2024-05-14T01:26:19.387 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/ceph/ install 2024-05-14T01:26:19.391 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/ceph/group.list 2024-05-14T01:26:19.410 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-05-14T01:26:19.421 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-05-14T01:26:19.446 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-05-14T01:26:19.459 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-05-14T01:26:19.483 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/cifs/ install 2024-05-14T01:26:19.487 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/cifs/group.list 2024-05-14T01:26:19.503 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-05-14T01:26:19.515 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-05-14T01:26:19.527 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-05-14T01:26:19.539 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-05-14T01:26:19.551 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/ext4/ install 2024-05-14T01:26:19.555 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/ext4/group.list 2024-05-14T01:26:19.604 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-05-14T01:26:19.615 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-05-14T01:26:19.839 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-05-14T01:26:19.850 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-05-14T01:26:20.085 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/f2fs/ install 2024-05-14T01:26:20.089 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/f2fs/group.list 2024-05-14T01:26:20.112 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-05-14T01:26:20.124 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-05-14T01:26:20.140 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-05-14T01:26:20.152 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-05-14T01:26:20.168 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/generic/ install 2024-05-14T01:26:20.173 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/generic/group.list 2024-05-14T01:26:20.293 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-05-14T01:26:20.304 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 741 742 743 744 /var/lib/xfstests/tests/generic 2024-05-14T01:26:22.736 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-05-14T01:26:22.747 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 741.out 742.out 743.out 744.out /var/lib/xfstests/tests/generic 2024-05-14T01:26:25.188 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/nfs/ install 2024-05-14T01:26:25.192 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/nfs/group.list 2024-05-14T01:26:25.211 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-05-14T01:26:25.223 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-05-14T01:26:25.235 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-05-14T01:26:25.246 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-05-14T01:26:25.259 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/ocfs2/ install 2024-05-14T01:26:25.263 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/ocfs2/group.list 2024-05-14T01:26:25.279 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-05-14T01:26:25.291 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-05-14T01:26:25.303 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-05-14T01:26:25.315 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-05-14T01:26:25.327 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/overlay/ install 2024-05-14T01:26:25.331 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/overlay/group.list 2024-05-14T01:26:25.383 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-05-14T01:26:25.396 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-05-14T01:26:25.725 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-05-14T01:26:25.737 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-05-14T01:26:26.073 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/perf/ install 2024-05-14T01:26:26.076 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/perf/group.list 2024-05-14T01:26:26.091 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-05-14T01:26:26.103 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-05-14T01:26:26.115 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-05-14T01:26:26.126 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-05-14T01:26:26.139 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/selftest/ install 2024-05-14T01:26:26.142 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/selftest/group.list 2024-05-14T01:26:26.158 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-05-14T01:26:26.170 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-05-14T01:26:26.198 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-05-14T01:26:26.210 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-05-14T01:26:26.237 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/shared/ install 2024-05-14T01:26:26.241 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/shared/group.list 2024-05-14T01:26:26.262 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-05-14T01:26:26.274 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-05-14T01:26:26.293 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-05-14T01:26:26.306 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-05-14T01:26:26.324 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/tmpfs/ install 2024-05-14T01:26:26.329 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/tmpfs/group.list 2024-05-14T01:26:26.346 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-05-14T01:26:26.357 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-05-14T01:26:26.369 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-05-14T01:26:26.380 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-05-14T01:26:26.391 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/udf/ install 2024-05-14T01:26:26.395 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/udf/group.list 2024-05-14T01:26:26.408 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-05-14T01:26:26.418 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-05-14T01:26:26.429 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-05-14T01:26:26.440 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-05-14T01:26:26.451 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/xfs/ install 2024-05-14T01:26:26.455 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.E8tkN6FrZCxfstests-dev/tests/xfs/group.list 2024-05-14T01:26:26.579 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-05-14T01:26:26.591 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 612 613 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-05-14T01:26:28.862 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-05-14T01:26:28.874 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 612.out 613.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-05-14T01:26:31.171 INFO:teuthology.orchestra.run.smithi154.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-05-14T01:26:31.183 INFO:teuthology.orchestra.run.smithi154.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-05-14T01:26:31.194 INFO:teuthology.orchestra.run.smithi154.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-05-14T01:26:31.206 INFO:teuthology.orchestra.run.smithi154.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-05-14T01:26:31.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T01:26:31.220 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec ls tests/generic) 2024-05-14T01:26:31.268 INFO:teuthology.orchestra.run.smithi154.stdout:001 2024-05-14T01:26:31.268 INFO:teuthology.orchestra.run.smithi154.stdout:001.out 2024-05-14T01:26:31.268 INFO:teuthology.orchestra.run.smithi154.stdout:002 2024-05-14T01:26:31.268 INFO:teuthology.orchestra.run.smithi154.stdout:002.out 2024-05-14T01:26:31.268 INFO:teuthology.orchestra.run.smithi154.stdout:003 2024-05-14T01:26:31.269 INFO:teuthology.orchestra.run.smithi154.stdout:003.out 2024-05-14T01:26:31.269 INFO:teuthology.orchestra.run.smithi154.stdout:004 2024-05-14T01:26:31.269 INFO:teuthology.orchestra.run.smithi154.stdout:004.out 2024-05-14T01:26:31.269 INFO:teuthology.orchestra.run.smithi154.stdout:005 2024-05-14T01:26:31.269 INFO:teuthology.orchestra.run.smithi154.stdout:005.out 2024-05-14T01:26:31.269 INFO:teuthology.orchestra.run.smithi154.stdout:006 2024-05-14T01:26:31.269 INFO:teuthology.orchestra.run.smithi154.stdout:006.out 2024-05-14T01:26:31.269 INFO:teuthology.orchestra.run.smithi154.stdout:007 2024-05-14T01:26:31.269 INFO:teuthology.orchestra.run.smithi154.stdout:007.out 2024-05-14T01:26:31.269 INFO:teuthology.orchestra.run.smithi154.stdout:008 2024-05-14T01:26:31.269 INFO:teuthology.orchestra.run.smithi154.stdout:008.out 2024-05-14T01:26:31.269 INFO:teuthology.orchestra.run.smithi154.stdout:009 2024-05-14T01:26:31.269 INFO:teuthology.orchestra.run.smithi154.stdout:009.out 2024-05-14T01:26:31.270 INFO:teuthology.orchestra.run.smithi154.stdout:010 2024-05-14T01:26:31.270 INFO:teuthology.orchestra.run.smithi154.stdout:010.out 2024-05-14T01:26:31.270 INFO:teuthology.orchestra.run.smithi154.stdout:011 2024-05-14T01:26:31.270 INFO:teuthology.orchestra.run.smithi154.stdout:011.out 2024-05-14T01:26:31.270 INFO:teuthology.orchestra.run.smithi154.stdout:012 2024-05-14T01:26:31.270 INFO:teuthology.orchestra.run.smithi154.stdout:012.out 2024-05-14T01:26:31.270 INFO:teuthology.orchestra.run.smithi154.stdout:013 2024-05-14T01:26:31.270 INFO:teuthology.orchestra.run.smithi154.stdout:013.out 2024-05-14T01:26:31.270 INFO:teuthology.orchestra.run.smithi154.stdout:014 2024-05-14T01:26:31.270 INFO:teuthology.orchestra.run.smithi154.stdout:014.out 2024-05-14T01:26:31.270 INFO:teuthology.orchestra.run.smithi154.stdout:015 2024-05-14T01:26:31.270 INFO:teuthology.orchestra.run.smithi154.stdout:015.out 2024-05-14T01:26:31.270 INFO:teuthology.orchestra.run.smithi154.stdout:016 2024-05-14T01:26:31.270 INFO:teuthology.orchestra.run.smithi154.stdout:016.out 2024-05-14T01:26:31.271 INFO:teuthology.orchestra.run.smithi154.stdout:017 2024-05-14T01:26:31.271 INFO:teuthology.orchestra.run.smithi154.stdout:017.out 2024-05-14T01:26:31.271 INFO:teuthology.orchestra.run.smithi154.stdout:018 2024-05-14T01:26:31.271 INFO:teuthology.orchestra.run.smithi154.stdout:018.out 2024-05-14T01:26:31.271 INFO:teuthology.orchestra.run.smithi154.stdout:019 2024-05-14T01:26:31.271 INFO:teuthology.orchestra.run.smithi154.stdout:019.out 2024-05-14T01:26:31.271 INFO:teuthology.orchestra.run.smithi154.stdout:020 2024-05-14T01:26:31.271 INFO:teuthology.orchestra.run.smithi154.stdout:020.out 2024-05-14T01:26:31.271 INFO:teuthology.orchestra.run.smithi154.stdout:021 2024-05-14T01:26:31.271 INFO:teuthology.orchestra.run.smithi154.stdout:021.out 2024-05-14T01:26:31.271 INFO:teuthology.orchestra.run.smithi154.stdout:022 2024-05-14T01:26:31.271 INFO:teuthology.orchestra.run.smithi154.stdout:022.out 2024-05-14T01:26:31.271 INFO:teuthology.orchestra.run.smithi154.stdout:023 2024-05-14T01:26:31.271 INFO:teuthology.orchestra.run.smithi154.stdout:023.out 2024-05-14T01:26:31.272 INFO:teuthology.orchestra.run.smithi154.stdout:024 2024-05-14T01:26:31.272 INFO:teuthology.orchestra.run.smithi154.stdout:024.out 2024-05-14T01:26:31.272 INFO:teuthology.orchestra.run.smithi154.stdout:025 2024-05-14T01:26:31.272 INFO:teuthology.orchestra.run.smithi154.stdout:025.out 2024-05-14T01:26:31.272 INFO:teuthology.orchestra.run.smithi154.stdout:026 2024-05-14T01:26:31.272 INFO:teuthology.orchestra.run.smithi154.stdout:026.out 2024-05-14T01:26:31.272 INFO:teuthology.orchestra.run.smithi154.stdout:027 2024-05-14T01:26:31.272 INFO:teuthology.orchestra.run.smithi154.stdout:027.out 2024-05-14T01:26:31.272 INFO:teuthology.orchestra.run.smithi154.stdout:028 2024-05-14T01:26:31.272 INFO:teuthology.orchestra.run.smithi154.stdout:028.out 2024-05-14T01:26:31.272 INFO:teuthology.orchestra.run.smithi154.stdout:029 2024-05-14T01:26:31.272 INFO:teuthology.orchestra.run.smithi154.stdout:029.out 2024-05-14T01:26:31.272 INFO:teuthology.orchestra.run.smithi154.stdout:030 2024-05-14T01:26:31.272 INFO:teuthology.orchestra.run.smithi154.stdout:030.out 2024-05-14T01:26:31.273 INFO:teuthology.orchestra.run.smithi154.stdout:031 2024-05-14T01:26:31.273 INFO:teuthology.orchestra.run.smithi154.stdout:031.out 2024-05-14T01:26:31.273 INFO:teuthology.orchestra.run.smithi154.stdout:032 2024-05-14T01:26:31.273 INFO:teuthology.orchestra.run.smithi154.stdout:032.out 2024-05-14T01:26:31.273 INFO:teuthology.orchestra.run.smithi154.stdout:033 2024-05-14T01:26:31.273 INFO:teuthology.orchestra.run.smithi154.stdout:033.out 2024-05-14T01:26:31.273 INFO:teuthology.orchestra.run.smithi154.stdout:034 2024-05-14T01:26:31.273 INFO:teuthology.orchestra.run.smithi154.stdout:034.out 2024-05-14T01:26:31.273 INFO:teuthology.orchestra.run.smithi154.stdout:035 2024-05-14T01:26:31.273 INFO:teuthology.orchestra.run.smithi154.stdout:035.cfg 2024-05-14T01:26:31.273 INFO:teuthology.orchestra.run.smithi154.stdout:035.out.default 2024-05-14T01:26:31.273 INFO:teuthology.orchestra.run.smithi154.stdout:035.out.nfs 2024-05-14T01:26:31.274 INFO:teuthology.orchestra.run.smithi154.stdout:036 2024-05-14T01:26:31.274 INFO:teuthology.orchestra.run.smithi154.stdout:036.out 2024-05-14T01:26:31.274 INFO:teuthology.orchestra.run.smithi154.stdout:037 2024-05-14T01:26:31.274 INFO:teuthology.orchestra.run.smithi154.stdout:037.out 2024-05-14T01:26:31.274 INFO:teuthology.orchestra.run.smithi154.stdout:038 2024-05-14T01:26:31.274 INFO:teuthology.orchestra.run.smithi154.stdout:038.out 2024-05-14T01:26:31.274 INFO:teuthology.orchestra.run.smithi154.stdout:039 2024-05-14T01:26:31.274 INFO:teuthology.orchestra.run.smithi154.stdout:039.out 2024-05-14T01:26:31.274 INFO:teuthology.orchestra.run.smithi154.stdout:040 2024-05-14T01:26:31.274 INFO:teuthology.orchestra.run.smithi154.stdout:040.out 2024-05-14T01:26:31.274 INFO:teuthology.orchestra.run.smithi154.stdout:041 2024-05-14T01:26:31.274 INFO:teuthology.orchestra.run.smithi154.stdout:041.out 2024-05-14T01:26:31.274 INFO:teuthology.orchestra.run.smithi154.stdout:042 2024-05-14T01:26:31.275 INFO:teuthology.orchestra.run.smithi154.stdout:042.out 2024-05-14T01:26:31.275 INFO:teuthology.orchestra.run.smithi154.stdout:043 2024-05-14T01:26:31.275 INFO:teuthology.orchestra.run.smithi154.stdout:043.out 2024-05-14T01:26:31.275 INFO:teuthology.orchestra.run.smithi154.stdout:044 2024-05-14T01:26:31.275 INFO:teuthology.orchestra.run.smithi154.stdout:044.out 2024-05-14T01:26:31.275 INFO:teuthology.orchestra.run.smithi154.stdout:045 2024-05-14T01:26:31.275 INFO:teuthology.orchestra.run.smithi154.stdout:045.out 2024-05-14T01:26:31.275 INFO:teuthology.orchestra.run.smithi154.stdout:046 2024-05-14T01:26:31.275 INFO:teuthology.orchestra.run.smithi154.stdout:046.out 2024-05-14T01:26:31.276 INFO:teuthology.orchestra.run.smithi154.stdout:047 2024-05-14T01:26:31.276 INFO:teuthology.orchestra.run.smithi154.stdout:047.out 2024-05-14T01:26:31.276 INFO:teuthology.orchestra.run.smithi154.stdout:048 2024-05-14T01:26:31.276 INFO:teuthology.orchestra.run.smithi154.stdout:048.out 2024-05-14T01:26:31.276 INFO:teuthology.orchestra.run.smithi154.stdout:049 2024-05-14T01:26:31.276 INFO:teuthology.orchestra.run.smithi154.stdout:049.out 2024-05-14T01:26:31.276 INFO:teuthology.orchestra.run.smithi154.stdout:050 2024-05-14T01:26:31.276 INFO:teuthology.orchestra.run.smithi154.stdout:050.cfg 2024-05-14T01:26:31.276 INFO:teuthology.orchestra.run.smithi154.stdout:050.out.default 2024-05-14T01:26:31.276 INFO:teuthology.orchestra.run.smithi154.stdout:050.out.nojournal 2024-05-14T01:26:31.276 INFO:teuthology.orchestra.run.smithi154.stdout:050.out.xfsquota 2024-05-14T01:26:31.276 INFO:teuthology.orchestra.run.smithi154.stdout:051 2024-05-14T01:26:31.276 INFO:teuthology.orchestra.run.smithi154.stdout:051.out 2024-05-14T01:26:31.276 INFO:teuthology.orchestra.run.smithi154.stdout:052 2024-05-14T01:26:31.277 INFO:teuthology.orchestra.run.smithi154.stdout:052.out 2024-05-14T01:26:31.277 INFO:teuthology.orchestra.run.smithi154.stdout:053 2024-05-14T01:26:31.277 INFO:teuthology.orchestra.run.smithi154.stdout:053.out 2024-05-14T01:26:31.277 INFO:teuthology.orchestra.run.smithi154.stdout:054 2024-05-14T01:26:31.277 INFO:teuthology.orchestra.run.smithi154.stdout:054.out 2024-05-14T01:26:31.277 INFO:teuthology.orchestra.run.smithi154.stdout:055 2024-05-14T01:26:31.277 INFO:teuthology.orchestra.run.smithi154.stdout:055.out 2024-05-14T01:26:31.277 INFO:teuthology.orchestra.run.smithi154.stdout:056 2024-05-14T01:26:31.277 INFO:teuthology.orchestra.run.smithi154.stdout:056.out 2024-05-14T01:26:31.277 INFO:teuthology.orchestra.run.smithi154.stdout:057 2024-05-14T01:26:31.277 INFO:teuthology.orchestra.run.smithi154.stdout:057.out 2024-05-14T01:26:31.277 INFO:teuthology.orchestra.run.smithi154.stdout:058 2024-05-14T01:26:31.277 INFO:teuthology.orchestra.run.smithi154.stdout:058.out 2024-05-14T01:26:31.277 INFO:teuthology.orchestra.run.smithi154.stdout:059 2024-05-14T01:26:31.278 INFO:teuthology.orchestra.run.smithi154.stdout:059.out 2024-05-14T01:26:31.278 INFO:teuthology.orchestra.run.smithi154.stdout:060 2024-05-14T01:26:31.278 INFO:teuthology.orchestra.run.smithi154.stdout:060.out 2024-05-14T01:26:31.278 INFO:teuthology.orchestra.run.smithi154.stdout:061 2024-05-14T01:26:31.278 INFO:teuthology.orchestra.run.smithi154.stdout:061.out 2024-05-14T01:26:31.278 INFO:teuthology.orchestra.run.smithi154.stdout:062 2024-05-14T01:26:31.278 INFO:teuthology.orchestra.run.smithi154.stdout:062.out 2024-05-14T01:26:31.278 INFO:teuthology.orchestra.run.smithi154.stdout:063 2024-05-14T01:26:31.278 INFO:teuthology.orchestra.run.smithi154.stdout:063.out 2024-05-14T01:26:31.278 INFO:teuthology.orchestra.run.smithi154.stdout:064 2024-05-14T01:26:31.278 INFO:teuthology.orchestra.run.smithi154.stdout:064.out 2024-05-14T01:26:31.278 INFO:teuthology.orchestra.run.smithi154.stdout:065 2024-05-14T01:26:31.278 INFO:teuthology.orchestra.run.smithi154.stdout:065.out 2024-05-14T01:26:31.279 INFO:teuthology.orchestra.run.smithi154.stdout:066 2024-05-14T01:26:31.279 INFO:teuthology.orchestra.run.smithi154.stdout:066.out 2024-05-14T01:26:31.279 INFO:teuthology.orchestra.run.smithi154.stdout:067 2024-05-14T01:26:31.279 INFO:teuthology.orchestra.run.smithi154.stdout:067.out 2024-05-14T01:26:31.279 INFO:teuthology.orchestra.run.smithi154.stdout:068 2024-05-14T01:26:31.279 INFO:teuthology.orchestra.run.smithi154.stdout:068.out 2024-05-14T01:26:31.279 INFO:teuthology.orchestra.run.smithi154.stdout:069 2024-05-14T01:26:31.279 INFO:teuthology.orchestra.run.smithi154.stdout:069.out 2024-05-14T01:26:31.279 INFO:teuthology.orchestra.run.smithi154.stdout:070 2024-05-14T01:26:31.279 INFO:teuthology.orchestra.run.smithi154.stdout:070.out 2024-05-14T01:26:31.280 INFO:teuthology.orchestra.run.smithi154.stdout:071 2024-05-14T01:26:31.280 INFO:teuthology.orchestra.run.smithi154.stdout:071.out 2024-05-14T01:26:31.280 INFO:teuthology.orchestra.run.smithi154.stdout:072 2024-05-14T01:26:31.280 INFO:teuthology.orchestra.run.smithi154.stdout:072.out 2024-05-14T01:26:31.280 INFO:teuthology.orchestra.run.smithi154.stdout:073 2024-05-14T01:26:31.280 INFO:teuthology.orchestra.run.smithi154.stdout:073.out 2024-05-14T01:26:31.280 INFO:teuthology.orchestra.run.smithi154.stdout:074 2024-05-14T01:26:31.280 INFO:teuthology.orchestra.run.smithi154.stdout:074.out 2024-05-14T01:26:31.280 INFO:teuthology.orchestra.run.smithi154.stdout:075 2024-05-14T01:26:31.280 INFO:teuthology.orchestra.run.smithi154.stdout:075.out 2024-05-14T01:26:31.280 INFO:teuthology.orchestra.run.smithi154.stdout:076 2024-05-14T01:26:31.280 INFO:teuthology.orchestra.run.smithi154.stdout:076.out 2024-05-14T01:26:31.280 INFO:teuthology.orchestra.run.smithi154.stdout:077 2024-05-14T01:26:31.280 INFO:teuthology.orchestra.run.smithi154.stdout:077.out 2024-05-14T01:26:31.281 INFO:teuthology.orchestra.run.smithi154.stdout:078 2024-05-14T01:26:31.281 INFO:teuthology.orchestra.run.smithi154.stdout:078.out 2024-05-14T01:26:31.281 INFO:teuthology.orchestra.run.smithi154.stdout:079 2024-05-14T01:26:31.281 INFO:teuthology.orchestra.run.smithi154.stdout:079.out 2024-05-14T01:26:31.281 INFO:teuthology.orchestra.run.smithi154.stdout:080 2024-05-14T01:26:31.281 INFO:teuthology.orchestra.run.smithi154.stdout:080.out 2024-05-14T01:26:31.281 INFO:teuthology.orchestra.run.smithi154.stdout:081 2024-05-14T01:26:31.281 INFO:teuthology.orchestra.run.smithi154.stdout:081.out 2024-05-14T01:26:31.281 INFO:teuthology.orchestra.run.smithi154.stdout:082 2024-05-14T01:26:31.281 INFO:teuthology.orchestra.run.smithi154.stdout:082.out 2024-05-14T01:26:31.281 INFO:teuthology.orchestra.run.smithi154.stdout:083 2024-05-14T01:26:31.281 INFO:teuthology.orchestra.run.smithi154.stdout:083.out 2024-05-14T01:26:31.281 INFO:teuthology.orchestra.run.smithi154.stdout:084 2024-05-14T01:26:31.282 INFO:teuthology.orchestra.run.smithi154.stdout:084.out 2024-05-14T01:26:31.282 INFO:teuthology.orchestra.run.smithi154.stdout:085 2024-05-14T01:26:31.282 INFO:teuthology.orchestra.run.smithi154.stdout:085.out 2024-05-14T01:26:31.282 INFO:teuthology.orchestra.run.smithi154.stdout:086 2024-05-14T01:26:31.282 INFO:teuthology.orchestra.run.smithi154.stdout:086.out 2024-05-14T01:26:31.282 INFO:teuthology.orchestra.run.smithi154.stdout:087 2024-05-14T01:26:31.282 INFO:teuthology.orchestra.run.smithi154.stdout:087.out 2024-05-14T01:26:31.282 INFO:teuthology.orchestra.run.smithi154.stdout:088 2024-05-14T01:26:31.282 INFO:teuthology.orchestra.run.smithi154.stdout:088.out 2024-05-14T01:26:31.282 INFO:teuthology.orchestra.run.smithi154.stdout:089 2024-05-14T01:26:31.282 INFO:teuthology.orchestra.run.smithi154.stdout:089.out 2024-05-14T01:26:31.282 INFO:teuthology.orchestra.run.smithi154.stdout:090 2024-05-14T01:26:31.282 INFO:teuthology.orchestra.run.smithi154.stdout:090.out 2024-05-14T01:26:31.282 INFO:teuthology.orchestra.run.smithi154.stdout:091 2024-05-14T01:26:31.283 INFO:teuthology.orchestra.run.smithi154.stdout:091.out 2024-05-14T01:26:31.283 INFO:teuthology.orchestra.run.smithi154.stdout:092 2024-05-14T01:26:31.283 INFO:teuthology.orchestra.run.smithi154.stdout:092.out 2024-05-14T01:26:31.283 INFO:teuthology.orchestra.run.smithi154.stdout:093 2024-05-14T01:26:31.283 INFO:teuthology.orchestra.run.smithi154.stdout:093.out 2024-05-14T01:26:31.283 INFO:teuthology.orchestra.run.smithi154.stdout:094 2024-05-14T01:26:31.283 INFO:teuthology.orchestra.run.smithi154.stdout:094.out 2024-05-14T01:26:31.283 INFO:teuthology.orchestra.run.smithi154.stdout:095 2024-05-14T01:26:31.283 INFO:teuthology.orchestra.run.smithi154.stdout:095.out 2024-05-14T01:26:31.283 INFO:teuthology.orchestra.run.smithi154.stdout:096 2024-05-14T01:26:31.283 INFO:teuthology.orchestra.run.smithi154.stdout:096.out 2024-05-14T01:26:31.283 INFO:teuthology.orchestra.run.smithi154.stdout:097 2024-05-14T01:26:31.283 INFO:teuthology.orchestra.run.smithi154.stdout:097.out 2024-05-14T01:26:31.283 INFO:teuthology.orchestra.run.smithi154.stdout:098 2024-05-14T01:26:31.284 INFO:teuthology.orchestra.run.smithi154.stdout:098.out 2024-05-14T01:26:31.284 INFO:teuthology.orchestra.run.smithi154.stdout:099 2024-05-14T01:26:31.284 INFO:teuthology.orchestra.run.smithi154.stdout:099.out 2024-05-14T01:26:31.284 INFO:teuthology.orchestra.run.smithi154.stdout:100 2024-05-14T01:26:31.284 INFO:teuthology.orchestra.run.smithi154.stdout:100.out 2024-05-14T01:26:31.284 INFO:teuthology.orchestra.run.smithi154.stdout:101 2024-05-14T01:26:31.284 INFO:teuthology.orchestra.run.smithi154.stdout:101.out 2024-05-14T01:26:31.284 INFO:teuthology.orchestra.run.smithi154.stdout:102 2024-05-14T01:26:31.284 INFO:teuthology.orchestra.run.smithi154.stdout:102.out 2024-05-14T01:26:31.284 INFO:teuthology.orchestra.run.smithi154.stdout:103 2024-05-14T01:26:31.284 INFO:teuthology.orchestra.run.smithi154.stdout:103.out 2024-05-14T01:26:31.285 INFO:teuthology.orchestra.run.smithi154.stdout:104 2024-05-14T01:26:31.285 INFO:teuthology.orchestra.run.smithi154.stdout:104.out 2024-05-14T01:26:31.285 INFO:teuthology.orchestra.run.smithi154.stdout:105 2024-05-14T01:26:31.285 INFO:teuthology.orchestra.run.smithi154.stdout:105.out 2024-05-14T01:26:31.285 INFO:teuthology.orchestra.run.smithi154.stdout:106 2024-05-14T01:26:31.285 INFO:teuthology.orchestra.run.smithi154.stdout:106.out 2024-05-14T01:26:31.285 INFO:teuthology.orchestra.run.smithi154.stdout:107 2024-05-14T01:26:31.285 INFO:teuthology.orchestra.run.smithi154.stdout:107.out 2024-05-14T01:26:31.286 INFO:teuthology.orchestra.run.smithi154.stdout:108 2024-05-14T01:26:31.286 INFO:teuthology.orchestra.run.smithi154.stdout:108.out 2024-05-14T01:26:31.286 INFO:teuthology.orchestra.run.smithi154.stdout:109 2024-05-14T01:26:31.286 INFO:teuthology.orchestra.run.smithi154.stdout:109.out 2024-05-14T01:26:31.286 INFO:teuthology.orchestra.run.smithi154.stdout:110 2024-05-14T01:26:31.286 INFO:teuthology.orchestra.run.smithi154.stdout:110.out 2024-05-14T01:26:31.286 INFO:teuthology.orchestra.run.smithi154.stdout:111 2024-05-14T01:26:31.286 INFO:teuthology.orchestra.run.smithi154.stdout:111.out 2024-05-14T01:26:31.286 INFO:teuthology.orchestra.run.smithi154.stdout:112 2024-05-14T01:26:31.286 INFO:teuthology.orchestra.run.smithi154.stdout:112.out 2024-05-14T01:26:31.287 INFO:teuthology.orchestra.run.smithi154.stdout:113 2024-05-14T01:26:31.287 INFO:teuthology.orchestra.run.smithi154.stdout:113.out 2024-05-14T01:26:31.287 INFO:teuthology.orchestra.run.smithi154.stdout:114 2024-05-14T01:26:31.287 INFO:teuthology.orchestra.run.smithi154.stdout:114.out 2024-05-14T01:26:31.287 INFO:teuthology.orchestra.run.smithi154.stdout:115 2024-05-14T01:26:31.287 INFO:teuthology.orchestra.run.smithi154.stdout:115.out 2024-05-14T01:26:31.287 INFO:teuthology.orchestra.run.smithi154.stdout:116 2024-05-14T01:26:31.287 INFO:teuthology.orchestra.run.smithi154.stdout:116.out 2024-05-14T01:26:31.288 INFO:teuthology.orchestra.run.smithi154.stdout:117 2024-05-14T01:26:31.288 INFO:teuthology.orchestra.run.smithi154.stdout:117.out 2024-05-14T01:26:31.288 INFO:teuthology.orchestra.run.smithi154.stdout:118 2024-05-14T01:26:31.288 INFO:teuthology.orchestra.run.smithi154.stdout:118.out 2024-05-14T01:26:31.288 INFO:teuthology.orchestra.run.smithi154.stdout:119 2024-05-14T01:26:31.288 INFO:teuthology.orchestra.run.smithi154.stdout:119.out 2024-05-14T01:26:31.288 INFO:teuthology.orchestra.run.smithi154.stdout:120 2024-05-14T01:26:31.288 INFO:teuthology.orchestra.run.smithi154.stdout:120.out 2024-05-14T01:26:31.288 INFO:teuthology.orchestra.run.smithi154.stdout:121 2024-05-14T01:26:31.288 INFO:teuthology.orchestra.run.smithi154.stdout:121.out 2024-05-14T01:26:31.288 INFO:teuthology.orchestra.run.smithi154.stdout:122 2024-05-14T01:26:31.289 INFO:teuthology.orchestra.run.smithi154.stdout:122.out 2024-05-14T01:26:31.289 INFO:teuthology.orchestra.run.smithi154.stdout:123 2024-05-14T01:26:31.289 INFO:teuthology.orchestra.run.smithi154.stdout:123.out 2024-05-14T01:26:31.289 INFO:teuthology.orchestra.run.smithi154.stdout:124 2024-05-14T01:26:31.289 INFO:teuthology.orchestra.run.smithi154.stdout:124.out 2024-05-14T01:26:31.289 INFO:teuthology.orchestra.run.smithi154.stdout:125 2024-05-14T01:26:31.289 INFO:teuthology.orchestra.run.smithi154.stdout:125.out 2024-05-14T01:26:31.289 INFO:teuthology.orchestra.run.smithi154.stdout:126 2024-05-14T01:26:31.289 INFO:teuthology.orchestra.run.smithi154.stdout:126.out 2024-05-14T01:26:31.289 INFO:teuthology.orchestra.run.smithi154.stdout:127 2024-05-14T01:26:31.289 INFO:teuthology.orchestra.run.smithi154.stdout:127.out 2024-05-14T01:26:31.290 INFO:teuthology.orchestra.run.smithi154.stdout:128 2024-05-14T01:26:31.290 INFO:teuthology.orchestra.run.smithi154.stdout:128.out 2024-05-14T01:26:31.290 INFO:teuthology.orchestra.run.smithi154.stdout:129 2024-05-14T01:26:31.290 INFO:teuthology.orchestra.run.smithi154.stdout:129.out 2024-05-14T01:26:31.290 INFO:teuthology.orchestra.run.smithi154.stdout:130 2024-05-14T01:26:31.290 INFO:teuthology.orchestra.run.smithi154.stdout:130.out 2024-05-14T01:26:31.290 INFO:teuthology.orchestra.run.smithi154.stdout:131 2024-05-14T01:26:31.290 INFO:teuthology.orchestra.run.smithi154.stdout:131.out 2024-05-14T01:26:31.290 INFO:teuthology.orchestra.run.smithi154.stdout:132 2024-05-14T01:26:31.290 INFO:teuthology.orchestra.run.smithi154.stdout:132.out 2024-05-14T01:26:31.290 INFO:teuthology.orchestra.run.smithi154.stdout:133 2024-05-14T01:26:31.291 INFO:teuthology.orchestra.run.smithi154.stdout:133.out 2024-05-14T01:26:31.291 INFO:teuthology.orchestra.run.smithi154.stdout:134 2024-05-14T01:26:31.291 INFO:teuthology.orchestra.run.smithi154.stdout:134.out 2024-05-14T01:26:31.291 INFO:teuthology.orchestra.run.smithi154.stdout:135 2024-05-14T01:26:31.291 INFO:teuthology.orchestra.run.smithi154.stdout:135.out 2024-05-14T01:26:31.291 INFO:teuthology.orchestra.run.smithi154.stdout:136 2024-05-14T01:26:31.291 INFO:teuthology.orchestra.run.smithi154.stdout:136.out 2024-05-14T01:26:31.291 INFO:teuthology.orchestra.run.smithi154.stdout:137 2024-05-14T01:26:31.291 INFO:teuthology.orchestra.run.smithi154.stdout:137.out 2024-05-14T01:26:31.291 INFO:teuthology.orchestra.run.smithi154.stdout:138 2024-05-14T01:26:31.291 INFO:teuthology.orchestra.run.smithi154.stdout:138.out 2024-05-14T01:26:31.292 INFO:teuthology.orchestra.run.smithi154.stdout:139 2024-05-14T01:26:31.292 INFO:teuthology.orchestra.run.smithi154.stdout:139.out 2024-05-14T01:26:31.292 INFO:teuthology.orchestra.run.smithi154.stdout:140 2024-05-14T01:26:31.292 INFO:teuthology.orchestra.run.smithi154.stdout:140.out 2024-05-14T01:26:31.292 INFO:teuthology.orchestra.run.smithi154.stdout:141 2024-05-14T01:26:31.292 INFO:teuthology.orchestra.run.smithi154.stdout:141.out 2024-05-14T01:26:31.292 INFO:teuthology.orchestra.run.smithi154.stdout:142 2024-05-14T01:26:31.292 INFO:teuthology.orchestra.run.smithi154.stdout:142.out 2024-05-14T01:26:31.292 INFO:teuthology.orchestra.run.smithi154.stdout:143 2024-05-14T01:26:31.292 INFO:teuthology.orchestra.run.smithi154.stdout:143.out 2024-05-14T01:26:31.293 INFO:teuthology.orchestra.run.smithi154.stdout:144 2024-05-14T01:26:31.293 INFO:teuthology.orchestra.run.smithi154.stdout:144.out 2024-05-14T01:26:31.293 INFO:teuthology.orchestra.run.smithi154.stdout:145 2024-05-14T01:26:31.293 INFO:teuthology.orchestra.run.smithi154.stdout:145.out 2024-05-14T01:26:31.293 INFO:teuthology.orchestra.run.smithi154.stdout:146 2024-05-14T01:26:31.293 INFO:teuthology.orchestra.run.smithi154.stdout:146.out 2024-05-14T01:26:31.293 INFO:teuthology.orchestra.run.smithi154.stdout:147 2024-05-14T01:26:31.293 INFO:teuthology.orchestra.run.smithi154.stdout:147.out 2024-05-14T01:26:31.293 INFO:teuthology.orchestra.run.smithi154.stdout:148 2024-05-14T01:26:31.293 INFO:teuthology.orchestra.run.smithi154.stdout:148.out 2024-05-14T01:26:31.293 INFO:teuthology.orchestra.run.smithi154.stdout:149 2024-05-14T01:26:31.294 INFO:teuthology.orchestra.run.smithi154.stdout:149.out 2024-05-14T01:26:31.294 INFO:teuthology.orchestra.run.smithi154.stdout:150 2024-05-14T01:26:31.294 INFO:teuthology.orchestra.run.smithi154.stdout:150.out 2024-05-14T01:26:31.294 INFO:teuthology.orchestra.run.smithi154.stdout:151 2024-05-14T01:26:31.294 INFO:teuthology.orchestra.run.smithi154.stdout:151.out 2024-05-14T01:26:31.294 INFO:teuthology.orchestra.run.smithi154.stdout:152 2024-05-14T01:26:31.294 INFO:teuthology.orchestra.run.smithi154.stdout:152.out 2024-05-14T01:26:31.294 INFO:teuthology.orchestra.run.smithi154.stdout:153 2024-05-14T01:26:31.294 INFO:teuthology.orchestra.run.smithi154.stdout:153.out 2024-05-14T01:26:31.294 INFO:teuthology.orchestra.run.smithi154.stdout:154 2024-05-14T01:26:31.295 INFO:teuthology.orchestra.run.smithi154.stdout:154.out 2024-05-14T01:26:31.295 INFO:teuthology.orchestra.run.smithi154.stdout:155 2024-05-14T01:26:31.295 INFO:teuthology.orchestra.run.smithi154.stdout:155.out 2024-05-14T01:26:31.295 INFO:teuthology.orchestra.run.smithi154.stdout:156 2024-05-14T01:26:31.295 INFO:teuthology.orchestra.run.smithi154.stdout:156.out 2024-05-14T01:26:31.295 INFO:teuthology.orchestra.run.smithi154.stdout:157 2024-05-14T01:26:31.295 INFO:teuthology.orchestra.run.smithi154.stdout:157.out 2024-05-14T01:26:31.295 INFO:teuthology.orchestra.run.smithi154.stdout:158 2024-05-14T01:26:31.295 INFO:teuthology.orchestra.run.smithi154.stdout:158.out 2024-05-14T01:26:31.296 INFO:teuthology.orchestra.run.smithi154.stdout:159 2024-05-14T01:26:31.296 INFO:teuthology.orchestra.run.smithi154.stdout:159.out 2024-05-14T01:26:31.296 INFO:teuthology.orchestra.run.smithi154.stdout:160 2024-05-14T01:26:31.296 INFO:teuthology.orchestra.run.smithi154.stdout:160.out 2024-05-14T01:26:31.296 INFO:teuthology.orchestra.run.smithi154.stdout:161 2024-05-14T01:26:31.296 INFO:teuthology.orchestra.run.smithi154.stdout:161.out 2024-05-14T01:26:31.296 INFO:teuthology.orchestra.run.smithi154.stdout:162 2024-05-14T01:26:31.296 INFO:teuthology.orchestra.run.smithi154.stdout:162.out 2024-05-14T01:26:31.296 INFO:teuthology.orchestra.run.smithi154.stdout:163 2024-05-14T01:26:31.296 INFO:teuthology.orchestra.run.smithi154.stdout:163.out 2024-05-14T01:26:31.296 INFO:teuthology.orchestra.run.smithi154.stdout:164 2024-05-14T01:26:31.296 INFO:teuthology.orchestra.run.smithi154.stdout:164.out 2024-05-14T01:26:31.296 INFO:teuthology.orchestra.run.smithi154.stdout:165 2024-05-14T01:26:31.297 INFO:teuthology.orchestra.run.smithi154.stdout:165.out 2024-05-14T01:26:31.297 INFO:teuthology.orchestra.run.smithi154.stdout:166 2024-05-14T01:26:31.297 INFO:teuthology.orchestra.run.smithi154.stdout:166.out 2024-05-14T01:26:31.297 INFO:teuthology.orchestra.run.smithi154.stdout:167 2024-05-14T01:26:31.297 INFO:teuthology.orchestra.run.smithi154.stdout:167.out 2024-05-14T01:26:31.297 INFO:teuthology.orchestra.run.smithi154.stdout:168 2024-05-14T01:26:31.297 INFO:teuthology.orchestra.run.smithi154.stdout:168.out 2024-05-14T01:26:31.297 INFO:teuthology.orchestra.run.smithi154.stdout:169 2024-05-14T01:26:31.297 INFO:teuthology.orchestra.run.smithi154.stdout:169.out 2024-05-14T01:26:31.297 INFO:teuthology.orchestra.run.smithi154.stdout:170 2024-05-14T01:26:31.297 INFO:teuthology.orchestra.run.smithi154.stdout:170.out 2024-05-14T01:26:31.297 INFO:teuthology.orchestra.run.smithi154.stdout:171 2024-05-14T01:26:31.297 INFO:teuthology.orchestra.run.smithi154.stdout:171.out 2024-05-14T01:26:31.297 INFO:teuthology.orchestra.run.smithi154.stdout:172 2024-05-14T01:26:31.297 INFO:teuthology.orchestra.run.smithi154.stdout:172.out 2024-05-14T01:26:31.298 INFO:teuthology.orchestra.run.smithi154.stdout:173 2024-05-14T01:26:31.298 INFO:teuthology.orchestra.run.smithi154.stdout:173.out 2024-05-14T01:26:31.298 INFO:teuthology.orchestra.run.smithi154.stdout:174 2024-05-14T01:26:31.298 INFO:teuthology.orchestra.run.smithi154.stdout:174.out 2024-05-14T01:26:31.298 INFO:teuthology.orchestra.run.smithi154.stdout:175 2024-05-14T01:26:31.298 INFO:teuthology.orchestra.run.smithi154.stdout:175.out 2024-05-14T01:26:31.298 INFO:teuthology.orchestra.run.smithi154.stdout:176 2024-05-14T01:26:31.298 INFO:teuthology.orchestra.run.smithi154.stdout:176.out 2024-05-14T01:26:31.298 INFO:teuthology.orchestra.run.smithi154.stdout:177 2024-05-14T01:26:31.298 INFO:teuthology.orchestra.run.smithi154.stdout:177.out 2024-05-14T01:26:31.298 INFO:teuthology.orchestra.run.smithi154.stdout:178 2024-05-14T01:26:31.298 INFO:teuthology.orchestra.run.smithi154.stdout:178.out 2024-05-14T01:26:31.298 INFO:teuthology.orchestra.run.smithi154.stdout:179 2024-05-14T01:26:31.299 INFO:teuthology.orchestra.run.smithi154.stdout:179.out 2024-05-14T01:26:31.299 INFO:teuthology.orchestra.run.smithi154.stdout:180 2024-05-14T01:26:31.299 INFO:teuthology.orchestra.run.smithi154.stdout:180.out 2024-05-14T01:26:31.299 INFO:teuthology.orchestra.run.smithi154.stdout:181 2024-05-14T01:26:31.299 INFO:teuthology.orchestra.run.smithi154.stdout:181.out 2024-05-14T01:26:31.299 INFO:teuthology.orchestra.run.smithi154.stdout:182 2024-05-14T01:26:31.299 INFO:teuthology.orchestra.run.smithi154.stdout:182.out 2024-05-14T01:26:31.299 INFO:teuthology.orchestra.run.smithi154.stdout:183 2024-05-14T01:26:31.299 INFO:teuthology.orchestra.run.smithi154.stdout:183.out 2024-05-14T01:26:31.299 INFO:teuthology.orchestra.run.smithi154.stdout:184 2024-05-14T01:26:31.299 INFO:teuthology.orchestra.run.smithi154.stdout:184.out 2024-05-14T01:26:31.299 INFO:teuthology.orchestra.run.smithi154.stdout:185 2024-05-14T01:26:31.299 INFO:teuthology.orchestra.run.smithi154.stdout:185.out 2024-05-14T01:26:31.299 INFO:teuthology.orchestra.run.smithi154.stdout:186 2024-05-14T01:26:31.300 INFO:teuthology.orchestra.run.smithi154.stdout:186.out 2024-05-14T01:26:31.300 INFO:teuthology.orchestra.run.smithi154.stdout:187 2024-05-14T01:26:31.300 INFO:teuthology.orchestra.run.smithi154.stdout:187.out 2024-05-14T01:26:31.300 INFO:teuthology.orchestra.run.smithi154.stdout:188 2024-05-14T01:26:31.300 INFO:teuthology.orchestra.run.smithi154.stdout:188.out 2024-05-14T01:26:31.300 INFO:teuthology.orchestra.run.smithi154.stdout:189 2024-05-14T01:26:31.300 INFO:teuthology.orchestra.run.smithi154.stdout:189.out 2024-05-14T01:26:31.300 INFO:teuthology.orchestra.run.smithi154.stdout:190 2024-05-14T01:26:31.300 INFO:teuthology.orchestra.run.smithi154.stdout:190.out 2024-05-14T01:26:31.300 INFO:teuthology.orchestra.run.smithi154.stdout:191 2024-05-14T01:26:31.300 INFO:teuthology.orchestra.run.smithi154.stdout:191.out 2024-05-14T01:26:31.300 INFO:teuthology.orchestra.run.smithi154.stdout:192 2024-05-14T01:26:31.300 INFO:teuthology.orchestra.run.smithi154.stdout:192.out 2024-05-14T01:26:31.300 INFO:teuthology.orchestra.run.smithi154.stdout:193 2024-05-14T01:26:31.301 INFO:teuthology.orchestra.run.smithi154.stdout:193.out 2024-05-14T01:26:31.301 INFO:teuthology.orchestra.run.smithi154.stdout:194 2024-05-14T01:26:31.301 INFO:teuthology.orchestra.run.smithi154.stdout:194.out 2024-05-14T01:26:31.301 INFO:teuthology.orchestra.run.smithi154.stdout:195 2024-05-14T01:26:31.301 INFO:teuthology.orchestra.run.smithi154.stdout:195.out 2024-05-14T01:26:31.301 INFO:teuthology.orchestra.run.smithi154.stdout:196 2024-05-14T01:26:31.301 INFO:teuthology.orchestra.run.smithi154.stdout:196.out 2024-05-14T01:26:31.301 INFO:teuthology.orchestra.run.smithi154.stdout:197 2024-05-14T01:26:31.301 INFO:teuthology.orchestra.run.smithi154.stdout:197.out 2024-05-14T01:26:31.301 INFO:teuthology.orchestra.run.smithi154.stdout:198 2024-05-14T01:26:31.301 INFO:teuthology.orchestra.run.smithi154.stdout:198.out 2024-05-14T01:26:31.301 INFO:teuthology.orchestra.run.smithi154.stdout:199 2024-05-14T01:26:31.301 INFO:teuthology.orchestra.run.smithi154.stdout:199.out 2024-05-14T01:26:31.301 INFO:teuthology.orchestra.run.smithi154.stdout:200 2024-05-14T01:26:31.301 INFO:teuthology.orchestra.run.smithi154.stdout:200.out 2024-05-14T01:26:31.302 INFO:teuthology.orchestra.run.smithi154.stdout:201 2024-05-14T01:26:31.302 INFO:teuthology.orchestra.run.smithi154.stdout:201.out 2024-05-14T01:26:31.302 INFO:teuthology.orchestra.run.smithi154.stdout:202 2024-05-14T01:26:31.302 INFO:teuthology.orchestra.run.smithi154.stdout:202.out 2024-05-14T01:26:31.302 INFO:teuthology.orchestra.run.smithi154.stdout:203 2024-05-14T01:26:31.302 INFO:teuthology.orchestra.run.smithi154.stdout:203.out 2024-05-14T01:26:31.302 INFO:teuthology.orchestra.run.smithi154.stdout:204 2024-05-14T01:26:31.302 INFO:teuthology.orchestra.run.smithi154.stdout:204.out 2024-05-14T01:26:31.302 INFO:teuthology.orchestra.run.smithi154.stdout:205 2024-05-14T01:26:31.302 INFO:teuthology.orchestra.run.smithi154.stdout:205.out 2024-05-14T01:26:31.302 INFO:teuthology.orchestra.run.smithi154.stdout:206 2024-05-14T01:26:31.302 INFO:teuthology.orchestra.run.smithi154.stdout:206.out 2024-05-14T01:26:31.302 INFO:teuthology.orchestra.run.smithi154.stdout:207 2024-05-14T01:26:31.303 INFO:teuthology.orchestra.run.smithi154.stdout:207.out 2024-05-14T01:26:31.303 INFO:teuthology.orchestra.run.smithi154.stdout:208 2024-05-14T01:26:31.303 INFO:teuthology.orchestra.run.smithi154.stdout:208.out 2024-05-14T01:26:31.303 INFO:teuthology.orchestra.run.smithi154.stdout:209 2024-05-14T01:26:31.303 INFO:teuthology.orchestra.run.smithi154.stdout:209.out 2024-05-14T01:26:31.303 INFO:teuthology.orchestra.run.smithi154.stdout:210 2024-05-14T01:26:31.303 INFO:teuthology.orchestra.run.smithi154.stdout:210.out 2024-05-14T01:26:31.303 INFO:teuthology.orchestra.run.smithi154.stdout:211 2024-05-14T01:26:31.303 INFO:teuthology.orchestra.run.smithi154.stdout:211.out 2024-05-14T01:26:31.303 INFO:teuthology.orchestra.run.smithi154.stdout:212 2024-05-14T01:26:31.303 INFO:teuthology.orchestra.run.smithi154.stdout:212.out 2024-05-14T01:26:31.303 INFO:teuthology.orchestra.run.smithi154.stdout:213 2024-05-14T01:26:31.303 INFO:teuthology.orchestra.run.smithi154.stdout:213.out 2024-05-14T01:26:31.304 INFO:teuthology.orchestra.run.smithi154.stdout:214 2024-05-14T01:26:31.304 INFO:teuthology.orchestra.run.smithi154.stdout:214.out 2024-05-14T01:26:31.304 INFO:teuthology.orchestra.run.smithi154.stdout:215 2024-05-14T01:26:31.304 INFO:teuthology.orchestra.run.smithi154.stdout:215.out 2024-05-14T01:26:31.304 INFO:teuthology.orchestra.run.smithi154.stdout:216 2024-05-14T01:26:31.304 INFO:teuthology.orchestra.run.smithi154.stdout:216.out 2024-05-14T01:26:31.304 INFO:teuthology.orchestra.run.smithi154.stdout:217 2024-05-14T01:26:31.304 INFO:teuthology.orchestra.run.smithi154.stdout:217.out 2024-05-14T01:26:31.304 INFO:teuthology.orchestra.run.smithi154.stdout:218 2024-05-14T01:26:31.304 INFO:teuthology.orchestra.run.smithi154.stdout:218.out 2024-05-14T01:26:31.304 INFO:teuthology.orchestra.run.smithi154.stdout:219 2024-05-14T01:26:31.305 INFO:teuthology.orchestra.run.smithi154.stdout:219.out 2024-05-14T01:26:31.305 INFO:teuthology.orchestra.run.smithi154.stdout:220 2024-05-14T01:26:31.305 INFO:teuthology.orchestra.run.smithi154.stdout:220.out 2024-05-14T01:26:31.305 INFO:teuthology.orchestra.run.smithi154.stdout:221 2024-05-14T01:26:31.305 INFO:teuthology.orchestra.run.smithi154.stdout:221.out 2024-05-14T01:26:31.305 INFO:teuthology.orchestra.run.smithi154.stdout:222 2024-05-14T01:26:31.305 INFO:teuthology.orchestra.run.smithi154.stdout:222.out 2024-05-14T01:26:31.305 INFO:teuthology.orchestra.run.smithi154.stdout:223 2024-05-14T01:26:31.305 INFO:teuthology.orchestra.run.smithi154.stdout:223.out 2024-05-14T01:26:31.305 INFO:teuthology.orchestra.run.smithi154.stdout:224 2024-05-14T01:26:31.305 INFO:teuthology.orchestra.run.smithi154.stdout:224.out 2024-05-14T01:26:31.306 INFO:teuthology.orchestra.run.smithi154.stdout:225 2024-05-14T01:26:31.306 INFO:teuthology.orchestra.run.smithi154.stdout:225.out 2024-05-14T01:26:31.306 INFO:teuthology.orchestra.run.smithi154.stdout:226 2024-05-14T01:26:31.306 INFO:teuthology.orchestra.run.smithi154.stdout:226.out 2024-05-14T01:26:31.306 INFO:teuthology.orchestra.run.smithi154.stdout:227 2024-05-14T01:26:31.306 INFO:teuthology.orchestra.run.smithi154.stdout:227.out 2024-05-14T01:26:31.307 INFO:teuthology.orchestra.run.smithi154.stdout:228 2024-05-14T01:26:31.307 INFO:teuthology.orchestra.run.smithi154.stdout:228.out 2024-05-14T01:26:31.307 INFO:teuthology.orchestra.run.smithi154.stdout:229 2024-05-14T01:26:31.307 INFO:teuthology.orchestra.run.smithi154.stdout:229.out 2024-05-14T01:26:31.307 INFO:teuthology.orchestra.run.smithi154.stdout:230 2024-05-14T01:26:31.307 INFO:teuthology.orchestra.run.smithi154.stdout:230.out 2024-05-14T01:26:31.307 INFO:teuthology.orchestra.run.smithi154.stdout:231 2024-05-14T01:26:31.307 INFO:teuthology.orchestra.run.smithi154.stdout:231.out 2024-05-14T01:26:31.307 INFO:teuthology.orchestra.run.smithi154.stdout:232 2024-05-14T01:26:31.307 INFO:teuthology.orchestra.run.smithi154.stdout:232.out 2024-05-14T01:26:31.307 INFO:teuthology.orchestra.run.smithi154.stdout:233 2024-05-14T01:26:31.307 INFO:teuthology.orchestra.run.smithi154.stdout:233.out 2024-05-14T01:26:31.307 INFO:teuthology.orchestra.run.smithi154.stdout:234 2024-05-14T01:26:31.307 INFO:teuthology.orchestra.run.smithi154.stdout:234.out 2024-05-14T01:26:31.308 INFO:teuthology.orchestra.run.smithi154.stdout:235 2024-05-14T01:26:31.308 INFO:teuthology.orchestra.run.smithi154.stdout:235.out 2024-05-14T01:26:31.308 INFO:teuthology.orchestra.run.smithi154.stdout:236 2024-05-14T01:26:31.308 INFO:teuthology.orchestra.run.smithi154.stdout:236.out 2024-05-14T01:26:31.308 INFO:teuthology.orchestra.run.smithi154.stdout:237 2024-05-14T01:26:31.308 INFO:teuthology.orchestra.run.smithi154.stdout:237.out 2024-05-14T01:26:31.308 INFO:teuthology.orchestra.run.smithi154.stdout:238 2024-05-14T01:26:31.308 INFO:teuthology.orchestra.run.smithi154.stdout:238.out 2024-05-14T01:26:31.308 INFO:teuthology.orchestra.run.smithi154.stdout:239 2024-05-14T01:26:31.308 INFO:teuthology.orchestra.run.smithi154.stdout:239.out 2024-05-14T01:26:31.308 INFO:teuthology.orchestra.run.smithi154.stdout:240 2024-05-14T01:26:31.308 INFO:teuthology.orchestra.run.smithi154.stdout:240.out 2024-05-14T01:26:31.308 INFO:teuthology.orchestra.run.smithi154.stdout:241 2024-05-14T01:26:31.308 INFO:teuthology.orchestra.run.smithi154.stdout:241.out 2024-05-14T01:26:31.308 INFO:teuthology.orchestra.run.smithi154.stdout:242 2024-05-14T01:26:31.309 INFO:teuthology.orchestra.run.smithi154.stdout:242.out 2024-05-14T01:26:31.309 INFO:teuthology.orchestra.run.smithi154.stdout:243 2024-05-14T01:26:31.309 INFO:teuthology.orchestra.run.smithi154.stdout:243.out 2024-05-14T01:26:31.309 INFO:teuthology.orchestra.run.smithi154.stdout:244 2024-05-14T01:26:31.309 INFO:teuthology.orchestra.run.smithi154.stdout:244.out 2024-05-14T01:26:31.309 INFO:teuthology.orchestra.run.smithi154.stdout:245 2024-05-14T01:26:31.309 INFO:teuthology.orchestra.run.smithi154.stdout:245.out 2024-05-14T01:26:31.309 INFO:teuthology.orchestra.run.smithi154.stdout:246 2024-05-14T01:26:31.309 INFO:teuthology.orchestra.run.smithi154.stdout:246.out 2024-05-14T01:26:31.309 INFO:teuthology.orchestra.run.smithi154.stdout:247 2024-05-14T01:26:31.309 INFO:teuthology.orchestra.run.smithi154.stdout:247.out 2024-05-14T01:26:31.309 INFO:teuthology.orchestra.run.smithi154.stdout:248 2024-05-14T01:26:31.310 INFO:teuthology.orchestra.run.smithi154.stdout:248.out 2024-05-14T01:26:31.310 INFO:teuthology.orchestra.run.smithi154.stdout:249 2024-05-14T01:26:31.310 INFO:teuthology.orchestra.run.smithi154.stdout:249.out 2024-05-14T01:26:31.310 INFO:teuthology.orchestra.run.smithi154.stdout:250 2024-05-14T01:26:31.310 INFO:teuthology.orchestra.run.smithi154.stdout:250.out 2024-05-14T01:26:31.310 INFO:teuthology.orchestra.run.smithi154.stdout:251 2024-05-14T01:26:31.310 INFO:teuthology.orchestra.run.smithi154.stdout:251.out 2024-05-14T01:26:31.310 INFO:teuthology.orchestra.run.smithi154.stdout:252 2024-05-14T01:26:31.310 INFO:teuthology.orchestra.run.smithi154.stdout:252.out 2024-05-14T01:26:31.310 INFO:teuthology.orchestra.run.smithi154.stdout:253 2024-05-14T01:26:31.310 INFO:teuthology.orchestra.run.smithi154.stdout:253.out 2024-05-14T01:26:31.310 INFO:teuthology.orchestra.run.smithi154.stdout:254 2024-05-14T01:26:31.310 INFO:teuthology.orchestra.run.smithi154.stdout:254.out 2024-05-14T01:26:31.311 INFO:teuthology.orchestra.run.smithi154.stdout:255 2024-05-14T01:26:31.311 INFO:teuthology.orchestra.run.smithi154.stdout:255.out 2024-05-14T01:26:31.311 INFO:teuthology.orchestra.run.smithi154.stdout:256 2024-05-14T01:26:31.311 INFO:teuthology.orchestra.run.smithi154.stdout:256.out 2024-05-14T01:26:31.311 INFO:teuthology.orchestra.run.smithi154.stdout:257 2024-05-14T01:26:31.311 INFO:teuthology.orchestra.run.smithi154.stdout:257.out 2024-05-14T01:26:31.311 INFO:teuthology.orchestra.run.smithi154.stdout:258 2024-05-14T01:26:31.311 INFO:teuthology.orchestra.run.smithi154.stdout:258.out 2024-05-14T01:26:31.311 INFO:teuthology.orchestra.run.smithi154.stdout:259 2024-05-14T01:26:31.311 INFO:teuthology.orchestra.run.smithi154.stdout:259.out 2024-05-14T01:26:31.311 INFO:teuthology.orchestra.run.smithi154.stdout:260 2024-05-14T01:26:31.311 INFO:teuthology.orchestra.run.smithi154.stdout:260.out 2024-05-14T01:26:31.312 INFO:teuthology.orchestra.run.smithi154.stdout:261 2024-05-14T01:26:31.312 INFO:teuthology.orchestra.run.smithi154.stdout:261.out 2024-05-14T01:26:31.312 INFO:teuthology.orchestra.run.smithi154.stdout:262 2024-05-14T01:26:31.312 INFO:teuthology.orchestra.run.smithi154.stdout:262.out 2024-05-14T01:26:31.312 INFO:teuthology.orchestra.run.smithi154.stdout:263 2024-05-14T01:26:31.312 INFO:teuthology.orchestra.run.smithi154.stdout:263.out 2024-05-14T01:26:31.312 INFO:teuthology.orchestra.run.smithi154.stdout:264 2024-05-14T01:26:31.312 INFO:teuthology.orchestra.run.smithi154.stdout:264.out 2024-05-14T01:26:31.312 INFO:teuthology.orchestra.run.smithi154.stdout:265 2024-05-14T01:26:31.312 INFO:teuthology.orchestra.run.smithi154.stdout:265.out 2024-05-14T01:26:31.312 INFO:teuthology.orchestra.run.smithi154.stdout:266 2024-05-14T01:26:31.312 INFO:teuthology.orchestra.run.smithi154.stdout:266.out 2024-05-14T01:26:31.313 INFO:teuthology.orchestra.run.smithi154.stdout:267 2024-05-14T01:26:31.313 INFO:teuthology.orchestra.run.smithi154.stdout:267.out 2024-05-14T01:26:31.313 INFO:teuthology.orchestra.run.smithi154.stdout:268 2024-05-14T01:26:31.313 INFO:teuthology.orchestra.run.smithi154.stdout:268.out 2024-05-14T01:26:31.313 INFO:teuthology.orchestra.run.smithi154.stdout:269 2024-05-14T01:26:31.313 INFO:teuthology.orchestra.run.smithi154.stdout:269.out 2024-05-14T01:26:31.313 INFO:teuthology.orchestra.run.smithi154.stdout:270 2024-05-14T01:26:31.313 INFO:teuthology.orchestra.run.smithi154.stdout:270.out 2024-05-14T01:26:31.313 INFO:teuthology.orchestra.run.smithi154.stdout:271 2024-05-14T01:26:31.313 INFO:teuthology.orchestra.run.smithi154.stdout:271.out 2024-05-14T01:26:31.313 INFO:teuthology.orchestra.run.smithi154.stdout:272 2024-05-14T01:26:31.313 INFO:teuthology.orchestra.run.smithi154.stdout:272.out 2024-05-14T01:26:31.313 INFO:teuthology.orchestra.run.smithi154.stdout:273 2024-05-14T01:26:31.313 INFO:teuthology.orchestra.run.smithi154.stdout:273.out 2024-05-14T01:26:31.314 INFO:teuthology.orchestra.run.smithi154.stdout:274 2024-05-14T01:26:31.314 INFO:teuthology.orchestra.run.smithi154.stdout:274.out 2024-05-14T01:26:31.314 INFO:teuthology.orchestra.run.smithi154.stdout:275 2024-05-14T01:26:31.314 INFO:teuthology.orchestra.run.smithi154.stdout:275.out 2024-05-14T01:26:31.314 INFO:teuthology.orchestra.run.smithi154.stdout:276 2024-05-14T01:26:31.314 INFO:teuthology.orchestra.run.smithi154.stdout:276.out 2024-05-14T01:26:31.314 INFO:teuthology.orchestra.run.smithi154.stdout:277 2024-05-14T01:26:31.314 INFO:teuthology.orchestra.run.smithi154.stdout:277.out 2024-05-14T01:26:31.314 INFO:teuthology.orchestra.run.smithi154.stdout:278 2024-05-14T01:26:31.314 INFO:teuthology.orchestra.run.smithi154.stdout:278.out 2024-05-14T01:26:31.314 INFO:teuthology.orchestra.run.smithi154.stdout:279 2024-05-14T01:26:31.314 INFO:teuthology.orchestra.run.smithi154.stdout:279.out 2024-05-14T01:26:31.314 INFO:teuthology.orchestra.run.smithi154.stdout:280 2024-05-14T01:26:31.315 INFO:teuthology.orchestra.run.smithi154.stdout:280.out 2024-05-14T01:26:31.315 INFO:teuthology.orchestra.run.smithi154.stdout:281 2024-05-14T01:26:31.315 INFO:teuthology.orchestra.run.smithi154.stdout:281.out 2024-05-14T01:26:31.315 INFO:teuthology.orchestra.run.smithi154.stdout:282 2024-05-14T01:26:31.315 INFO:teuthology.orchestra.run.smithi154.stdout:282.out 2024-05-14T01:26:31.315 INFO:teuthology.orchestra.run.smithi154.stdout:283 2024-05-14T01:26:31.315 INFO:teuthology.orchestra.run.smithi154.stdout:283.out 2024-05-14T01:26:31.315 INFO:teuthology.orchestra.run.smithi154.stdout:284 2024-05-14T01:26:31.315 INFO:teuthology.orchestra.run.smithi154.stdout:284.out 2024-05-14T01:26:31.315 INFO:teuthology.orchestra.run.smithi154.stdout:285 2024-05-14T01:26:31.315 INFO:teuthology.orchestra.run.smithi154.stdout:285.out 2024-05-14T01:26:31.316 INFO:teuthology.orchestra.run.smithi154.stdout:286 2024-05-14T01:26:31.316 INFO:teuthology.orchestra.run.smithi154.stdout:286.out 2024-05-14T01:26:31.316 INFO:teuthology.orchestra.run.smithi154.stdout:287 2024-05-14T01:26:31.316 INFO:teuthology.orchestra.run.smithi154.stdout:287.out 2024-05-14T01:26:31.316 INFO:teuthology.orchestra.run.smithi154.stdout:288 2024-05-14T01:26:31.316 INFO:teuthology.orchestra.run.smithi154.stdout:288.out 2024-05-14T01:26:31.316 INFO:teuthology.orchestra.run.smithi154.stdout:289 2024-05-14T01:26:31.316 INFO:teuthology.orchestra.run.smithi154.stdout:289.out 2024-05-14T01:26:31.317 INFO:teuthology.orchestra.run.smithi154.stdout:290 2024-05-14T01:26:31.317 INFO:teuthology.orchestra.run.smithi154.stdout:290.out 2024-05-14T01:26:31.317 INFO:teuthology.orchestra.run.smithi154.stdout:291 2024-05-14T01:26:31.317 INFO:teuthology.orchestra.run.smithi154.stdout:291.out 2024-05-14T01:26:31.317 INFO:teuthology.orchestra.run.smithi154.stdout:292 2024-05-14T01:26:31.317 INFO:teuthology.orchestra.run.smithi154.stdout:292.out 2024-05-14T01:26:31.317 INFO:teuthology.orchestra.run.smithi154.stdout:293 2024-05-14T01:26:31.317 INFO:teuthology.orchestra.run.smithi154.stdout:293.out 2024-05-14T01:26:31.317 INFO:teuthology.orchestra.run.smithi154.stdout:294 2024-05-14T01:26:31.317 INFO:teuthology.orchestra.run.smithi154.stdout:294.out 2024-05-14T01:26:31.317 INFO:teuthology.orchestra.run.smithi154.stdout:295 2024-05-14T01:26:31.317 INFO:teuthology.orchestra.run.smithi154.stdout:295.out 2024-05-14T01:26:31.318 INFO:teuthology.orchestra.run.smithi154.stdout:296 2024-05-14T01:26:31.318 INFO:teuthology.orchestra.run.smithi154.stdout:296.out 2024-05-14T01:26:31.318 INFO:teuthology.orchestra.run.smithi154.stdout:297 2024-05-14T01:26:31.318 INFO:teuthology.orchestra.run.smithi154.stdout:297.out 2024-05-14T01:26:31.318 INFO:teuthology.orchestra.run.smithi154.stdout:298 2024-05-14T01:26:31.318 INFO:teuthology.orchestra.run.smithi154.stdout:298.out 2024-05-14T01:26:31.318 INFO:teuthology.orchestra.run.smithi154.stdout:299 2024-05-14T01:26:31.318 INFO:teuthology.orchestra.run.smithi154.stdout:299.out 2024-05-14T01:26:31.319 INFO:teuthology.orchestra.run.smithi154.stdout:300 2024-05-14T01:26:31.319 INFO:teuthology.orchestra.run.smithi154.stdout:300.out 2024-05-14T01:26:31.319 INFO:teuthology.orchestra.run.smithi154.stdout:301 2024-05-14T01:26:31.319 INFO:teuthology.orchestra.run.smithi154.stdout:301.out 2024-05-14T01:26:31.319 INFO:teuthology.orchestra.run.smithi154.stdout:302 2024-05-14T01:26:31.319 INFO:teuthology.orchestra.run.smithi154.stdout:302.out 2024-05-14T01:26:31.319 INFO:teuthology.orchestra.run.smithi154.stdout:303 2024-05-14T01:26:31.319 INFO:teuthology.orchestra.run.smithi154.stdout:303.out 2024-05-14T01:26:31.319 INFO:teuthology.orchestra.run.smithi154.stdout:304 2024-05-14T01:26:31.319 INFO:teuthology.orchestra.run.smithi154.stdout:304.out 2024-05-14T01:26:31.319 INFO:teuthology.orchestra.run.smithi154.stdout:305 2024-05-14T01:26:31.319 INFO:teuthology.orchestra.run.smithi154.stdout:305.out 2024-05-14T01:26:31.319 INFO:teuthology.orchestra.run.smithi154.stdout:306 2024-05-14T01:26:31.319 INFO:teuthology.orchestra.run.smithi154.stdout:306.out 2024-05-14T01:26:31.320 INFO:teuthology.orchestra.run.smithi154.stdout:307 2024-05-14T01:26:31.320 INFO:teuthology.orchestra.run.smithi154.stdout:307.out 2024-05-14T01:26:31.320 INFO:teuthology.orchestra.run.smithi154.stdout:308 2024-05-14T01:26:31.320 INFO:teuthology.orchestra.run.smithi154.stdout:308.out 2024-05-14T01:26:31.320 INFO:teuthology.orchestra.run.smithi154.stdout:309 2024-05-14T01:26:31.320 INFO:teuthology.orchestra.run.smithi154.stdout:309.out 2024-05-14T01:26:31.320 INFO:teuthology.orchestra.run.smithi154.stdout:310 2024-05-14T01:26:31.320 INFO:teuthology.orchestra.run.smithi154.stdout:310.out 2024-05-14T01:26:31.320 INFO:teuthology.orchestra.run.smithi154.stdout:311 2024-05-14T01:26:31.320 INFO:teuthology.orchestra.run.smithi154.stdout:311.out 2024-05-14T01:26:31.320 INFO:teuthology.orchestra.run.smithi154.stdout:312 2024-05-14T01:26:31.320 INFO:teuthology.orchestra.run.smithi154.stdout:312.out 2024-05-14T01:26:31.320 INFO:teuthology.orchestra.run.smithi154.stdout:313 2024-05-14T01:26:31.320 INFO:teuthology.orchestra.run.smithi154.stdout:313.out 2024-05-14T01:26:31.321 INFO:teuthology.orchestra.run.smithi154.stdout:314 2024-05-14T01:26:31.321 INFO:teuthology.orchestra.run.smithi154.stdout:314.out 2024-05-14T01:26:31.321 INFO:teuthology.orchestra.run.smithi154.stdout:315 2024-05-14T01:26:31.321 INFO:teuthology.orchestra.run.smithi154.stdout:315.out 2024-05-14T01:26:31.321 INFO:teuthology.orchestra.run.smithi154.stdout:316 2024-05-14T01:26:31.321 INFO:teuthology.orchestra.run.smithi154.stdout:316.out 2024-05-14T01:26:31.321 INFO:teuthology.orchestra.run.smithi154.stdout:317 2024-05-14T01:26:31.321 INFO:teuthology.orchestra.run.smithi154.stdout:317.out 2024-05-14T01:26:31.321 INFO:teuthology.orchestra.run.smithi154.stdout:318 2024-05-14T01:26:31.321 INFO:teuthology.orchestra.run.smithi154.stdout:318.out 2024-05-14T01:26:31.321 INFO:teuthology.orchestra.run.smithi154.stdout:319 2024-05-14T01:26:31.321 INFO:teuthology.orchestra.run.smithi154.stdout:319.out 2024-05-14T01:26:31.321 INFO:teuthology.orchestra.run.smithi154.stdout:320 2024-05-14T01:26:31.321 INFO:teuthology.orchestra.run.smithi154.stdout:320.out 2024-05-14T01:26:31.322 INFO:teuthology.orchestra.run.smithi154.stdout:321 2024-05-14T01:26:31.322 INFO:teuthology.orchestra.run.smithi154.stdout:321.out 2024-05-14T01:26:31.322 INFO:teuthology.orchestra.run.smithi154.stdout:322 2024-05-14T01:26:31.322 INFO:teuthology.orchestra.run.smithi154.stdout:322.out 2024-05-14T01:26:31.322 INFO:teuthology.orchestra.run.smithi154.stdout:323 2024-05-14T01:26:31.322 INFO:teuthology.orchestra.run.smithi154.stdout:323.out 2024-05-14T01:26:31.322 INFO:teuthology.orchestra.run.smithi154.stdout:324 2024-05-14T01:26:31.322 INFO:teuthology.orchestra.run.smithi154.stdout:324.out 2024-05-14T01:26:31.322 INFO:teuthology.orchestra.run.smithi154.stdout:325 2024-05-14T01:26:31.322 INFO:teuthology.orchestra.run.smithi154.stdout:325.out 2024-05-14T01:26:31.322 INFO:teuthology.orchestra.run.smithi154.stdout:326 2024-05-14T01:26:31.322 INFO:teuthology.orchestra.run.smithi154.stdout:326.out 2024-05-14T01:26:31.322 INFO:teuthology.orchestra.run.smithi154.stdout:327 2024-05-14T01:26:31.323 INFO:teuthology.orchestra.run.smithi154.stdout:327.out 2024-05-14T01:26:31.323 INFO:teuthology.orchestra.run.smithi154.stdout:328 2024-05-14T01:26:31.323 INFO:teuthology.orchestra.run.smithi154.stdout:328.out 2024-05-14T01:26:31.323 INFO:teuthology.orchestra.run.smithi154.stdout:329 2024-05-14T01:26:31.323 INFO:teuthology.orchestra.run.smithi154.stdout:329.out 2024-05-14T01:26:31.323 INFO:teuthology.orchestra.run.smithi154.stdout:330 2024-05-14T01:26:31.323 INFO:teuthology.orchestra.run.smithi154.stdout:330.out 2024-05-14T01:26:31.323 INFO:teuthology.orchestra.run.smithi154.stdout:331 2024-05-14T01:26:31.323 INFO:teuthology.orchestra.run.smithi154.stdout:331.out 2024-05-14T01:26:31.323 INFO:teuthology.orchestra.run.smithi154.stdout:332 2024-05-14T01:26:31.323 INFO:teuthology.orchestra.run.smithi154.stdout:332.out 2024-05-14T01:26:31.323 INFO:teuthology.orchestra.run.smithi154.stdout:333 2024-05-14T01:26:31.323 INFO:teuthology.orchestra.run.smithi154.stdout:333.out 2024-05-14T01:26:31.324 INFO:teuthology.orchestra.run.smithi154.stdout:334 2024-05-14T01:26:31.324 INFO:teuthology.orchestra.run.smithi154.stdout:334.out 2024-05-14T01:26:31.324 INFO:teuthology.orchestra.run.smithi154.stdout:335 2024-05-14T01:26:31.324 INFO:teuthology.orchestra.run.smithi154.stdout:335.out 2024-05-14T01:26:31.324 INFO:teuthology.orchestra.run.smithi154.stdout:336 2024-05-14T01:26:31.324 INFO:teuthology.orchestra.run.smithi154.stdout:336.out 2024-05-14T01:26:31.324 INFO:teuthology.orchestra.run.smithi154.stdout:337 2024-05-14T01:26:31.324 INFO:teuthology.orchestra.run.smithi154.stdout:337.out 2024-05-14T01:26:31.324 INFO:teuthology.orchestra.run.smithi154.stdout:338 2024-05-14T01:26:31.324 INFO:teuthology.orchestra.run.smithi154.stdout:338.out 2024-05-14T01:26:31.324 INFO:teuthology.orchestra.run.smithi154.stdout:339 2024-05-14T01:26:31.324 INFO:teuthology.orchestra.run.smithi154.stdout:339.out 2024-05-14T01:26:31.324 INFO:teuthology.orchestra.run.smithi154.stdout:340 2024-05-14T01:26:31.324 INFO:teuthology.orchestra.run.smithi154.stdout:340.out 2024-05-14T01:26:31.325 INFO:teuthology.orchestra.run.smithi154.stdout:341 2024-05-14T01:26:31.325 INFO:teuthology.orchestra.run.smithi154.stdout:341.out 2024-05-14T01:26:31.325 INFO:teuthology.orchestra.run.smithi154.stdout:342 2024-05-14T01:26:31.325 INFO:teuthology.orchestra.run.smithi154.stdout:342.out 2024-05-14T01:26:31.325 INFO:teuthology.orchestra.run.smithi154.stdout:343 2024-05-14T01:26:31.325 INFO:teuthology.orchestra.run.smithi154.stdout:343.out 2024-05-14T01:26:31.325 INFO:teuthology.orchestra.run.smithi154.stdout:344 2024-05-14T01:26:31.325 INFO:teuthology.orchestra.run.smithi154.stdout:344.out 2024-05-14T01:26:31.325 INFO:teuthology.orchestra.run.smithi154.stdout:345 2024-05-14T01:26:31.325 INFO:teuthology.orchestra.run.smithi154.stdout:345.out 2024-05-14T01:26:31.325 INFO:teuthology.orchestra.run.smithi154.stdout:346 2024-05-14T01:26:31.325 INFO:teuthology.orchestra.run.smithi154.stdout:346.out 2024-05-14T01:26:31.325 INFO:teuthology.orchestra.run.smithi154.stdout:347 2024-05-14T01:26:31.325 INFO:teuthology.orchestra.run.smithi154.stdout:347.out 2024-05-14T01:26:31.326 INFO:teuthology.orchestra.run.smithi154.stdout:348 2024-05-14T01:26:31.326 INFO:teuthology.orchestra.run.smithi154.stdout:348.out 2024-05-14T01:26:31.326 INFO:teuthology.orchestra.run.smithi154.stdout:349 2024-05-14T01:26:31.326 INFO:teuthology.orchestra.run.smithi154.stdout:349.out 2024-05-14T01:26:31.326 INFO:teuthology.orchestra.run.smithi154.stdout:350 2024-05-14T01:26:31.326 INFO:teuthology.orchestra.run.smithi154.stdout:350.out 2024-05-14T01:26:31.326 INFO:teuthology.orchestra.run.smithi154.stdout:351 2024-05-14T01:26:31.326 INFO:teuthology.orchestra.run.smithi154.stdout:351.out 2024-05-14T01:26:31.326 INFO:teuthology.orchestra.run.smithi154.stdout:352 2024-05-14T01:26:31.326 INFO:teuthology.orchestra.run.smithi154.stdout:352.out 2024-05-14T01:26:31.326 INFO:teuthology.orchestra.run.smithi154.stdout:353 2024-05-14T01:26:31.326 INFO:teuthology.orchestra.run.smithi154.stdout:353.out 2024-05-14T01:26:31.326 INFO:teuthology.orchestra.run.smithi154.stdout:354 2024-05-14T01:26:31.327 INFO:teuthology.orchestra.run.smithi154.stdout:354.out 2024-05-14T01:26:31.327 INFO:teuthology.orchestra.run.smithi154.stdout:355 2024-05-14T01:26:31.327 INFO:teuthology.orchestra.run.smithi154.stdout:355.out 2024-05-14T01:26:31.327 INFO:teuthology.orchestra.run.smithi154.stdout:356 2024-05-14T01:26:31.327 INFO:teuthology.orchestra.run.smithi154.stdout:356.out 2024-05-14T01:26:31.327 INFO:teuthology.orchestra.run.smithi154.stdout:357 2024-05-14T01:26:31.327 INFO:teuthology.orchestra.run.smithi154.stdout:357.out 2024-05-14T01:26:31.327 INFO:teuthology.orchestra.run.smithi154.stdout:358 2024-05-14T01:26:31.327 INFO:teuthology.orchestra.run.smithi154.stdout:358.out 2024-05-14T01:26:31.327 INFO:teuthology.orchestra.run.smithi154.stdout:359 2024-05-14T01:26:31.327 INFO:teuthology.orchestra.run.smithi154.stdout:359.out 2024-05-14T01:26:31.327 INFO:teuthology.orchestra.run.smithi154.stdout:360 2024-05-14T01:26:31.327 INFO:teuthology.orchestra.run.smithi154.stdout:360.out 2024-05-14T01:26:31.327 INFO:teuthology.orchestra.run.smithi154.stdout:361 2024-05-14T01:26:31.328 INFO:teuthology.orchestra.run.smithi154.stdout:361.out 2024-05-14T01:26:31.328 INFO:teuthology.orchestra.run.smithi154.stdout:362 2024-05-14T01:26:31.328 INFO:teuthology.orchestra.run.smithi154.stdout:362.out 2024-05-14T01:26:31.328 INFO:teuthology.orchestra.run.smithi154.stdout:363 2024-05-14T01:26:31.328 INFO:teuthology.orchestra.run.smithi154.stdout:363.out 2024-05-14T01:26:31.328 INFO:teuthology.orchestra.run.smithi154.stdout:364 2024-05-14T01:26:31.328 INFO:teuthology.orchestra.run.smithi154.stdout:364.out 2024-05-14T01:26:31.328 INFO:teuthology.orchestra.run.smithi154.stdout:365 2024-05-14T01:26:31.328 INFO:teuthology.orchestra.run.smithi154.stdout:365.out 2024-05-14T01:26:31.328 INFO:teuthology.orchestra.run.smithi154.stdout:366 2024-05-14T01:26:31.328 INFO:teuthology.orchestra.run.smithi154.stdout:366.out 2024-05-14T01:26:31.328 INFO:teuthology.orchestra.run.smithi154.stdout:367 2024-05-14T01:26:31.328 INFO:teuthology.orchestra.run.smithi154.stdout:367.out 2024-05-14T01:26:31.328 INFO:teuthology.orchestra.run.smithi154.stdout:368 2024-05-14T01:26:31.329 INFO:teuthology.orchestra.run.smithi154.stdout:368.out 2024-05-14T01:26:31.329 INFO:teuthology.orchestra.run.smithi154.stdout:369 2024-05-14T01:26:31.329 INFO:teuthology.orchestra.run.smithi154.stdout:369.out 2024-05-14T01:26:31.329 INFO:teuthology.orchestra.run.smithi154.stdout:370 2024-05-14T01:26:31.329 INFO:teuthology.orchestra.run.smithi154.stdout:370.out 2024-05-14T01:26:31.329 INFO:teuthology.orchestra.run.smithi154.stdout:371 2024-05-14T01:26:31.329 INFO:teuthology.orchestra.run.smithi154.stdout:371.out 2024-05-14T01:26:31.329 INFO:teuthology.orchestra.run.smithi154.stdout:372 2024-05-14T01:26:31.329 INFO:teuthology.orchestra.run.smithi154.stdout:372.out 2024-05-14T01:26:31.329 INFO:teuthology.orchestra.run.smithi154.stdout:373 2024-05-14T01:26:31.329 INFO:teuthology.orchestra.run.smithi154.stdout:373.out 2024-05-14T01:26:31.329 INFO:teuthology.orchestra.run.smithi154.stdout:374 2024-05-14T01:26:31.329 INFO:teuthology.orchestra.run.smithi154.stdout:374.out 2024-05-14T01:26:31.329 INFO:teuthology.orchestra.run.smithi154.stdout:375 2024-05-14T01:26:31.330 INFO:teuthology.orchestra.run.smithi154.stdout:375.out 2024-05-14T01:26:31.330 INFO:teuthology.orchestra.run.smithi154.stdout:376 2024-05-14T01:26:31.330 INFO:teuthology.orchestra.run.smithi154.stdout:376.out 2024-05-14T01:26:31.330 INFO:teuthology.orchestra.run.smithi154.stdout:377 2024-05-14T01:26:31.330 INFO:teuthology.orchestra.run.smithi154.stdout:377.out 2024-05-14T01:26:31.330 INFO:teuthology.orchestra.run.smithi154.stdout:378 2024-05-14T01:26:31.330 INFO:teuthology.orchestra.run.smithi154.stdout:378.out 2024-05-14T01:26:31.330 INFO:teuthology.orchestra.run.smithi154.stdout:379 2024-05-14T01:26:31.330 INFO:teuthology.orchestra.run.smithi154.stdout:379.out 2024-05-14T01:26:31.330 INFO:teuthology.orchestra.run.smithi154.stdout:380 2024-05-14T01:26:31.330 INFO:teuthology.orchestra.run.smithi154.stdout:380.out 2024-05-14T01:26:31.330 INFO:teuthology.orchestra.run.smithi154.stdout:381 2024-05-14T01:26:31.330 INFO:teuthology.orchestra.run.smithi154.stdout:381.out 2024-05-14T01:26:31.330 INFO:teuthology.orchestra.run.smithi154.stdout:382 2024-05-14T01:26:31.331 INFO:teuthology.orchestra.run.smithi154.stdout:382.out 2024-05-14T01:26:31.331 INFO:teuthology.orchestra.run.smithi154.stdout:383 2024-05-14T01:26:31.331 INFO:teuthology.orchestra.run.smithi154.stdout:383.out 2024-05-14T01:26:31.331 INFO:teuthology.orchestra.run.smithi154.stdout:384 2024-05-14T01:26:31.331 INFO:teuthology.orchestra.run.smithi154.stdout:384.out 2024-05-14T01:26:31.331 INFO:teuthology.orchestra.run.smithi154.stdout:385 2024-05-14T01:26:31.331 INFO:teuthology.orchestra.run.smithi154.stdout:385.out 2024-05-14T01:26:31.331 INFO:teuthology.orchestra.run.smithi154.stdout:386 2024-05-14T01:26:31.331 INFO:teuthology.orchestra.run.smithi154.stdout:386.out 2024-05-14T01:26:31.331 INFO:teuthology.orchestra.run.smithi154.stdout:387 2024-05-14T01:26:31.331 INFO:teuthology.orchestra.run.smithi154.stdout:387.out 2024-05-14T01:26:31.331 INFO:teuthology.orchestra.run.smithi154.stdout:388 2024-05-14T01:26:31.331 INFO:teuthology.orchestra.run.smithi154.stdout:388.out 2024-05-14T01:26:31.331 INFO:teuthology.orchestra.run.smithi154.stdout:389 2024-05-14T01:26:31.331 INFO:teuthology.orchestra.run.smithi154.stdout:389.out 2024-05-14T01:26:31.332 INFO:teuthology.orchestra.run.smithi154.stdout:390 2024-05-14T01:26:31.332 INFO:teuthology.orchestra.run.smithi154.stdout:390.out 2024-05-14T01:26:31.332 INFO:teuthology.orchestra.run.smithi154.stdout:391 2024-05-14T01:26:31.332 INFO:teuthology.orchestra.run.smithi154.stdout:391.out 2024-05-14T01:26:31.332 INFO:teuthology.orchestra.run.smithi154.stdout:392 2024-05-14T01:26:31.332 INFO:teuthology.orchestra.run.smithi154.stdout:392.out 2024-05-14T01:26:31.332 INFO:teuthology.orchestra.run.smithi154.stdout:393 2024-05-14T01:26:31.332 INFO:teuthology.orchestra.run.smithi154.stdout:393.out 2024-05-14T01:26:31.332 INFO:teuthology.orchestra.run.smithi154.stdout:394 2024-05-14T01:26:31.332 INFO:teuthology.orchestra.run.smithi154.stdout:394.out 2024-05-14T01:26:31.332 INFO:teuthology.orchestra.run.smithi154.stdout:395 2024-05-14T01:26:31.332 INFO:teuthology.orchestra.run.smithi154.stdout:395.out 2024-05-14T01:26:31.332 INFO:teuthology.orchestra.run.smithi154.stdout:396 2024-05-14T01:26:31.332 INFO:teuthology.orchestra.run.smithi154.stdout:396.out 2024-05-14T01:26:31.332 INFO:teuthology.orchestra.run.smithi154.stdout:397 2024-05-14T01:26:31.333 INFO:teuthology.orchestra.run.smithi154.stdout:397.out 2024-05-14T01:26:31.333 INFO:teuthology.orchestra.run.smithi154.stdout:398 2024-05-14T01:26:31.333 INFO:teuthology.orchestra.run.smithi154.stdout:398.out 2024-05-14T01:26:31.333 INFO:teuthology.orchestra.run.smithi154.stdout:399 2024-05-14T01:26:31.333 INFO:teuthology.orchestra.run.smithi154.stdout:399.out 2024-05-14T01:26:31.333 INFO:teuthology.orchestra.run.smithi154.stdout:400 2024-05-14T01:26:31.333 INFO:teuthology.orchestra.run.smithi154.stdout:400.out 2024-05-14T01:26:31.333 INFO:teuthology.orchestra.run.smithi154.stdout:401 2024-05-14T01:26:31.333 INFO:teuthology.orchestra.run.smithi154.stdout:401.out 2024-05-14T01:26:31.333 INFO:teuthology.orchestra.run.smithi154.stdout:402 2024-05-14T01:26:31.333 INFO:teuthology.orchestra.run.smithi154.stdout:402.out 2024-05-14T01:26:31.333 INFO:teuthology.orchestra.run.smithi154.stdout:403 2024-05-14T01:26:31.333 INFO:teuthology.orchestra.run.smithi154.stdout:403.out 2024-05-14T01:26:31.333 INFO:teuthology.orchestra.run.smithi154.stdout:404 2024-05-14T01:26:31.333 INFO:teuthology.orchestra.run.smithi154.stdout:404.out 2024-05-14T01:26:31.334 INFO:teuthology.orchestra.run.smithi154.stdout:405 2024-05-14T01:26:31.334 INFO:teuthology.orchestra.run.smithi154.stdout:405.out 2024-05-14T01:26:31.334 INFO:teuthology.orchestra.run.smithi154.stdout:406 2024-05-14T01:26:31.334 INFO:teuthology.orchestra.run.smithi154.stdout:406.out 2024-05-14T01:26:31.334 INFO:teuthology.orchestra.run.smithi154.stdout:407 2024-05-14T01:26:31.334 INFO:teuthology.orchestra.run.smithi154.stdout:407.out 2024-05-14T01:26:31.334 INFO:teuthology.orchestra.run.smithi154.stdout:408 2024-05-14T01:26:31.334 INFO:teuthology.orchestra.run.smithi154.stdout:408.out 2024-05-14T01:26:31.334 INFO:teuthology.orchestra.run.smithi154.stdout:409 2024-05-14T01:26:31.334 INFO:teuthology.orchestra.run.smithi154.stdout:409.out 2024-05-14T01:26:31.334 INFO:teuthology.orchestra.run.smithi154.stdout:410 2024-05-14T01:26:31.334 INFO:teuthology.orchestra.run.smithi154.stdout:410.out 2024-05-14T01:26:31.334 INFO:teuthology.orchestra.run.smithi154.stdout:411 2024-05-14T01:26:31.334 INFO:teuthology.orchestra.run.smithi154.stdout:411.out 2024-05-14T01:26:31.334 INFO:teuthology.orchestra.run.smithi154.stdout:412 2024-05-14T01:26:31.335 INFO:teuthology.orchestra.run.smithi154.stdout:412.out 2024-05-14T01:26:31.335 INFO:teuthology.orchestra.run.smithi154.stdout:413 2024-05-14T01:26:31.335 INFO:teuthology.orchestra.run.smithi154.stdout:413.out 2024-05-14T01:26:31.335 INFO:teuthology.orchestra.run.smithi154.stdout:414 2024-05-14T01:26:31.335 INFO:teuthology.orchestra.run.smithi154.stdout:414.out 2024-05-14T01:26:31.335 INFO:teuthology.orchestra.run.smithi154.stdout:415 2024-05-14T01:26:31.335 INFO:teuthology.orchestra.run.smithi154.stdout:415.out 2024-05-14T01:26:31.335 INFO:teuthology.orchestra.run.smithi154.stdout:416 2024-05-14T01:26:31.335 INFO:teuthology.orchestra.run.smithi154.stdout:416.out 2024-05-14T01:26:31.335 INFO:teuthology.orchestra.run.smithi154.stdout:417 2024-05-14T01:26:31.335 INFO:teuthology.orchestra.run.smithi154.stdout:417.out 2024-05-14T01:26:31.335 INFO:teuthology.orchestra.run.smithi154.stdout:418 2024-05-14T01:26:31.335 INFO:teuthology.orchestra.run.smithi154.stdout:418.out 2024-05-14T01:26:31.335 INFO:teuthology.orchestra.run.smithi154.stdout:419 2024-05-14T01:26:31.335 INFO:teuthology.orchestra.run.smithi154.stdout:419.out 2024-05-14T01:26:31.336 INFO:teuthology.orchestra.run.smithi154.stdout:420 2024-05-14T01:26:31.336 INFO:teuthology.orchestra.run.smithi154.stdout:420.out 2024-05-14T01:26:31.336 INFO:teuthology.orchestra.run.smithi154.stdout:421 2024-05-14T01:26:31.336 INFO:teuthology.orchestra.run.smithi154.stdout:421.out 2024-05-14T01:26:31.336 INFO:teuthology.orchestra.run.smithi154.stdout:422 2024-05-14T01:26:31.336 INFO:teuthology.orchestra.run.smithi154.stdout:422.out 2024-05-14T01:26:31.336 INFO:teuthology.orchestra.run.smithi154.stdout:423 2024-05-14T01:26:31.336 INFO:teuthology.orchestra.run.smithi154.stdout:423.out 2024-05-14T01:26:31.336 INFO:teuthology.orchestra.run.smithi154.stdout:424 2024-05-14T01:26:31.336 INFO:teuthology.orchestra.run.smithi154.stdout:424.out 2024-05-14T01:26:31.336 INFO:teuthology.orchestra.run.smithi154.stdout:425 2024-05-14T01:26:31.336 INFO:teuthology.orchestra.run.smithi154.stdout:425.out 2024-05-14T01:26:31.336 INFO:teuthology.orchestra.run.smithi154.stdout:426 2024-05-14T01:26:31.336 INFO:teuthology.orchestra.run.smithi154.stdout:426.out 2024-05-14T01:26:31.336 INFO:teuthology.orchestra.run.smithi154.stdout:427 2024-05-14T01:26:31.336 INFO:teuthology.orchestra.run.smithi154.stdout:427.out 2024-05-14T01:26:31.337 INFO:teuthology.orchestra.run.smithi154.stdout:428 2024-05-14T01:26:31.337 INFO:teuthology.orchestra.run.smithi154.stdout:428.out 2024-05-14T01:26:31.337 INFO:teuthology.orchestra.run.smithi154.stdout:429 2024-05-14T01:26:31.337 INFO:teuthology.orchestra.run.smithi154.stdout:429.out 2024-05-14T01:26:31.337 INFO:teuthology.orchestra.run.smithi154.stdout:430 2024-05-14T01:26:31.337 INFO:teuthology.orchestra.run.smithi154.stdout:430.out 2024-05-14T01:26:31.337 INFO:teuthology.orchestra.run.smithi154.stdout:431 2024-05-14T01:26:31.337 INFO:teuthology.orchestra.run.smithi154.stdout:431.out 2024-05-14T01:26:31.337 INFO:teuthology.orchestra.run.smithi154.stdout:432 2024-05-14T01:26:31.337 INFO:teuthology.orchestra.run.smithi154.stdout:432.out 2024-05-14T01:26:31.337 INFO:teuthology.orchestra.run.smithi154.stdout:433 2024-05-14T01:26:31.337 INFO:teuthology.orchestra.run.smithi154.stdout:433.out 2024-05-14T01:26:31.337 INFO:teuthology.orchestra.run.smithi154.stdout:434 2024-05-14T01:26:31.337 INFO:teuthology.orchestra.run.smithi154.stdout:434.out 2024-05-14T01:26:31.338 INFO:teuthology.orchestra.run.smithi154.stdout:435 2024-05-14T01:26:31.338 INFO:teuthology.orchestra.run.smithi154.stdout:435.out 2024-05-14T01:26:31.338 INFO:teuthology.orchestra.run.smithi154.stdout:436 2024-05-14T01:26:31.338 INFO:teuthology.orchestra.run.smithi154.stdout:436.out 2024-05-14T01:26:31.338 INFO:teuthology.orchestra.run.smithi154.stdout:437 2024-05-14T01:26:31.338 INFO:teuthology.orchestra.run.smithi154.stdout:437.out 2024-05-14T01:26:31.338 INFO:teuthology.orchestra.run.smithi154.stdout:438 2024-05-14T01:26:31.338 INFO:teuthology.orchestra.run.smithi154.stdout:438.out 2024-05-14T01:26:31.338 INFO:teuthology.orchestra.run.smithi154.stdout:439 2024-05-14T01:26:31.338 INFO:teuthology.orchestra.run.smithi154.stdout:439.out 2024-05-14T01:26:31.338 INFO:teuthology.orchestra.run.smithi154.stdout:440 2024-05-14T01:26:31.338 INFO:teuthology.orchestra.run.smithi154.stdout:440.out 2024-05-14T01:26:31.338 INFO:teuthology.orchestra.run.smithi154.stdout:441 2024-05-14T01:26:31.338 INFO:teuthology.orchestra.run.smithi154.stdout:441.out 2024-05-14T01:26:31.339 INFO:teuthology.orchestra.run.smithi154.stdout:442 2024-05-14T01:26:31.339 INFO:teuthology.orchestra.run.smithi154.stdout:442.out 2024-05-14T01:26:31.339 INFO:teuthology.orchestra.run.smithi154.stdout:443 2024-05-14T01:26:31.339 INFO:teuthology.orchestra.run.smithi154.stdout:443.out 2024-05-14T01:26:31.339 INFO:teuthology.orchestra.run.smithi154.stdout:444 2024-05-14T01:26:31.339 INFO:teuthology.orchestra.run.smithi154.stdout:444.out 2024-05-14T01:26:31.339 INFO:teuthology.orchestra.run.smithi154.stdout:445 2024-05-14T01:26:31.339 INFO:teuthology.orchestra.run.smithi154.stdout:445.out 2024-05-14T01:26:31.339 INFO:teuthology.orchestra.run.smithi154.stdout:446 2024-05-14T01:26:31.339 INFO:teuthology.orchestra.run.smithi154.stdout:446.out 2024-05-14T01:26:31.339 INFO:teuthology.orchestra.run.smithi154.stdout:447 2024-05-14T01:26:31.339 INFO:teuthology.orchestra.run.smithi154.stdout:447.out 2024-05-14T01:26:31.339 INFO:teuthology.orchestra.run.smithi154.stdout:448 2024-05-14T01:26:31.339 INFO:teuthology.orchestra.run.smithi154.stdout:448.out 2024-05-14T01:26:31.339 INFO:teuthology.orchestra.run.smithi154.stdout:449 2024-05-14T01:26:31.339 INFO:teuthology.orchestra.run.smithi154.stdout:449.out 2024-05-14T01:26:31.340 INFO:teuthology.orchestra.run.smithi154.stdout:450 2024-05-14T01:26:31.340 INFO:teuthology.orchestra.run.smithi154.stdout:450.out 2024-05-14T01:26:31.340 INFO:teuthology.orchestra.run.smithi154.stdout:451 2024-05-14T01:26:31.340 INFO:teuthology.orchestra.run.smithi154.stdout:451.out 2024-05-14T01:26:31.340 INFO:teuthology.orchestra.run.smithi154.stdout:452 2024-05-14T01:26:31.340 INFO:teuthology.orchestra.run.smithi154.stdout:452.out 2024-05-14T01:26:31.340 INFO:teuthology.orchestra.run.smithi154.stdout:453 2024-05-14T01:26:31.340 INFO:teuthology.orchestra.run.smithi154.stdout:453.out 2024-05-14T01:26:31.340 INFO:teuthology.orchestra.run.smithi154.stdout:454 2024-05-14T01:26:31.340 INFO:teuthology.orchestra.run.smithi154.stdout:454.out 2024-05-14T01:26:31.340 INFO:teuthology.orchestra.run.smithi154.stdout:455 2024-05-14T01:26:31.340 INFO:teuthology.orchestra.run.smithi154.stdout:455.out 2024-05-14T01:26:31.340 INFO:teuthology.orchestra.run.smithi154.stdout:456 2024-05-14T01:26:31.340 INFO:teuthology.orchestra.run.smithi154.stdout:456.out 2024-05-14T01:26:31.340 INFO:teuthology.orchestra.run.smithi154.stdout:457 2024-05-14T01:26:31.340 INFO:teuthology.orchestra.run.smithi154.stdout:457.out 2024-05-14T01:26:31.341 INFO:teuthology.orchestra.run.smithi154.stdout:458 2024-05-14T01:26:31.341 INFO:teuthology.orchestra.run.smithi154.stdout:458.out 2024-05-14T01:26:31.341 INFO:teuthology.orchestra.run.smithi154.stdout:459 2024-05-14T01:26:31.341 INFO:teuthology.orchestra.run.smithi154.stdout:459.out 2024-05-14T01:26:31.341 INFO:teuthology.orchestra.run.smithi154.stdout:460 2024-05-14T01:26:31.341 INFO:teuthology.orchestra.run.smithi154.stdout:460.out 2024-05-14T01:26:31.341 INFO:teuthology.orchestra.run.smithi154.stdout:461 2024-05-14T01:26:31.341 INFO:teuthology.orchestra.run.smithi154.stdout:461.out 2024-05-14T01:26:31.341 INFO:teuthology.orchestra.run.smithi154.stdout:462 2024-05-14T01:26:31.341 INFO:teuthology.orchestra.run.smithi154.stdout:462.out 2024-05-14T01:26:31.341 INFO:teuthology.orchestra.run.smithi154.stdout:463 2024-05-14T01:26:31.341 INFO:teuthology.orchestra.run.smithi154.stdout:463.out 2024-05-14T01:26:31.341 INFO:teuthology.orchestra.run.smithi154.stdout:464 2024-05-14T01:26:31.341 INFO:teuthology.orchestra.run.smithi154.stdout:464.out 2024-05-14T01:26:31.342 INFO:teuthology.orchestra.run.smithi154.stdout:465 2024-05-14T01:26:31.342 INFO:teuthology.orchestra.run.smithi154.stdout:465.out 2024-05-14T01:26:31.342 INFO:teuthology.orchestra.run.smithi154.stdout:466 2024-05-14T01:26:31.342 INFO:teuthology.orchestra.run.smithi154.stdout:466.out 2024-05-14T01:26:31.342 INFO:teuthology.orchestra.run.smithi154.stdout:467 2024-05-14T01:26:31.342 INFO:teuthology.orchestra.run.smithi154.stdout:467.out 2024-05-14T01:26:31.342 INFO:teuthology.orchestra.run.smithi154.stdout:468 2024-05-14T01:26:31.342 INFO:teuthology.orchestra.run.smithi154.stdout:468.out 2024-05-14T01:26:31.342 INFO:teuthology.orchestra.run.smithi154.stdout:469 2024-05-14T01:26:31.342 INFO:teuthology.orchestra.run.smithi154.stdout:469.out 2024-05-14T01:26:31.342 INFO:teuthology.orchestra.run.smithi154.stdout:470 2024-05-14T01:26:31.342 INFO:teuthology.orchestra.run.smithi154.stdout:470.out 2024-05-14T01:26:31.342 INFO:teuthology.orchestra.run.smithi154.stdout:471 2024-05-14T01:26:31.342 INFO:teuthology.orchestra.run.smithi154.stdout:471.out 2024-05-14T01:26:31.342 INFO:teuthology.orchestra.run.smithi154.stdout:472 2024-05-14T01:26:31.343 INFO:teuthology.orchestra.run.smithi154.stdout:472.out 2024-05-14T01:26:31.343 INFO:teuthology.orchestra.run.smithi154.stdout:473 2024-05-14T01:26:31.343 INFO:teuthology.orchestra.run.smithi154.stdout:473.out 2024-05-14T01:26:31.343 INFO:teuthology.orchestra.run.smithi154.stdout:474 2024-05-14T01:26:31.343 INFO:teuthology.orchestra.run.smithi154.stdout:474.out 2024-05-14T01:26:31.343 INFO:teuthology.orchestra.run.smithi154.stdout:475 2024-05-14T01:26:31.343 INFO:teuthology.orchestra.run.smithi154.stdout:475.out 2024-05-14T01:26:31.343 INFO:teuthology.orchestra.run.smithi154.stdout:476 2024-05-14T01:26:31.343 INFO:teuthology.orchestra.run.smithi154.stdout:476.out 2024-05-14T01:26:31.343 INFO:teuthology.orchestra.run.smithi154.stdout:477 2024-05-14T01:26:31.343 INFO:teuthology.orchestra.run.smithi154.stdout:477.out 2024-05-14T01:26:31.343 INFO:teuthology.orchestra.run.smithi154.stdout:478 2024-05-14T01:26:31.343 INFO:teuthology.orchestra.run.smithi154.stdout:478.out 2024-05-14T01:26:31.343 INFO:teuthology.orchestra.run.smithi154.stdout:479 2024-05-14T01:26:31.343 INFO:teuthology.orchestra.run.smithi154.stdout:479.out 2024-05-14T01:26:31.344 INFO:teuthology.orchestra.run.smithi154.stdout:480 2024-05-14T01:26:31.344 INFO:teuthology.orchestra.run.smithi154.stdout:480.out 2024-05-14T01:26:31.344 INFO:teuthology.orchestra.run.smithi154.stdout:481 2024-05-14T01:26:31.344 INFO:teuthology.orchestra.run.smithi154.stdout:481.out 2024-05-14T01:26:31.344 INFO:teuthology.orchestra.run.smithi154.stdout:482 2024-05-14T01:26:31.344 INFO:teuthology.orchestra.run.smithi154.stdout:482.out 2024-05-14T01:26:31.344 INFO:teuthology.orchestra.run.smithi154.stdout:483 2024-05-14T01:26:31.344 INFO:teuthology.orchestra.run.smithi154.stdout:483.out 2024-05-14T01:26:31.344 INFO:teuthology.orchestra.run.smithi154.stdout:484 2024-05-14T01:26:31.344 INFO:teuthology.orchestra.run.smithi154.stdout:484.out 2024-05-14T01:26:31.344 INFO:teuthology.orchestra.run.smithi154.stdout:485 2024-05-14T01:26:31.344 INFO:teuthology.orchestra.run.smithi154.stdout:485.out 2024-05-14T01:26:31.344 INFO:teuthology.orchestra.run.smithi154.stdout:486 2024-05-14T01:26:31.344 INFO:teuthology.orchestra.run.smithi154.stdout:486.out 2024-05-14T01:26:31.344 INFO:teuthology.orchestra.run.smithi154.stdout:487 2024-05-14T01:26:31.344 INFO:teuthology.orchestra.run.smithi154.stdout:487.out 2024-05-14T01:26:31.345 INFO:teuthology.orchestra.run.smithi154.stdout:488 2024-05-14T01:26:31.345 INFO:teuthology.orchestra.run.smithi154.stdout:488.out 2024-05-14T01:26:31.345 INFO:teuthology.orchestra.run.smithi154.stdout:489 2024-05-14T01:26:31.345 INFO:teuthology.orchestra.run.smithi154.stdout:489.out 2024-05-14T01:26:31.345 INFO:teuthology.orchestra.run.smithi154.stdout:490 2024-05-14T01:26:31.345 INFO:teuthology.orchestra.run.smithi154.stdout:490.out 2024-05-14T01:26:31.345 INFO:teuthology.orchestra.run.smithi154.stdout:491 2024-05-14T01:26:31.345 INFO:teuthology.orchestra.run.smithi154.stdout:491.out 2024-05-14T01:26:31.345 INFO:teuthology.orchestra.run.smithi154.stdout:492 2024-05-14T01:26:31.345 INFO:teuthology.orchestra.run.smithi154.stdout:492.out 2024-05-14T01:26:31.345 INFO:teuthology.orchestra.run.smithi154.stdout:493 2024-05-14T01:26:31.345 INFO:teuthology.orchestra.run.smithi154.stdout:493.out 2024-05-14T01:26:31.345 INFO:teuthology.orchestra.run.smithi154.stdout:494 2024-05-14T01:26:31.345 INFO:teuthology.orchestra.run.smithi154.stdout:494.out 2024-05-14T01:26:31.345 INFO:teuthology.orchestra.run.smithi154.stdout:495 2024-05-14T01:26:31.346 INFO:teuthology.orchestra.run.smithi154.stdout:495.out 2024-05-14T01:26:31.346 INFO:teuthology.orchestra.run.smithi154.stdout:496 2024-05-14T01:26:31.346 INFO:teuthology.orchestra.run.smithi154.stdout:496.out 2024-05-14T01:26:31.346 INFO:teuthology.orchestra.run.smithi154.stdout:497 2024-05-14T01:26:31.346 INFO:teuthology.orchestra.run.smithi154.stdout:497.out 2024-05-14T01:26:31.346 INFO:teuthology.orchestra.run.smithi154.stdout:498 2024-05-14T01:26:31.346 INFO:teuthology.orchestra.run.smithi154.stdout:498.out 2024-05-14T01:26:31.346 INFO:teuthology.orchestra.run.smithi154.stdout:499 2024-05-14T01:26:31.346 INFO:teuthology.orchestra.run.smithi154.stdout:499.out 2024-05-14T01:26:31.346 INFO:teuthology.orchestra.run.smithi154.stdout:500 2024-05-14T01:26:31.346 INFO:teuthology.orchestra.run.smithi154.stdout:500.out 2024-05-14T01:26:31.346 INFO:teuthology.orchestra.run.smithi154.stdout:501 2024-05-14T01:26:31.346 INFO:teuthology.orchestra.run.smithi154.stdout:501.out 2024-05-14T01:26:31.346 INFO:teuthology.orchestra.run.smithi154.stdout:502 2024-05-14T01:26:31.347 INFO:teuthology.orchestra.run.smithi154.stdout:502.out 2024-05-14T01:26:31.347 INFO:teuthology.orchestra.run.smithi154.stdout:503 2024-05-14T01:26:31.347 INFO:teuthology.orchestra.run.smithi154.stdout:503.out 2024-05-14T01:26:31.347 INFO:teuthology.orchestra.run.smithi154.stdout:504 2024-05-14T01:26:31.347 INFO:teuthology.orchestra.run.smithi154.stdout:504.out 2024-05-14T01:26:31.347 INFO:teuthology.orchestra.run.smithi154.stdout:505 2024-05-14T01:26:31.347 INFO:teuthology.orchestra.run.smithi154.stdout:505.out 2024-05-14T01:26:31.347 INFO:teuthology.orchestra.run.smithi154.stdout:506 2024-05-14T01:26:31.347 INFO:teuthology.orchestra.run.smithi154.stdout:506.out 2024-05-14T01:26:31.347 INFO:teuthology.orchestra.run.smithi154.stdout:507 2024-05-14T01:26:31.347 INFO:teuthology.orchestra.run.smithi154.stdout:507.out 2024-05-14T01:26:31.347 INFO:teuthology.orchestra.run.smithi154.stdout:508 2024-05-14T01:26:31.347 INFO:teuthology.orchestra.run.smithi154.stdout:508.out 2024-05-14T01:26:31.347 INFO:teuthology.orchestra.run.smithi154.stdout:509 2024-05-14T01:26:31.347 INFO:teuthology.orchestra.run.smithi154.stdout:509.out 2024-05-14T01:26:31.347 INFO:teuthology.orchestra.run.smithi154.stdout:510 2024-05-14T01:26:31.348 INFO:teuthology.orchestra.run.smithi154.stdout:510.out 2024-05-14T01:26:31.348 INFO:teuthology.orchestra.run.smithi154.stdout:511 2024-05-14T01:26:31.348 INFO:teuthology.orchestra.run.smithi154.stdout:511.out 2024-05-14T01:26:31.348 INFO:teuthology.orchestra.run.smithi154.stdout:512 2024-05-14T01:26:31.348 INFO:teuthology.orchestra.run.smithi154.stdout:512.out 2024-05-14T01:26:31.348 INFO:teuthology.orchestra.run.smithi154.stdout:513 2024-05-14T01:26:31.348 INFO:teuthology.orchestra.run.smithi154.stdout:513.out 2024-05-14T01:26:31.348 INFO:teuthology.orchestra.run.smithi154.stdout:514 2024-05-14T01:26:31.348 INFO:teuthology.orchestra.run.smithi154.stdout:514.out 2024-05-14T01:26:31.348 INFO:teuthology.orchestra.run.smithi154.stdout:515 2024-05-14T01:26:31.348 INFO:teuthology.orchestra.run.smithi154.stdout:515.out 2024-05-14T01:26:31.348 INFO:teuthology.orchestra.run.smithi154.stdout:516 2024-05-14T01:26:31.348 INFO:teuthology.orchestra.run.smithi154.stdout:516.out 2024-05-14T01:26:31.348 INFO:teuthology.orchestra.run.smithi154.stdout:517 2024-05-14T01:26:31.348 INFO:teuthology.orchestra.run.smithi154.stdout:517.out 2024-05-14T01:26:31.349 INFO:teuthology.orchestra.run.smithi154.stdout:518 2024-05-14T01:26:31.349 INFO:teuthology.orchestra.run.smithi154.stdout:518.out 2024-05-14T01:26:31.349 INFO:teuthology.orchestra.run.smithi154.stdout:519 2024-05-14T01:26:31.349 INFO:teuthology.orchestra.run.smithi154.stdout:519.out 2024-05-14T01:26:31.349 INFO:teuthology.orchestra.run.smithi154.stdout:520 2024-05-14T01:26:31.349 INFO:teuthology.orchestra.run.smithi154.stdout:520.out 2024-05-14T01:26:31.349 INFO:teuthology.orchestra.run.smithi154.stdout:521 2024-05-14T01:26:31.349 INFO:teuthology.orchestra.run.smithi154.stdout:521.out 2024-05-14T01:26:31.349 INFO:teuthology.orchestra.run.smithi154.stdout:522 2024-05-14T01:26:31.349 INFO:teuthology.orchestra.run.smithi154.stdout:522.out 2024-05-14T01:26:31.349 INFO:teuthology.orchestra.run.smithi154.stdout:523 2024-05-14T01:26:31.349 INFO:teuthology.orchestra.run.smithi154.stdout:523.out 2024-05-14T01:26:31.349 INFO:teuthology.orchestra.run.smithi154.stdout:524 2024-05-14T01:26:31.349 INFO:teuthology.orchestra.run.smithi154.stdout:524.out 2024-05-14T01:26:31.349 INFO:teuthology.orchestra.run.smithi154.stdout:525 2024-05-14T01:26:31.350 INFO:teuthology.orchestra.run.smithi154.stdout:525.out 2024-05-14T01:26:31.350 INFO:teuthology.orchestra.run.smithi154.stdout:526 2024-05-14T01:26:31.350 INFO:teuthology.orchestra.run.smithi154.stdout:526.out 2024-05-14T01:26:31.350 INFO:teuthology.orchestra.run.smithi154.stdout:527 2024-05-14T01:26:31.350 INFO:teuthology.orchestra.run.smithi154.stdout:527.out 2024-05-14T01:26:31.350 INFO:teuthology.orchestra.run.smithi154.stdout:528 2024-05-14T01:26:31.350 INFO:teuthology.orchestra.run.smithi154.stdout:528.out 2024-05-14T01:26:31.350 INFO:teuthology.orchestra.run.smithi154.stdout:529 2024-05-14T01:26:31.350 INFO:teuthology.orchestra.run.smithi154.stdout:529.out 2024-05-14T01:26:31.350 INFO:teuthology.orchestra.run.smithi154.stdout:530 2024-05-14T01:26:31.350 INFO:teuthology.orchestra.run.smithi154.stdout:530.out 2024-05-14T01:26:31.350 INFO:teuthology.orchestra.run.smithi154.stdout:531 2024-05-14T01:26:31.350 INFO:teuthology.orchestra.run.smithi154.stdout:531.out 2024-05-14T01:26:31.350 INFO:teuthology.orchestra.run.smithi154.stdout:532 2024-05-14T01:26:31.351 INFO:teuthology.orchestra.run.smithi154.stdout:532.out 2024-05-14T01:26:31.351 INFO:teuthology.orchestra.run.smithi154.stdout:533 2024-05-14T01:26:31.351 INFO:teuthology.orchestra.run.smithi154.stdout:533.out 2024-05-14T01:26:31.351 INFO:teuthology.orchestra.run.smithi154.stdout:534 2024-05-14T01:26:31.351 INFO:teuthology.orchestra.run.smithi154.stdout:534.out 2024-05-14T01:26:31.351 INFO:teuthology.orchestra.run.smithi154.stdout:535 2024-05-14T01:26:31.351 INFO:teuthology.orchestra.run.smithi154.stdout:535.out 2024-05-14T01:26:31.351 INFO:teuthology.orchestra.run.smithi154.stdout:536 2024-05-14T01:26:31.351 INFO:teuthology.orchestra.run.smithi154.stdout:536.out 2024-05-14T01:26:31.351 INFO:teuthology.orchestra.run.smithi154.stdout:537 2024-05-14T01:26:31.351 INFO:teuthology.orchestra.run.smithi154.stdout:537.out 2024-05-14T01:26:31.351 INFO:teuthology.orchestra.run.smithi154.stdout:538 2024-05-14T01:26:31.351 INFO:teuthology.orchestra.run.smithi154.stdout:538.out 2024-05-14T01:26:31.351 INFO:teuthology.orchestra.run.smithi154.stdout:539 2024-05-14T01:26:31.351 INFO:teuthology.orchestra.run.smithi154.stdout:539.out 2024-05-14T01:26:31.352 INFO:teuthology.orchestra.run.smithi154.stdout:540 2024-05-14T01:26:31.352 INFO:teuthology.orchestra.run.smithi154.stdout:540.out 2024-05-14T01:26:31.352 INFO:teuthology.orchestra.run.smithi154.stdout:541 2024-05-14T01:26:31.352 INFO:teuthology.orchestra.run.smithi154.stdout:541.out 2024-05-14T01:26:31.352 INFO:teuthology.orchestra.run.smithi154.stdout:542 2024-05-14T01:26:31.352 INFO:teuthology.orchestra.run.smithi154.stdout:542.out 2024-05-14T01:26:31.352 INFO:teuthology.orchestra.run.smithi154.stdout:543 2024-05-14T01:26:31.352 INFO:teuthology.orchestra.run.smithi154.stdout:543.out 2024-05-14T01:26:31.352 INFO:teuthology.orchestra.run.smithi154.stdout:544 2024-05-14T01:26:31.352 INFO:teuthology.orchestra.run.smithi154.stdout:544.out 2024-05-14T01:26:31.352 INFO:teuthology.orchestra.run.smithi154.stdout:545 2024-05-14T01:26:31.352 INFO:teuthology.orchestra.run.smithi154.stdout:545.out 2024-05-14T01:26:31.352 INFO:teuthology.orchestra.run.smithi154.stdout:546 2024-05-14T01:26:31.352 INFO:teuthology.orchestra.run.smithi154.stdout:546.out 2024-05-14T01:26:31.352 INFO:teuthology.orchestra.run.smithi154.stdout:547 2024-05-14T01:26:31.353 INFO:teuthology.orchestra.run.smithi154.stdout:547.out 2024-05-14T01:26:31.353 INFO:teuthology.orchestra.run.smithi154.stdout:548 2024-05-14T01:26:31.353 INFO:teuthology.orchestra.run.smithi154.stdout:548.out 2024-05-14T01:26:31.353 INFO:teuthology.orchestra.run.smithi154.stdout:549 2024-05-14T01:26:31.353 INFO:teuthology.orchestra.run.smithi154.stdout:549.out 2024-05-14T01:26:31.353 INFO:teuthology.orchestra.run.smithi154.stdout:550 2024-05-14T01:26:31.353 INFO:teuthology.orchestra.run.smithi154.stdout:550.out 2024-05-14T01:26:31.353 INFO:teuthology.orchestra.run.smithi154.stdout:551 2024-05-14T01:26:31.353 INFO:teuthology.orchestra.run.smithi154.stdout:551.out 2024-05-14T01:26:31.353 INFO:teuthology.orchestra.run.smithi154.stdout:552 2024-05-14T01:26:31.353 INFO:teuthology.orchestra.run.smithi154.stdout:552.out 2024-05-14T01:26:31.353 INFO:teuthology.orchestra.run.smithi154.stdout:553 2024-05-14T01:26:31.353 INFO:teuthology.orchestra.run.smithi154.stdout:553.out 2024-05-14T01:26:31.353 INFO:teuthology.orchestra.run.smithi154.stdout:554 2024-05-14T01:26:31.353 INFO:teuthology.orchestra.run.smithi154.stdout:554.out 2024-05-14T01:26:31.354 INFO:teuthology.orchestra.run.smithi154.stdout:555 2024-05-14T01:26:31.354 INFO:teuthology.orchestra.run.smithi154.stdout:555.out 2024-05-14T01:26:31.354 INFO:teuthology.orchestra.run.smithi154.stdout:556 2024-05-14T01:26:31.354 INFO:teuthology.orchestra.run.smithi154.stdout:556.out 2024-05-14T01:26:31.354 INFO:teuthology.orchestra.run.smithi154.stdout:557 2024-05-14T01:26:31.354 INFO:teuthology.orchestra.run.smithi154.stdout:557.out 2024-05-14T01:26:31.354 INFO:teuthology.orchestra.run.smithi154.stdout:558 2024-05-14T01:26:31.354 INFO:teuthology.orchestra.run.smithi154.stdout:558.out 2024-05-14T01:26:31.354 INFO:teuthology.orchestra.run.smithi154.stdout:559 2024-05-14T01:26:31.354 INFO:teuthology.orchestra.run.smithi154.stdout:559.out 2024-05-14T01:26:31.354 INFO:teuthology.orchestra.run.smithi154.stdout:560 2024-05-14T01:26:31.354 INFO:teuthology.orchestra.run.smithi154.stdout:560.out 2024-05-14T01:26:31.354 INFO:teuthology.orchestra.run.smithi154.stdout:561 2024-05-14T01:26:31.354 INFO:teuthology.orchestra.run.smithi154.stdout:561.out 2024-05-14T01:26:31.355 INFO:teuthology.orchestra.run.smithi154.stdout:562 2024-05-14T01:26:31.355 INFO:teuthology.orchestra.run.smithi154.stdout:562.out 2024-05-14T01:26:31.355 INFO:teuthology.orchestra.run.smithi154.stdout:563 2024-05-14T01:26:31.355 INFO:teuthology.orchestra.run.smithi154.stdout:563.out 2024-05-14T01:26:31.355 INFO:teuthology.orchestra.run.smithi154.stdout:564 2024-05-14T01:26:31.355 INFO:teuthology.orchestra.run.smithi154.stdout:564.out 2024-05-14T01:26:31.355 INFO:teuthology.orchestra.run.smithi154.stdout:565 2024-05-14T01:26:31.355 INFO:teuthology.orchestra.run.smithi154.stdout:565.out 2024-05-14T01:26:31.355 INFO:teuthology.orchestra.run.smithi154.stdout:566 2024-05-14T01:26:31.355 INFO:teuthology.orchestra.run.smithi154.stdout:566.out 2024-05-14T01:26:31.355 INFO:teuthology.orchestra.run.smithi154.stdout:567 2024-05-14T01:26:31.355 INFO:teuthology.orchestra.run.smithi154.stdout:567.out 2024-05-14T01:26:31.355 INFO:teuthology.orchestra.run.smithi154.stdout:568 2024-05-14T01:26:31.355 INFO:teuthology.orchestra.run.smithi154.stdout:568.out 2024-05-14T01:26:31.355 INFO:teuthology.orchestra.run.smithi154.stdout:569 2024-05-14T01:26:31.356 INFO:teuthology.orchestra.run.smithi154.stdout:569.out 2024-05-14T01:26:31.356 INFO:teuthology.orchestra.run.smithi154.stdout:570 2024-05-14T01:26:31.356 INFO:teuthology.orchestra.run.smithi154.stdout:570.out 2024-05-14T01:26:31.356 INFO:teuthology.orchestra.run.smithi154.stdout:571 2024-05-14T01:26:31.356 INFO:teuthology.orchestra.run.smithi154.stdout:571.out 2024-05-14T01:26:31.356 INFO:teuthology.orchestra.run.smithi154.stdout:572 2024-05-14T01:26:31.356 INFO:teuthology.orchestra.run.smithi154.stdout:572.out 2024-05-14T01:26:31.356 INFO:teuthology.orchestra.run.smithi154.stdout:573 2024-05-14T01:26:31.356 INFO:teuthology.orchestra.run.smithi154.stdout:573.out 2024-05-14T01:26:31.356 INFO:teuthology.orchestra.run.smithi154.stdout:574 2024-05-14T01:26:31.356 INFO:teuthology.orchestra.run.smithi154.stdout:574.out 2024-05-14T01:26:31.356 INFO:teuthology.orchestra.run.smithi154.stdout:575 2024-05-14T01:26:31.356 INFO:teuthology.orchestra.run.smithi154.stdout:575.out 2024-05-14T01:26:31.356 INFO:teuthology.orchestra.run.smithi154.stdout:576 2024-05-14T01:26:31.356 INFO:teuthology.orchestra.run.smithi154.stdout:576.out 2024-05-14T01:26:31.356 INFO:teuthology.orchestra.run.smithi154.stdout:577 2024-05-14T01:26:31.357 INFO:teuthology.orchestra.run.smithi154.stdout:577.out 2024-05-14T01:26:31.357 INFO:teuthology.orchestra.run.smithi154.stdout:578 2024-05-14T01:26:31.357 INFO:teuthology.orchestra.run.smithi154.stdout:578.out 2024-05-14T01:26:31.357 INFO:teuthology.orchestra.run.smithi154.stdout:579 2024-05-14T01:26:31.357 INFO:teuthology.orchestra.run.smithi154.stdout:579.out 2024-05-14T01:26:31.357 INFO:teuthology.orchestra.run.smithi154.stdout:580 2024-05-14T01:26:31.357 INFO:teuthology.orchestra.run.smithi154.stdout:580.out 2024-05-14T01:26:31.357 INFO:teuthology.orchestra.run.smithi154.stdout:581 2024-05-14T01:26:31.357 INFO:teuthology.orchestra.run.smithi154.stdout:581.out 2024-05-14T01:26:31.357 INFO:teuthology.orchestra.run.smithi154.stdout:582 2024-05-14T01:26:31.357 INFO:teuthology.orchestra.run.smithi154.stdout:582.out 2024-05-14T01:26:31.357 INFO:teuthology.orchestra.run.smithi154.stdout:583 2024-05-14T01:26:31.357 INFO:teuthology.orchestra.run.smithi154.stdout:583.out 2024-05-14T01:26:31.357 INFO:teuthology.orchestra.run.smithi154.stdout:584 2024-05-14T01:26:31.357 INFO:teuthology.orchestra.run.smithi154.stdout:584.out 2024-05-14T01:26:31.358 INFO:teuthology.orchestra.run.smithi154.stdout:585 2024-05-14T01:26:31.358 INFO:teuthology.orchestra.run.smithi154.stdout:585.out 2024-05-14T01:26:31.358 INFO:teuthology.orchestra.run.smithi154.stdout:586 2024-05-14T01:26:31.358 INFO:teuthology.orchestra.run.smithi154.stdout:586.out 2024-05-14T01:26:31.358 INFO:teuthology.orchestra.run.smithi154.stdout:587 2024-05-14T01:26:31.358 INFO:teuthology.orchestra.run.smithi154.stdout:587.out 2024-05-14T01:26:31.358 INFO:teuthology.orchestra.run.smithi154.stdout:588 2024-05-14T01:26:31.358 INFO:teuthology.orchestra.run.smithi154.stdout:588.out 2024-05-14T01:26:31.358 INFO:teuthology.orchestra.run.smithi154.stdout:589 2024-05-14T01:26:31.358 INFO:teuthology.orchestra.run.smithi154.stdout:589.out 2024-05-14T01:26:31.358 INFO:teuthology.orchestra.run.smithi154.stdout:590 2024-05-14T01:26:31.358 INFO:teuthology.orchestra.run.smithi154.stdout:590.out 2024-05-14T01:26:31.358 INFO:teuthology.orchestra.run.smithi154.stdout:591 2024-05-14T01:26:31.358 INFO:teuthology.orchestra.run.smithi154.stdout:591.out 2024-05-14T01:26:31.359 INFO:teuthology.orchestra.run.smithi154.stdout:592 2024-05-14T01:26:31.359 INFO:teuthology.orchestra.run.smithi154.stdout:592.out 2024-05-14T01:26:31.359 INFO:teuthology.orchestra.run.smithi154.stdout:593 2024-05-14T01:26:31.359 INFO:teuthology.orchestra.run.smithi154.stdout:593.out 2024-05-14T01:26:31.359 INFO:teuthology.orchestra.run.smithi154.stdout:594 2024-05-14T01:26:31.359 INFO:teuthology.orchestra.run.smithi154.stdout:594.out 2024-05-14T01:26:31.359 INFO:teuthology.orchestra.run.smithi154.stdout:595 2024-05-14T01:26:31.359 INFO:teuthology.orchestra.run.smithi154.stdout:595.out 2024-05-14T01:26:31.359 INFO:teuthology.orchestra.run.smithi154.stdout:596 2024-05-14T01:26:31.359 INFO:teuthology.orchestra.run.smithi154.stdout:596.out 2024-05-14T01:26:31.359 INFO:teuthology.orchestra.run.smithi154.stdout:597 2024-05-14T01:26:31.359 INFO:teuthology.orchestra.run.smithi154.stdout:597.out 2024-05-14T01:26:31.359 INFO:teuthology.orchestra.run.smithi154.stdout:598 2024-05-14T01:26:31.359 INFO:teuthology.orchestra.run.smithi154.stdout:598.out 2024-05-14T01:26:31.359 INFO:teuthology.orchestra.run.smithi154.stdout:599 2024-05-14T01:26:31.360 INFO:teuthology.orchestra.run.smithi154.stdout:599.out 2024-05-14T01:26:31.360 INFO:teuthology.orchestra.run.smithi154.stdout:600 2024-05-14T01:26:31.360 INFO:teuthology.orchestra.run.smithi154.stdout:600.out 2024-05-14T01:26:31.360 INFO:teuthology.orchestra.run.smithi154.stdout:601 2024-05-14T01:26:31.360 INFO:teuthology.orchestra.run.smithi154.stdout:601.out 2024-05-14T01:26:31.360 INFO:teuthology.orchestra.run.smithi154.stdout:602 2024-05-14T01:26:31.360 INFO:teuthology.orchestra.run.smithi154.stdout:602.out 2024-05-14T01:26:31.360 INFO:teuthology.orchestra.run.smithi154.stdout:603 2024-05-14T01:26:31.360 INFO:teuthology.orchestra.run.smithi154.stdout:603.out 2024-05-14T01:26:31.360 INFO:teuthology.orchestra.run.smithi154.stdout:604 2024-05-14T01:26:31.360 INFO:teuthology.orchestra.run.smithi154.stdout:604.out 2024-05-14T01:26:31.360 INFO:teuthology.orchestra.run.smithi154.stdout:605 2024-05-14T01:26:31.360 INFO:teuthology.orchestra.run.smithi154.stdout:605.out 2024-05-14T01:26:31.360 INFO:teuthology.orchestra.run.smithi154.stdout:606 2024-05-14T01:26:31.361 INFO:teuthology.orchestra.run.smithi154.stdout:606.out 2024-05-14T01:26:31.361 INFO:teuthology.orchestra.run.smithi154.stdout:607 2024-05-14T01:26:31.361 INFO:teuthology.orchestra.run.smithi154.stdout:607.out 2024-05-14T01:26:31.361 INFO:teuthology.orchestra.run.smithi154.stdout:608 2024-05-14T01:26:31.361 INFO:teuthology.orchestra.run.smithi154.stdout:608.out 2024-05-14T01:26:31.361 INFO:teuthology.orchestra.run.smithi154.stdout:609 2024-05-14T01:26:31.361 INFO:teuthology.orchestra.run.smithi154.stdout:609.out 2024-05-14T01:26:31.361 INFO:teuthology.orchestra.run.smithi154.stdout:610 2024-05-14T01:26:31.361 INFO:teuthology.orchestra.run.smithi154.stdout:610.out 2024-05-14T01:26:31.361 INFO:teuthology.orchestra.run.smithi154.stdout:611 2024-05-14T01:26:31.361 INFO:teuthology.orchestra.run.smithi154.stdout:611.out 2024-05-14T01:26:31.361 INFO:teuthology.orchestra.run.smithi154.stdout:612 2024-05-14T01:26:31.361 INFO:teuthology.orchestra.run.smithi154.stdout:612.out 2024-05-14T01:26:31.361 INFO:teuthology.orchestra.run.smithi154.stdout:613 2024-05-14T01:26:31.362 INFO:teuthology.orchestra.run.smithi154.stdout:613.out 2024-05-14T01:26:31.362 INFO:teuthology.orchestra.run.smithi154.stdout:614 2024-05-14T01:26:31.362 INFO:teuthology.orchestra.run.smithi154.stdout:614.out 2024-05-14T01:26:31.362 INFO:teuthology.orchestra.run.smithi154.stdout:615 2024-05-14T01:26:31.362 INFO:teuthology.orchestra.run.smithi154.stdout:615.out 2024-05-14T01:26:31.362 INFO:teuthology.orchestra.run.smithi154.stdout:616 2024-05-14T01:26:31.362 INFO:teuthology.orchestra.run.smithi154.stdout:616.out 2024-05-14T01:26:31.362 INFO:teuthology.orchestra.run.smithi154.stdout:617 2024-05-14T01:26:31.362 INFO:teuthology.orchestra.run.smithi154.stdout:617.out 2024-05-14T01:26:31.362 INFO:teuthology.orchestra.run.smithi154.stdout:618 2024-05-14T01:26:31.362 INFO:teuthology.orchestra.run.smithi154.stdout:618.out 2024-05-14T01:26:31.362 INFO:teuthology.orchestra.run.smithi154.stdout:619 2024-05-14T01:26:31.362 INFO:teuthology.orchestra.run.smithi154.stdout:619.out 2024-05-14T01:26:31.363 INFO:teuthology.orchestra.run.smithi154.stdout:620 2024-05-14T01:26:31.363 INFO:teuthology.orchestra.run.smithi154.stdout:620.out 2024-05-14T01:26:31.363 INFO:teuthology.orchestra.run.smithi154.stdout:621 2024-05-14T01:26:31.363 INFO:teuthology.orchestra.run.smithi154.stdout:621.out 2024-05-14T01:26:31.363 INFO:teuthology.orchestra.run.smithi154.stdout:622 2024-05-14T01:26:31.363 INFO:teuthology.orchestra.run.smithi154.stdout:622.out 2024-05-14T01:26:31.363 INFO:teuthology.orchestra.run.smithi154.stdout:623 2024-05-14T01:26:31.363 INFO:teuthology.orchestra.run.smithi154.stdout:623.out 2024-05-14T01:26:31.363 INFO:teuthology.orchestra.run.smithi154.stdout:624 2024-05-14T01:26:31.363 INFO:teuthology.orchestra.run.smithi154.stdout:624.out 2024-05-14T01:26:31.363 INFO:teuthology.orchestra.run.smithi154.stdout:625 2024-05-14T01:26:31.363 INFO:teuthology.orchestra.run.smithi154.stdout:625.out 2024-05-14T01:26:31.363 INFO:teuthology.orchestra.run.smithi154.stdout:626 2024-05-14T01:26:31.363 INFO:teuthology.orchestra.run.smithi154.stdout:626.out 2024-05-14T01:26:31.363 INFO:teuthology.orchestra.run.smithi154.stdout:627 2024-05-14T01:26:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:627.out 2024-05-14T01:26:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:628 2024-05-14T01:26:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:628.out 2024-05-14T01:26:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:629 2024-05-14T01:26:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:629.out 2024-05-14T01:26:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:630 2024-05-14T01:26:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:630.out 2024-05-14T01:26:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:631 2024-05-14T01:26:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:631.out 2024-05-14T01:26:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:632 2024-05-14T01:26:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:632.out 2024-05-14T01:26:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:633 2024-05-14T01:26:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:633.out 2024-05-14T01:26:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:634 2024-05-14T01:26:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:634.out 2024-05-14T01:26:31.365 INFO:teuthology.orchestra.run.smithi154.stdout:635 2024-05-14T01:26:31.365 INFO:teuthology.orchestra.run.smithi154.stdout:635.out 2024-05-14T01:26:31.365 INFO:teuthology.orchestra.run.smithi154.stdout:636 2024-05-14T01:26:31.365 INFO:teuthology.orchestra.run.smithi154.stdout:636.out 2024-05-14T01:26:31.365 INFO:teuthology.orchestra.run.smithi154.stdout:637 2024-05-14T01:26:31.365 INFO:teuthology.orchestra.run.smithi154.stdout:637.out 2024-05-14T01:26:31.365 INFO:teuthology.orchestra.run.smithi154.stdout:638 2024-05-14T01:26:31.365 INFO:teuthology.orchestra.run.smithi154.stdout:638.out 2024-05-14T01:26:31.365 INFO:teuthology.orchestra.run.smithi154.stdout:639 2024-05-14T01:26:31.365 INFO:teuthology.orchestra.run.smithi154.stdout:639.out 2024-05-14T01:26:31.365 INFO:teuthology.orchestra.run.smithi154.stdout:640 2024-05-14T01:26:31.365 INFO:teuthology.orchestra.run.smithi154.stdout:640.out 2024-05-14T01:26:31.365 INFO:teuthology.orchestra.run.smithi154.stdout:641 2024-05-14T01:26:31.365 INFO:teuthology.orchestra.run.smithi154.stdout:641.out 2024-05-14T01:26:31.365 INFO:teuthology.orchestra.run.smithi154.stdout:642 2024-05-14T01:26:31.366 INFO:teuthology.orchestra.run.smithi154.stdout:642.out 2024-05-14T01:26:31.366 INFO:teuthology.orchestra.run.smithi154.stdout:643 2024-05-14T01:26:31.366 INFO:teuthology.orchestra.run.smithi154.stdout:643.out 2024-05-14T01:26:31.366 INFO:teuthology.orchestra.run.smithi154.stdout:644 2024-05-14T01:26:31.366 INFO:teuthology.orchestra.run.smithi154.stdout:644.out 2024-05-14T01:26:31.366 INFO:teuthology.orchestra.run.smithi154.stdout:645 2024-05-14T01:26:31.366 INFO:teuthology.orchestra.run.smithi154.stdout:645.out 2024-05-14T01:26:31.366 INFO:teuthology.orchestra.run.smithi154.stdout:646 2024-05-14T01:26:31.366 INFO:teuthology.orchestra.run.smithi154.stdout:646.out 2024-05-14T01:26:31.366 INFO:teuthology.orchestra.run.smithi154.stdout:647 2024-05-14T01:26:31.366 INFO:teuthology.orchestra.run.smithi154.stdout:647.out 2024-05-14T01:26:31.366 INFO:teuthology.orchestra.run.smithi154.stdout:648 2024-05-14T01:26:31.366 INFO:teuthology.orchestra.run.smithi154.stdout:648.out 2024-05-14T01:26:31.366 INFO:teuthology.orchestra.run.smithi154.stdout:649 2024-05-14T01:26:31.367 INFO:teuthology.orchestra.run.smithi154.stdout:649.out 2024-05-14T01:26:31.367 INFO:teuthology.orchestra.run.smithi154.stdout:650 2024-05-14T01:26:31.367 INFO:teuthology.orchestra.run.smithi154.stdout:650.out 2024-05-14T01:26:31.367 INFO:teuthology.orchestra.run.smithi154.stdout:651 2024-05-14T01:26:31.367 INFO:teuthology.orchestra.run.smithi154.stdout:651.out 2024-05-14T01:26:31.367 INFO:teuthology.orchestra.run.smithi154.stdout:652 2024-05-14T01:26:31.367 INFO:teuthology.orchestra.run.smithi154.stdout:652.out 2024-05-14T01:26:31.367 INFO:teuthology.orchestra.run.smithi154.stdout:653 2024-05-14T01:26:31.367 INFO:teuthology.orchestra.run.smithi154.stdout:653.out 2024-05-14T01:26:31.367 INFO:teuthology.orchestra.run.smithi154.stdout:654 2024-05-14T01:26:31.367 INFO:teuthology.orchestra.run.smithi154.stdout:654.out 2024-05-14T01:26:31.367 INFO:teuthology.orchestra.run.smithi154.stdout:655 2024-05-14T01:26:31.367 INFO:teuthology.orchestra.run.smithi154.stdout:655.out 2024-05-14T01:26:31.367 INFO:teuthology.orchestra.run.smithi154.stdout:656 2024-05-14T01:26:31.367 INFO:teuthology.orchestra.run.smithi154.stdout:656.out 2024-05-14T01:26:31.368 INFO:teuthology.orchestra.run.smithi154.stdout:657 2024-05-14T01:26:31.368 INFO:teuthology.orchestra.run.smithi154.stdout:657.out 2024-05-14T01:26:31.368 INFO:teuthology.orchestra.run.smithi154.stdout:658 2024-05-14T01:26:31.368 INFO:teuthology.orchestra.run.smithi154.stdout:658.out 2024-05-14T01:26:31.368 INFO:teuthology.orchestra.run.smithi154.stdout:659 2024-05-14T01:26:31.368 INFO:teuthology.orchestra.run.smithi154.stdout:659.out 2024-05-14T01:26:31.368 INFO:teuthology.orchestra.run.smithi154.stdout:660 2024-05-14T01:26:31.368 INFO:teuthology.orchestra.run.smithi154.stdout:660.out 2024-05-14T01:26:31.368 INFO:teuthology.orchestra.run.smithi154.stdout:661 2024-05-14T01:26:31.368 INFO:teuthology.orchestra.run.smithi154.stdout:661.out 2024-05-14T01:26:31.368 INFO:teuthology.orchestra.run.smithi154.stdout:662 2024-05-14T01:26:31.368 INFO:teuthology.orchestra.run.smithi154.stdout:662.out 2024-05-14T01:26:31.368 INFO:teuthology.orchestra.run.smithi154.stdout:663 2024-05-14T01:26:31.368 INFO:teuthology.orchestra.run.smithi154.stdout:663.out 2024-05-14T01:26:31.368 INFO:teuthology.orchestra.run.smithi154.stdout:664 2024-05-14T01:26:31.369 INFO:teuthology.orchestra.run.smithi154.stdout:664.out 2024-05-14T01:26:31.369 INFO:teuthology.orchestra.run.smithi154.stdout:665 2024-05-14T01:26:31.369 INFO:teuthology.orchestra.run.smithi154.stdout:665.out 2024-05-14T01:26:31.369 INFO:teuthology.orchestra.run.smithi154.stdout:666 2024-05-14T01:26:31.369 INFO:teuthology.orchestra.run.smithi154.stdout:666.out 2024-05-14T01:26:31.369 INFO:teuthology.orchestra.run.smithi154.stdout:667 2024-05-14T01:26:31.369 INFO:teuthology.orchestra.run.smithi154.stdout:667.out 2024-05-14T01:26:31.369 INFO:teuthology.orchestra.run.smithi154.stdout:668 2024-05-14T01:26:31.369 INFO:teuthology.orchestra.run.smithi154.stdout:668.out 2024-05-14T01:26:31.369 INFO:teuthology.orchestra.run.smithi154.stdout:669 2024-05-14T01:26:31.369 INFO:teuthology.orchestra.run.smithi154.stdout:669.out 2024-05-14T01:26:31.369 INFO:teuthology.orchestra.run.smithi154.stdout:670 2024-05-14T01:26:31.369 INFO:teuthology.orchestra.run.smithi154.stdout:670.out 2024-05-14T01:26:31.369 INFO:teuthology.orchestra.run.smithi154.stdout:671 2024-05-14T01:26:31.369 INFO:teuthology.orchestra.run.smithi154.stdout:671.out 2024-05-14T01:26:31.370 INFO:teuthology.orchestra.run.smithi154.stdout:672 2024-05-14T01:26:31.370 INFO:teuthology.orchestra.run.smithi154.stdout:672.out 2024-05-14T01:26:31.370 INFO:teuthology.orchestra.run.smithi154.stdout:673 2024-05-14T01:26:31.370 INFO:teuthology.orchestra.run.smithi154.stdout:673.out 2024-05-14T01:26:31.370 INFO:teuthology.orchestra.run.smithi154.stdout:674 2024-05-14T01:26:31.370 INFO:teuthology.orchestra.run.smithi154.stdout:674.out 2024-05-14T01:26:31.370 INFO:teuthology.orchestra.run.smithi154.stdout:675 2024-05-14T01:26:31.370 INFO:teuthology.orchestra.run.smithi154.stdout:675.out 2024-05-14T01:26:31.370 INFO:teuthology.orchestra.run.smithi154.stdout:676 2024-05-14T01:26:31.370 INFO:teuthology.orchestra.run.smithi154.stdout:676.out 2024-05-14T01:26:31.370 INFO:teuthology.orchestra.run.smithi154.stdout:677 2024-05-14T01:26:31.370 INFO:teuthology.orchestra.run.smithi154.stdout:677.out 2024-05-14T01:26:31.370 INFO:teuthology.orchestra.run.smithi154.stdout:678 2024-05-14T01:26:31.371 INFO:teuthology.orchestra.run.smithi154.stdout:678.out 2024-05-14T01:26:31.371 INFO:teuthology.orchestra.run.smithi154.stdout:679 2024-05-14T01:26:31.371 INFO:teuthology.orchestra.run.smithi154.stdout:679.out 2024-05-14T01:26:31.371 INFO:teuthology.orchestra.run.smithi154.stdout:680 2024-05-14T01:26:31.371 INFO:teuthology.orchestra.run.smithi154.stdout:680.out 2024-05-14T01:26:31.371 INFO:teuthology.orchestra.run.smithi154.stdout:681 2024-05-14T01:26:31.371 INFO:teuthology.orchestra.run.smithi154.stdout:681.out 2024-05-14T01:26:31.371 INFO:teuthology.orchestra.run.smithi154.stdout:682 2024-05-14T01:26:31.371 INFO:teuthology.orchestra.run.smithi154.stdout:682.out 2024-05-14T01:26:31.371 INFO:teuthology.orchestra.run.smithi154.stdout:683 2024-05-14T01:26:31.371 INFO:teuthology.orchestra.run.smithi154.stdout:683.out 2024-05-14T01:26:31.371 INFO:teuthology.orchestra.run.smithi154.stdout:684 2024-05-14T01:26:31.371 INFO:teuthology.orchestra.run.smithi154.stdout:684.out 2024-05-14T01:26:31.371 INFO:teuthology.orchestra.run.smithi154.stdout:685 2024-05-14T01:26:31.371 INFO:teuthology.orchestra.run.smithi154.stdout:685.out 2024-05-14T01:26:31.372 INFO:teuthology.orchestra.run.smithi154.stdout:686 2024-05-14T01:26:31.372 INFO:teuthology.orchestra.run.smithi154.stdout:686.out 2024-05-14T01:26:31.372 INFO:teuthology.orchestra.run.smithi154.stdout:687 2024-05-14T01:26:31.372 INFO:teuthology.orchestra.run.smithi154.stdout:687.out 2024-05-14T01:26:31.372 INFO:teuthology.orchestra.run.smithi154.stdout:688 2024-05-14T01:26:31.372 INFO:teuthology.orchestra.run.smithi154.stdout:688.out 2024-05-14T01:26:31.372 INFO:teuthology.orchestra.run.smithi154.stdout:689 2024-05-14T01:26:31.372 INFO:teuthology.orchestra.run.smithi154.stdout:689.out 2024-05-14T01:26:31.372 INFO:teuthology.orchestra.run.smithi154.stdout:690 2024-05-14T01:26:31.372 INFO:teuthology.orchestra.run.smithi154.stdout:690.out 2024-05-14T01:26:31.372 INFO:teuthology.orchestra.run.smithi154.stdout:691 2024-05-14T01:26:31.372 INFO:teuthology.orchestra.run.smithi154.stdout:691.out 2024-05-14T01:26:31.372 INFO:teuthology.orchestra.run.smithi154.stdout:692 2024-05-14T01:26:31.372 INFO:teuthology.orchestra.run.smithi154.stdout:692.out 2024-05-14T01:26:31.372 INFO:teuthology.orchestra.run.smithi154.stdout:693 2024-05-14T01:26:31.373 INFO:teuthology.orchestra.run.smithi154.stdout:693.out 2024-05-14T01:26:31.373 INFO:teuthology.orchestra.run.smithi154.stdout:694 2024-05-14T01:26:31.373 INFO:teuthology.orchestra.run.smithi154.stdout:694.out 2024-05-14T01:26:31.373 INFO:teuthology.orchestra.run.smithi154.stdout:695 2024-05-14T01:26:31.373 INFO:teuthology.orchestra.run.smithi154.stdout:695.out 2024-05-14T01:26:31.373 INFO:teuthology.orchestra.run.smithi154.stdout:696 2024-05-14T01:26:31.373 INFO:teuthology.orchestra.run.smithi154.stdout:696.out 2024-05-14T01:26:31.373 INFO:teuthology.orchestra.run.smithi154.stdout:697 2024-05-14T01:26:31.373 INFO:teuthology.orchestra.run.smithi154.stdout:697.out 2024-05-14T01:26:31.373 INFO:teuthology.orchestra.run.smithi154.stdout:698 2024-05-14T01:26:31.373 INFO:teuthology.orchestra.run.smithi154.stdout:698.out 2024-05-14T01:26:31.373 INFO:teuthology.orchestra.run.smithi154.stdout:699 2024-05-14T01:26:31.373 INFO:teuthology.orchestra.run.smithi154.stdout:699.out 2024-05-14T01:26:31.373 INFO:teuthology.orchestra.run.smithi154.stdout:700 2024-05-14T01:26:31.373 INFO:teuthology.orchestra.run.smithi154.stdout:700.out 2024-05-14T01:26:31.374 INFO:teuthology.orchestra.run.smithi154.stdout:701 2024-05-14T01:26:31.374 INFO:teuthology.orchestra.run.smithi154.stdout:701.out 2024-05-14T01:26:31.374 INFO:teuthology.orchestra.run.smithi154.stdout:702 2024-05-14T01:26:31.374 INFO:teuthology.orchestra.run.smithi154.stdout:702.out 2024-05-14T01:26:31.374 INFO:teuthology.orchestra.run.smithi154.stdout:703 2024-05-14T01:26:31.374 INFO:teuthology.orchestra.run.smithi154.stdout:703.out 2024-05-14T01:26:31.374 INFO:teuthology.orchestra.run.smithi154.stdout:704 2024-05-14T01:26:31.374 INFO:teuthology.orchestra.run.smithi154.stdout:704.out 2024-05-14T01:26:31.374 INFO:teuthology.orchestra.run.smithi154.stdout:705 2024-05-14T01:26:31.374 INFO:teuthology.orchestra.run.smithi154.stdout:705.out 2024-05-14T01:26:31.374 INFO:teuthology.orchestra.run.smithi154.stdout:706 2024-05-14T01:26:31.374 INFO:teuthology.orchestra.run.smithi154.stdout:706.out 2024-05-14T01:26:31.374 INFO:teuthology.orchestra.run.smithi154.stdout:707 2024-05-14T01:26:31.374 INFO:teuthology.orchestra.run.smithi154.stdout:707.out 2024-05-14T01:26:31.375 INFO:teuthology.orchestra.run.smithi154.stdout:708 2024-05-14T01:26:31.375 INFO:teuthology.orchestra.run.smithi154.stdout:708.out 2024-05-14T01:26:31.375 INFO:teuthology.orchestra.run.smithi154.stdout:709 2024-05-14T01:26:31.375 INFO:teuthology.orchestra.run.smithi154.stdout:709.out 2024-05-14T01:26:31.375 INFO:teuthology.orchestra.run.smithi154.stdout:710 2024-05-14T01:26:31.375 INFO:teuthology.orchestra.run.smithi154.stdout:710.out 2024-05-14T01:26:31.375 INFO:teuthology.orchestra.run.smithi154.stdout:711 2024-05-14T01:26:31.375 INFO:teuthology.orchestra.run.smithi154.stdout:711.out 2024-05-14T01:26:31.375 INFO:teuthology.orchestra.run.smithi154.stdout:712 2024-05-14T01:26:31.375 INFO:teuthology.orchestra.run.smithi154.stdout:712.out 2024-05-14T01:26:31.375 INFO:teuthology.orchestra.run.smithi154.stdout:713 2024-05-14T01:26:31.375 INFO:teuthology.orchestra.run.smithi154.stdout:713.out 2024-05-14T01:26:31.375 INFO:teuthology.orchestra.run.smithi154.stdout:714 2024-05-14T01:26:31.375 INFO:teuthology.orchestra.run.smithi154.stdout:714.out 2024-05-14T01:26:31.376 INFO:teuthology.orchestra.run.smithi154.stdout:715 2024-05-14T01:26:31.376 INFO:teuthology.orchestra.run.smithi154.stdout:715.out 2024-05-14T01:26:31.376 INFO:teuthology.orchestra.run.smithi154.stdout:716 2024-05-14T01:26:31.376 INFO:teuthology.orchestra.run.smithi154.stdout:716.out 2024-05-14T01:26:31.376 INFO:teuthology.orchestra.run.smithi154.stdout:717 2024-05-14T01:26:31.376 INFO:teuthology.orchestra.run.smithi154.stdout:717.out 2024-05-14T01:26:31.376 INFO:teuthology.orchestra.run.smithi154.stdout:718 2024-05-14T01:26:31.376 INFO:teuthology.orchestra.run.smithi154.stdout:718.out 2024-05-14T01:26:31.376 INFO:teuthology.orchestra.run.smithi154.stdout:719 2024-05-14T01:26:31.376 INFO:teuthology.orchestra.run.smithi154.stdout:719.out 2024-05-14T01:26:31.376 INFO:teuthology.orchestra.run.smithi154.stdout:720 2024-05-14T01:26:31.376 INFO:teuthology.orchestra.run.smithi154.stdout:720.out 2024-05-14T01:26:31.376 INFO:teuthology.orchestra.run.smithi154.stdout:721 2024-05-14T01:26:31.376 INFO:teuthology.orchestra.run.smithi154.stdout:721.out 2024-05-14T01:26:31.376 INFO:teuthology.orchestra.run.smithi154.stdout:722 2024-05-14T01:26:31.377 INFO:teuthology.orchestra.run.smithi154.stdout:722.out 2024-05-14T01:26:31.377 INFO:teuthology.orchestra.run.smithi154.stdout:723 2024-05-14T01:26:31.377 INFO:teuthology.orchestra.run.smithi154.stdout:723.out 2024-05-14T01:26:31.377 INFO:teuthology.orchestra.run.smithi154.stdout:724 2024-05-14T01:26:31.377 INFO:teuthology.orchestra.run.smithi154.stdout:724.out 2024-05-14T01:26:31.377 INFO:teuthology.orchestra.run.smithi154.stdout:725 2024-05-14T01:26:31.377 INFO:teuthology.orchestra.run.smithi154.stdout:725.out 2024-05-14T01:26:31.377 INFO:teuthology.orchestra.run.smithi154.stdout:726 2024-05-14T01:26:31.377 INFO:teuthology.orchestra.run.smithi154.stdout:726.out 2024-05-14T01:26:31.377 INFO:teuthology.orchestra.run.smithi154.stdout:727 2024-05-14T01:26:31.377 INFO:teuthology.orchestra.run.smithi154.stdout:727.out 2024-05-14T01:26:31.377 INFO:teuthology.orchestra.run.smithi154.stdout:728 2024-05-14T01:26:31.377 INFO:teuthology.orchestra.run.smithi154.stdout:728.out 2024-05-14T01:26:31.377 INFO:teuthology.orchestra.run.smithi154.stdout:729 2024-05-14T01:26:31.377 INFO:teuthology.orchestra.run.smithi154.stdout:729.out 2024-05-14T01:26:31.378 INFO:teuthology.orchestra.run.smithi154.stdout:730 2024-05-14T01:26:31.378 INFO:teuthology.orchestra.run.smithi154.stdout:730.out 2024-05-14T01:26:31.378 INFO:teuthology.orchestra.run.smithi154.stdout:731 2024-05-14T01:26:31.378 INFO:teuthology.orchestra.run.smithi154.stdout:731.out 2024-05-14T01:26:31.378 INFO:teuthology.orchestra.run.smithi154.stdout:732 2024-05-14T01:26:31.378 INFO:teuthology.orchestra.run.smithi154.stdout:732.out 2024-05-14T01:26:31.378 INFO:teuthology.orchestra.run.smithi154.stdout:733 2024-05-14T01:26:31.378 INFO:teuthology.orchestra.run.smithi154.stdout:733.out 2024-05-14T01:26:31.378 INFO:teuthology.orchestra.run.smithi154.stdout:734 2024-05-14T01:26:31.378 INFO:teuthology.orchestra.run.smithi154.stdout:734.out 2024-05-14T01:26:31.378 INFO:teuthology.orchestra.run.smithi154.stdout:735 2024-05-14T01:26:31.378 INFO:teuthology.orchestra.run.smithi154.stdout:735.out 2024-05-14T01:26:31.378 INFO:teuthology.orchestra.run.smithi154.stdout:736 2024-05-14T01:26:31.378 INFO:teuthology.orchestra.run.smithi154.stdout:736.out 2024-05-14T01:26:31.379 INFO:teuthology.orchestra.run.smithi154.stdout:737 2024-05-14T01:26:31.379 INFO:teuthology.orchestra.run.smithi154.stdout:737.out 2024-05-14T01:26:31.379 INFO:teuthology.orchestra.run.smithi154.stdout:738 2024-05-14T01:26:31.379 INFO:teuthology.orchestra.run.smithi154.stdout:738.out 2024-05-14T01:26:31.379 INFO:teuthology.orchestra.run.smithi154.stdout:739 2024-05-14T01:26:31.379 INFO:teuthology.orchestra.run.smithi154.stdout:739.out 2024-05-14T01:26:31.379 INFO:teuthology.orchestra.run.smithi154.stdout:741 2024-05-14T01:26:31.379 INFO:teuthology.orchestra.run.smithi154.stdout:741.out 2024-05-14T01:26:31.379 INFO:teuthology.orchestra.run.smithi154.stdout:742 2024-05-14T01:26:31.379 INFO:teuthology.orchestra.run.smithi154.stdout:742.out 2024-05-14T01:26:31.379 INFO:teuthology.orchestra.run.smithi154.stdout:743 2024-05-14T01:26:31.379 INFO:teuthology.orchestra.run.smithi154.stdout:743.out 2024-05-14T01:26:31.379 INFO:teuthology.orchestra.run.smithi154.stdout:744 2024-05-14T01:26:31.379 INFO:teuthology.orchestra.run.smithi154.stdout:744.out 2024-05-14T01:26:31.379 INFO:teuthology.orchestra.run.smithi154.stdout:group.list 2024-05-14T01:26:31.380 INFO:teuthology.orchestra.run.smithi154.stdout:Makefile 2024-05-14T01:26:31.380 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-05-14T01:26:31.594 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:26:31.599 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:26:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:26:33.940 INFO:teuthology.orchestra.run.smithi154.stdout:generic/001 2s 2024-05-14T01:26:33.947 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/001 2024-05-14T01:26:33.947 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:26:33.951 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:26:33.953 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi154.stderr:ceph-fuse[38049]: fuse finished with error 0 and tester_r 0 2024-05-14T01:26:33.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:26:33.963 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-05-14T01:26:34.144 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:26:34.149 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:26:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:26:34.302 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:26:34.304 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:26:34.575 INFO:teuthology.orchestra.run.smithi154.stdout:generic/002 0s 2024-05-14T01:26:34.580 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/002 2024-05-14T01:26:34.580 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:26:34.583 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:26:34.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:26:34.592 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-05-14T01:26:34.788 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:26:34.792 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:26:34.792 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:26:34.893 INFO:teuthology.orchestra.run.smithi154.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:26:34.897 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/003 2024-05-14T01:26:34.897 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/003 2024-05-14T01:26:34.897 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:26:34.899 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:26:34.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:26:34.907 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-05-14T01:26:35.049 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:26:35.053 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:26:35.053 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:26:35.161 INFO:teuthology.orchestra.run.smithi154.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-05-14T01:26:35.164 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/004 2024-05-14T01:26:35.164 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/004 2024-05-14T01:26:35.164 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:26:35.167 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:26:35.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:26:35.175 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-05-14T01:26:35.317 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:26:35.321 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:26:35.321 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:26:35.791 INFO:teuthology.orchestra.run.smithi154.stdout:generic/005 0s 2024-05-14T01:26:35.796 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/005 2024-05-14T01:26:35.796 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:26:35.799 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:26:35.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:26:35.807 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-05-14T01:26:35.981 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:26:35.985 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:26:35.985 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:27:04.484 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:27:04.487 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:27:19.447 INFO:teuthology.orchestra.run.smithi154.stdout:generic/006 43s 2024-05-14T01:27:19.513 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/006 2024-05-14T01:27:19.514 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:27:19.517 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:27:19.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:27:19.527 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-05-14T01:27:19.717 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:27:19.721 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:27:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:27:34.647 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:27:34.649 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:28:04.893 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:28:04.896 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:28:33.211 INFO:teuthology.orchestra.run.smithi154.stdout:generic/007 74s 2024-05-14T01:28:33.217 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/007 2024-05-14T01:28:33.217 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:28:33.219 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:28:33.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:28:33.229 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-05-14T01:28:33.408 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:28:33.412 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:28:33.412 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:28:34.393 INFO:teuthology.orchestra.run.smithi154.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-14T01:28:34.399 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/008 2024-05-14T01:28:34.399 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/008 2024-05-14T01:28:34.399 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:28:34.402 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:28:34.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:28:34.412 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-05-14T01:28:34.566 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:28:34.570 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:28:34.571 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:28:35.292 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:28:35.296 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:28:35.785 INFO:teuthology.orchestra.run.smithi154.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-14T01:28:35.791 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/009 2024-05-14T01:28:35.791 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/009 2024-05-14T01:28:35.791 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:28:35.794 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:28:35.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:28:35.805 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-05-14T01:28:35.995 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:28:36.000 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:28:36.000 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:28:36.126 INFO:teuthology.orchestra.run.smithi154.stdout:generic/010 [not run] /tmp/tmp.E8tkN6FrZCxfstests-dev/src/dbtest not built 2024-05-14T01:28:36.131 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/010 2024-05-14T01:28:36.131 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/010 2024-05-14T01:28:36.131 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:28:36.134 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:28:36.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:28:36.143 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-05-14T01:28:36.320 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:28:36.325 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:28:36.325 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:29:05.591 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:29:05.593 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:29:14.832 INFO:teuthology.orchestra.run.smithi154.stdout:generic/011 38s 2024-05-14T01:29:14.838 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/011 2024-05-14T01:29:14.838 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:29:14.840 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:29:14.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:29:14.906 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-05-14T01:29:15.177 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:29:15.181 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:29:15.181 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:29:16.340 INFO:teuthology.orchestra.run.smithi154.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T01:29:16.344 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/012 2024-05-14T01:29:16.344 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/012 2024-05-14T01:29:16.345 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:29:16.347 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:29:16.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:29:16.359 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-05-14T01:29:16.556 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:29:16.561 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:29:16.561 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:29:35.864 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:29:35.868 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:30:05.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:30:05.911 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:30:36.190 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:30:36.193 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:30:36.380 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-05-14T01:30:36.390+0000 7fc439c46640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 84825) UID: 0 2024-05-14T01:30:36.380 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-05-14T01:30:36.390+0000 7f3b88d8a640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 84825) UID: 0 2024-05-14T01:31:01.371 INFO:teuthology.orchestra.run.smithi154.stdout:generic/013 105s 2024-05-14T01:31:01.434 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/013 2024-05-14T01:31:01.434 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:01.439 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:01.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:01.452 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-05-14T01:31:01.929 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:01.938 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:01.938 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:02.496 INFO:teuthology.orchestra.run.smithi154.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-05-14T01:31:02.502 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/014 2024-05-14T01:31:02.503 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/014 2024-05-14T01:31:02.503 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:02.505 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:02.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:02.517 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-05-14T01:31:03.006 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:03.029 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:03.029 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:03.195 INFO:teuthology.orchestra.run.smithi154.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:03.203 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/015 2024-05-14T01:31:03.204 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/015 2024-05-14T01:31:03.204 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:03.207 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:03.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:03.234 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-05-14T01:31:03.576 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:03.582 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:03.582 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:05.348 INFO:teuthology.orchestra.run.smithi154.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T01:31:05.353 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/016 2024-05-14T01:31:05.353 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/016 2024-05-14T01:31:05.353 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:05.358 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:05.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:05.374 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-05-14T01:31:05.880 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:05.892 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:05.893 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:06.079 INFO:teuthology.orchestra.run.smithi154.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:06.084 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/017 2024-05-14T01:31:06.084 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/017 2024-05-14T01:31:06.084 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:06.088 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:06.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:06.110 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-05-14T01:31:06.521 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:06.538 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:06.538 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:06.733 INFO:teuthology.orchestra.run.smithi154.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:06.738 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/018 2024-05-14T01:31:06.738 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/018 2024-05-14T01:31:06.738 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:06.741 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:06.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:06.768 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-05-14T01:31:07.161 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:07.177 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:07.177 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:07.408 INFO:teuthology.orchestra.run.smithi154.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:07.414 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/019 2024-05-14T01:31:07.414 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/019 2024-05-14T01:31:07.414 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:07.418 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:07.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:07.431 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-05-14T01:31:07.706 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:07.713 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:07.713 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:20.929 INFO:teuthology.orchestra.run.smithi154.stdout:generic/020 - output mismatch (see /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/020.out.bad) 2024-05-14T01:31:20.933 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/020.out 2024-05-14 01:24:47.228293347 +0000 2024-05-14T01:31:20.933 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/020.out.bad 2024-05-14 01:31:20.937688993 +0000 2024-05-14T01:31:20.933 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -47,9 +47,13 @@ 2024-05-14T01:31:20.933 INFO:teuthology.orchestra.run.smithi154.stdout: user.snrub="fish2\012" 2024-05-14T01:31:20.933 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:20.933 INFO:teuthology.orchestra.run.smithi154.stdout: *** really long value 2024-05-14T01:31:20.933 INFO:teuthology.orchestra.run.smithi154.stdout: -0000000 00 2024-05-14T01:31:20.934 INFO:teuthology.orchestra.run.smithi154.stdout: -* 2024-05-14T01:31:20.934 INFO:teuthology.orchestra.run.smithi154.stdout: -ATTRSIZE 2024-05-14T01:31:20.934 INFO:teuthology.orchestra.run.smithi154.stdout: +attr_set: No space left on device 2024-05-14T01:31:20.934 INFO:teuthology.orchestra.run.smithi154.stdout: +Could not set "long_attr" for 2024-05-14T01:31:20.934 INFO:teuthology.orchestra.run.smithi154.stdout: +attr_get: No data available 2024-05-14T01:31:20.934 INFO:teuthology.orchestra.run.smithi154.stdout: +Could not get "long_attr" for 2024-05-14T01:31:20.934 INFO:teuthology.orchestra.run.smithi154.stdout: +0000000 2024-05-14T01:31:20.934 INFO:teuthology.orchestra.run.smithi154.stdout: +attr_remove: No data available 2024-05-14T01:31:20.934 INFO:teuthology.orchestra.run.smithi154.stdout: +Could not remove "long_attr" for 2024-05-14T01:31:20.934 INFO:teuthology.orchestra.run.smithi154.stdout: *** set/get/remove really long names (expect failure) 2024-05-14T01:31:20.934 INFO:teuthology.orchestra.run.smithi154.stdout: attr_set: Invalid argument 2024-05-14T01:31:20.934 INFO:teuthology.orchestra.run.smithi154.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2024-05-14T01:31:20.938 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/020 2024-05-14T01:31:20.939 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/020 2024-05-14T01:31:20.939 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2024-05-14T01:31:20.942 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:21.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T01:31:21.096 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-14T01:31:21.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-14T01:31:21.096 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-05-14T01:31:21.451 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:21.458 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:21.458 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:23.148 INFO:teuthology.orchestra.run.smithi154.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T01:31:23.154 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/021 2024-05-14T01:31:23.154 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/021 2024-05-14T01:31:23.154 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:23.158 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:23.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:23.229 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-05-14T01:31:23.708 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:23.715 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:23.715 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:25.565 INFO:teuthology.orchestra.run.smithi154.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T01:31:25.571 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/022 2024-05-14T01:31:25.571 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/022 2024-05-14T01:31:25.571 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:25.582 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:25.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:25.647 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-05-14T01:31:26.078 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:26.084 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:26.085 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:28.228 INFO:teuthology.orchestra.run.smithi154.stdout:generic/023 2s 2024-05-14T01:31:28.248 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/023 2024-05-14T01:31:28.248 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:28.251 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:28.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:28.380 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-05-14T01:31:28.807 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:28.813 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:28.813 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:29.026 INFO:teuthology.orchestra.run.smithi154.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-05-14T01:31:29.035 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/024 2024-05-14T01:31:29.035 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/024 2024-05-14T01:31:29.035 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:29.038 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:29.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:29.050 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-05-14T01:31:29.568 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:29.583 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:29.583 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:29.811 INFO:teuthology.orchestra.run.smithi154.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-05-14T01:31:29.821 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/025 2024-05-14T01:31:29.821 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/025 2024-05-14T01:31:29.821 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:29.826 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:29.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:29.916 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-05-14T01:31:30.306 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:30.313 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:30.314 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:30.591 INFO:teuthology.orchestra.run.smithi154.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-14T01:31:30.605 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/026 2024-05-14T01:31:30.605 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/026 2024-05-14T01:31:30.606 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:30.608 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:30.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:30.629 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-05-14T01:31:30.982 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:30.988 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:30.988 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:31.170 INFO:teuthology.orchestra.run.smithi154.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:31.178 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/027 2024-05-14T01:31:31.178 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/027 2024-05-14T01:31:31.179 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:31.184 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:31.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:31.198 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-05-14T01:31:31.557 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:31.565 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:36.808 INFO:teuthology.orchestra.run.smithi154.stdout:generic/028 5s 2024-05-14T01:31:36.865 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/028 2024-05-14T01:31:36.865 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:36.868 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:36.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:36.880 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-05-14T01:31:37.229 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:37.236 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:37.236 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:37.465 INFO:teuthology.orchestra.run.smithi154.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:37.470 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/029 2024-05-14T01:31:37.470 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/029 2024-05-14T01:31:37.470 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:37.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:37.503 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-05-14T01:31:37.886 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:37.901 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:37.901 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:38.082 INFO:teuthology.orchestra.run.smithi154.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:38.089 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/030 2024-05-14T01:31:38.089 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/030 2024-05-14T01:31:38.089 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:38.092 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:38.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:38.113 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-05-14T01:31:38.473 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:38.479 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:38.479 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:38.678 INFO:teuthology.orchestra.run.smithi154.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:38.687 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/031 2024-05-14T01:31:38.688 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/031 2024-05-14T01:31:38.688 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:38.690 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:38.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:38.707 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-05-14T01:31:39.069 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:39.074 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:39.075 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:39.239 INFO:teuthology.orchestra.run.smithi154.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:39.244 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/032 2024-05-14T01:31:39.244 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/032 2024-05-14T01:31:39.244 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:39.246 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:39.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:39.259 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-05-14T01:31:39.593 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:39.598 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:39.599 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:39.793 INFO:teuthology.orchestra.run.smithi154.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:39.797 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/033 2024-05-14T01:31:39.797 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/033 2024-05-14T01:31:39.797 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:39.820 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:39.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:39.833 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-05-14T01:31:40.141 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:40.146 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:40.146 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:40.346 INFO:teuthology.orchestra.run.smithi154.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:40.352 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/034 2024-05-14T01:31:40.352 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/034 2024-05-14T01:31:40.353 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:40.358 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:40.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:40.371 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-05-14T01:31:40.734 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:40.739 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:40.739 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:41.105 INFO:teuthology.orchestra.run.smithi154.stdout:generic/035 1s 2024-05-14T01:31:41.156 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/035 2024-05-14T01:31:41.156 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:41.170 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:41.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:41.187 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-05-14T01:31:41.683 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:41.688 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:41.688 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:52.095 INFO:teuthology.orchestra.run.smithi154.stdout:generic/036 11s 2024-05-14T01:31:52.103 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/036 2024-05-14T01:31:52.103 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:52.106 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:52.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:52.280 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-05-14T01:31:52.647 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:52.656 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:52.656 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:52.819 INFO:teuthology.orchestra.run.smithi154.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:52.830 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/037 2024-05-14T01:31:52.830 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/037 2024-05-14T01:31:52.830 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:52.836 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:52.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:52.860 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-05-14T01:31:53.197 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:53.208 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:53.208 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:53.402 INFO:teuthology.orchestra.run.smithi154.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:53.409 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/038 2024-05-14T01:31:53.409 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/038 2024-05-14T01:31:53.409 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:53.414 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:53.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:53.429 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-05-14T01:31:53.778 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:53.802 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:53.803 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:54.006 INFO:teuthology.orchestra.run.smithi154.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:54.010 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/039 2024-05-14T01:31:54.011 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/039 2024-05-14T01:31:54.011 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:54.014 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:54.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:54.036 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-05-14T01:31:54.444 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:54.449 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:54.449 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:54.691 INFO:teuthology.orchestra.run.smithi154.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:54.696 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/040 2024-05-14T01:31:54.696 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/040 2024-05-14T01:31:54.696 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:54.709 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:54.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:54.723 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-05-14T01:31:55.137 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:55.145 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:55.145 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:55.353 INFO:teuthology.orchestra.run.smithi154.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:55.362 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/041 2024-05-14T01:31:55.362 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/041 2024-05-14T01:31:55.362 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:55.373 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:55.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:55.400 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-05-14T01:31:55.791 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:55.803 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:55.803 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:55.993 INFO:teuthology.orchestra.run.smithi154.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:56.001 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/042 2024-05-14T01:31:56.001 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/042 2024-05-14T01:31:56.001 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:56.004 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:56.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:56.027 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-05-14T01:31:56.475 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:56.480 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:56.481 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:56.678 INFO:teuthology.orchestra.run.smithi154.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:56.682 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/043 2024-05-14T01:31:56.682 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/043 2024-05-14T01:31:56.682 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:56.685 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:56.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:56.708 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-05-14T01:31:57.041 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:57.047 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:57.047 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:57.237 INFO:teuthology.orchestra.run.smithi154.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:57.242 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/044 2024-05-14T01:31:57.242 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/044 2024-05-14T01:31:57.242 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:57.245 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:57.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:57.274 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-05-14T01:31:57.583 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:57.588 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:57.588 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:57.761 INFO:teuthology.orchestra.run.smithi154.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:57.772 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/045 2024-05-14T01:31:57.772 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/045 2024-05-14T01:31:57.772 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:57.775 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:57.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:57.790 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-05-14T01:31:58.176 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:58.182 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:58.182 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:58.360 INFO:teuthology.orchestra.run.smithi154.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:58.365 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/046 2024-05-14T01:31:58.365 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/046 2024-05-14T01:31:58.365 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:58.369 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:58.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:58.381 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-05-14T01:31:58.750 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:58.756 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:58.756 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:58.956 INFO:teuthology.orchestra.run.smithi154.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:58.967 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/047 2024-05-14T01:31:58.967 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/047 2024-05-14T01:31:58.967 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:58.971 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:58.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:58.981 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-05-14T01:31:59.304 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:59.309 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:59.309 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:59.490 INFO:teuthology.orchestra.run.smithi154.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:31:59.497 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/048 2024-05-14T01:31:59.497 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/048 2024-05-14T01:31:59.497 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:31:59.502 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:31:59.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:31:59.529 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-05-14T01:31:59.884 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:31:59.892 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:31:59.892 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:00.088 INFO:teuthology.orchestra.run.smithi154.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:32:00.097 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/049 2024-05-14T01:32:00.097 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/049 2024-05-14T01:32:00.097 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:00.100 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:00.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:00.112 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-05-14T01:32:00.485 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:00.500 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:00.500 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:00.666 INFO:teuthology.orchestra.run.smithi154.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:32:00.670 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/050 2024-05-14T01:32:00.670 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/050 2024-05-14T01:32:00.671 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:00.673 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:00.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:00.688 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-05-14T01:32:01.038 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:01.046 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:01.046 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:01.248 INFO:teuthology.orchestra.run.smithi154.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:32:01.253 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/051 2024-05-14T01:32:01.253 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/051 2024-05-14T01:32:01.253 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:01.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:01.276 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-05-14T01:32:01.608 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:01.614 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:01.614 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:01.823 INFO:teuthology.orchestra.run.smithi154.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:32:01.826 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/052 2024-05-14T01:32:01.826 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/052 2024-05-14T01:32:01.827 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:01.829 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:01.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:01.842 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-05-14T01:32:02.260 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:02.274 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:02.275 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:02.473 INFO:teuthology.orchestra.run.smithi154.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:32:02.478 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/053 2024-05-14T01:32:02.478 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/053 2024-05-14T01:32:02.478 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:02.481 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:02.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:02.503 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-05-14T01:32:02.839 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:02.851 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:02.852 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:03.043 INFO:teuthology.orchestra.run.smithi154.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:32:03.050 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/054 2024-05-14T01:32:03.051 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/054 2024-05-14T01:32:03.051 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:03.053 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:03.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:03.068 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-05-14T01:32:03.389 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:03.395 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:03.395 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:03.596 INFO:teuthology.orchestra.run.smithi154.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:32:03.601 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/055 2024-05-14T01:32:03.601 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/055 2024-05-14T01:32:03.601 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:03.606 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:03.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:03.615 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-05-14T01:32:03.947 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:03.953 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:04.148 INFO:teuthology.orchestra.run.smithi154.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:32:04.153 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/056 2024-05-14T01:32:04.153 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/056 2024-05-14T01:32:04.153 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:04.156 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:04.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:04.180 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-05-14T01:32:04.550 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:04.558 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:04.558 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:04.791 INFO:teuthology.orchestra.run.smithi154.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:32:04.812 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/057 2024-05-14T01:32:04.812 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/057 2024-05-14T01:32:04.812 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:04.817 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:04.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:04.832 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-05-14T01:32:05.211 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:05.215 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:05.215 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:07.048 INFO:teuthology.orchestra.run.smithi154.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T01:32:07.269 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/058 2024-05-14T01:32:07.269 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/058 2024-05-14T01:32:07.269 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:07.269 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:07.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:07.269 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-05-14T01:32:07.603 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:07.612 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:07.612 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:07.779 INFO:teuthology.orchestra.run.smithi154.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:32:07.783 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/059 2024-05-14T01:32:07.783 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/059 2024-05-14T01:32:07.783 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:07.785 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:07.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:07.796 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-05-14T01:32:08.105 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:08.110 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:08.110 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:09.831 INFO:teuthology.orchestra.run.smithi154.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T01:32:09.839 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/060 2024-05-14T01:32:09.839 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/060 2024-05-14T01:32:09.839 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:09.842 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:09.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:09.854 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-05-14T01:32:10.353 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:10.358 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:10.359 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:12.101 INFO:teuthology.orchestra.run.smithi154.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T01:32:12.105 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/061 2024-05-14T01:32:12.105 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/061 2024-05-14T01:32:12.105 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:12.108 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:12.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:12.152 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-05-14T01:32:12.610 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:12.617 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:12.617 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:12.789 INFO:teuthology.orchestra.run.smithi154.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:32:12.804 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/062 2024-05-14T01:32:12.804 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/062 2024-05-14T01:32:12.804 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:12.808 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:12.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:12.827 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-05-14T01:32:13.145 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:13.150 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:13.150 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:14.921 INFO:teuthology.orchestra.run.smithi154.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T01:32:14.926 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/063 2024-05-14T01:32:14.926 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/063 2024-05-14T01:32:14.926 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:14.941 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:15.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:15.150 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-05-14T01:32:15.548 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:15.556 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:15.556 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:15.757 INFO:teuthology.orchestra.run.smithi154.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:32:15.770 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/064 2024-05-14T01:32:15.771 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/064 2024-05-14T01:32:15.771 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:15.773 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:15.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:15.854 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-05-14T01:32:16.235 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:16.240 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:16.240 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:16.448 INFO:teuthology.orchestra.run.smithi154.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:32:16.469 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/065 2024-05-14T01:32:16.469 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/065 2024-05-14T01:32:16.469 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:16.478 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:16.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:16.490 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-05-14T01:32:16.902 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:16.906 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:16.907 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:17.091 INFO:teuthology.orchestra.run.smithi154.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:32:17.099 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/066 2024-05-14T01:32:17.099 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/066 2024-05-14T01:32:17.099 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:17.101 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:17.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:17.137 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-05-14T01:32:17.499 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:17.506 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:17.506 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:17.732 INFO:teuthology.orchestra.run.smithi154.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:32:17.737 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/067 2024-05-14T01:32:17.737 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/067 2024-05-14T01:32:17.737 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:17.740 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:17.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:17.790 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-05-14T01:32:18.105 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:18.111 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:18.111 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:18.422 INFO:teuthology.orchestra.run.smithi154.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:32:18.426 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/068 2024-05-14T01:32:18.426 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/068 2024-05-14T01:32:18.426 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:18.429 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:18.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:18.453 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-05-14T01:32:18.847 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:18.860 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:18.860 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:19.034 INFO:teuthology.orchestra.run.smithi154.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:32:19.044 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/069 2024-05-14T01:32:19.044 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/069 2024-05-14T01:32:19.044 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:32:19.054 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:32:19.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:32:19.071 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-05-14T01:32:19.439 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:32:19.444 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:32:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:33:49.659 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:33:49.663 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:33:59.340 INFO:teuthology.orchestra.run.smithi154.stdout:generic/070 100s 2024-05-14T01:33:59.348 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/070 2024-05-14T01:33:59.348 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:33:59.353 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:33:59.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:33:59.593 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-05-14T01:33:59.892 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:33:59.897 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:33:59.897 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:34:00.044 INFO:teuthology.orchestra.run.smithi154.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:34:00.049 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/071 2024-05-14T01:34:00.049 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/071 2024-05-14T01:34:00.049 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:34:00.053 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:34:00.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:34:00.066 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-05-14T01:34:00.320 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:34:00.325 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:34:00.325 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:34:01.658 INFO:teuthology.orchestra.run.smithi154.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-05-14T01:34:01.662 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/072 2024-05-14T01:34:01.662 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/072 2024-05-14T01:34:01.662 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:34:01.665 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:34:01.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:34:01.679 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-05-14T01:34:01.945 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:34:01.961 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:34:01.962 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:34:02.133 INFO:teuthology.orchestra.run.smithi154.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T01:34:02.137 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/073 2024-05-14T01:34:02.137 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/073 2024-05-14T01:34:02.138 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T01:34:02.142 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:34:02.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T01:34:02.156 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-05-14T01:34:02.428 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T01:34:02.441 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T01:34:02.441 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T01:34:19.933 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:34:19.935 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:34:49.999 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:34:50.002 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:35:20.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:35:20.093 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:35:50.218 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:35:50.221 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:36:20.560 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:36:20.563 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:36:50.782 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:36:50.785 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:37:21.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:37:21.013 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:37:51.250 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:37:51.254 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:38:21.323 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:38:21.325 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:38:51.502 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:38:51.505 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:39:21.742 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:39:21.780 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:39:51.948 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:39:51.951 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:40:22.061 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:40:22.064 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:40:52.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:40:52.154 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:41:22.207 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:41:22.209 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:41:52.570 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:41:52.572 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:42:22.619 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:42:22.622 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:42:52.956 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:42:52.958 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:43:23.255 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:43:23.258 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:43:53.303 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:43:53.306 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:44:23.467 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:44:23.469 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:44:53.569 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:44:53.572 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:45:23.693 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:45:23.696 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:45:53.815 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:45:53.818 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:46:23.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:46:23.856 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:46:54.001 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:46:54.003 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:47:24.107 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:47:24.110 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:47:54.246 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:47:54.249 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:48:24.426 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:48:24.430 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:48:54.684 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:48:54.687 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:49:25.140 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:49:25.143 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:49:55.554 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:49:55.556 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:50:25.624 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:50:25.627 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:50:55.756 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:50:55.759 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:51:25.803 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:51:25.806 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:51:55.901 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:51:55.905 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:52:26.039 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:52:26.042 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:52:56.170 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:52:56.173 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:53:26.234 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:53:26.237 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:53:56.298 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:53:56.301 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:54:26.645 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:54:26.648 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:54:56.586 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T01:54:56.578+0000 7f9b94ddb640 -1 bdev(0x5620da144e00 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 3 2024-05-14T01:54:56.717 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:54:56.719 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:55:27.097 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:55:27.101 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:55:57.153 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:55:57.156 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:56:27.442 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:56:27.445 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:56:57.531 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:56:57.533 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:57:27.887 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:57:27.889 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:57:58.042 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:57:58.045 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:58:28.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:58:28.109 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:58:58.162 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:58:58.165 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:59:28.308 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:59:28.311 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:59:58.423 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T01:59:58.425 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:00:28.774 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:00:28.777 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:00:58.866 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:00:58.869 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:01:29.114 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:01:29.117 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:01:59.236 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:01:59.239 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:01:59.272 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-05-14T02:01:59.266+0000 7f75626b8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34258) UID: 0 2024-05-14T02:01:59.273 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T02:01:59.266+0000 7f9bb37f5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34258) UID: 0 2024-05-14T02:01:59.273 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-05-14T02:01:59.266+0000 7f396d567640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34258) UID: 0 2024-05-14T02:01:59.273 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-05-14T02:01:59.266+0000 7f01ba1e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34258) UID: 0 2024-05-14T02:04:54.499 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:04:54.502 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:04:54.517 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-05-14T02:04:54.509+0000 7f01ba1e9640 -1 received signal: Hangup from (PID: 34392) UID: 0 2024-05-14T02:04:54.518 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T02:04:54.509+0000 7f9bb37f5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34392) UID: 0 2024-05-14T02:04:54.519 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-05-14T02:04:54.509+0000 7f396d567640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34392) UID: 0 2024-05-14T02:04:54.520 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-05-14T02:04:54.509+0000 7f75626b8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34392) UID: 0 2024-05-14T02:04:54.606 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T02:04:54.610+0000 7fa1653a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118060) UID: 0 2024-05-14T02:04:54.607 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-05-14T02:04:54.610+0000 7f7aa7691640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118060) UID: 0 2024-05-14T02:04:54.607 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T02:04:54.610+0000 7fef9122a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118060) UID: 0 2024-05-14T02:04:54.607 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-05-14T02:04:54.610+0000 7f7af66da640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118060) UID: 0 2024-05-14T02:05:54.481 INFO:teuthology.orchestra.run.smithi154.stdout:generic/074 1912s 2024-05-14T02:05:54.687 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/074 2024-05-14T02:05:54.688 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:05:54.690 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:05:54.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:05:54.700 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-05-14T02:05:55.727 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:05:55.731 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:05:55.731 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:05.515 INFO:teuthology.orchestra.run.smithi154.stdout:generic/075 70s 2024-05-14T02:07:05.521 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/075 2024-05-14T02:07:05.521 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:07:05.523 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:05.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:07:05.692 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-05-14T02:07:06.114 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:07:06.118 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:07:06.119 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:06.225 INFO:teuthology.orchestra.run.smithi154.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:07:06.228 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/076 2024-05-14T02:07:06.229 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/076 2024-05-14T02:07:06.229 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:07:06.231 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:06.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:07:06.239 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-05-14T02:07:06.397 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:07:06.401 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:07:06.401 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:08.724 INFO:teuthology.orchestra.run.smithi154.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:07:08.729 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/077 2024-05-14T02:07:08.729 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/077 2024-05-14T02:07:08.729 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:07:08.734 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:08.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:07:08.742 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-05-14T02:07:08.905 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:07:08.909 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:07:08.909 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:09.068 INFO:teuthology.orchestra.run.smithi154.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-05-14T02:07:09.072 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/078 2024-05-14T02:07:09.073 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/078 2024-05-14T02:07:09.073 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:07:09.075 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:09.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:07:09.084 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-05-14T02:07:09.621 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:07:09.625 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:07:09.625 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:09.807 INFO:teuthology.orchestra.run.smithi154.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-05-14T02:07:09.811 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/079 2024-05-14T02:07:09.811 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/079 2024-05-14T02:07:09.811 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:07:09.813 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:09.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:07:09.823 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-05-14T02:07:09.973 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:07:09.977 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:07:09.977 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:12.414 INFO:teuthology.orchestra.run.smithi154.stdout:generic/080 3s 2024-05-14T02:07:12.419 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/080 2024-05-14T02:07:12.419 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:07:12.422 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:12.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:07:12.434 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-05-14T02:07:12.594 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:07:12.598 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:07:12.598 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:12.707 INFO:teuthology.orchestra.run.smithi154.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:07:12.710 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/081 2024-05-14T02:07:12.710 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/081 2024-05-14T02:07:12.710 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:07:12.713 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:12.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:07:12.721 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-05-14T02:07:12.874 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:07:12.878 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:07:12.878 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:12.987 INFO:teuthology.orchestra.run.smithi154.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:07:12.991 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/082 2024-05-14T02:07:12.991 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/082 2024-05-14T02:07:12.991 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:07:12.993 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:13.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:07:13.002 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-05-14T02:07:13.151 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:07:13.155 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:07:13.155 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:13.258 INFO:teuthology.orchestra.run.smithi154.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:07:13.262 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/083 2024-05-14T02:07:13.262 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/083 2024-05-14T02:07:13.262 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:07:13.265 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:13.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:07:13.274 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-05-14T02:07:13.427 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:07:13.431 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:07:13.431 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:13.534 INFO:teuthology.orchestra.run.smithi154.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:07:13.537 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/084 2024-05-14T02:07:13.538 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/084 2024-05-14T02:07:13.538 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:07:13.540 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:13.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:07:13.548 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-05-14T02:07:13.696 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:07:13.700 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:07:13.700 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:13.850 INFO:teuthology.orchestra.run.smithi154.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:07:13.854 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/085 2024-05-14T02:07:13.854 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/085 2024-05-14T02:07:13.854 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:07:13.882 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:13.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:07:13.890 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-05-14T02:07:14.040 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:07:14.044 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:07:14.044 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:20.050 INFO:teuthology.orchestra.run.smithi154.stdout:generic/086 5s 2024-05-14T02:07:20.324 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/086 2024-05-14T02:07:20.324 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:07:20.331 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:20.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:07:20.422 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-05-14T02:07:23.514 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:07:23.520 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:07:23.520 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:24.059 INFO:teuthology.orchestra.run.smithi154.stdout:generic/087 1s 2024-05-14T02:07:24.066 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/087 2024-05-14T02:07:24.066 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:07:24.069 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:24.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:07:24.079 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-05-14T02:07:24.586 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:07:24.590 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:07:24.590 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:24.776 INFO:teuthology.orchestra.run.smithi154.stdout:generic/088 0s 2024-05-14T02:07:24.781 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/088 2024-05-14T02:07:24.781 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:07:24.783 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:24.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:07:24.792 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-05-14T02:07:25.300 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:07:25.304 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:07:25.304 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:07:54.069 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:07:54.073 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:08:24.792 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:08:24.795 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:08:54.842 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:08:54.877 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:09:25.113 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:09:25.115 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:09:55.187 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:09:55.191 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:10:25.478 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:10:25.481 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:10:25.598 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-05-14T02:10:25.595+0000 7fc439c46640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 124616) UID: 0 2024-05-14T02:10:25.599 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-05-14T02:10:25.595+0000 7f3b88d8a640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 124616) UID: 0 2024-05-14T02:13:38.077 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:13:38.080 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:14:08.321 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:14:08.323 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:14:38.370 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:14:38.372 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:14:38.387 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-05-14T02:14:38.384+0000 7fc439c46640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 124846) UID: 0 2024-05-14T02:14:38.388 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-05-14T02:14:38.384+0000 7f3b88d8a640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 124846) UID: 0 2024-05-14T02:17:26.599 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:17:26.603 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:17:56.804 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:17:56.806 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:18:26.843 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:18:26.846 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:18:57.015 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:18:57.017 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:18:57.031 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-05-14T02:18:57.026+0000 7fc439c46640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 126880) UID: 0 2024-05-14T02:18:57.031 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-05-14T02:18:57.026+0000 7f3b88d8a640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 126880) UID: 0 2024-05-14T02:21:43.860 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:21:43.863 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:22:16.249 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:22:16.252 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:22:46.373 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:22:46.376 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:22:48.628 INFO:teuthology.orchestra.run.smithi154.stdout:generic/089 923s 2024-05-14T02:22:48.695 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/089 2024-05-14T02:22:48.695 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:22:48.700 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:22:48.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:22:48.714 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-05-14T02:22:49.688 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:22:49.692 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:22:49.692 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:22:49.896 INFO:teuthology.orchestra.run.smithi154.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:22:49.899 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/090 2024-05-14T02:22:49.899 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/090 2024-05-14T02:22:49.899 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:22:49.902 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:22:49.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:22:49.911 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-05-14T02:22:50.074 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:22:50.078 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:22:50.078 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:23:16.795 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:23:16.798 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:23:46.852 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:23:46.856 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:24:16.973 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:24:16.976 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:24:47.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:24:47.025 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:25:17.143 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:25:17.146 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:25:47.207 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:25:47.210 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:25:47.231 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-05-14T02:25:47.228+0000 7f75626b8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34488) UID: 0 2024-05-14T02:25:47.231 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-05-14T02:25:47.228+0000 7f396d567640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34488) UID: 0 2024-05-14T02:25:47.232 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T02:25:47.228+0000 7f9bb37f5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34488) UID: 0 2024-05-14T02:25:47.232 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-05-14T02:25:47.228+0000 7f01ba1e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34488) UID: 0 2024-05-14T02:27:11.012 INFO:teuthology.orchestra.run.smithi154.stdout:generic/091 260s 2024-05-14T02:27:11.020 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/091 2024-05-14T02:27:11.021 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:11.026 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:11.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:11.040 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-05-14T02:27:11.596 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:11.600 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:11.601 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:11.772 INFO:teuthology.orchestra.run.smithi154.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T02:27:11.776 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/092 2024-05-14T02:27:11.776 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/092 2024-05-14T02:27:11.776 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:11.779 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:11.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:11.787 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-05-14T02:27:12.313 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:12.317 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:12.317 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:13.272 INFO:teuthology.orchestra.run.smithi154.stdout:generic/093 1s 2024-05-14T02:27:13.277 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/093 2024-05-14T02:27:13.277 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:13.279 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:13.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:13.288 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-05-14T02:27:13.813 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:13.817 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:13.817 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:13.918 INFO:teuthology.orchestra.run.smithi154.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:27:13.921 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/094 2024-05-14T02:27:13.922 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/094 2024-05-14T02:27:13.922 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:13.924 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:13.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:13.933 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-05-14T02:27:14.084 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:14.088 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:14.088 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:14.191 INFO:teuthology.orchestra.run.smithi154.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:27:14.195 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/095 2024-05-14T02:27:14.195 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/095 2024-05-14T02:27:14.195 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:14.197 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:14.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:14.205 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-05-14T02:27:14.356 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:14.362 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:14.362 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:14.464 INFO:teuthology.orchestra.run.smithi154.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:27:14.468 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/096 2024-05-14T02:27:14.468 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/096 2024-05-14T02:27:14.468 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:14.470 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:14.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:14.478 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-05-14T02:27:14.626 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:14.631 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:14.631 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:15.281 INFO:teuthology.orchestra.run.smithi154.stdout:generic/097 1s 2024-05-14T02:27:15.286 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/097 2024-05-14T02:27:15.286 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:15.288 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:15.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:15.296 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-05-14T02:27:15.445 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:15.449 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:15.449 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:15.550 INFO:teuthology.orchestra.run.smithi154.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:27:15.553 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/098 2024-05-14T02:27:15.554 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/098 2024-05-14T02:27:15.554 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:15.556 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:15.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:15.564 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-05-14T02:27:15.713 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:15.718 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:15.718 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:15.884 INFO:teuthology.orchestra.run.smithi154.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-14T02:27:15.888 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/099 2024-05-14T02:27:15.888 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/099 2024-05-14T02:27:15.888 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:15.890 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:15.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:15.898 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-05-14T02:27:16.050 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:16.054 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:16.055 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:48.948 INFO:teuthology.orchestra.run.smithi154.stdout:generic/100 32s 2024-05-14T02:27:48.956 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/100 2024-05-14T02:27:48.956 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:48.960 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:48.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:48.984 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-05-14T02:27:49.162 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:49.166 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:49.166 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:49.595 INFO:teuthology.orchestra.run.smithi154.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:27:49.600 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/101 2024-05-14T02:27:49.600 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/101 2024-05-14T02:27:49.600 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:49.603 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:49.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:49.632 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-05-14T02:27:49.788 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:49.792 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:49.792 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:49.894 INFO:teuthology.orchestra.run.smithi154.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:27:49.898 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/102 2024-05-14T02:27:49.898 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/102 2024-05-14T02:27:49.898 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:49.901 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:49.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:49.909 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-05-14T02:27:50.064 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:50.068 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:50.068 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:50.169 INFO:teuthology.orchestra.run.smithi154.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:27:50.172 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/103 2024-05-14T02:27:50.172 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/103 2024-05-14T02:27:50.173 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:50.175 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:50.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:50.184 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-05-14T02:27:50.334 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:50.338 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:50.338 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:50.460 INFO:teuthology.orchestra.run.smithi154.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:27:50.464 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/104 2024-05-14T02:27:50.464 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/104 2024-05-14T02:27:50.464 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:50.466 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:50.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:50.474 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-05-14T02:27:50.622 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:50.626 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:50.729 INFO:teuthology.orchestra.run.smithi154.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:27:50.734 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/105 2024-05-14T02:27:50.734 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/105 2024-05-14T02:27:50.734 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:50.735 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:50.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:50.744 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-05-14T02:27:50.893 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:50.897 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:50.897 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:51.017 INFO:teuthology.orchestra.run.smithi154.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:27:51.020 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/106 2024-05-14T02:27:51.020 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/106 2024-05-14T02:27:51.020 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:51.022 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:51.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:51.031 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-05-14T02:27:51.182 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:51.187 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:51.187 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:51.300 INFO:teuthology.orchestra.run.smithi154.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:27:51.304 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/107 2024-05-14T02:27:51.304 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/107 2024-05-14T02:27:51.304 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:51.306 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:51.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:51.315 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-05-14T02:27:51.463 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:51.467 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:51.467 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:51.795 INFO:teuthology.orchestra.run.smithi154.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:27:51.801 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/108 2024-05-14T02:27:51.801 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/108 2024-05-14T02:27:51.801 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:51.805 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:51.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:51.816 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-05-14T02:27:51.994 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:51.999 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:51.999 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:52.104 INFO:teuthology.orchestra.run.smithi154.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:27:52.107 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/109 2024-05-14T02:27:52.108 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/109 2024-05-14T02:27:52.108 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:52.110 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:52.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:52.118 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-05-14T02:27:52.268 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:52.272 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:52.272 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:52.433 INFO:teuthology.orchestra.run.smithi154.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T02:27:52.437 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/110 2024-05-14T02:27:52.437 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/110 2024-05-14T02:27:52.437 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:52.439 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:52.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:52.447 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-05-14T02:27:52.960 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:52.964 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:53.110 INFO:teuthology.orchestra.run.smithi154.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T02:27:53.113 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/111 2024-05-14T02:27:53.113 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/111 2024-05-14T02:27:53.113 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:27:53.116 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:27:53.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:27:53.124 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-05-14T02:27:53.634 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:27:53.638 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:27:53.638 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:28:03.740 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:28:03.744 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:28:33.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:28:33.856 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:29:03.900 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:29:03.903 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:29:25.171 INFO:teuthology.orchestra.run.smithi154.stdout:generic/112 92s 2024-05-14T02:29:25.178 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/112 2024-05-14T02:29:25.178 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:29:25.183 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:29:25.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:29:25.195 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-05-14T02:29:25.744 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:29:25.748 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:29:25.748 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:29:34.003 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:29:34.006 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:30:04.143 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:30:04.147 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:30:04.252 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-05-14T02:30:04.249+0000 7fc439c46640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 151524) UID: 0 2024-05-14T02:30:04.253 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-05-14T02:30:04.249+0000 7f3b88d8a640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 151524) UID: 0 2024-05-14T02:30:12.562 INFO:teuthology.orchestra.run.smithi154.stdout:generic/113 47s 2024-05-14T02:30:12.567 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/113 2024-05-14T02:30:12.567 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:30:12.570 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:12.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:30:12.579 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-05-14T02:30:13.201 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:30:13.205 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:30:13.205 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:13.360 INFO:teuthology.orchestra.run.smithi154.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-05-14T02:30:13.364 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/114 2024-05-14T02:30:13.364 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/114 2024-05-14T02:30:13.364 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:30:13.366 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:13.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:30:13.374 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-05-14T02:30:13.525 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:30:13.529 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:30:13.530 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:13.680 INFO:teuthology.orchestra.run.smithi154.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T02:30:13.683 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/115 2024-05-14T02:30:13.683 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/115 2024-05-14T02:30:13.683 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:30:13.685 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:13.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:30:13.694 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-05-14T02:30:14.255 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:30:14.259 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:30:14.259 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:14.412 INFO:teuthology.orchestra.run.smithi154.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T02:30:14.416 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/116 2024-05-14T02:30:14.416 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/116 2024-05-14T02:30:14.416 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:30:14.418 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:14.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:30:14.427 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-05-14T02:30:14.974 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:30:14.978 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:30:14.979 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:15.081 INFO:teuthology.orchestra.run.smithi154.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:30:15.085 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/117 2024-05-14T02:30:15.085 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/117 2024-05-14T02:30:15.085 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:30:15.087 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:15.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:30:15.096 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-05-14T02:30:15.246 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:30:15.251 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:30:15.251 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:15.402 INFO:teuthology.orchestra.run.smithi154.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T02:30:15.406 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/118 2024-05-14T02:30:15.406 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/118 2024-05-14T02:30:15.406 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:30:15.408 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:15.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:30:15.416 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-05-14T02:30:15.953 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:30:15.957 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:30:15.957 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:16.107 INFO:teuthology.orchestra.run.smithi154.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T02:30:16.111 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/119 2024-05-14T02:30:16.111 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/119 2024-05-14T02:30:16.111 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:30:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:16.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:30:16.121 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-05-14T02:30:16.660 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:30:16.665 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:30:16.665 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:16.769 INFO:teuthology.orchestra.run.smithi154.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:30:16.773 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/120 2024-05-14T02:30:16.773 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/120 2024-05-14T02:30:16.773 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:30:16.775 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:16.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:30:16.783 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-05-14T02:30:16.956 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:30:16.960 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:30:16.960 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:17.116 INFO:teuthology.orchestra.run.smithi154.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-14T02:30:17.120 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/121 2024-05-14T02:30:17.120 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/121 2024-05-14T02:30:17.120 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:30:17.122 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:17.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:30:17.131 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-05-14T02:30:17.660 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:30:17.663 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:30:17.664 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:17.818 INFO:teuthology.orchestra.run.smithi154.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-14T02:30:17.822 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/122 2024-05-14T02:30:17.822 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/122 2024-05-14T02:30:17.822 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:30:17.824 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:17.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:30:17.833 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-05-14T02:30:18.396 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:30:18.400 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:30:18.400 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:18.769 INFO:teuthology.orchestra.run.smithi154.stdout:generic/123 0s 2024-05-14T02:30:18.774 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/123 2024-05-14T02:30:18.774 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:30:18.777 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:18.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:30:18.786 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-05-14T02:30:19.339 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:30:19.343 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:30:19.343 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:19.449 INFO:teuthology.orchestra.run.smithi154.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:30:19.452 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/124 2024-05-14T02:30:19.452 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/124 2024-05-14T02:30:19.452 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:30:19.454 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:30:19.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:30:19.463 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-05-14T02:30:19.611 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:30:19.615 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:30:19.615 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:31:21.512 INFO:teuthology.orchestra.run.smithi154.stdout:generic/125 62s 2024-05-14T02:31:21.519 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/125 2024-05-14T02:31:21.519 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:31:21.523 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:31:21.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:31:21.553 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-05-14T02:31:22.101 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:31:22.105 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:31:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:31:22.671 INFO:teuthology.orchestra.run.smithi154.stdout:generic/126 - output mismatch (see /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/126.out.bad) 2024-05-14T02:31:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/126.out 2024-05-14 01:24:47.236293205 +0000 2024-05-14T02:31:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/126.out.bad 2024-05-14 02:31:22.667733544 +0000 2024-05-14T02:31:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,7 +1,7 @@ 2024-05-14T02:31:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 126 2024-05-14T02:31:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2024-05-14T02:31:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2024-05-14T02:31:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2024-05-14T02:31:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2024-05-14T02:31:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2024-05-14T02:31:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2024-05-14T02:31:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2024-05-14T02:31:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2024-05-14T02:31:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2024-05-14T02:31:22.675 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/126 2024-05-14T02:31:22.675 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/126 2024-05-14T02:31:22.675 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2024-05-14T02:31:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:31:22.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T02:31:22.686 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-14T02:31:22.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-14T02:31:22.686 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-05-14T02:31:23.259 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:31:23.263 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:31:23.263 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:32:29.068 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:32:29.071 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:32:59.197 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:32:59.201 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:33:29.294 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:33:29.297 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:33:59.392 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:33:59.394 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:34:29.443 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:34:29.446 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:34:59.556 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:34:59.562 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:35:29.687 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:35:29.689 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:35:59.830 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:35:59.834 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:36:29.873 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:36:29.876 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:37:00.213 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:37:00.216 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:37:30.432 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:37:30.435 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:38:00.496 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:38:00.499 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:38:30.788 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:38:30.791 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:39:00.841 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:39:00.845 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:39:30.965 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:39:30.969 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:40:01.104 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:40:01.108 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:40:31.357 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:40:31.361 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:41:01.406 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:41:01.409 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:41:31.581 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:41:31.584 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:42:01.703 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:42:01.706 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:42:31.783 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:42:31.786 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:43:01.935 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:43:01.939 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:43:32.111 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:43:32.114 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:44:02.166 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:44:02.169 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:44:32.262 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:44:32.265 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:45:02.366 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:45:02.369 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:45:32.502 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:45:32.506 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:46:02.664 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:46:02.668 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:46:32.710 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:46:32.715 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:47:02.773 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:47:02.777 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:47:02.795 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T02:47:02.791+0000 7fef9122a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 157836) UID: 0 2024-05-14T02:47:02.795 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T02:47:02.791+0000 7fa1653a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 157836) UID: 0 2024-05-14T02:47:02.795 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-05-14T02:47:02.791+0000 7f7aa7691640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 157836) UID: 0 2024-05-14T02:47:02.796 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-05-14T02:47:02.791+0000 7f7af66da640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 157836) UID: 0 2024-05-14T02:49:40.979 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:49:40.982 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:49:41.025 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T02:49:41.022+0000 7fef9122a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 157851) UID: 0 2024-05-14T02:49:41.026 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T02:49:41.022+0000 7fa1653a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 157851) UID: 0 2024-05-14T02:49:41.026 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-05-14T02:49:41.022+0000 7f7aa7691640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 157851) UID: 0 2024-05-14T02:49:41.026 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-05-14T02:49:41.022+0000 7f7af66da640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 157851) UID: 0 2024-05-14T02:52:18.297 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:52:18.301 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:52:48.354 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:52:48.357 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:53:18.464 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:53:18.468 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:53:48.562 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:53:48.565 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:54:18.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:54:18.700 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:54:49.078 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:54:49.081 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:55:19.208 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:55:19.211 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:55:49.330 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:55:49.334 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:56:19.493 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:56:19.496 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:56:49.910 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:56:49.913 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:57:19.961 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:57:19.964 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:57:50.069 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:57:50.072 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:57:59.623 INFO:teuthology.orchestra.run.smithi154.stdout:generic/127 1596s 2024-05-14T02:57:59.630 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/127 2024-05-14T02:57:59.630 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:57:59.634 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:57:59.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:57:59.646 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-05-14T02:58:00.224 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:58:00.228 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:58:00.229 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:58:00.387 INFO:teuthology.orchestra.run.smithi154.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:58:00.390 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/128 2024-05-14T02:58:00.391 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/128 2024-05-14T02:58:00.391 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:58:00.393 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:58:00.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:58:00.403 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-05-14T02:58:00.562 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:58:00.567 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:58:00.567 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:58:00.687 INFO:teuthology.orchestra.run.smithi154.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:58:00.691 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/129 2024-05-14T02:58:00.691 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/129 2024-05-14T02:58:00.691 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:58:00.693 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:58:00.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:58:00.701 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-05-14T02:58:00.849 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:58:00.853 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:58:00.853 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:58:00.966 INFO:teuthology.orchestra.run.smithi154.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:58:00.970 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/130 2024-05-14T02:58:00.970 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/130 2024-05-14T02:58:00.970 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:58:00.972 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:58:00.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:58:00.981 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-05-14T02:58:01.127 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:58:01.131 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:58:01.132 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:58:02.532 INFO:teuthology.orchestra.run.smithi154.stdout:generic/131 1s 2024-05-14T02:58:02.539 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/131 2024-05-14T02:58:02.539 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:58:02.542 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:58:02.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:58:02.553 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-05-14T02:58:03.089 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:58:03.093 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:58:03.093 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:58:03.195 INFO:teuthology.orchestra.run.smithi154.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T02:58:03.198 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/132 2024-05-14T02:58:03.198 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/132 2024-05-14T02:58:03.199 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T02:58:03.201 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:58:03.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T02:58:03.209 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-05-14T02:58:03.354 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T02:58:03.359 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T02:58:03.359 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T02:58:20.183 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:58:20.186 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:58:50.305 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:58:50.309 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:59:20.403 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:59:20.406 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:59:50.566 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T02:59:50.570 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:00:20.638 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:00:20.641 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:00:50.686 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:00:50.689 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:01:20.799 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:01:20.826 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:01:50.871 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:01:50.874 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:02:21.178 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:02:21.181 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:02:51.215 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:02:51.219 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:03:21.346 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:03:21.349 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:03:51.409 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:03:51.411 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:04:21.532 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:04:21.535 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:04:51.596 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:04:51.599 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:05:21.659 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:05:21.663 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:05:51.715 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:05:51.718 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:06:21.762 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:06:21.765 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:06:41.883 INFO:teuthology.orchestra.run.smithi154.stdout:generic/133 518s 2024-05-14T03:06:41.890 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/133 2024-05-14T03:06:41.891 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:41.895 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:41.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:41.907 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-05-14T03:06:42.457 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:42.461 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:42.461 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:42.670 INFO:teuthology.orchestra.run.smithi154.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:42.679 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/134 2024-05-14T03:06:42.680 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/134 2024-05-14T03:06:42.680 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:42.687 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:42.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:42.707 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-05-14T03:06:43.285 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:43.289 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:43.289 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:43.453 INFO:teuthology.orchestra.run.smithi154.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:06:43.457 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/135 2024-05-14T03:06:43.457 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/135 2024-05-14T03:06:43.457 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:43.459 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:43.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:43.468 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-05-14T03:06:43.617 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:43.621 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:43.621 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:43.771 INFO:teuthology.orchestra.run.smithi154.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:43.775 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/136 2024-05-14T03:06:43.775 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/136 2024-05-14T03:06:43.775 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:43.778 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:43.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:43.786 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-05-14T03:06:44.298 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:44.302 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:44.302 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:44.453 INFO:teuthology.orchestra.run.smithi154.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:44.457 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/137 2024-05-14T03:06:44.457 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/137 2024-05-14T03:06:44.457 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:44.459 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:44.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:44.468 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-05-14T03:06:44.986 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:44.990 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:44.990 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:45.137 INFO:teuthology.orchestra.run.smithi154.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:45.141 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/138 2024-05-14T03:06:45.141 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/138 2024-05-14T03:06:45.141 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:45.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:45.153 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-05-14T03:06:45.676 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:45.680 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:45.680 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:45.824 INFO:teuthology.orchestra.run.smithi154.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:45.828 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/139 2024-05-14T03:06:45.828 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/139 2024-05-14T03:06:45.828 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:45.831 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:45.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:45.839 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-05-14T03:06:46.349 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:46.353 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:46.353 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:46.498 INFO:teuthology.orchestra.run.smithi154.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:46.502 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/140 2024-05-14T03:06:46.502 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/140 2024-05-14T03:06:46.502 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:46.504 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:46.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:46.513 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-05-14T03:06:47.045 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:47.049 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:47.049 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:47.159 INFO:teuthology.orchestra.run.smithi154.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:06:47.163 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/141 2024-05-14T03:06:47.164 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/141 2024-05-14T03:06:47.164 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:47.166 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:47.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:47.174 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-05-14T03:06:47.320 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:47.324 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:47.324 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:47.469 INFO:teuthology.orchestra.run.smithi154.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:47.473 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/142 2024-05-14T03:06:47.473 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/142 2024-05-14T03:06:47.473 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:47.475 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:47.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:47.483 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-05-14T03:06:48.022 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:48.026 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:48.026 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:48.174 INFO:teuthology.orchestra.run.smithi154.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:48.177 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/143 2024-05-14T03:06:48.177 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/143 2024-05-14T03:06:48.177 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:48.180 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:48.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:48.188 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-05-14T03:06:48.705 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:48.709 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:48.709 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:48.852 INFO:teuthology.orchestra.run.smithi154.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:48.856 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/144 2024-05-14T03:06:48.856 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/144 2024-05-14T03:06:48.856 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:48.858 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:48.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:48.868 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-05-14T03:06:49.389 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:49.393 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:49.393 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:49.540 INFO:teuthology.orchestra.run.smithi154.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:49.543 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/145 2024-05-14T03:06:49.543 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/145 2024-05-14T03:06:49.543 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:49.546 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:49.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:49.554 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-05-14T03:06:50.093 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:50.097 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:50.097 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:50.242 INFO:teuthology.orchestra.run.smithi154.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:50.246 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/146 2024-05-14T03:06:50.246 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/146 2024-05-14T03:06:50.246 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:50.248 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:50.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:50.257 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-05-14T03:06:50.769 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:50.773 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:50.773 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:50.919 INFO:teuthology.orchestra.run.smithi154.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:50.923 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/147 2024-05-14T03:06:50.923 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/147 2024-05-14T03:06:50.923 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:50.925 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:50.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:50.933 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-05-14T03:06:51.453 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:51.457 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:51.457 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:51.606 INFO:teuthology.orchestra.run.smithi154.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:51.610 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/148 2024-05-14T03:06:51.610 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/148 2024-05-14T03:06:51.610 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:51.612 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:51.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:51.620 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-05-14T03:06:51.860 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:06:51.863 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:06:52.154 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:52.158 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:52.159 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:52.349 INFO:teuthology.orchestra.run.smithi154.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:52.352 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/149 2024-05-14T03:06:52.353 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/149 2024-05-14T03:06:52.353 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:52.355 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:52.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:52.363 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-05-14T03:06:52.883 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:52.887 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:52.887 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:53.043 INFO:teuthology.orchestra.run.smithi154.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:53.046 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/150 2024-05-14T03:06:53.046 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/150 2024-05-14T03:06:53.046 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:53.049 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:53.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:53.057 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-05-14T03:06:53.562 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:53.566 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:53.566 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:53.718 INFO:teuthology.orchestra.run.smithi154.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:53.721 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/151 2024-05-14T03:06:53.722 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/151 2024-05-14T03:06:53.722 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:53.724 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:53.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:53.732 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-05-14T03:06:54.242 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:54.246 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:54.247 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:54.399 INFO:teuthology.orchestra.run.smithi154.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:54.402 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/152 2024-05-14T03:06:54.403 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/152 2024-05-14T03:06:54.403 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:54.405 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:54.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:54.414 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-05-14T03:06:54.926 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:54.930 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:54.930 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:55.077 INFO:teuthology.orchestra.run.smithi154.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:55.081 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/153 2024-05-14T03:06:55.081 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/153 2024-05-14T03:06:55.081 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:55.083 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:55.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:55.092 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-05-14T03:06:55.604 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:55.608 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:55.608 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:55.756 INFO:teuthology.orchestra.run.smithi154.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:55.759 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/154 2024-05-14T03:06:55.760 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/154 2024-05-14T03:06:55.760 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:55.762 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:55.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:55.770 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-05-14T03:06:56.279 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:56.283 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:56.283 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:56.431 INFO:teuthology.orchestra.run.smithi154.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:56.434 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/155 2024-05-14T03:06:56.434 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/155 2024-05-14T03:06:56.435 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:56.437 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:56.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:56.445 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-05-14T03:06:56.941 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:56.945 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:56.945 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:57.100 INFO:teuthology.orchestra.run.smithi154.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:57.103 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/156 2024-05-14T03:06:57.103 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/156 2024-05-14T03:06:57.103 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:57.105 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:57.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:57.114 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-05-14T03:06:57.633 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:57.637 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:57.637 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:57.787 INFO:teuthology.orchestra.run.smithi154.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:57.790 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/157 2024-05-14T03:06:57.791 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/157 2024-05-14T03:06:57.791 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:57.793 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:57.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:57.801 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-05-14T03:06:58.323 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:58.327 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:58.327 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:58.480 INFO:teuthology.orchestra.run.smithi154.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-14T03:06:58.484 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/158 2024-05-14T03:06:58.484 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/158 2024-05-14T03:06:58.484 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:58.486 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:58.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:58.495 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-05-14T03:06:59.011 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:59.015 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:59.015 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:59.162 INFO:teuthology.orchestra.run.smithi154.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-05-14T03:06:59.166 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/159 2024-05-14T03:06:59.166 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/159 2024-05-14T03:06:59.166 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:59.168 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:59.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:59.177 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-05-14T03:06:59.321 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:59.325 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:59.325 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:59.464 INFO:teuthology.orchestra.run.smithi154.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-05-14T03:06:59.468 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/160 2024-05-14T03:06:59.468 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/160 2024-05-14T03:06:59.468 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:59.470 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:59.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:59.482 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-05-14T03:06:59.629 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:59.634 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:59.634 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:59.740 INFO:teuthology.orchestra.run.smithi154.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:06:59.744 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/161 2024-05-14T03:06:59.744 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/161 2024-05-14T03:06:59.744 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:06:59.746 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:06:59.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:06:59.755 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-05-14T03:06:59.905 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:06:59.909 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:06:59.909 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:00.015 INFO:teuthology.orchestra.run.smithi154.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:00.018 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/162 2024-05-14T03:07:00.018 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/162 2024-05-14T03:07:00.018 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:00.019 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:00.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:00.028 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-05-14T03:07:00.172 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:00.176 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:00.176 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:00.282 INFO:teuthology.orchestra.run.smithi154.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:00.286 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/163 2024-05-14T03:07:00.286 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/163 2024-05-14T03:07:00.286 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:00.288 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:00.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:00.297 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-05-14T03:07:00.445 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:00.449 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:00.449 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:00.550 INFO:teuthology.orchestra.run.smithi154.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:00.553 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/164 2024-05-14T03:07:00.553 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/164 2024-05-14T03:07:00.553 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:00.555 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:00.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:00.564 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-05-14T03:07:00.708 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:00.712 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:00.712 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:00.814 INFO:teuthology.orchestra.run.smithi154.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:00.818 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/165 2024-05-14T03:07:00.818 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/165 2024-05-14T03:07:00.818 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:00.820 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:00.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:00.830 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-05-14T03:07:00.974 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:00.978 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:00.978 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:01.080 INFO:teuthology.orchestra.run.smithi154.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:01.084 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/166 2024-05-14T03:07:01.084 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/166 2024-05-14T03:07:01.084 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:01.087 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:01.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:01.095 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-05-14T03:07:01.245 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:01.249 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:01.353 INFO:teuthology.orchestra.run.smithi154.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:01.357 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/167 2024-05-14T03:07:01.357 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/167 2024-05-14T03:07:01.357 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:01.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:01.368 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-05-14T03:07:01.514 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:01.518 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:01.518 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:01.621 INFO:teuthology.orchestra.run.smithi154.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:01.625 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/168 2024-05-14T03:07:01.625 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/168 2024-05-14T03:07:01.625 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:01.627 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:01.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:01.636 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-05-14T03:07:01.782 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:01.787 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:01.787 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:01.889 INFO:teuthology.orchestra.run.smithi154.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:01.893 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/169 2024-05-14T03:07:01.893 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/169 2024-05-14T03:07:01.893 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:01.895 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:01.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:01.903 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-05-14T03:07:02.053 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:02.057 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:02.057 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:02.159 INFO:teuthology.orchestra.run.smithi154.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:02.163 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/170 2024-05-14T03:07:02.163 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/170 2024-05-14T03:07:02.163 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:02.165 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:02.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:02.173 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-05-14T03:07:02.319 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:02.324 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:02.324 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:02.431 INFO:teuthology.orchestra.run.smithi154.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:02.435 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/171 2024-05-14T03:07:02.435 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/171 2024-05-14T03:07:02.435 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:02.437 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:02.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:02.446 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-05-14T03:07:02.589 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:02.593 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:02.593 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:02.702 INFO:teuthology.orchestra.run.smithi154.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:02.706 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/172 2024-05-14T03:07:02.706 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/172 2024-05-14T03:07:02.706 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:02.708 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:02.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:02.716 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-05-14T03:07:02.862 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:02.866 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:02.867 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:02.974 INFO:teuthology.orchestra.run.smithi154.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:02.978 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/173 2024-05-14T03:07:02.978 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/173 2024-05-14T03:07:02.978 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:02.980 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:02.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:02.989 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-05-14T03:07:03.137 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:03.141 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:03.141 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:03.248 INFO:teuthology.orchestra.run.smithi154.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:03.252 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/174 2024-05-14T03:07:03.252 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/174 2024-05-14T03:07:03.252 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:03.254 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:03.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:03.262 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-05-14T03:07:03.408 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:03.411 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:03.411 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:03.518 INFO:teuthology.orchestra.run.smithi154.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:03.521 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/175 2024-05-14T03:07:03.521 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/175 2024-05-14T03:07:03.521 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:03.524 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:03.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:03.532 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-05-14T03:07:03.679 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:03.683 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:03.683 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:03.786 INFO:teuthology.orchestra.run.smithi154.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:03.790 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/176 2024-05-14T03:07:03.790 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/176 2024-05-14T03:07:03.790 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:03.792 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:03.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:03.801 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-05-14T03:07:03.947 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:03.951 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:04.124 INFO:teuthology.orchestra.run.smithi154.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:04.128 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/177 2024-05-14T03:07:04.128 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/177 2024-05-14T03:07:04.128 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:04.131 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:04.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:04.140 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-05-14T03:07:04.285 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:04.289 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:04.289 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:04.436 INFO:teuthology.orchestra.run.smithi154.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:07:04.440 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/178 2024-05-14T03:07:04.440 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/178 2024-05-14T03:07:04.440 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:04.443 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:04.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:04.451 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-05-14T03:07:04.955 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:04.959 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:04.959 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:05.102 INFO:teuthology.orchestra.run.smithi154.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:07:05.105 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/179 2024-05-14T03:07:05.106 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/179 2024-05-14T03:07:05.106 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:05.108 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:05.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:05.117 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-05-14T03:07:05.621 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:05.625 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:05.626 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:05.770 INFO:teuthology.orchestra.run.smithi154.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:07:05.774 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/180 2024-05-14T03:07:05.774 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/180 2024-05-14T03:07:05.774 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:05.777 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:05.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:05.785 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-05-14T03:07:06.251 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:06.256 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:06.256 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:06.403 INFO:teuthology.orchestra.run.smithi154.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:07:06.407 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/181 2024-05-14T03:07:06.407 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/181 2024-05-14T03:07:06.407 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:06.409 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:06.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:06.418 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-05-14T03:07:06.944 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:06.949 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:06.949 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:07.101 INFO:teuthology.orchestra.run.smithi154.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-14T03:07:07.104 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/182 2024-05-14T03:07:07.104 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/182 2024-05-14T03:07:07.105 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:07.106 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:07.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:07.115 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-05-14T03:07:07.637 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:07.641 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:07.641 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:07.744 INFO:teuthology.orchestra.run.smithi154.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:07.748 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/183 2024-05-14T03:07:07.748 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/183 2024-05-14T03:07:07.748 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:07.750 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:07.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:07.759 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-05-14T03:07:07.904 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:07.909 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:07.909 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:08.061 INFO:teuthology.orchestra.run.smithi154.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/184.out.bad) 2024-05-14T03:07:08.063 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/184.out 2024-05-14 01:24:47.240293133 +0000 2024-05-14T03:07:08.063 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/184.out.bad 2024-05-14 03:07:08.060736271 +0000 2024-05-14T03:07:08.063 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1 +1,2 @@ 2024-05-14T03:07:08.063 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 184 2024-05-14T03:07:08.063 INFO:teuthology.orchestra.run.smithi154.stdout: +/tmp/tmp.E8tkN6FrZCxfstests-dev/tests/generic/184: line 23: /tmp/tmp.v73wnydYBctest/null: Permission denied 2024-05-14T03:07:08.065 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/184 2024-05-14T03:07:08.065 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/184 2024-05-14T03:07:08.065 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2024-05-14T03:07:08.068 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:08.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T03:07:08.078 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-14T03:07:08.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-14T03:07:08.078 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-05-14T03:07:08.225 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:08.229 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:08.230 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:08.333 INFO:teuthology.orchestra.run.smithi154.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:08.337 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/185 2024-05-14T03:07:08.337 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/185 2024-05-14T03:07:08.337 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:08.340 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:08.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:08.349 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-05-14T03:07:08.497 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:08.501 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:08.501 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:08.606 INFO:teuthology.orchestra.run.smithi154.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:08.610 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/186 2024-05-14T03:07:08.610 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/186 2024-05-14T03:07:08.610 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:08.612 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:08.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:08.621 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-05-14T03:07:08.766 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:08.771 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:08.771 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:08.884 INFO:teuthology.orchestra.run.smithi154.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:08.888 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/187 2024-05-14T03:07:08.888 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/187 2024-05-14T03:07:08.888 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:08.891 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:08.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:08.900 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-05-14T03:07:09.050 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:09.054 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:09.054 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:09.156 INFO:teuthology.orchestra.run.smithi154.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:09.159 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/188 2024-05-14T03:07:09.159 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/188 2024-05-14T03:07:09.159 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:09.162 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:09.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:09.170 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-05-14T03:07:09.316 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:09.320 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:09.421 INFO:teuthology.orchestra.run.smithi154.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:09.425 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/189 2024-05-14T03:07:09.425 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/189 2024-05-14T03:07:09.425 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:09.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:09.436 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-05-14T03:07:09.581 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:09.585 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:09.586 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:09.690 INFO:teuthology.orchestra.run.smithi154.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:09.694 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/190 2024-05-14T03:07:09.694 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/190 2024-05-14T03:07:09.694 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:09.697 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:09.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:09.706 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-05-14T03:07:09.856 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:09.860 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:09.860 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:09.964 INFO:teuthology.orchestra.run.smithi154.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:09.968 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/191 2024-05-14T03:07:09.968 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/191 2024-05-14T03:07:09.968 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:09.970 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:09.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:09.978 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-05-14T03:07:10.126 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:10.130 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:10.130 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:10.239 INFO:teuthology.orchestra.run.smithi154.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2024-05-14T03:07:10.242 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/192 2024-05-14T03:07:10.242 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/192 2024-05-14T03:07:10.242 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:10.244 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:10.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:10.253 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-05-14T03:07:10.399 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:10.403 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:10.403 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:11.200 INFO:teuthology.orchestra.run.smithi154.stdout:generic/193 - output mismatch (see /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/193.out.bad) 2024-05-14T03:07:11.202 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/193.out 2024-05-14 01:24:47.240293133 +0000 2024-05-14T03:07:11.202 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/193.out.bad 2024-05-14 03:07:11.196652556 +0000 2024-05-14T03:07:11.202 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -24,7 +24,6 @@ 2024-05-14T03:07:11.202 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:11.202 INFO:teuthology.orchestra.run.smithi154.stdout: user: chmod a+r on qa_user owned file (should succeed) 2024-05-14T03:07:11.202 INFO:teuthology.orchestra.run.smithi154.stdout: user: chmod a+r on root owned file (should fail) 2024-05-14T03:07:11.202 INFO:teuthology.orchestra.run.smithi154.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2024-05-14T03:07:11.203 INFO:teuthology.orchestra.run.smithi154.stdout: check that the sgid bit is cleared 2024-05-14T03:07:11.203 INFO:teuthology.orchestra.run.smithi154.stdout: -rw-rw-rw- 2024-05-14T03:07:11.203 INFO:teuthology.orchestra.run.smithi154.stdout: check that suid bit is not cleared 2024-05-14T03:07:11.204 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/193 2024-05-14T03:07:11.204 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/193 2024-05-14T03:07:11.204 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2024-05-14T03:07:11.206 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:11.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T03:07:11.215 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-14T03:07:11.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-14T03:07:11.216 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-05-14T03:07:11.740 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:11.744 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:11.744 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:11.846 INFO:teuthology.orchestra.run.smithi154.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:11.850 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/194 2024-05-14T03:07:11.850 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/194 2024-05-14T03:07:11.850 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:11.852 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:11.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:11.861 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-05-14T03:07:12.004 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:12.008 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:12.008 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:12.111 INFO:teuthology.orchestra.run.smithi154.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:12.114 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/195 2024-05-14T03:07:12.114 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/195 2024-05-14T03:07:12.115 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:12.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:12.126 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-05-14T03:07:12.270 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:12.275 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:12.275 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:12.378 INFO:teuthology.orchestra.run.smithi154.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:12.382 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/196 2024-05-14T03:07:12.382 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/196 2024-05-14T03:07:12.382 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:12.384 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:12.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:12.392 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-05-14T03:07:12.541 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:12.545 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:12.546 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:12.648 INFO:teuthology.orchestra.run.smithi154.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:12.652 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/197 2024-05-14T03:07:12.652 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/197 2024-05-14T03:07:12.652 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:12.654 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:12.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:12.663 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-05-14T03:07:12.812 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:12.816 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:12.816 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:13.938 INFO:teuthology.orchestra.run.smithi154.stdout:generic/198 1s 2024-05-14T03:07:13.972 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/198 2024-05-14T03:07:13.972 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:13.976 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:13.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:13.990 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-05-14T03:07:14.532 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:14.536 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:14.660 INFO:teuthology.orchestra.run.smithi154.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:14.670 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/199 2024-05-14T03:07:14.670 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/199 2024-05-14T03:07:14.670 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:14.673 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:14.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:14.689 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-05-14T03:07:14.852 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:14.856 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:14.856 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:14.965 INFO:teuthology.orchestra.run.smithi154.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:14.968 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/200 2024-05-14T03:07:14.968 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/200 2024-05-14T03:07:14.968 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:14.971 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:14.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:14.979 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-05-14T03:07:15.124 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:15.128 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:15.128 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:15.229 INFO:teuthology.orchestra.run.smithi154.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:15.233 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/201 2024-05-14T03:07:15.233 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/201 2024-05-14T03:07:15.233 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:15.235 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:15.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:15.243 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-05-14T03:07:15.389 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:15.393 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:15.393 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:15.495 INFO:teuthology.orchestra.run.smithi154.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:15.499 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/202 2024-05-14T03:07:15.499 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/202 2024-05-14T03:07:15.499 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:15.501 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:15.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:15.510 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-05-14T03:07:15.657 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:15.661 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:15.661 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:15.777 INFO:teuthology.orchestra.run.smithi154.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:15.781 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/203 2024-05-14T03:07:15.781 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/203 2024-05-14T03:07:15.781 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:15.783 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:15.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:15.792 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-05-14T03:07:15.936 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:15.940 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:15.941 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:16.719 INFO:teuthology.orchestra.run.smithi154.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:16.727 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/204 2024-05-14T03:07:16.727 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/204 2024-05-14T03:07:16.727 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:16.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:16.744 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-05-14T03:07:16.916 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:16.920 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:16.920 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:17.034 INFO:teuthology.orchestra.run.smithi154.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:17.038 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/205 2024-05-14T03:07:17.038 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/205 2024-05-14T03:07:17.038 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:17.041 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:17.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:17.050 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-05-14T03:07:17.202 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:17.207 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:17.207 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:17.314 INFO:teuthology.orchestra.run.smithi154.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:07:17.318 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/206 2024-05-14T03:07:17.318 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/206 2024-05-14T03:07:17.318 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:17.321 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:17.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:17.330 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-05-14T03:07:17.482 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:17.486 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:17.486 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:22.123 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:07:22.126 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:07:52.186 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:07:52.189 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:07:59.152 INFO:teuthology.orchestra.run.smithi154.stdout:generic/207 42s 2024-05-14T03:07:59.159 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/207 2024-05-14T03:07:59.159 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:07:59.162 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:07:59.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:07:59.385 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-05-14T03:07:59.725 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:07:59.729 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:07:59.729 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:08:22.259 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:08:22.263 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:08:52.573 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:08:52.576 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:09:22.621 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:09:22.625 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:09:52.742 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:09:52.745 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:10:22.815 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:10:22.819 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:10:53.180 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:10:53.183 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:11:20.164 INFO:teuthology.orchestra.run.smithi154.stdout:generic/208 201s 2024-05-14T03:11:20.172 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/208 2024-05-14T03:11:20.173 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:20.177 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:20.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:20.267 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-05-14T03:11:20.725 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:20.728 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:20.728 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:23.226 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:11:23.229 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:11:39.834 INFO:teuthology.orchestra.run.smithi154.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/209.out.bad) 2024-05-14T03:11:39.885 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/209.out 2024-05-14 01:24:47.240293133 +0000 2024-05-14T03:11:39.885 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/209.out.bad 2024-05-14 03:11:39.825418102 +0000 2024-05-14T03:11:39.885 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,2 +1,2 @@ 2024-05-14T03:11:39.885 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 209 2024-05-14T03:11:39.885 INFO:teuthology.orchestra.run.smithi154.stdout: -test ran for 30 seconds without error 2024-05-14T03:11:39.885 INFO:teuthology.orchestra.run.smithi154.stdout: +reader found old byte at pos 4096 2024-05-14T03:11:39.885 INFO:teuthology.orchestra.run.smithi154.stdout: \ No newline at end of file 2024-05-14T03:11:39.889 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/209 2024-05-14T03:11:39.889 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/209 2024-05-14T03:11:39.889 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2024-05-14T03:11:39.894 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:40.002 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T03:11:40.003 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-14T03:11:40.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-14T03:11:40.003 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-05-14T03:11:40.216 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:40.220 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:40.220 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:40.606 INFO:teuthology.orchestra.run.smithi154.stdout:generic/210 0s 2024-05-14T03:11:40.612 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/210 2024-05-14T03:11:40.613 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:40.616 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:40.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:40.637 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-05-14T03:11:41.096 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:41.100 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:41.464 INFO:teuthology.orchestra.run.smithi154.stdout:generic/211 0s 2024-05-14T03:11:41.470 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/211 2024-05-14T03:11:41.470 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:41.473 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:41.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:41.482 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-05-14T03:11:41.634 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:41.638 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:41.638 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:41.884 INFO:teuthology.orchestra.run.smithi154.stdout:generic/212 0s 2024-05-14T03:11:41.888 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/212 2024-05-14T03:11:41.888 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:41.891 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:41.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:41.899 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-05-14T03:11:42.046 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:42.050 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:42.050 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:42.428 INFO:teuthology.orchestra.run.smithi154.stdout:generic/213 - output mismatch (see /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/213.out.bad) 2024-05-14T03:11:42.432 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/213.out 2024-05-14 01:24:47.240293133 +0000 2024-05-14T03:11:42.432 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/213.out.bad 2024-05-14 03:11:42.425346476 +0000 2024-05-14T03:11:42.432 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,4 +1,3 @@ 2024-05-14T03:11:42.432 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 213 2024-05-14T03:11:42.432 INFO:teuthology.orchestra.run.smithi154.stdout: We should get: fallocate: No space left on device 2024-05-14T03:11:42.433 INFO:teuthology.orchestra.run.smithi154.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2024-05-14T03:11:42.433 INFO:teuthology.orchestra.run.smithi154.stdout: -fallocate: No space left on device 2024-05-14T03:11:42.435 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/213 2024-05-14T03:11:42.435 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/213 2024-05-14T03:11:42.435 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2024-05-14T03:11:42.437 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:42.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T03:11:42.453 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-14T03:11:42.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-14T03:11:42.454 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-05-14T03:11:43.038 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:43.043 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:43.044 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:43.646 INFO:teuthology.orchestra.run.smithi154.stdout:generic/214 0s 2024-05-14T03:11:43.653 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/214 2024-05-14T03:11:43.653 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:43.656 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:43.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:43.672 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-05-14T03:11:44.274 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:44.279 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:44.280 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:47.410 INFO:teuthology.orchestra.run.smithi154.stdout:generic/215 3s 2024-05-14T03:11:47.420 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/215 2024-05-14T03:11:47.420 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:47.425 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:47.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:47.439 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-05-14T03:11:47.660 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:47.666 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:47.666 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:47.834 INFO:teuthology.orchestra.run.smithi154.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:11:47.838 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/216 2024-05-14T03:11:47.838 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/216 2024-05-14T03:11:47.839 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:47.841 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:47.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:47.858 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-05-14T03:11:48.122 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:48.127 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:48.127 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:48.305 INFO:teuthology.orchestra.run.smithi154.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:11:48.309 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/217 2024-05-14T03:11:48.309 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/217 2024-05-14T03:11:48.309 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:48.311 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:48.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:48.326 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-05-14T03:11:48.571 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:48.576 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:48.576 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:48.738 INFO:teuthology.orchestra.run.smithi154.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:11:48.742 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/218 2024-05-14T03:11:48.743 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/218 2024-05-14T03:11:48.743 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:48.745 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:48.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:48.763 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-05-14T03:11:49.024 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:49.029 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:49.029 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:49.199 INFO:teuthology.orchestra.run.smithi154.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:11:49.204 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/219 2024-05-14T03:11:49.204 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/219 2024-05-14T03:11:49.204 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:49.206 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:49.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:49.224 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-05-14T03:11:49.445 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:49.450 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:49.451 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:49.608 INFO:teuthology.orchestra.run.smithi154.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:11:49.612 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/220 2024-05-14T03:11:49.612 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/220 2024-05-14T03:11:49.612 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:49.621 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:49.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:49.642 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-05-14T03:11:49.928 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:49.932 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:49.932 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:51.137 INFO:teuthology.orchestra.run.smithi154.stdout:generic/221 2s 2024-05-14T03:11:51.143 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/221 2024-05-14T03:11:51.143 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:51.147 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:51.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:51.159 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-05-14T03:11:51.425 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:51.429 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:51.429 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:51.574 INFO:teuthology.orchestra.run.smithi154.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:11:51.578 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/222 2024-05-14T03:11:51.578 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/222 2024-05-14T03:11:51.578 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:51.580 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:51.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:51.596 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-05-14T03:11:51.839 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:51.845 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:51.845 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:51.992 INFO:teuthology.orchestra.run.smithi154.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:11:51.997 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/223 2024-05-14T03:11:51.997 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/223 2024-05-14T03:11:51.997 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:52.008 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:52.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:52.018 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-05-14T03:11:52.275 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:52.279 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:52.279 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:52.460 INFO:teuthology.orchestra.run.smithi154.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:11:52.464 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/224 2024-05-14T03:11:52.464 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/224 2024-05-14T03:11:52.464 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:52.467 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:52.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:52.479 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-05-14T03:11:52.711 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:52.716 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:52.716 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:52.877 INFO:teuthology.orchestra.run.smithi154.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:11:52.882 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/225 2024-05-14T03:11:52.882 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/225 2024-05-14T03:11:52.882 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:52.891 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:52.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:52.911 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-05-14T03:11:53.174 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:53.179 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:53.179 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:53.342 INFO:teuthology.orchestra.run.smithi154.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:11:53.349 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/226 2024-05-14T03:11:53.349 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/226 2024-05-14T03:11:53.350 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:53.352 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:53.364 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:11:53.366 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:11:53.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:53.371 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-05-14T03:11:53.672 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:53.678 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:53.678 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:53.843 INFO:teuthology.orchestra.run.smithi154.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:11:53.851 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/227 2024-05-14T03:11:53.852 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/227 2024-05-14T03:11:53.852 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:53.854 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:53.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:53.911 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-05-14T03:11:54.143 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:54.148 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:54.148 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:54.450 INFO:teuthology.orchestra.run.smithi154.stdout:generic/228 0s 2024-05-14T03:11:54.463 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/228 2024-05-14T03:11:54.463 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:54.465 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:54.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:54.505 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-05-14T03:11:55.089 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:55.094 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:55.094 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:55.260 INFO:teuthology.orchestra.run.smithi154.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:11:55.266 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/229 2024-05-14T03:11:55.266 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/229 2024-05-14T03:11:55.266 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:55.269 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:55.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:55.289 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-05-14T03:11:55.571 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:55.577 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:55.578 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:55.732 INFO:teuthology.orchestra.run.smithi154.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:11:55.736 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/230 2024-05-14T03:11:55.737 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/230 2024-05-14T03:11:55.737 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:55.738 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:55.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:55.751 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-05-14T03:11:56.001 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:56.007 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:56.007 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:56.185 INFO:teuthology.orchestra.run.smithi154.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:11:56.195 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/231 2024-05-14T03:11:56.196 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/231 2024-05-14T03:11:56.196 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:56.198 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:56.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:56.223 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-05-14T03:11:56.465 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:56.469 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:56.470 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:56.623 INFO:teuthology.orchestra.run.smithi154.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:11:56.630 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/232 2024-05-14T03:11:56.630 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/232 2024-05-14T03:11:56.630 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:56.631 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:56.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:56.644 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-05-14T03:11:56.889 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:56.898 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:56.898 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:57.048 INFO:teuthology.orchestra.run.smithi154.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:11:57.052 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/233 2024-05-14T03:11:57.053 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/233 2024-05-14T03:11:57.053 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:57.056 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:57.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:57.072 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-05-14T03:11:57.339 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:57.345 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:57.345 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:57.494 INFO:teuthology.orchestra.run.smithi154.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:11:57.498 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/234 2024-05-14T03:11:57.499 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/234 2024-05-14T03:11:57.499 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:57.501 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:57.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:57.510 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-05-14T03:11:57.757 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:57.762 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:57.762 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:57.982 INFO:teuthology.orchestra.run.smithi154.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:11:57.991 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/235 2024-05-14T03:11:57.991 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/235 2024-05-14T03:11:57.991 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:11:57.994 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:11:58.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:11:58.040 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-05-14T03:11:58.273 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:11:58.281 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:11:58.281 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:12:00.214 INFO:teuthology.orchestra.run.smithi154.stdout:generic/236 2s 2024-05-14T03:12:00.220 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/236 2024-05-14T03:12:00.221 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:12:00.223 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:12:00.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:12:00.238 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-05-14T03:12:00.820 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:12:00.824 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:12:00.825 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:12:01.065 INFO:teuthology.orchestra.run.smithi154.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-14T03:12:01.070 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/237 2024-05-14T03:12:01.070 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/237 2024-05-14T03:12:01.070 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:12:01.077 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:12:01.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:12:01.087 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-05-14T03:12:01.334 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:12:01.336 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:12:01.336 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:12:01.490 INFO:teuthology.orchestra.run.smithi154.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:12:01.494 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/238 2024-05-14T03:12:01.495 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/238 2024-05-14T03:12:01.495 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:12:01.498 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:12:01.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:12:01.513 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-05-14T03:12:01.766 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:12:01.776 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:12:01.776 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:12:02.017 INFO:teuthology.orchestra.run.smithi154.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-05-14T03:12:02.021 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/239 2024-05-14T03:12:02.021 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/239 2024-05-14T03:12:02.021 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:12:02.023 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:12:02.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:12:02.032 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-05-14T03:12:02.301 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:12:02.306 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:12:02.306 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:12:02.474 INFO:teuthology.orchestra.run.smithi154.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-05-14T03:12:02.482 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/240 2024-05-14T03:12:02.482 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/240 2024-05-14T03:12:02.482 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:12:02.487 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:12:02.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:12:02.501 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-05-14T03:12:02.753 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:12:02.758 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:12:02.758 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:12:23.406 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:12:23.410 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:12:53.452 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:12:53.455 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:13:16.527 INFO:teuthology.orchestra.run.smithi154.stdout:generic/241 74s 2024-05-14T03:13:16.532 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/241 2024-05-14T03:13:16.532 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:13:16.535 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:13:16.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:13:16.554 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-05-14T03:13:17.173 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:13:17.180 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:13:17.180 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:13:17.327 INFO:teuthology.orchestra.run.smithi154.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:13:17.335 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/242 2024-05-14T03:13:17.336 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/242 2024-05-14T03:13:17.336 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:13:17.339 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:13:17.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:13:17.349 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-05-14T03:13:17.602 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:13:17.612 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:13:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:13:17.764 INFO:teuthology.orchestra.run.smithi154.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:13:17.768 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/243 2024-05-14T03:13:17.768 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/243 2024-05-14T03:13:17.768 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:13:17.771 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:13:17.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:13:17.781 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-05-14T03:13:18.049 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:13:18.054 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:13:18.054 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:13:18.234 INFO:teuthology.orchestra.run.smithi154.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-14T03:13:18.238 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/244 2024-05-14T03:13:18.238 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/244 2024-05-14T03:13:18.238 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:13:18.240 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:13:18.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:13:18.256 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-05-14T03:13:18.505 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:13:18.510 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:13:18.510 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:13:19.074 INFO:teuthology.orchestra.run.smithi154.stdout:generic/245 0s 2024-05-14T03:13:19.120 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/245 2024-05-14T03:13:19.120 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:13:19.123 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:13:19.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:13:19.142 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-05-14T03:13:19.733 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:13:19.738 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:13:19.738 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:13:20.397 INFO:teuthology.orchestra.run.smithi154.stdout:generic/246 1s 2024-05-14T03:13:20.439 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/246 2024-05-14T03:13:20.439 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:13:20.441 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:13:20.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:13:20.451 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-05-14T03:13:21.078 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:13:21.083 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:13:21.083 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:13:23.622 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:13:23.624 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:13:54.338 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:13:54.341 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:14:14.070 INFO:teuthology.orchestra.run.smithi154.stdout:generic/247 53s 2024-05-14T03:14:14.081 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/247 2024-05-14T03:14:14.081 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:14:14.084 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:14.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:14:14.094 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-05-14T03:14:14.336 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:14:14.340 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:14:14.340 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:14.638 INFO:teuthology.orchestra.run.smithi154.stdout:generic/248 0s 2024-05-14T03:14:14.650 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/248 2024-05-14T03:14:14.650 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:14:14.653 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:14.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:14:14.662 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-05-14T03:14:14.938 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:14:14.945 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:14:14.945 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:17.247 INFO:teuthology.orchestra.run.smithi154.stdout:generic/249 3s 2024-05-14T03:14:17.254 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/249 2024-05-14T03:14:17.254 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:14:17.257 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:17.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:14:17.268 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-05-14T03:14:17.895 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:14:17.899 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:14:17.899 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:18.127 INFO:teuthology.orchestra.run.smithi154.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:14:18.132 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/250 2024-05-14T03:14:18.132 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/250 2024-05-14T03:14:18.132 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:14:18.138 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:18.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:14:18.148 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-05-14T03:14:18.420 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:14:18.424 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:14:18.424 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:18.574 INFO:teuthology.orchestra.run.smithi154.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:14:18.578 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/251 2024-05-14T03:14:18.578 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/251 2024-05-14T03:14:18.578 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:14:18.581 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:18.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:14:18.594 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-05-14T03:14:18.864 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:14:18.869 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:14:18.869 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:19.042 INFO:teuthology.orchestra.run.smithi154.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:14:19.047 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/252 2024-05-14T03:14:19.047 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/252 2024-05-14T03:14:19.047 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:14:19.055 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:19.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:14:19.070 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-05-14T03:14:19.317 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:14:19.323 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:14:19.323 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:19.476 INFO:teuthology.orchestra.run.smithi154.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:14:19.481 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/253 2024-05-14T03:14:19.481 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/253 2024-05-14T03:14:19.481 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:14:19.484 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:19.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:14:19.494 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-05-14T03:14:19.759 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:14:19.764 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:14:19.765 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:19.925 INFO:teuthology.orchestra.run.smithi154.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:14:19.930 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/254 2024-05-14T03:14:19.930 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/254 2024-05-14T03:14:19.930 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:14:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:19.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:14:19.942 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-05-14T03:14:20.168 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:14:20.173 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:14:20.173 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:21.613 INFO:teuthology.orchestra.run.smithi154.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T03:14:21.617 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/255 2024-05-14T03:14:21.617 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/255 2024-05-14T03:14:21.617 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:14:21.619 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:21.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:14:21.631 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-05-14T03:14:22.293 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:14:22.298 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:14:22.298 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:23.676 INFO:teuthology.orchestra.run.smithi154.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:14:23.685 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/256 2024-05-14T03:14:23.685 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/256 2024-05-14T03:14:23.685 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:14:23.687 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:23.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:14:23.737 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-05-14T03:14:23.957 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:14:23.961 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:14:23.962 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:24.394 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:14:24.396 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:14:26.059 INFO:teuthology.orchestra.run.smithi154.stdout:generic/257 3s 2024-05-14T03:14:26.070 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/257 2024-05-14T03:14:26.070 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:14:26.073 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:26.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:14:26.129 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-05-14T03:14:26.707 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:14:26.720 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:14:26.721 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:26.943 INFO:teuthology.orchestra.run.smithi154.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/258.out.bad) 2024-05-14T03:14:26.945 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/258.out 2024-05-14 01:24:47.244293061 +0000 2024-05-14T03:14:26.946 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/258.out.bad 2024-05-14 03:14:26.940891653 +0000 2024-05-14T03:14:26.946 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,5 +1,6 @@ 2024-05-14T03:14:26.946 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 258 2024-05-14T03:14:26.946 INFO:teuthology.orchestra.run.smithi154.stdout: Creating file with timestamp of Jan 1, 1960 2024-05-14T03:14:26.946 INFO:teuthology.orchestra.run.smithi154.stdout: Testing for negative seconds since epoch 2024-05-14T03:14:26.946 INFO:teuthology.orchestra.run.smithi154.stdout: -Remounting to flush cache 2024-05-14T03:14:26.946 INFO:teuthology.orchestra.run.smithi154.stdout: -Testing for negative seconds since epoch 2024-05-14T03:14:26.946 INFO:teuthology.orchestra.run.smithi154.stdout: +Timestamp wrapped: 3979351756 2024-05-14T03:14:26.946 INFO:teuthology.orchestra.run.smithi154.stdout: +Timestamp wrapped 2024-05-14T03:14:26.946 INFO:teuthology.orchestra.run.smithi154.stdout: +(see /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/258.full for details) 2024-05-14T03:14:26.948 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/258 2024-05-14T03:14:26.949 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/258 2024-05-14T03:14:26.949 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2024-05-14T03:14:26.951 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:26.960 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T03:14:26.960 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-14T03:14:26.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-14T03:14:26.960 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-05-14T03:14:27.258 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:14:27.263 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:14:27.263 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:27.418 INFO:teuthology.orchestra.run.smithi154.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:14:27.422 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/259 2024-05-14T03:14:27.422 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/259 2024-05-14T03:14:27.423 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:14:27.425 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:27.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:14:27.441 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-05-14T03:14:27.688 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:14:27.693 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:14:27.693 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:28.028 INFO:teuthology.orchestra.run.smithi154.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:14:28.032 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/260 2024-05-14T03:14:28.032 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/260 2024-05-14T03:14:28.032 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:14:28.035 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:28.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:14:28.050 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-05-14T03:14:28.345 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:14:28.349 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:14:28.349 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:28.494 INFO:teuthology.orchestra.run.smithi154.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:14:28.504 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/261 2024-05-14T03:14:28.505 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/261 2024-05-14T03:14:28.505 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:14:28.507 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:28.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:14:28.523 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-05-14T03:14:28.776 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:14:28.783 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:14:28.783 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:29.023 INFO:teuthology.orchestra.run.smithi154.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:14:29.060 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/262 2024-05-14T03:14:29.060 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/262 2024-05-14T03:14:29.060 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:14:29.093 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:29.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:14:29.111 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-05-14T03:14:29.363 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:14:29.372 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:14:29.372 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:14:54.455 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:14:54.458 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:15:24.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:15:24.623 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:15:55.027 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:15:55.035 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:16:07.856 INFO:teuthology.orchestra.run.smithi154.stdout:generic/263 98s 2024-05-14T03:16:07.871 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/263 2024-05-14T03:16:07.872 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:07.875 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:08.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:08.053 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-05-14T03:16:08.429 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:08.433 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:08.433 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:08.572 INFO:teuthology.orchestra.run.smithi154.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:08.576 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/264 2024-05-14T03:16:08.576 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/264 2024-05-14T03:16:08.576 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:08.578 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:08.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:08.586 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-05-14T03:16:08.737 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:08.741 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:08.741 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:08.907 INFO:teuthology.orchestra.run.smithi154.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:08.910 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/265 2024-05-14T03:16:08.911 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/265 2024-05-14T03:16:08.911 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:08.913 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:08.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:08.921 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-05-14T03:16:09.079 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:09.083 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:09.083 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:09.214 INFO:teuthology.orchestra.run.smithi154.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:09.217 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/266 2024-05-14T03:16:09.218 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/266 2024-05-14T03:16:09.218 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:09.220 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:09.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:09.228 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-05-14T03:16:09.376 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:09.380 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:09.496 INFO:teuthology.orchestra.run.smithi154.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:09.500 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/267 2024-05-14T03:16:09.500 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/267 2024-05-14T03:16:09.500 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:09.502 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:09.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:09.510 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-05-14T03:16:09.657 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:09.661 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:09.661 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:09.826 INFO:teuthology.orchestra.run.smithi154.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:09.830 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/268 2024-05-14T03:16:09.830 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/268 2024-05-14T03:16:09.831 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:09.833 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:09.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:09.842 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-05-14T03:16:09.994 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:09.999 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:09.999 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:10.226 INFO:teuthology.orchestra.run.smithi154.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:10.230 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/269 2024-05-14T03:16:10.230 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/269 2024-05-14T03:16:10.230 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:10.233 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:10.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:10.243 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-05-14T03:16:10.407 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:10.411 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:10.412 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:10.664 INFO:teuthology.orchestra.run.smithi154.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-14T03:16:10.669 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/270 2024-05-14T03:16:10.670 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/270 2024-05-14T03:16:10.670 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:10.672 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:10.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:10.682 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-05-14T03:16:10.837 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:10.841 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:10.841 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:11.173 INFO:teuthology.orchestra.run.smithi154.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:11.178 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/271 2024-05-14T03:16:11.178 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/271 2024-05-14T03:16:11.178 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:11.182 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:11.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:11.193 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-05-14T03:16:11.390 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:11.395 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:11.395 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:11.556 INFO:teuthology.orchestra.run.smithi154.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:11.560 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/272 2024-05-14T03:16:11.560 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/272 2024-05-14T03:16:11.561 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:11.563 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:11.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:11.574 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-05-14T03:16:11.753 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:11.759 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:11.759 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:11.871 INFO:teuthology.orchestra.run.smithi154.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:11.875 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/273 2024-05-14T03:16:11.875 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/273 2024-05-14T03:16:11.875 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:11.877 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:11.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:11.885 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-05-14T03:16:12.041 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:12.045 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:12.046 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:12.162 INFO:teuthology.orchestra.run.smithi154.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:12.165 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/274 2024-05-14T03:16:12.166 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/274 2024-05-14T03:16:12.166 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:12.168 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:12.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:12.176 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-05-14T03:16:12.327 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:12.331 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:12.331 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:12.433 INFO:teuthology.orchestra.run.smithi154.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:12.437 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/275 2024-05-14T03:16:12.437 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/275 2024-05-14T03:16:12.437 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:12.439 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:12.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:12.447 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-05-14T03:16:12.596 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:12.600 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:12.600 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:12.734 INFO:teuthology.orchestra.run.smithi154.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:12.738 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/276 2024-05-14T03:16:12.738 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/276 2024-05-14T03:16:12.738 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:12.740 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:12.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:12.749 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-05-14T03:16:12.904 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:12.908 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:12.908 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:13.028 INFO:teuthology.orchestra.run.smithi154.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:13.032 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/277 2024-05-14T03:16:13.032 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/277 2024-05-14T03:16:13.032 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:13.035 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:13.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:13.044 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-05-14T03:16:13.195 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:13.199 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:13.199 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:13.319 INFO:teuthology.orchestra.run.smithi154.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:13.322 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/278 2024-05-14T03:16:13.322 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/278 2024-05-14T03:16:13.322 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:13.324 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:13.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:13.333 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-05-14T03:16:13.481 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:13.485 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:13.486 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:13.610 INFO:teuthology.orchestra.run.smithi154.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:13.614 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/279 2024-05-14T03:16:13.614 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/279 2024-05-14T03:16:13.614 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:13.617 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:13.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:13.625 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-05-14T03:16:13.773 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:13.777 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:13.777 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:13.940 INFO:teuthology.orchestra.run.smithi154.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:13.943 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/280 2024-05-14T03:16:13.943 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/280 2024-05-14T03:16:13.943 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:13.946 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:13.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:13.954 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-05-14T03:16:14.103 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:14.108 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:14.108 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:14.227 INFO:teuthology.orchestra.run.smithi154.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:14.230 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/281 2024-05-14T03:16:14.230 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/281 2024-05-14T03:16:14.231 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:14.233 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:14.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:14.241 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-05-14T03:16:14.391 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:14.395 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:14.395 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:14.514 INFO:teuthology.orchestra.run.smithi154.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:14.518 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/282 2024-05-14T03:16:14.518 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/282 2024-05-14T03:16:14.518 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:14.520 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:14.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:14.529 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-05-14T03:16:14.676 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:14.680 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:14.680 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:14.799 INFO:teuthology.orchestra.run.smithi154.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:14.803 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/283 2024-05-14T03:16:14.803 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/283 2024-05-14T03:16:14.803 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:14.805 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:14.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:14.814 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-05-14T03:16:14.963 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:14.967 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:14.967 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:15.069 INFO:teuthology.orchestra.run.smithi154.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:16:15.073 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/284 2024-05-14T03:16:15.073 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/284 2024-05-14T03:16:15.073 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:15.075 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:15.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:15.083 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-05-14T03:16:15.231 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:15.235 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:15.235 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:17.707 INFO:teuthology.orchestra.run.smithi154.stdout:generic/285 2s 2024-05-14T03:16:17.713 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/285 2024-05-14T03:16:17.713 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:16:17.715 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:17.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:16:17.964 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-05-14T03:16:18.436 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:16:18.441 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:16:18.441 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:16:25.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:16:25.094 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:16:55.316 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:16:55.319 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:17:25.364 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:17:25.367 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:17:27.635 INFO:teuthology.orchestra.run.smithi154.stdout:generic/286 69s 2024-05-14T03:17:27.643 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/286 2024-05-14T03:17:27.643 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:27.646 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:27.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:27.659 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-05-14T03:17:28.213 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:28.217 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:28.217 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:28.409 INFO:teuthology.orchestra.run.smithi154.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:28.413 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/287 2024-05-14T03:17:28.413 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/287 2024-05-14T03:17:28.413 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:28.416 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:28.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:28.427 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-05-14T03:17:28.625 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:28.629 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:28.732 INFO:teuthology.orchestra.run.smithi154.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:28.736 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/288 2024-05-14T03:17:28.736 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/288 2024-05-14T03:17:28.736 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:28.738 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:28.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:28.746 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-05-14T03:17:28.894 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:28.898 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:28.898 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:29.001 INFO:teuthology.orchestra.run.smithi154.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:29.005 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/289 2024-05-14T03:17:29.005 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/289 2024-05-14T03:17:29.005 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:29.007 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:29.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:29.015 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-05-14T03:17:29.163 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:29.167 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:29.167 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:29.270 INFO:teuthology.orchestra.run.smithi154.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:29.274 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/290 2024-05-14T03:17:29.274 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/290 2024-05-14T03:17:29.275 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:29.277 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:29.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:29.286 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-05-14T03:17:29.437 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:29.442 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:29.442 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:29.543 INFO:teuthology.orchestra.run.smithi154.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:29.547 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/291 2024-05-14T03:17:29.547 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/291 2024-05-14T03:17:29.547 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:29.550 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:29.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:29.558 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-05-14T03:17:29.707 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:29.711 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:29.712 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:29.812 INFO:teuthology.orchestra.run.smithi154.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:29.816 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/292 2024-05-14T03:17:29.816 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/292 2024-05-14T03:17:29.816 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:29.818 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:29.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:29.827 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-05-14T03:17:29.972 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:29.976 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:29.976 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:30.080 INFO:teuthology.orchestra.run.smithi154.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:30.084 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/293 2024-05-14T03:17:30.084 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/293 2024-05-14T03:17:30.084 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:30.087 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:30.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:30.095 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-05-14T03:17:30.242 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:30.246 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:30.246 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:30.349 INFO:teuthology.orchestra.run.smithi154.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:30.352 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/294 2024-05-14T03:17:30.352 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/294 2024-05-14T03:17:30.352 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:30.354 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:30.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:30.362 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-05-14T03:17:30.510 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:30.514 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:30.514 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:30.619 INFO:teuthology.orchestra.run.smithi154.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:30.622 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/295 2024-05-14T03:17:30.622 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/295 2024-05-14T03:17:30.622 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:30.625 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:30.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:30.633 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-05-14T03:17:30.783 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:30.787 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:30.787 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:30.890 INFO:teuthology.orchestra.run.smithi154.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:30.893 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/296 2024-05-14T03:17:30.894 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/296 2024-05-14T03:17:30.894 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:30.896 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:30.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:30.904 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-05-14T03:17:31.052 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:31.056 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:31.056 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:31.182 INFO:teuthology.orchestra.run.smithi154.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:31.185 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/297 2024-05-14T03:17:31.185 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/297 2024-05-14T03:17:31.185 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:31.188 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:31.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:31.196 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-05-14T03:17:31.346 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:31.350 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:31.351 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:31.458 INFO:teuthology.orchestra.run.smithi154.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:31.460 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/298 2024-05-14T03:17:31.460 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/298 2024-05-14T03:17:31.460 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:31.463 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:31.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:31.471 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-05-14T03:17:31.621 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:31.625 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:31.731 INFO:teuthology.orchestra.run.smithi154.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:31.735 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/299 2024-05-14T03:17:31.735 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/299 2024-05-14T03:17:31.735 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:31.737 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:31.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:31.745 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-05-14T03:17:31.894 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:31.899 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:31.899 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:32.000 INFO:teuthology.orchestra.run.smithi154.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:32.004 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/300 2024-05-14T03:17:32.004 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/300 2024-05-14T03:17:32.004 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:32.007 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:32.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:32.015 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-05-14T03:17:32.160 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:32.165 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:32.165 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:32.271 INFO:teuthology.orchestra.run.smithi154.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:32.275 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/301 2024-05-14T03:17:32.275 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/301 2024-05-14T03:17:32.275 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:32.278 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:32.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:32.286 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-05-14T03:17:32.435 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:32.439 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:32.439 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:32.542 INFO:teuthology.orchestra.run.smithi154.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:32.546 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/302 2024-05-14T03:17:32.546 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/302 2024-05-14T03:17:32.546 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:32.548 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:32.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:32.556 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-05-14T03:17:32.704 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:32.708 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:32.708 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:32.866 INFO:teuthology.orchestra.run.smithi154.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:17:32.870 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/303 2024-05-14T03:17:32.870 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/303 2024-05-14T03:17:32.870 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:32.872 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:32.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:32.881 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-05-14T03:17:33.366 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:33.371 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:33.371 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:33.522 INFO:teuthology.orchestra.run.smithi154.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-14T03:17:33.525 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/304 2024-05-14T03:17:33.525 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/304 2024-05-14T03:17:33.525 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:33.528 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:33.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:33.536 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-05-14T03:17:34.031 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:34.036 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:34.036 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:34.148 INFO:teuthology.orchestra.run.smithi154.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:34.152 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/305 2024-05-14T03:17:34.152 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/305 2024-05-14T03:17:34.153 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:34.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:34.163 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-05-14T03:17:34.311 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:34.316 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:34.316 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:34.420 INFO:teuthology.orchestra.run.smithi154.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:34.424 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/306 2024-05-14T03:17:34.424 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/306 2024-05-14T03:17:34.424 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:34.426 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:34.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:34.435 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-05-14T03:17:34.587 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:34.591 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:34.591 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:34.714 INFO:teuthology.orchestra.run.smithi154.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:17:34.718 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/307 2024-05-14T03:17:34.718 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/307 2024-05-14T03:17:34.718 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:34.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:34.728 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-05-14T03:17:34.879 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:34.883 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:34.883 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:35.018 INFO:teuthology.orchestra.run.smithi154.stdout:generic/308 1s 2024-05-14T03:17:35.023 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/308 2024-05-14T03:17:35.023 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:35.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:35.034 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-05-14T03:17:35.184 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:35.188 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:35.188 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:36.376 INFO:teuthology.orchestra.run.smithi154.stdout:generic/309 1s 2024-05-14T03:17:36.383 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/309 2024-05-14T03:17:36.383 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:17:36.386 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:36.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:17:36.396 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-05-14T03:17:36.904 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:17:36.908 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:17:36.908 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:17:55.499 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:17:55.502 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:18:25.546 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:18:25.549 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:18:55.711 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:18:55.714 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:19:03.263 INFO:teuthology.orchestra.run.smithi154.stdout:generic/310 87s 2024-05-14T03:19:03.271 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/310 2024-05-14T03:19:03.271 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:19:03.274 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:03.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:19:03.293 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-05-14T03:19:03.482 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:19:03.486 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:19:03.486 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:03.733 INFO:teuthology.orchestra.run.smithi154.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:19:03.773 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/311 2024-05-14T03:19:03.774 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/311 2024-05-14T03:19:03.774 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:19:03.783 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:03.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:19:03.865 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-05-14T03:19:04.138 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:19:04.142 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:19:04.142 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:04.295 INFO:teuthology.orchestra.run.smithi154.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:19:04.298 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/312 2024-05-14T03:19:04.298 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/312 2024-05-14T03:19:04.298 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:19:04.300 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:04.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:19:04.308 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-05-14T03:19:04.471 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:19:04.476 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:19:04.476 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:08.893 INFO:teuthology.orchestra.run.smithi154.stdout:generic/313 4s 2024-05-14T03:19:08.901 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/313 2024-05-14T03:19:08.901 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:19:08.905 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:08.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:19:08.968 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-05-14T03:19:09.168 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:19:09.174 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:19:09.174 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:09.719 INFO:teuthology.orchestra.run.smithi154.stdout:generic/314 0s 2024-05-14T03:19:09.725 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/314 2024-05-14T03:19:09.725 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:19:09.728 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:09.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:19:09.738 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-05-14T03:19:09.910 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:19:09.915 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:19:09.915 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:14.384 INFO:teuthology.orchestra.run.smithi154.stdout:generic/315 5s 2024-05-14T03:19:14.391 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/315 2024-05-14T03:19:14.391 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:19:14.394 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:14.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:19:14.580 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-05-14T03:19:14.938 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:19:14.942 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:19:14.942 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:16.150 INFO:teuthology.orchestra.run.smithi154.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T03:19:16.155 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/316 2024-05-14T03:19:16.155 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/316 2024-05-14T03:19:16.155 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:19:16.159 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:16.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:19:16.172 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-05-14T03:19:16.702 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:19:16.706 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:19:16.706 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:16.830 INFO:teuthology.orchestra.run.smithi154.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:19:16.834 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/317 2024-05-14T03:19:16.835 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/317 2024-05-14T03:19:16.835 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:19:16.837 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:16.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:19:16.847 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-05-14T03:19:17.011 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:19:17.015 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:19:17.015 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:17.120 INFO:teuthology.orchestra.run.smithi154.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:19:17.124 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/318 2024-05-14T03:19:17.124 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/318 2024-05-14T03:19:17.124 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:19:17.126 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:17.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:19:17.134 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-05-14T03:19:17.290 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:19:17.294 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:19:17.294 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:17.429 INFO:teuthology.orchestra.run.smithi154.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-14T03:19:17.432 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/319 2024-05-14T03:19:17.433 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/319 2024-05-14T03:19:17.433 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:19:17.435 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:17.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:19:17.443 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-05-14T03:19:17.597 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:19:17.601 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:19:17.602 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:17.702 INFO:teuthology.orchestra.run.smithi154.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:19:17.706 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/320 2024-05-14T03:19:17.706 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/320 2024-05-14T03:19:17.706 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:19:17.708 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:17.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:19:17.716 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-05-14T03:19:17.868 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:19:17.872 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:19:17.872 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:18.023 INFO:teuthology.orchestra.run.smithi154.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:19:18.028 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/321 2024-05-14T03:19:18.029 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/321 2024-05-14T03:19:18.029 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:19:18.031 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:18.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:19:18.039 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-05-14T03:19:18.190 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:19:18.194 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:19:18.195 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:18.318 INFO:teuthology.orchestra.run.smithi154.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:19:18.322 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/322 2024-05-14T03:19:18.323 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/322 2024-05-14T03:19:18.323 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:19:18.325 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:18.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:19:18.334 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-05-14T03:19:18.487 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:19:18.491 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:19:18.492 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:19:25.765 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:19:25.768 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:19:55.828 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:19:55.831 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:20:26.601 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:20:26.604 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:20:56.658 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:20:56.661 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:21:20.228 INFO:teuthology.orchestra.run.smithi154.stdout:generic/323 122s 2024-05-14T03:21:20.235 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/323 2024-05-14T03:21:20.235 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:20.239 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:20.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:20.251 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-05-14T03:21:20.738 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:20.742 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:20.742 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:20.873 INFO:teuthology.orchestra.run.smithi154.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:20.877 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/324 2024-05-14T03:21:20.877 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/324 2024-05-14T03:21:20.877 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:20.879 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:20.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:20.887 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-05-14T03:21:21.042 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:21.046 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:21.046 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:21.658 INFO:teuthology.orchestra.run.smithi154.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:21.666 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/325 2024-05-14T03:21:21.666 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/325 2024-05-14T03:21:21.666 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:21.670 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:21.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:21.683 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-05-14T03:21:21.876 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:21.880 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:21.880 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:22.008 INFO:teuthology.orchestra.run.smithi154.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:22.012 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/326 2024-05-14T03:21:22.012 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/326 2024-05-14T03:21:22.012 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:22.014 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:22.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:22.024 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-05-14T03:21:22.183 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:22.187 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:22.187 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:22.675 INFO:teuthology.orchestra.run.smithi154.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:22.680 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/327 2024-05-14T03:21:22.680 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/327 2024-05-14T03:21:22.680 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:22.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:22.692 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-05-14T03:21:22.884 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:22.888 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:22.889 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:23.340 INFO:teuthology.orchestra.run.smithi154.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:23.345 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/328 2024-05-14T03:21:23.345 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/328 2024-05-14T03:21:23.345 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:23.348 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:23.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:23.360 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-05-14T03:21:23.542 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:23.546 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:23.716 INFO:teuthology.orchestra.run.smithi154.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:23.721 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/329 2024-05-14T03:21:23.721 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/329 2024-05-14T03:21:23.721 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:23.724 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:23.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:23.734 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-05-14T03:21:23.915 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:23.919 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:24.357 INFO:teuthology.orchestra.run.smithi154.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:24.362 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/330 2024-05-14T03:21:24.362 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/330 2024-05-14T03:21:24.362 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:24.365 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:24.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:24.376 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-05-14T03:21:24.568 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:24.573 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:24.573 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:24.881 INFO:teuthology.orchestra.run.smithi154.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:24.885 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/331 2024-05-14T03:21:24.885 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/331 2024-05-14T03:21:24.885 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:24.888 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:24.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:24.898 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-05-14T03:21:25.078 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:25.083 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:25.083 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:25.242 INFO:teuthology.orchestra.run.smithi154.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:25.246 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/332 2024-05-14T03:21:25.246 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/332 2024-05-14T03:21:25.246 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:25.249 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:25.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:25.258 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-05-14T03:21:25.425 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:25.429 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:25.429 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:25.552 INFO:teuthology.orchestra.run.smithi154.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:25.556 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/333 2024-05-14T03:21:25.556 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/333 2024-05-14T03:21:25.556 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:25.559 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:25.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:25.569 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-05-14T03:21:25.752 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:25.757 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:25.757 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:26.003 INFO:teuthology.orchestra.run.smithi154.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:26.008 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/334 2024-05-14T03:21:26.008 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/334 2024-05-14T03:21:26.008 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:26.011 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:26.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:26.021 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-05-14T03:21:26.207 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:26.212 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:26.212 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:26.354 INFO:teuthology.orchestra.run.smithi154.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:26.358 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/335 2024-05-14T03:21:26.358 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/335 2024-05-14T03:21:26.358 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:26.361 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:26.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:26.370 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-05-14T03:21:26.549 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:26.554 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:26.554 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:26.789 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:21:26.792 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:21:26.958 INFO:teuthology.orchestra.run.smithi154.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:26.963 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/336 2024-05-14T03:21:26.963 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/336 2024-05-14T03:21:26.963 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:26.966 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:26.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:26.977 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-05-14T03:21:27.163 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:27.168 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:27.168 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:27.823 INFO:teuthology.orchestra.run.smithi154.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:27.831 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/337 2024-05-14T03:21:27.831 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/337 2024-05-14T03:21:27.831 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:27.835 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:27.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:27.848 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-05-14T03:21:28.054 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:28.059 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:28.059 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:28.325 INFO:teuthology.orchestra.run.smithi154.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:28.331 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/338 2024-05-14T03:21:28.331 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/338 2024-05-14T03:21:28.331 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:28.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:28.346 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-05-14T03:21:28.545 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:28.550 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:28.550 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:28.673 INFO:teuthology.orchestra.run.smithi154.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:28.677 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/339 2024-05-14T03:21:28.677 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/339 2024-05-14T03:21:28.678 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:28.681 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:28.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:28.690 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-05-14T03:21:28.871 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:28.875 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:28.876 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:29.262 INFO:teuthology.orchestra.run.smithi154.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:29.268 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/340 2024-05-14T03:21:29.268 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/340 2024-05-14T03:21:29.268 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:29.271 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:29.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:29.281 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-05-14T03:21:29.476 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:29.481 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:29.481 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:29.657 INFO:teuthology.orchestra.run.smithi154.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:29.661 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/341 2024-05-14T03:21:29.662 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/341 2024-05-14T03:21:29.662 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:29.664 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:29.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:29.675 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-05-14T03:21:29.857 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:29.862 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:29.862 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:29.987 INFO:teuthology.orchestra.run.smithi154.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:29.991 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/342 2024-05-14T03:21:29.991 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/342 2024-05-14T03:21:29.991 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:29.993 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:30.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:30.002 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-05-14T03:21:30.155 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:30.160 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:30.160 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:30.295 INFO:teuthology.orchestra.run.smithi154.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:30.299 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/343 2024-05-14T03:21:30.299 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/343 2024-05-14T03:21:30.299 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:30.301 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:30.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:30.309 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-05-14T03:21:30.462 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:30.466 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:30.466 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:30.580 INFO:teuthology.orchestra.run.smithi154.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:30.583 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/344 2024-05-14T03:21:30.583 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/344 2024-05-14T03:21:30.583 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:30.586 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:30.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:30.593 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-05-14T03:21:30.748 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:30.753 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:30.753 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:30.856 INFO:teuthology.orchestra.run.smithi154.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:30.859 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/345 2024-05-14T03:21:30.859 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/345 2024-05-14T03:21:30.859 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:30.861 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:30.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:30.870 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-05-14T03:21:31.022 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:31.027 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:31.027 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:31.142 INFO:teuthology.orchestra.run.smithi154.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:31.146 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/346 2024-05-14T03:21:31.147 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/346 2024-05-14T03:21:31.147 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:31.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:31.158 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-05-14T03:21:31.317 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:31.321 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:31.322 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:31.512 INFO:teuthology.orchestra.run.smithi154.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:31.516 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/347 2024-05-14T03:21:31.517 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/347 2024-05-14T03:21:31.517 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:31.519 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:31.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:31.529 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-05-14T03:21:31.692 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:31.696 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:31.696 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:31.816 INFO:teuthology.orchestra.run.smithi154.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:31.819 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/348 2024-05-14T03:21:31.820 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/348 2024-05-14T03:21:31.820 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:31.822 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:31.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:31.831 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-05-14T03:21:31.989 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:31.993 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:31.993 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:33.920 INFO:teuthology.orchestra.run.smithi154.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-14T03:21:33.926 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/349 2024-05-14T03:21:33.926 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/349 2024-05-14T03:21:33.926 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:33.930 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:33.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:33.945 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-05-14T03:21:34.151 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:34.156 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:36.036 INFO:teuthology.orchestra.run.smithi154.stdout:generic/350 2s 2024-05-14T03:21:36.044 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/350 2024-05-14T03:21:36.044 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:36.047 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:36.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:36.058 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-05-14T03:21:36.260 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:36.265 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:36.265 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:37.521 INFO:teuthology.orchestra.run.smithi154.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-05-14T03:21:37.527 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/351 2024-05-14T03:21:37.527 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/351 2024-05-14T03:21:37.527 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:37.530 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:37.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:37.542 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-05-14T03:21:38.071 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:38.075 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:38.075 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:38.199 INFO:teuthology.orchestra.run.smithi154.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:38.203 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/352 2024-05-14T03:21:38.203 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/352 2024-05-14T03:21:38.203 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:38.206 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:38.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:38.214 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-05-14T03:21:38.369 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:38.374 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:38.374 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:38.478 INFO:teuthology.orchestra.run.smithi154.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:38.482 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/353 2024-05-14T03:21:38.482 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/353 2024-05-14T03:21:38.482 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:38.485 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:38.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:38.493 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-05-14T03:21:38.650 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:38.654 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:38.654 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:38.757 INFO:teuthology.orchestra.run.smithi154.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:38.761 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/354 2024-05-14T03:21:38.761 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/354 2024-05-14T03:21:38.761 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:38.763 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:38.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:38.772 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-05-14T03:21:38.925 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:38.930 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:38.930 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:39.535 INFO:teuthology.orchestra.run.smithi154.stdout:generic/355 1s 2024-05-14T03:21:39.540 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/355 2024-05-14T03:21:39.540 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:39.543 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:39.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:39.551 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-05-14T03:21:40.047 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:40.051 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:40.051 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:40.154 INFO:teuthology.orchestra.run.smithi154.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:40.157 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/356 2024-05-14T03:21:40.157 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/356 2024-05-14T03:21:40.157 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:40.159 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:40.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:40.168 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-05-14T03:21:40.318 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:40.322 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:40.322 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:40.428 INFO:teuthology.orchestra.run.smithi154.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:40.433 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/357 2024-05-14T03:21:40.433 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/357 2024-05-14T03:21:40.433 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:40.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:40.444 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-05-14T03:21:40.601 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:40.605 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:40.605 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:40.725 INFO:teuthology.orchestra.run.smithi154.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:40.728 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/358 2024-05-14T03:21:40.728 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/358 2024-05-14T03:21:40.728 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:40.730 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:40.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:40.739 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-05-14T03:21:40.893 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:40.898 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:40.898 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:41.003 INFO:teuthology.orchestra.run.smithi154.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:41.007 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/359 2024-05-14T03:21:41.007 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/359 2024-05-14T03:21:41.007 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:41.009 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:41.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:41.017 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-05-14T03:21:41.171 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:41.175 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:41.175 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:41.373 INFO:teuthology.orchestra.run.smithi154.stdout:generic/360 0s 2024-05-14T03:21:41.378 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/360 2024-05-14T03:21:41.378 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:41.380 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:41.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:41.388 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-05-14T03:21:41.543 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:41.547 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:41.547 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:41.713 INFO:teuthology.orchestra.run.smithi154.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:41.718 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/361 2024-05-14T03:21:41.718 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/361 2024-05-14T03:21:41.718 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:41.722 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:41.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:41.732 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-05-14T03:21:41.899 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:41.904 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:41.904 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:42.003 INFO:teuthology.orchestra.run.smithi154.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:42.007 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/362 2024-05-14T03:21:42.007 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/362 2024-05-14T03:21:42.007 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:42.009 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:42.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:42.017 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2024-05-14T03:21:42.173 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:42.177 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:42.177 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:42.278 INFO:teuthology.orchestra.run.smithi154.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:42.282 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/363 2024-05-14T03:21:42.282 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/363 2024-05-14T03:21:42.282 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:42.285 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:42.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:42.293 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2024-05-14T03:21:42.446 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:42.450 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:42.451 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:42.554 INFO:teuthology.orchestra.run.smithi154.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:42.558 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/364 2024-05-14T03:21:42.558 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/364 2024-05-14T03:21:42.558 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:42.561 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:42.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:42.569 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2024-05-14T03:21:42.722 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:42.726 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:42.726 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:42.827 INFO:teuthology.orchestra.run.smithi154.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:42.831 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/365 2024-05-14T03:21:42.831 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/365 2024-05-14T03:21:42.831 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:42.833 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:42.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:42.842 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2024-05-14T03:21:42.994 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:42.998 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:42.998 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:43.100 INFO:teuthology.orchestra.run.smithi154.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:43.104 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/366 2024-05-14T03:21:43.104 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/366 2024-05-14T03:21:43.104 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:43.106 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:43.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:43.114 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2024-05-14T03:21:43.265 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:43.269 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:43.269 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:43.371 INFO:teuthology.orchestra.run.smithi154.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:43.375 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/367 2024-05-14T03:21:43.375 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/367 2024-05-14T03:21:43.375 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:43.377 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:43.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:43.386 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2024-05-14T03:21:43.539 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:43.543 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:43.543 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:43.644 INFO:teuthology.orchestra.run.smithi154.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:43.648 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/368 2024-05-14T03:21:43.648 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/368 2024-05-14T03:21:43.648 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:43.651 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:43.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:43.659 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2024-05-14T03:21:43.812 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:43.816 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:43.816 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:43.917 INFO:teuthology.orchestra.run.smithi154.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:43.921 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/369 2024-05-14T03:21:43.921 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/369 2024-05-14T03:21:43.921 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:43.923 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:43.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:43.932 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2024-05-14T03:21:44.084 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:44.089 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:44.089 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:44.189 INFO:teuthology.orchestra.run.smithi154.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:44.193 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/370 2024-05-14T03:21:44.193 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/370 2024-05-14T03:21:44.193 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:44.195 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:44.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:44.203 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-05-14T03:21:44.356 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:44.360 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:44.361 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:44.462 INFO:teuthology.orchestra.run.smithi154.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:44.465 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/371 2024-05-14T03:21:44.465 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/371 2024-05-14T03:21:44.466 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:44.468 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:44.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:44.476 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-05-14T03:21:44.627 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:44.631 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:44.631 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:44.734 INFO:teuthology.orchestra.run.smithi154.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:44.737 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/372 2024-05-14T03:21:44.738 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/372 2024-05-14T03:21:44.738 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:44.740 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:44.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:44.748 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-05-14T03:21:44.902 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:44.906 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:44.906 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:45.010 INFO:teuthology.orchestra.run.smithi154.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:45.013 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/373 2024-05-14T03:21:45.014 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/373 2024-05-14T03:21:45.014 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:45.016 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:45.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:45.024 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-05-14T03:21:45.177 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:45.181 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:45.181 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:45.286 INFO:teuthology.orchestra.run.smithi154.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:45.289 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/374 2024-05-14T03:21:45.290 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/374 2024-05-14T03:21:45.290 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:45.292 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:45.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:45.300 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-05-14T03:21:45.456 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:45.460 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:45.460 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:45.602 INFO:teuthology.orchestra.run.smithi154.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-14T03:21:45.606 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/375 2024-05-14T03:21:45.606 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/375 2024-05-14T03:21:45.606 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:45.608 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:45.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:45.616 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-05-14T03:21:45.771 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:45.775 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:45.775 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:45.936 INFO:teuthology.orchestra.run.smithi154.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:45.940 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/376 2024-05-14T03:21:45.940 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/376 2024-05-14T03:21:45.940 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:45.942 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:45.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:45.952 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-05-14T03:21:46.116 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:46.120 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:46.120 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:46.227 INFO:teuthology.orchestra.run.smithi154.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:46.231 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/377 2024-05-14T03:21:46.231 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/377 2024-05-14T03:21:46.231 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:46.233 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:46.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:46.241 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-05-14T03:21:46.395 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:46.399 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:46.593 INFO:teuthology.orchestra.run.smithi154.stdout:generic/378 0s 2024-05-14T03:21:46.597 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/378 2024-05-14T03:21:46.598 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:46.600 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:46.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:46.608 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-05-14T03:21:47.106 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:47.110 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:47.110 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:47.217 INFO:teuthology.orchestra.run.smithi154.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:47.220 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/379 2024-05-14T03:21:47.220 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/379 2024-05-14T03:21:47.221 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:47.223 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:47.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:47.231 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-05-14T03:21:47.383 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:47.387 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:47.387 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:47.492 INFO:teuthology.orchestra.run.smithi154.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:47.495 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/380 2024-05-14T03:21:47.496 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/380 2024-05-14T03:21:47.496 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:47.498 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:47.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:47.506 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-05-14T03:21:47.658 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:47.662 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:47.663 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:47.766 INFO:teuthology.orchestra.run.smithi154.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:47.769 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/381 2024-05-14T03:21:47.770 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/381 2024-05-14T03:21:47.770 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:47.772 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:47.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:47.780 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-05-14T03:21:47.934 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:47.938 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:47.938 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:48.040 INFO:teuthology.orchestra.run.smithi154.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:48.044 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/382 2024-05-14T03:21:48.044 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/382 2024-05-14T03:21:48.044 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:48.046 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:48.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:48.054 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-05-14T03:21:48.208 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:48.212 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:48.212 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:48.321 INFO:teuthology.orchestra.run.smithi154.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:48.325 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/383 2024-05-14T03:21:48.325 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/383 2024-05-14T03:21:48.325 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:48.327 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:48.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:48.335 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-05-14T03:21:48.494 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:48.498 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:48.498 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:48.610 INFO:teuthology.orchestra.run.smithi154.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-14T03:21:48.614 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/384 2024-05-14T03:21:48.614 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/384 2024-05-14T03:21:48.614 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:48.616 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:48.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:48.624 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-05-14T03:21:48.779 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:48.783 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:48.783 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:48.888 INFO:teuthology.orchestra.run.smithi154.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:48.891 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/385 2024-05-14T03:21:48.891 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/385 2024-05-14T03:21:48.892 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:48.894 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:48.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:48.903 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-05-14T03:21:49.058 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:49.062 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:49.062 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:49.164 INFO:teuthology.orchestra.run.smithi154.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-14T03:21:49.168 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/386 2024-05-14T03:21:49.168 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/386 2024-05-14T03:21:49.168 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:49.171 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:49.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:49.179 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-05-14T03:21:49.334 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:49.338 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:49.338 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:49.441 INFO:teuthology.orchestra.run.smithi154.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:49.444 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/387 2024-05-14T03:21:49.445 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/387 2024-05-14T03:21:49.445 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:49.447 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:49.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:49.455 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-05-14T03:21:49.609 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:49.614 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:49.614 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:49.720 INFO:teuthology.orchestra.run.smithi154.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:49.724 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/388 2024-05-14T03:21:49.724 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/388 2024-05-14T03:21:49.724 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:49.726 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:49.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:49.734 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-05-14T03:21:49.891 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:49.895 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:49.896 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:50.006 INFO:teuthology.orchestra.run.smithi154.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-05-14T03:21:50.010 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/389 2024-05-14T03:21:50.010 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/389 2024-05-14T03:21:50.010 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:50.012 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:50.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:50.020 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-05-14T03:21:50.172 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:50.176 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:50.176 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:50.297 INFO:teuthology.orchestra.run.smithi154.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:21:50.301 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/390 2024-05-14T03:21:50.301 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/390 2024-05-14T03:21:50.301 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:21:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:50.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:21:50.312 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-05-14T03:21:50.465 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:21:50.469 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:21:50.469 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:21:57.415 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:21:57.419 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:22:27.476 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:22:27.481 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:22:30.578 INFO:teuthology.orchestra.run.smithi154.stdout:generic/391 40s 2024-05-14T03:22:30.737 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/391 2024-05-14T03:22:30.738 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:30.743 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:30.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:30.764 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-05-14T03:22:31.871 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:31.877 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:31.877 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:32.086 INFO:teuthology.orchestra.run.smithi154.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:32.090 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/392 2024-05-14T03:22:32.091 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/392 2024-05-14T03:22:32.091 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:32.093 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:32.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:32.105 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-05-14T03:22:32.332 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:32.336 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:32.336 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:32.474 INFO:teuthology.orchestra.run.smithi154.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:32.478 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/393 2024-05-14T03:22:32.478 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/393 2024-05-14T03:22:32.478 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:32.480 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:32.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:32.492 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-05-14T03:22:32.734 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:32.739 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:32.994 INFO:teuthology.orchestra.run.smithi154.stdout:generic/394 0s 2024-05-14T03:22:33.000 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/394 2024-05-14T03:22:33.000 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:33.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:33.018 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-05-14T03:22:33.606 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:33.610 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:33.611 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:33.800 INFO:teuthology.orchestra.run.smithi154.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:33.804 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/395 2024-05-14T03:22:33.804 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/395 2024-05-14T03:22:33.804 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:33.807 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:33.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:33.823 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-05-14T03:22:34.092 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:34.098 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:34.274 INFO:teuthology.orchestra.run.smithi154.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:34.284 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/396 2024-05-14T03:22:34.284 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/396 2024-05-14T03:22:34.284 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:34.286 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:34.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:34.298 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-05-14T03:22:34.526 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:34.531 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:34.531 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:34.754 INFO:teuthology.orchestra.run.smithi154.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:34.759 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/397 2024-05-14T03:22:34.759 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/397 2024-05-14T03:22:34.759 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:34.764 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:34.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:34.773 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-05-14T03:22:35.021 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:35.035 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:35.035 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:35.220 INFO:teuthology.orchestra.run.smithi154.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:35.225 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/398 2024-05-14T03:22:35.225 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/398 2024-05-14T03:22:35.226 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:35.229 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:35.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:35.242 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-05-14T03:22:35.489 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:35.495 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:35.495 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:35.689 INFO:teuthology.orchestra.run.smithi154.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:35.693 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/399 2024-05-14T03:22:35.693 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/399 2024-05-14T03:22:35.693 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:35.696 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:35.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:35.706 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-05-14T03:22:35.942 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:35.946 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:35.947 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:36.099 INFO:teuthology.orchestra.run.smithi154.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-14T03:22:36.104 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/400 2024-05-14T03:22:36.104 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/400 2024-05-14T03:22:36.104 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:36.106 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:36.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:36.121 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-05-14T03:22:36.366 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:36.371 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:36.371 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:36.520 INFO:teuthology.orchestra.run.smithi154.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:36.529 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/401 2024-05-14T03:22:36.529 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/401 2024-05-14T03:22:36.529 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:36.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:36.542 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-05-14T03:22:36.785 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:36.789 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:36.789 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:36.963 INFO:teuthology.orchestra.run.smithi154.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:36.968 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/402 2024-05-14T03:22:36.969 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/402 2024-05-14T03:22:36.969 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:36.972 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:36.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:36.981 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-05-14T03:22:37.134 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:37.139 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:37.139 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:37.246 INFO:teuthology.orchestra.run.smithi154.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:37.250 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/403 2024-05-14T03:22:37.250 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/403 2024-05-14T03:22:37.250 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:37.252 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:37.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:37.261 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-05-14T03:22:37.417 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:37.421 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:38.756 INFO:teuthology.orchestra.run.smithi154.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-05-14T03:22:38.762 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/404 2024-05-14T03:22:38.762 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/404 2024-05-14T03:22:38.762 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:38.764 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:38.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:38.774 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-05-14T03:22:39.306 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:39.310 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:39.310 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:39.534 INFO:teuthology.orchestra.run.smithi154.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:39.537 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/405 2024-05-14T03:22:39.538 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/405 2024-05-14T03:22:39.538 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:39.541 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:39.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:39.550 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-05-14T03:22:39.718 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:39.722 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:39.723 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:39.827 INFO:teuthology.orchestra.run.smithi154.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:39.831 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/406 2024-05-14T03:22:39.831 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/406 2024-05-14T03:22:39.831 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:39.833 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:39.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:39.841 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-05-14T03:22:39.995 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:39.999 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:39.999 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:40.160 INFO:teuthology.orchestra.run.smithi154.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:22:40.164 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/407 2024-05-14T03:22:40.164 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/407 2024-05-14T03:22:40.164 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:40.166 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:40.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:40.174 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-05-14T03:22:40.662 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:40.666 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:40.666 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:40.825 INFO:teuthology.orchestra.run.smithi154.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-14T03:22:40.828 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/408 2024-05-14T03:22:40.828 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/408 2024-05-14T03:22:40.828 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:40.830 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:40.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:40.839 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-05-14T03:22:41.322 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:41.326 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:41.326 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:41.434 INFO:teuthology.orchestra.run.smithi154.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:41.437 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/409 2024-05-14T03:22:41.437 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/409 2024-05-14T03:22:41.438 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:41.440 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:41.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:41.448 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-05-14T03:22:41.601 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:41.606 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:41.606 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:41.713 INFO:teuthology.orchestra.run.smithi154.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:41.716 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/410 2024-05-14T03:22:41.717 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/410 2024-05-14T03:22:41.717 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:41.719 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:41.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:41.727 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-05-14T03:22:41.881 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:41.885 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:41.885 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:41.990 INFO:teuthology.orchestra.run.smithi154.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:41.993 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/411 2024-05-14T03:22:41.993 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/411 2024-05-14T03:22:41.993 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:41.995 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:42.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:42.004 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-05-14T03:22:42.154 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:42.158 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:42.159 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:42.259 INFO:teuthology.orchestra.run.smithi154.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:42.263 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/412 2024-05-14T03:22:42.263 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/412 2024-05-14T03:22:42.263 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:42.265 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:42.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:42.273 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-05-14T03:22:42.428 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:42.432 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:42.432 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:42.539 INFO:teuthology.orchestra.run.smithi154.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:42.543 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/413 2024-05-14T03:22:42.543 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/413 2024-05-14T03:22:42.543 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:42.545 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:42.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:42.553 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-05-14T03:22:42.706 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:42.710 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:42.710 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:42.814 INFO:teuthology.orchestra.run.smithi154.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:42.818 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/414 2024-05-14T03:22:42.818 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/414 2024-05-14T03:22:42.818 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:42.821 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:42.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:42.829 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-05-14T03:22:42.982 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:42.986 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:42.986 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:43.089 INFO:teuthology.orchestra.run.smithi154.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:43.093 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/415 2024-05-14T03:22:43.093 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/415 2024-05-14T03:22:43.093 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:43.095 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:43.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:43.103 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-05-14T03:22:43.256 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:43.260 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:43.260 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:43.365 INFO:teuthology.orchestra.run.smithi154.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:43.368 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/416 2024-05-14T03:22:43.368 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/416 2024-05-14T03:22:43.368 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:43.371 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:43.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:43.379 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-05-14T03:22:43.532 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:43.537 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:43.537 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:43.637 INFO:teuthology.orchestra.run.smithi154.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:43.641 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/417 2024-05-14T03:22:43.641 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/417 2024-05-14T03:22:43.641 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:43.643 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:43.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:43.651 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-05-14T03:22:43.803 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:43.807 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:43.807 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:43.961 INFO:teuthology.orchestra.run.smithi154.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2024-05-14T03:22:43.965 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/418 2024-05-14T03:22:43.965 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/418 2024-05-14T03:22:43.965 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:43.967 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:43.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:43.976 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-05-14T03:22:44.130 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:44.134 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:44.134 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:44.263 INFO:teuthology.orchestra.run.smithi154.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:44.267 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/419 2024-05-14T03:22:44.267 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/419 2024-05-14T03:22:44.267 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:44.269 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:44.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:44.278 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-05-14T03:22:44.431 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:44.435 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:44.435 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:45.433 INFO:teuthology.orchestra.run.smithi154.stdout:generic/420 1s 2024-05-14T03:22:45.439 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/420 2024-05-14T03:22:45.439 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:45.442 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:45.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:45.451 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-05-14T03:22:45.970 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:45.974 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:46.104 INFO:teuthology.orchestra.run.smithi154.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:46.108 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/421 2024-05-14T03:22:46.108 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/421 2024-05-14T03:22:46.108 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:46.110 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:46.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:46.119 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-05-14T03:22:46.275 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:46.279 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:46.389 INFO:teuthology.orchestra.run.smithi154.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:46.393 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/422 2024-05-14T03:22:46.393 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/422 2024-05-14T03:22:46.393 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:46.394 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:46.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:46.403 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-05-14T03:22:46.558 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:46.562 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:46.563 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:46.833 INFO:teuthology.orchestra.run.smithi154.stdout:generic/423 0s 2024-05-14T03:22:46.839 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/423 2024-05-14T03:22:46.839 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:46.842 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:46.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:46.849 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-05-14T03:22:47.323 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:47.327 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:47.327 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:47.468 INFO:teuthology.orchestra.run.smithi154.stdout:generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i 2024-05-14T03:22:47.471 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/424 2024-05-14T03:22:47.471 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/424 2024-05-14T03:22:47.471 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:47.474 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:47.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:47.482 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-05-14T03:22:47.649 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:47.654 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:47.654 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:47.757 INFO:teuthology.orchestra.run.smithi154.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:22:47.761 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/425 2024-05-14T03:22:47.761 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/425 2024-05-14T03:22:47.761 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:22:47.763 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:47.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:22:47.771 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-05-14T03:22:47.930 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:22:47.934 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:22:47.934 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:22:58.439 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:22:58.442 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:23:28.759 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:23:28.763 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:23:32.130 INFO:teuthology.orchestra.run.smithi154.stdout:generic/426 - output mismatch (see /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/426.out.bad) 2024-05-14T03:23:32.165 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/426.out 2024-05-14 01:24:47.256292846 +0000 2024-05-14T03:23:32.165 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/426.out.bad 2024-05-14 03:23:32.118316882 +0000 2024-05-14T03:23:32.166 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,5 +1,121 @@ 2024-05-14T03:23:32.166 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 426 2024-05-14T03:23:32.166 INFO:teuthology.orchestra.run.smithi154.stdout: test_file_handles TEST_DIR/426-dir -d 2024-05-14T03:23:32.166 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000535) opened an unlinked file! 2024-05-14T03:23:32.166 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000536) opened an unlinked file! 2024-05-14T03:23:32.166 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000537) opened an unlinked file! 2024-05-14T03:23:32.166 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000538) opened an unlinked file! 2024-05-14T03:23:32.166 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000539) opened an unlinked file! 2024-05-14T03:23:32.166 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000540) opened an unlinked file! 2024-05-14T03:23:32.166 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000541) opened an unlinked file! 2024-05-14T03:23:32.166 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000542) opened an unlinked file! 2024-05-14T03:23:32.166 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000543) opened an unlinked file! 2024-05-14T03:23:32.166 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000544) opened an unlinked file! 2024-05-14T03:23:32.167 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000545) opened an unlinked file! 2024-05-14T03:23:32.167 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000546) opened an unlinked file! 2024-05-14T03:23:32.167 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000547) opened an unlinked file! 2024-05-14T03:23:32.167 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000548) opened an unlinked file! 2024-05-14T03:23:32.167 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000549) opened an unlinked file! 2024-05-14T03:23:32.167 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000550) opened an unlinked file! 2024-05-14T03:23:32.167 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000551) opened an unlinked file! 2024-05-14T03:23:32.167 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000552) opened an unlinked file! 2024-05-14T03:23:32.167 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000553) opened an unlinked file! 2024-05-14T03:23:32.167 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000554) opened an unlinked file! 2024-05-14T03:23:32.167 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000555) opened an unlinked file! 2024-05-14T03:23:32.167 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000556) opened an unlinked file! 2024-05-14T03:23:32.167 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000557) opened an unlinked file! 2024-05-14T03:23:32.167 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000558) opened an unlinked file! 2024-05-14T03:23:32.168 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000559) opened an unlinked file! 2024-05-14T03:23:32.168 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000560) opened an unlinked file! 2024-05-14T03:23:32.168 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000561) opened an unlinked file! 2024-05-14T03:23:32.168 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000562) opened an unlinked file! 2024-05-14T03:23:32.168 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000563) opened an unlinked file! 2024-05-14T03:23:32.168 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000564) opened an unlinked file! 2024-05-14T03:23:32.168 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000565) opened an unlinked file! 2024-05-14T03:23:32.168 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000566) opened an unlinked file! 2024-05-14T03:23:32.168 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000567) opened an unlinked file! 2024-05-14T03:23:32.168 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000568) opened an unlinked file! 2024-05-14T03:23:32.168 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000569) opened an unlinked file! 2024-05-14T03:23:32.168 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000570) opened an unlinked file! 2024-05-14T03:23:32.168 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000571) opened an unlinked file! 2024-05-14T03:23:32.168 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000572) opened an unlinked file! 2024-05-14T03:23:32.168 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000573) opened an unlinked file! 2024-05-14T03:23:32.169 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000574) opened an unlinked file! 2024-05-14T03:23:32.169 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000575) opened an unlinked file! 2024-05-14T03:23:32.169 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000576) opened an unlinked file! 2024-05-14T03:23:32.169 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000577) opened an unlinked file! 2024-05-14T03:23:32.169 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000578) opened an unlinked file! 2024-05-14T03:23:32.169 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000579) opened an unlinked file! 2024-05-14T03:23:32.169 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000580) opened an unlinked file! 2024-05-14T03:23:32.169 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000581) opened an unlinked file! 2024-05-14T03:23:32.169 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000582) opened an unlinked file! 2024-05-14T03:23:32.169 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000583) opened an unlinked file! 2024-05-14T03:23:32.169 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000584) opened an unlinked file! 2024-05-14T03:23:32.169 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000585) opened an unlinked file! 2024-05-14T03:23:32.169 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000586) opened an unlinked file! 2024-05-14T03:23:32.169 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000587) opened an unlinked file! 2024-05-14T03:23:32.170 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000588) opened an unlinked file! 2024-05-14T03:23:32.170 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000589) opened an unlinked file! 2024-05-14T03:23:32.170 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000590) opened an unlinked file! 2024-05-14T03:23:32.170 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000591) opened an unlinked file! 2024-05-14T03:23:32.170 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000592) opened an unlinked file! 2024-05-14T03:23:32.170 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000593) opened an unlinked file! 2024-05-14T03:23:32.170 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000594) opened an unlinked file! 2024-05-14T03:23:32.170 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000595) opened an unlinked file! 2024-05-14T03:23:32.170 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000596) opened an unlinked file! 2024-05-14T03:23:32.170 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000597) opened an unlinked file! 2024-05-14T03:23:32.170 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000598) opened an unlinked file! 2024-05-14T03:23:32.170 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000599) opened an unlinked file! 2024-05-14T03:23:32.170 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000600) opened an unlinked file! 2024-05-14T03:23:32.170 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000601) opened an unlinked file! 2024-05-14T03:23:32.171 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000602) opened an unlinked file! 2024-05-14T03:23:32.171 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000603) opened an unlinked file! 2024-05-14T03:23:32.171 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000604) opened an unlinked file! 2024-05-14T03:23:32.171 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000605) opened an unlinked file! 2024-05-14T03:23:32.171 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000606) opened an unlinked file! 2024-05-14T03:23:32.171 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000607) opened an unlinked file! 2024-05-14T03:23:32.171 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000608) opened an unlinked file! 2024-05-14T03:23:32.171 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000609) opened an unlinked file! 2024-05-14T03:23:32.171 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000610) opened an unlinked file! 2024-05-14T03:23:32.171 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000611) opened an unlinked file! 2024-05-14T03:23:32.171 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000612) opened an unlinked file! 2024-05-14T03:23:32.171 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000613) opened an unlinked file! 2024-05-14T03:23:32.172 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000614) opened an unlinked file! 2024-05-14T03:23:32.172 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000615) opened an unlinked file! 2024-05-14T03:23:32.172 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000616) opened an unlinked file! 2024-05-14T03:23:32.172 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000617) opened an unlinked file! 2024-05-14T03:23:32.172 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000618) opened an unlinked file! 2024-05-14T03:23:32.172 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000619) opened an unlinked file! 2024-05-14T03:23:32.172 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000620) opened an unlinked file! 2024-05-14T03:23:32.172 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000621) opened an unlinked file! 2024-05-14T03:23:32.172 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000622) opened an unlinked file! 2024-05-14T03:23:32.172 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000623) opened an unlinked file! 2024-05-14T03:23:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000624) opened an unlinked file! 2024-05-14T03:23:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000625) opened an unlinked file! 2024-05-14T03:23:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000626) opened an unlinked file! 2024-05-14T03:23:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000627) opened an unlinked file! 2024-05-14T03:23:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000628) opened an unlinked file! 2024-05-14T03:23:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000629) opened an unlinked file! 2024-05-14T03:23:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000630) opened an unlinked file! 2024-05-14T03:23:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000631) opened an unlinked file! 2024-05-14T03:23:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000632) opened an unlinked file! 2024-05-14T03:23:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000633) opened an unlinked file! 2024-05-14T03:23:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000634) opened an unlinked file! 2024-05-14T03:23:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000635) opened an unlinked file! 2024-05-14T03:23:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000636) opened an unlinked file! 2024-05-14T03:23:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000637) opened an unlinked file! 2024-05-14T03:23:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000638) opened an unlinked file! 2024-05-14T03:23:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000639) opened an unlinked file! 2024-05-14T03:23:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000640) opened an unlinked file! 2024-05-14T03:23:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000641) opened an unlinked file! 2024-05-14T03:23:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000642) opened an unlinked file! 2024-05-14T03:23:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000643) opened an unlinked file! 2024-05-14T03:23:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000644) opened an unlinked file! 2024-05-14T03:23:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000645) opened an unlinked file! 2024-05-14T03:23:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000646) opened an unlinked file! 2024-05-14T03:23:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000647) opened an unlinked file! 2024-05-14T03:23:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000648) opened an unlinked file! 2024-05-14T03:23:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000649) opened an unlinked file! 2024-05-14T03:23:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/426-dir/file000650) opened an unlinked file! 2024-05-14T03:23:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: test_file_handles TEST_DIR/426-dir 2024-05-14T03:23:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: test_file_handles TEST_DIR/426-dir -l 2024-05-14T03:23:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: test_file_handles TEST_DIR/426-dir -u 2024-05-14T03:23:32.188 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/426 2024-05-14T03:23:32.189 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/426 2024-05-14T03:23:32.189 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2024-05-14T03:23:32.218 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:32.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T03:23:32.241 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-14T03:23:32.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-14T03:23:32.241 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-05-14T03:23:33.996 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:23:34.000 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:23:34.000 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:34.150 INFO:teuthology.orchestra.run.smithi154.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:23:34.154 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/427 2024-05-14T03:23:34.154 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/427 2024-05-14T03:23:34.154 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:23:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:34.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:23:34.164 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-05-14T03:23:34.314 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:23:34.318 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:23:34.318 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:34.480 INFO:teuthology.orchestra.run.smithi154.stdout:generic/428 0s 2024-05-14T03:23:34.493 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/428 2024-05-14T03:23:34.493 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:23:34.495 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:34.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:23:34.503 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-05-14T03:23:34.655 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:23:34.659 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:23:34.659 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:34.794 INFO:teuthology.orchestra.run.smithi154.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:23:34.797 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/429 2024-05-14T03:23:34.798 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/429 2024-05-14T03:23:34.798 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:23:34.799 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:34.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:23:34.810 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-05-14T03:23:34.959 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:23:34.963 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:23:34.963 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:35.215 INFO:teuthology.orchestra.run.smithi154.stdout:generic/430 1s 2024-05-14T03:23:35.220 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/430 2024-05-14T03:23:35.220 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:23:35.223 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:35.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:23:35.231 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-05-14T03:23:35.728 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:23:35.732 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:23:35.733 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:35.969 INFO:teuthology.orchestra.run.smithi154.stdout:generic/431 0s 2024-05-14T03:23:35.974 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/431 2024-05-14T03:23:35.974 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:23:35.976 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:35.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:23:35.985 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-05-14T03:23:36.501 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:23:36.506 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:23:36.506 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:36.748 INFO:teuthology.orchestra.run.smithi154.stdout:generic/432 0s 2024-05-14T03:23:36.753 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/432 2024-05-14T03:23:36.753 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:23:36.755 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:36.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:23:36.764 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-05-14T03:23:37.266 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:23:37.270 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:23:37.270 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:37.486 INFO:teuthology.orchestra.run.smithi154.stdout:generic/433 0s 2024-05-14T03:23:37.491 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/433 2024-05-14T03:23:37.491 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:23:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:37.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:23:37.502 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-05-14T03:23:37.983 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:23:37.987 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:23:37.987 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:38.213 INFO:teuthology.orchestra.run.smithi154.stdout:generic/434 - output mismatch (see /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/434.out.bad) 2024-05-14T03:23:38.214 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/434.out 2024-05-14 01:24:47.256292846 +0000 2024-05-14T03:23:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/434.out.bad 2024-05-14 03:23:38.210160113 +0000 2024-05-14T03:23:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -9,6 +9,6 @@ 2024-05-14T03:23:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: copy_range: Bad file descriptor 2024-05-14T03:23:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2024-05-14T03:23:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: Try to copy to a device 2024-05-14T03:23:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: -copy_range: Invalid argument 2024-05-14T03:23:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: +/tmp/tmp.v73wnydYBctest/test-434/dev1: Permission denied 2024-05-14T03:23:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: Try to copy to a fifo 2024-05-14T03:23:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: copy_range: Invalid argument 2024-05-14T03:23:38.217 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/434 2024-05-14T03:23:38.217 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/434 2024-05-14T03:23:38.217 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2024-05-14T03:23:38.220 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:38.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T03:23:38.228 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-14T03:23:38.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-14T03:23:38.228 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-05-14T03:23:38.720 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:23:38.726 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:23:38.726 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:38.852 INFO:teuthology.orchestra.run.smithi154.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:23:38.856 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/435 2024-05-14T03:23:38.856 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/435 2024-05-14T03:23:38.856 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:23:38.858 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:38.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:23:38.866 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-05-14T03:23:39.016 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:23:39.021 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:23:39.021 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:40.793 INFO:teuthology.orchestra.run.smithi154.stdout:generic/436 1s 2024-05-14T03:23:40.800 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/436 2024-05-14T03:23:40.800 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:23:40.803 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:40.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:23:40.932 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-05-14T03:23:41.375 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:23:41.379 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:23:41.379 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:42.260 INFO:teuthology.orchestra.run.smithi154.stdout:generic/437 1s 2024-05-14T03:23:42.267 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/437 2024-05-14T03:23:42.267 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:23:42.271 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:23:42.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:23:42.314 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-05-14T03:23:42.516 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:23:42.521 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:23:42.521 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:02.019 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:24:02.021 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:24:32.459 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:24:32.461 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:24:43.019 INFO:teuthology.orchestra.run.smithi154.stdout:generic/438 60s 2024-05-14T03:24:43.063 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/438 2024-05-14T03:24:43.064 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:43.068 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:43.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:43.082 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-05-14T03:24:43.247 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:43.251 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:43.251 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:43.618 INFO:teuthology.orchestra.run.smithi154.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:43.622 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/439 2024-05-14T03:24:43.622 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/439 2024-05-14T03:24:43.622 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:43.625 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:43.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:43.636 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-05-14T03:24:43.794 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:43.798 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:43.798 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:43.947 INFO:teuthology.orchestra.run.smithi154.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:43.951 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/440 2024-05-14T03:24:43.951 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/440 2024-05-14T03:24:43.951 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:43.953 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:43.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:43.962 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-05-14T03:24:44.113 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:44.117 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:44.117 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:44.566 INFO:teuthology.orchestra.run.smithi154.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:44.571 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/441 2024-05-14T03:24:44.571 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/441 2024-05-14T03:24:44.571 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:44.574 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:44.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:44.585 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-05-14T03:24:44.750 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:44.754 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:44.755 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:44.883 INFO:teuthology.orchestra.run.smithi154.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:44.887 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/442 2024-05-14T03:24:44.887 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/442 2024-05-14T03:24:44.887 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:44.889 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:44.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:44.898 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-05-14T03:24:45.051 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:45.055 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:45.055 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:45.207 INFO:teuthology.orchestra.run.smithi154.stdout:generic/443 0s 2024-05-14T03:24:45.212 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/443 2024-05-14T03:24:45.212 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:45.214 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:45.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:45.223 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-05-14T03:24:45.371 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:45.375 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:45.375 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:45.541 INFO:teuthology.orchestra.run.smithi154.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-14T03:24:45.545 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/444 2024-05-14T03:24:45.545 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/444 2024-05-14T03:24:45.545 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:45.547 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:45.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:45.556 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-05-14T03:24:45.707 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:45.711 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:45.711 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:46.919 INFO:teuthology.orchestra.run.smithi154.stdout:generic/445 1s 2024-05-14T03:24:46.940 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/445 2024-05-14T03:24:46.940 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:46.943 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:46.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:46.955 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-05-14T03:24:47.488 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:47.492 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:47.492 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:47.596 INFO:teuthology.orchestra.run.smithi154.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:47.600 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/446 2024-05-14T03:24:47.600 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/446 2024-05-14T03:24:47.600 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:47.602 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:47.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:47.611 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-05-14T03:24:47.761 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:47.765 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:47.765 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:47.892 INFO:teuthology.orchestra.run.smithi154.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:47.895 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/447 2024-05-14T03:24:47.896 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/447 2024-05-14T03:24:47.896 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:47.898 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:47.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:47.906 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-05-14T03:24:48.067 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:48.071 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:48.071 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:49.562 INFO:teuthology.orchestra.run.smithi154.stdout:generic/448 1s 2024-05-14T03:24:49.576 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/448 2024-05-14T03:24:49.576 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:49.579 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:49.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:49.590 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-05-14T03:24:50.117 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:50.121 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:50.121 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:50.239 INFO:teuthology.orchestra.run.smithi154.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:50.243 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/449 2024-05-14T03:24:50.243 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/449 2024-05-14T03:24:50.244 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:50.246 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:50.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:50.255 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-05-14T03:24:50.427 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:50.431 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:50.431 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:51.672 INFO:teuthology.orchestra.run.smithi154.stdout:generic/450 1s 2024-05-14T03:24:51.679 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/450 2024-05-14T03:24:51.680 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:51.683 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:51.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:51.781 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-05-14T03:24:52.198 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:52.202 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:52.202 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:52.682 INFO:teuthology.orchestra.run.smithi154.stdout:generic/451 - output mismatch (see /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/451.out.bad) 2024-05-14T03:24:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/451.out 2024-05-14 01:24:47.260292773 +0000 2024-05-14T03:24:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/451.out.bad 2024-05-14 03:24:52.680250756 +0000 2024-05-14T03:24:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,2 +1,5 @@ 2024-05-14T03:24:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 451 2024-05-14T03:24:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: +get stale data from buffer read 2024-05-14T03:24:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: +00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 2024-05-14T03:24:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: +000a0000 2024-05-14T03:24:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: Silence is golden 2024-05-14T03:24:52.686 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/451 2024-05-14T03:24:52.687 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/451 2024-05-14T03:24:52.687 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2024-05-14T03:24:52.689 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:52.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T03:24:52.697 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-14T03:24:52.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-14T03:24:52.697 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-05-14T03:24:53.190 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:53.194 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:53.194 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:53.301 INFO:teuthology.orchestra.run.smithi154.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:53.305 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/452 2024-05-14T03:24:53.305 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/452 2024-05-14T03:24:53.305 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:53.307 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:53.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:53.316 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-05-14T03:24:53.464 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:53.468 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:53.468 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:53.569 INFO:teuthology.orchestra.run.smithi154.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:53.572 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/453 2024-05-14T03:24:53.572 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/453 2024-05-14T03:24:53.572 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:53.574 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:53.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:53.582 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-05-14T03:24:53.730 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:53.734 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:53.734 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:53.836 INFO:teuthology.orchestra.run.smithi154.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:53.840 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/454 2024-05-14T03:24:53.840 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/454 2024-05-14T03:24:53.840 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:53.842 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:53.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:53.851 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-05-14T03:24:54.002 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:54.006 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:54.006 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:54.213 INFO:teuthology.orchestra.run.smithi154.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:54.218 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/455 2024-05-14T03:24:54.219 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/455 2024-05-14T03:24:54.219 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:54.221 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:54.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:54.230 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-05-14T03:24:54.382 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:54.386 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:54.386 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:54.504 INFO:teuthology.orchestra.run.smithi154.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:54.507 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/456 2024-05-14T03:24:54.507 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/456 2024-05-14T03:24:54.507 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:54.510 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:54.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:54.518 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-05-14T03:24:54.665 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:54.669 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:54.669 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:54.855 INFO:teuthology.orchestra.run.smithi154.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:54.860 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/457 2024-05-14T03:24:54.860 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/457 2024-05-14T03:24:54.860 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:54.863 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:54.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:54.873 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-05-14T03:24:55.019 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:55.023 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:55.023 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:55.126 INFO:teuthology.orchestra.run.smithi154.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:55.130 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/458 2024-05-14T03:24:55.130 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/458 2024-05-14T03:24:55.130 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:55.133 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:55.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:55.141 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-05-14T03:24:55.290 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:55.293 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:55.294 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:55.571 INFO:teuthology.orchestra.run.smithi154.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:55.577 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/459 2024-05-14T03:24:55.577 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/459 2024-05-14T03:24:55.577 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:55.582 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:55.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:55.646 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-05-14T03:24:55.819 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:55.823 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:55.823 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:55.932 INFO:teuthology.orchestra.run.smithi154.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:55.936 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/460 2024-05-14T03:24:55.936 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/460 2024-05-14T03:24:55.936 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:55.939 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:55.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:55.947 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-05-14T03:24:56.092 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:56.096 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:56.096 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:56.201 INFO:teuthology.orchestra.run.smithi154.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:56.204 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/461 2024-05-14T03:24:56.205 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/461 2024-05-14T03:24:56.205 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:56.207 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:56.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:56.215 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-05-14T03:24:56.363 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:56.367 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:56.367 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:56.477 INFO:teuthology.orchestra.run.smithi154.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:56.480 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/462 2024-05-14T03:24:56.481 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/462 2024-05-14T03:24:56.481 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:56.483 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:56.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:56.491 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-05-14T03:24:56.639 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:56.642 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:56.643 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:56.806 INFO:teuthology.orchestra.run.smithi154.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T03:24:56.809 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/463 2024-05-14T03:24:56.809 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/463 2024-05-14T03:24:56.809 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:56.812 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:56.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:56.820 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-05-14T03:24:57.327 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:57.331 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:57.331 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:57.434 INFO:teuthology.orchestra.run.smithi154.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:24:57.437 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/464 2024-05-14T03:24:57.437 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/464 2024-05-14T03:24:57.437 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:24:57.440 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:24:57.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:24:57.448 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-05-14T03:24:57.597 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:24:57.602 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:24:57.602 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:25:02.701 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:25:02.704 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:25:22.689 INFO:teuthology.orchestra.run.smithi154.stdout:generic/465 25s 2024-05-14T03:25:22.755 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/465 2024-05-14T03:25:22.756 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:25:22.774 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:25:22.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:25:22.810 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-05-14T03:25:23.077 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:25:23.081 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:25:23.081 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:25:23.192 INFO:teuthology.orchestra.run.smithi154.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:25:23.196 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/466 2024-05-14T03:25:23.196 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/466 2024-05-14T03:25:23.196 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:25:23.198 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:25:23.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:25:23.212 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-05-14T03:25:23.374 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:25:23.378 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:25:23.378 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:25:30.286 INFO:teuthology.orchestra.run.smithi154.stdout:generic/467 - output mismatch (see /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/467.out.bad) 2024-05-14T03:25:30.302 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/467.out 2024-05-14 01:24:47.260292773 +0000 2024-05-14T03:25:30.303 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/467.out.bad 2024-05-14 03:25:30.275291440 +0000 2024-05-14T03:25:30.303 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,5 +1,15 @@ 2024-05-14T03:25:30.303 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 467 2024-05-14T03:25:30.303 INFO:teuthology.orchestra.run.smithi154.stdout: test_file_handles TEST_DIR/467-dir -dp 2024-05-14T03:25:30.303 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/467-dir/file000000) opened an unlinked file! 2024-05-14T03:25:30.303 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/467-dir/file000001) opened an unlinked file! 2024-05-14T03:25:30.303 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/467-dir/file000002) opened an unlinked file! 2024-05-14T03:25:30.303 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/467-dir/file000003) opened an unlinked file! 2024-05-14T03:25:30.303 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/467-dir/file000004) opened an unlinked file! 2024-05-14T03:25:30.303 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/467-dir/file000005) opened an unlinked file! 2024-05-14T03:25:30.303 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/467-dir/file000006) opened an unlinked file! 2024-05-14T03:25:30.303 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/467-dir/file000007) opened an unlinked file! 2024-05-14T03:25:30.303 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/467-dir/file000008) opened an unlinked file! 2024-05-14T03:25:30.304 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.v73wnydYBctest/467-dir/file000009) opened an unlinked file! 2024-05-14T03:25:30.304 INFO:teuthology.orchestra.run.smithi154.stdout: test_file_handles TEST_DIR/467-dir -rp 2024-05-14T03:25:30.304 INFO:teuthology.orchestra.run.smithi154.stdout: test_file_handles TEST_DIR/467-dir -dkr 2024-05-14T03:25:30.304 INFO:teuthology.orchestra.run.smithi154.stdout: test_file_handles TEST_DIR/467-dir -lr 2024-05-14T03:25:30.317 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/467 2024-05-14T03:25:30.317 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/467 2024-05-14T03:25:30.317 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2024-05-14T03:25:30.339 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:25:30.380 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T03:25:30.380 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-14T03:25:30.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-14T03:25:30.381 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-05-14T03:25:31.901 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:25:31.906 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:25:31.906 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:25:32.107 INFO:teuthology.orchestra.run.smithi154.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:25:32.111 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/468 2024-05-14T03:25:32.111 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/468 2024-05-14T03:25:32.111 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:25:32.114 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:25:32.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:25:32.123 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-05-14T03:25:32.280 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:25:32.284 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:25:32.284 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:25:32.769 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:25:32.773 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:25:34.228 INFO:teuthology.orchestra.run.smithi154.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-14T03:25:34.233 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/469 2024-05-14T03:25:34.233 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/469 2024-05-14T03:25:34.233 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:25:34.236 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:25:34.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:25:34.247 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-05-14T03:25:34.752 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:25:34.756 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:25:34.756 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:25:34.923 INFO:teuthology.orchestra.run.smithi154.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:25:34.929 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/470 2024-05-14T03:25:34.929 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/470 2024-05-14T03:25:34.929 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:25:34.931 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:25:34.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:25:34.941 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-05-14T03:25:35.096 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:25:35.100 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:25:35.101 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:26:02.869 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:26:02.873 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:26:33.593 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:26:33.596 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:26:52.885 INFO:teuthology.orchestra.run.smithi154.stdout:generic/471 77s 2024-05-14T03:26:52.909 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/471 2024-05-14T03:26:52.910 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:26:52.918 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:26:52.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:26:52.943 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-05-14T03:26:53.664 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:26:53.668 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:26:53.668 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:26:54.245 INFO:teuthology.orchestra.run.smithi154.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:26:54.250 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/472 2024-05-14T03:26:54.250 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/472 2024-05-14T03:26:54.250 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:26:54.258 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:26:54.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:26:54.290 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-05-14T03:26:54.440 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:26:54.444 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:26:54.444 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:26:54.798 INFO:teuthology.orchestra.run.smithi154.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T03:26:54.803 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/473 2024-05-14T03:26:54.803 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/473 2024-05-14T03:26:54.803 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:26:54.806 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:26:54.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:26:54.815 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-05-14T03:26:54.970 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:26:54.974 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:26:54.974 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:26:55.176 INFO:teuthology.orchestra.run.smithi154.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:26:55.180 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/474 2024-05-14T03:26:55.180 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/474 2024-05-14T03:26:55.180 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:26:55.182 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:26:55.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:26:55.191 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-05-14T03:26:55.340 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:26:55.344 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:26:55.344 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:26:55.860 INFO:teuthology.orchestra.run.smithi154.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:26:55.867 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/475 2024-05-14T03:26:55.867 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/475 2024-05-14T03:26:55.867 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:26:55.871 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:26:55.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:26:55.884 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-05-14T03:26:56.083 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:26:56.087 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:26:56.087 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:26:56.705 INFO:teuthology.orchestra.run.smithi154.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:26:56.709 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/476 2024-05-14T03:26:56.709 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/476 2024-05-14T03:26:56.710 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:26:56.712 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:26:56.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:26:56.722 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2024-05-14T03:26:56.907 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:26:56.912 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:26:56.912 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:03.697 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:27:03.700 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:27:05.185 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-05-14T03:27:05.184+0000 7fc439c46640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 362295) UID: 0 2024-05-14T03:27:05.192 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-05-14T03:27:05.184+0000 7f3b88d8a640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 362295) UID: 0 2024-05-14T03:27:07.456 INFO:teuthology.orchestra.run.smithi154.stdout:generic/477 11s 2024-05-14T03:27:07.826 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/477 2024-05-14T03:27:07.826 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:07.832 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:07.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:07.905 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2024-05-14T03:27:10.779 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:10.785 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:10.785 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:21.537 INFO:teuthology.orchestra.run.smithi154.stdout:generic/478 - output mismatch (see /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/478.out.bad) 2024-05-14T03:27:21.540 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/478.out 2024-05-14 01:24:47.260292773 +0000 2024-05-14T03:27:21.540 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/478.out.bad 2024-05-14 03:27:21.500468922 +0000 2024-05-14T03:27:21.540 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -10,7 +10,7 @@ 2024-05-14T03:27:21.540 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2024-05-14T03:27:21.540 INFO:teuthology.orchestra.run.smithi154.stdout: get wrlck 2024-05-14T03:27:21.540 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2024-05-14T03:27:21.541 INFO:teuthology.orchestra.run.smithi154.stdout: -lock could be placed 2024-05-14T03:27:21.541 INFO:teuthology.orchestra.run.smithi154.stdout: +get wrlck 2024-05-14T03:27:21.541 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2024-05-14T03:27:21.541 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2024-05-14T03:27:21.541 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2024-05-14T03:27:21.541 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -25,7 +25,7 @@ 2024-05-14T03:27:21.541 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2024-05-14T03:27:21.541 INFO:teuthology.orchestra.run.smithi154.stdout: get wrlck 2024-05-14T03:27:21.541 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2024-05-14T03:27:21.541 INFO:teuthology.orchestra.run.smithi154.stdout: -lock could be placed 2024-05-14T03:27:21.541 INFO:teuthology.orchestra.run.smithi154.stdout: +get wrlck 2024-05-14T03:27:21.541 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2024-05-14T03:27:21.542 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2024-05-14T03:27:21.542 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2024-05-14T03:27:21.542 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -37,7 +37,7 @@ 2024-05-14T03:27:21.542 INFO:teuthology.orchestra.run.smithi154.stdout: get rdlck 2024-05-14T03:27:21.542 INFO:teuthology.orchestra.run.smithi154.stdout: get rdlck 2024-05-14T03:27:21.542 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2024-05-14T03:27:21.542 INFO:teuthology.orchestra.run.smithi154.stdout: -lock could be placed 2024-05-14T03:27:21.542 INFO:teuthology.orchestra.run.smithi154.stdout: +get rdlck 2024-05-14T03:27:21.542 INFO:teuthology.orchestra.run.smithi154.stdout: get rdlck 2024-05-14T03:27:21.542 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2024-05-14T03:27:21.542 INFO:teuthology.orchestra.run.smithi154.stdout: get rdlck 2024-05-14T03:27:21.542 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -46,7 +46,7 @@ 2024-05-14T03:27:21.542 INFO:teuthology.orchestra.run.smithi154.stdout: get rdlck 2024-05-14T03:27:21.543 INFO:teuthology.orchestra.run.smithi154.stdout: get rdlck 2024-05-14T03:27:21.543 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2024-05-14T03:27:21.543 INFO:teuthology.orchestra.run.smithi154.stdout: -lock could be placed 2024-05-14T03:27:21.543 INFO:teuthology.orchestra.run.smithi154.stdout: +get rdlck 2024-05-14T03:27:21.543 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2024-05-14T03:27:21.543 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2024-05-14T03:27:21.543 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2024-05-14T03:27:21.543 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/478 2024-05-14T03:27:21.544 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/478 2024-05-14T03:27:21.544 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2024-05-14T03:27:21.547 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:21.557 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T03:27:21.558 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-14T03:27:21.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-14T03:27:21.558 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2024-05-14T03:27:21.744 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:21.749 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:21.749 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:22.001 INFO:teuthology.orchestra.run.smithi154.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:22.006 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/479 2024-05-14T03:27:22.006 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/479 2024-05-14T03:27:22.006 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:22.010 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:22.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:22.020 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2024-05-14T03:27:22.209 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:22.213 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:22.213 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:22.340 INFO:teuthology.orchestra.run.smithi154.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:22.344 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/480 2024-05-14T03:27:22.344 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/480 2024-05-14T03:27:22.344 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:22.346 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:22.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:22.355 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2024-05-14T03:27:22.510 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:22.514 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:22.515 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:22.644 INFO:teuthology.orchestra.run.smithi154.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:22.648 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/481 2024-05-14T03:27:22.649 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/481 2024-05-14T03:27:22.649 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:22.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:22.659 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2024-05-14T03:27:22.812 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:22.817 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:22.817 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:23.044 INFO:teuthology.orchestra.run.smithi154.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:23.049 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/482 2024-05-14T03:27:23.049 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/482 2024-05-14T03:27:23.049 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:23.051 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:23.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:23.059 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2024-05-14T03:27:23.212 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:23.216 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:23.216 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:23.356 INFO:teuthology.orchestra.run.smithi154.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:23.360 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/483 2024-05-14T03:27:23.360 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/483 2024-05-14T03:27:23.360 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:23.362 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:23.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:23.370 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2024-05-14T03:27:23.525 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:23.530 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:23.530 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:23.659 INFO:teuthology.orchestra.run.smithi154.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:23.663 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/484 2024-05-14T03:27:23.663 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/484 2024-05-14T03:27:23.663 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:23.665 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:23.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:23.674 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2024-05-14T03:27:23.826 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:23.830 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:23.831 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:24.729 INFO:teuthology.orchestra.run.smithi154.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-05-14T03:27:24.733 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/485 2024-05-14T03:27:24.733 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/485 2024-05-14T03:27:24.733 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:24.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:24.745 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2024-05-14T03:27:25.258 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:25.262 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:25.262 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:25.399 INFO:teuthology.orchestra.run.smithi154.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:25.402 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/486 2024-05-14T03:27:25.403 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/486 2024-05-14T03:27:25.403 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:25.405 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:25.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:25.414 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2024-05-14T03:27:25.563 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:25.567 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:25.567 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:25.699 INFO:teuthology.orchestra.run.smithi154.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:25.703 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/487 2024-05-14T03:27:25.703 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/487 2024-05-14T03:27:25.703 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:25.706 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:25.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:25.714 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2024-05-14T03:27:25.864 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:25.868 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:25.869 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:25.973 INFO:teuthology.orchestra.run.smithi154.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:25.976 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/488 2024-05-14T03:27:25.976 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/488 2024-05-14T03:27:25.976 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:25.978 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:25.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:25.987 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2024-05-14T03:27:26.138 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:26.142 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:26.142 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:26.276 INFO:teuthology.orchestra.run.smithi154.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:26.279 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/489 2024-05-14T03:27:26.280 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/489 2024-05-14T03:27:26.280 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:26.282 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:26.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:26.290 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2024-05-14T03:27:26.441 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:26.445 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:26.445 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:27.814 INFO:teuthology.orchestra.run.smithi154.stdout:generic/490 1s 2024-05-14T03:27:27.819 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/490 2024-05-14T03:27:27.819 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:27.822 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:27.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:27.832 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2024-05-14T03:27:28.453 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:28.457 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:28.457 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:28.612 INFO:teuthology.orchestra.run.smithi154.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:28.616 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/491 2024-05-14T03:27:28.616 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/491 2024-05-14T03:27:28.616 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:28.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:28.627 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2024-05-14T03:27:28.782 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:28.786 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:28.787 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:28.891 INFO:teuthology.orchestra.run.smithi154.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:28.895 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/492 2024-05-14T03:27:28.895 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/492 2024-05-14T03:27:28.895 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:28.897 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:28.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:28.906 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2024-05-14T03:27:29.055 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:29.060 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:29.060 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:29.165 INFO:teuthology.orchestra.run.smithi154.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:29.168 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/493 2024-05-14T03:27:29.168 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/493 2024-05-14T03:27:29.168 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:29.171 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:29.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:29.179 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2024-05-14T03:27:29.330 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:29.334 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:29.334 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:29.438 INFO:teuthology.orchestra.run.smithi154.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:29.442 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/494 2024-05-14T03:27:29.442 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/494 2024-05-14T03:27:29.442 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:29.444 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:29.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:29.452 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2024-05-14T03:27:29.605 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:29.608 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:29.608 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:29.714 INFO:teuthology.orchestra.run.smithi154.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:29.717 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/495 2024-05-14T03:27:29.717 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/495 2024-05-14T03:27:29.717 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:29.720 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:29.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:29.728 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2024-05-14T03:27:29.879 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:29.883 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:29.883 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:30.006 INFO:teuthology.orchestra.run.smithi154.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/496 2024-05-14T03:27:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/496 2024-05-14T03:27:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:30.012 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:30.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:30.020 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2024-05-14T03:27:30.173 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:30.177 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:30.177 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:30.282 INFO:teuthology.orchestra.run.smithi154.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:30.286 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/497 2024-05-14T03:27:30.286 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/497 2024-05-14T03:27:30.286 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:30.288 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:30.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:30.296 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2024-05-14T03:27:30.448 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:30.452 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:30.452 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:30.579 INFO:teuthology.orchestra.run.smithi154.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:30.583 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/498 2024-05-14T03:27:30.583 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/498 2024-05-14T03:27:30.583 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:30.585 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:30.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:30.594 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2024-05-14T03:27:30.742 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:30.746 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:30.746 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:30.851 INFO:teuthology.orchestra.run.smithi154.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:30.854 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/499 2024-05-14T03:27:30.854 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/499 2024-05-14T03:27:30.854 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:30.857 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:30.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:30.865 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2024-05-14T03:27:31.016 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:31.020 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:31.020 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:31.201 INFO:teuthology.orchestra.run.smithi154.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:31.205 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/500 2024-05-14T03:27:31.205 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/500 2024-05-14T03:27:31.205 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:31.207 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:31.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:31.215 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2024-05-14T03:27:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:31.368 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:31.368 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:31.487 INFO:teuthology.orchestra.run.smithi154.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:31.491 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/501 2024-05-14T03:27:31.491 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/501 2024-05-14T03:27:31.491 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:31.493 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:31.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:31.501 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2024-05-14T03:27:31.649 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:31.653 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:31.653 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:31.796 INFO:teuthology.orchestra.run.smithi154.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:31.799 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/502 2024-05-14T03:27:31.799 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/502 2024-05-14T03:27:31.799 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:31.802 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:31.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:31.810 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2024-05-14T03:27:31.960 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:31.964 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:31.964 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:32.070 INFO:teuthology.orchestra.run.smithi154.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:32.074 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/503 2024-05-14T03:27:32.074 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/503 2024-05-14T03:27:32.074 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:32.076 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:32.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:32.085 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2024-05-14T03:27:32.233 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:32.237 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:32.237 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:32.428 INFO:teuthology.orchestra.run.smithi154.stdout:generic/504 - output mismatch (see /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/504.out.bad) 2024-05-14T03:27:32.430 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/504.out 2024-05-14 01:24:47.260292773 +0000 2024-05-14T03:27:32.430 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/504.out.bad 2024-05-14 03:27:32.424192850 +0000 2024-05-14T03:27:32.430 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,2 +1,3 @@ 2024-05-14T03:27:32.430 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 504 2024-05-14T03:27:32.430 INFO:teuthology.orchestra.run.smithi154.stdout: +lock info not found 2024-05-14T03:27:32.430 INFO:teuthology.orchestra.run.smithi154.stdout: Silence is golden 2024-05-14T03:27:32.432 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/504 2024-05-14T03:27:32.432 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/504 2024-05-14T03:27:32.433 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2024-05-14T03:27:32.435 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:32.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T03:27:32.443 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-14T03:27:32.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-14T03:27:32.443 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2024-05-14T03:27:32.591 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:32.596 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:32.596 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:32.700 INFO:teuthology.orchestra.run.smithi154.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:32.704 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/505 2024-05-14T03:27:32.704 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/505 2024-05-14T03:27:32.704 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:32.705 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:32.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:32.714 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2024-05-14T03:27:32.863 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:32.868 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:32.868 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:32.973 INFO:teuthology.orchestra.run.smithi154.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:32.977 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/506 2024-05-14T03:27:32.977 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/506 2024-05-14T03:27:32.977 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:32.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:32.988 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2024-05-14T03:27:33.146 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:33.152 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:33.152 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:33.311 INFO:teuthology.orchestra.run.smithi154.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-05-14T03:27:33.315 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/507 2024-05-14T03:27:33.315 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/507 2024-05-14T03:27:33.315 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:33.317 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:33.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:33.326 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2024-05-14T03:27:33.478 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:33.482 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:33.482 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:33.598 INFO:teuthology.orchestra.run.smithi154.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2024-05-14T03:27:33.601 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/508 2024-05-14T03:27:33.601 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/508 2024-05-14T03:27:33.601 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:33.603 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:33.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:33.612 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2024-05-14T03:27:33.764 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:33.769 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:33.769 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:33.890 INFO:teuthology.orchestra.run.smithi154.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:33.891 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/509 2024-05-14T03:27:33.892 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/509 2024-05-14T03:27:33.892 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:33.894 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:33.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:33.903 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2024-05-14T03:27:34.054 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:34.059 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:34.059 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:34.176 INFO:teuthology.orchestra.run.smithi154.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:34.180 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/510 2024-05-14T03:27:34.180 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/510 2024-05-14T03:27:34.180 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:34.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:34.191 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2024-05-14T03:27:34.341 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:34.345 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:34.345 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:34.449 INFO:teuthology.orchestra.run.smithi154.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:34.453 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/511 2024-05-14T03:27:34.453 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/511 2024-05-14T03:27:34.453 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:34.455 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:34.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:34.463 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2024-05-14T03:27:34.611 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:34.615 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:34.616 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:34.731 INFO:teuthology.orchestra.run.smithi154.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:34.735 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/512 2024-05-14T03:27:34.735 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/512 2024-05-14T03:27:34.735 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:34.737 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:34.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:34.745 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2024-05-14T03:27:34.904 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:34.908 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:34.908 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:35.013 INFO:teuthology.orchestra.run.smithi154.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:35.017 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/513 2024-05-14T03:27:35.017 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/513 2024-05-14T03:27:35.017 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:35.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:35.028 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2024-05-14T03:27:35.179 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:35.183 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:35.183 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:35.290 INFO:teuthology.orchestra.run.smithi154.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:35.293 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/514 2024-05-14T03:27:35.293 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/514 2024-05-14T03:27:35.293 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:35.296 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:35.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:35.304 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2024-05-14T03:27:35.456 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:35.460 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:35.565 INFO:teuthology.orchestra.run.smithi154.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:35.569 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/515 2024-05-14T03:27:35.569 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/515 2024-05-14T03:27:35.569 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:35.571 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:35.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:35.579 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2024-05-14T03:27:35.729 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:35.734 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:35.734 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:35.883 INFO:teuthology.orchestra.run.smithi154.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-14T03:27:35.887 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/516 2024-05-14T03:27:35.887 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/516 2024-05-14T03:27:35.887 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:35.890 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:35.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:35.897 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2024-05-14T03:27:36.379 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:36.383 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:36.383 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:36.487 INFO:teuthology.orchestra.run.smithi154.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:36.491 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/517 2024-05-14T03:27:36.491 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/517 2024-05-14T03:27:36.491 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:36.493 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:36.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:36.502 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2024-05-14T03:27:36.653 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:36.657 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:36.657 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:36.764 INFO:teuthology.orchestra.run.smithi154.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:36.768 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/518 2024-05-14T03:27:36.768 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/518 2024-05-14T03:27:36.768 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:36.770 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:36.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:36.779 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2024-05-14T03:27:36.928 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:36.932 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:36.932 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:37.038 INFO:teuthology.orchestra.run.smithi154.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:37.042 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/519 2024-05-14T03:27:37.042 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/519 2024-05-14T03:27:37.042 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:37.044 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:37.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:37.052 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2024-05-14T03:27:37.200 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:37.204 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:37.204 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:37.323 INFO:teuthology.orchestra.run.smithi154.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T03:27:37.327 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/520 2024-05-14T03:27:37.328 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/520 2024-05-14T03:27:37.328 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T03:27:37.330 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:27:37.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T03:27:37.338 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2024-05-14T03:27:37.486 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T03:27:37.490 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T03:27:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T03:29:54.476 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:29:54.480 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:30:24.580 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:30:24.583 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:30:54.726 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:30:54.730 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:31:24.848 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:31:24.852 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:31:55.099 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:31:55.102 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:32:25.160 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:32:25.164 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:32:55.241 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:32:55.244 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:33:25.346 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:33:25.349 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:33:55.451 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:33:55.454 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:34:25.515 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:34:25.519 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:34:55.713 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:34:55.716 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:35:25.775 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:35:25.779 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:35:55.966 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:35:55.970 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:36:26.013 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:36:26.016 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:36:56.118 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:36:56.122 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:37:26.157 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:37:26.161 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:37:56.288 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:37:56.291 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:38:26.335 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:38:26.338 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:38:56.390 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:38:56.393 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:39:26.538 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:39:26.541 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:39:56.659 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:39:56.662 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:40:26.840 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:40:26.845 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:40:56.912 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:40:56.915 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:41:27.201 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:41:27.204 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:41:57.265 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:41:57.268 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:42:27.428 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:42:27.432 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:42:57.559 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:42:57.562 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:43:27.680 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:43:27.684 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:43:57.794 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:43:57.798 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:44:28.000 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:44:28.003 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:44:58.047 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:44:58.050 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:45:28.246 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:45:28.249 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:45:58.328 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:45:58.332 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:46:28.400 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:46:28.404 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:46:58.497 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:46:58.500 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:47:28.628 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:47:28.631 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:47:58.674 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:47:58.677 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:48:28.763 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:48:28.766 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:48:58.803 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:48:58.806 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:49:28.923 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:49:28.927 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:49:58.987 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:49:58.991 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:50:29.050 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:50:29.054 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:50:59.148 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:50:59.152 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:51:29.196 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:51:29.200 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:51:29.219 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T03:51:29.219+0000 7fa1653a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 381907) UID: 0 2024-05-14T03:51:29.220 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-05-14T03:51:29.219+0000 7f7aa7691640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 381907) UID: 0 2024-05-14T03:51:29.220 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T03:51:29.219+0000 7fef9122a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 381907) UID: 0 2024-05-14T03:51:29.220 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-05-14T03:51:29.219+0000 7f7af66da640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 381907) UID: 0 2024-05-14T03:53:57.183 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:53:57.187 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:54:27.311 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:54:27.315 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:54:57.359 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:54:57.363 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:55:27.405 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:55:27.408 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:55:57.461 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:55:57.464 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:56:27.609 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:56:27.612 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:56:57.722 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:56:57.725 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:57:27.802 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:57:27.806 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:57:58.117 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:57:58.121 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:58:28.171 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:58:28.174 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:58:58.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:58:58.290 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:59:28.593 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:59:28.596 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:59:58.647 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T03:59:58.650 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:00:28.762 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:00:28.766 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:00:58.893 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:00:58.897 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:01:29.032 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:01:29.036 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:01:59.113 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:01:59.118 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:02:29.191 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:02:29.194 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:02:59.281 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:02:59.284 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:03:29.387 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:03:29.391 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:03:59.470 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:03:59.473 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:04:29.526 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:04:29.530 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:04:59.568 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:04:59.571 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:05:29.671 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:05:29.676 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:05:59.806 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:05:59.809 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:06:29.886 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:06:29.889 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:07:00.026 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:07:00.029 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:07:30.314 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:07:30.317 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:08:00.378 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:08:00.381 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:08:30.475 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:08:30.478 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:09:00.605 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:09:00.608 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:09:30.651 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:09:30.655 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:10:00.742 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:10:00.745 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:10:30.778 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:10:30.782 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:11:00.850 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:11:00.853 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:11:30.923 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:11:30.926 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:12:01.037 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:12:01.040 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:12:31.134 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:12:31.136 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:13:01.179 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:13:01.182 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:13:31.504 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:13:31.507 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:14:01.558 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:14:01.561 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:14:31.655 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:14:31.658 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:15:01.768 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:15:01.771 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:15:01.797 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T04:15:01.797+0000 7fef9122a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 382046) UID: 0 2024-05-14T04:15:01.798 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T04:15:01.797+0000 7fa1653a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 382046) UID: 0 2024-05-14T04:15:01.799 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-05-14T04:15:01.797+0000 7f7af66da640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 382046) UID: 0 2024-05-14T04:15:01.799 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-05-14T04:15:01.797+0000 7f7aa7691640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 382046) UID: 0 2024-05-14T04:17:07.914 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:17:07.917 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:17:37.985 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:17:37.988 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:18:08.097 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:18:08.100 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:18:38.154 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:18:38.157 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:19:08.417 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:19:08.420 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:19:38.731 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:19:38.735 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:20:08.903 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:20:08.906 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:20:38.950 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:20:38.953 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:21:09.073 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:21:09.076 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:21:39.195 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:21:39.201 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:22:09.267 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:22:09.270 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:22:39.373 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:22:39.375 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:23:09.445 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:23:09.448 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:23:39.534 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:23:39.538 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:24:09.649 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:24:09.652 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:24:39.710 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:24:39.713 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:25:09.768 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:25:09.771 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:25:39.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:25:39.824 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:26:09.969 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:26:09.971 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:26:40.100 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:26:40.103 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:27:10.221 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:27:10.224 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:27:40.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:27:40.289 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:28:10.566 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:28:10.569 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:28:40.608 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:28:40.611 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:29:10.998 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:29:11.001 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:29:41.041 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:29:41.044 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:30:11.138 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:30:11.141 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:30:41.235 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:30:41.238 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:31:11.340 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:31:11.343 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:31:41.396 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:31:41.399 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:32:11.748 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:32:11.751 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:32:41.915 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:32:41.918 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:33:12.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:33:12.024 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:33:42.135 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:33:42.139 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:34:12.274 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:34:12.277 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:34:42.326 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:34:42.330 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:35:12.440 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:35:12.443 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:35:42.540 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:35:42.544 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:36:12.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:36:12.599 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:36:42.693 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:36:42.697 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:37:12.782 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:37:12.785 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:37:42.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:37:42.866 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:38:12.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:38:12.912 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:38:43.231 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:38:43.235 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:39:13.277 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:39:13.280 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:39:43.408 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:39:43.412 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:40:13.548 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:40:13.551 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:40:43.662 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:40:43.668 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:41:13.709 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:41:13.712 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:41:43.773 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:41:43.776 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:42:14.122 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:42:14.125 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:42:44.192 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:42:44.196 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:43:14.238 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:43:14.242 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:43:44.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:43:44.291 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:44:14.426 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:44:14.430 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:44:44.507 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:44:44.510 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:45:14.604 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:45:14.608 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:45:44.659 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:45:44.663 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:46:14.757 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:46:14.762 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:46:45.181 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:46:45.184 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:47:15.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:47:15.290 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:47:45.400 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:47:45.403 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:48:15.456 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:48:15.459 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:48:45.579 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:48:45.583 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:49:15.684 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:49:15.687 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:49:45.770 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:49:45.773 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:50:15.858 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:50:15.861 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:50:46.097 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:50:46.100 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:51:16.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:51:16.155 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:51:46.295 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:51:46.299 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:52:16.368 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:52:16.372 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:52:46.456 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:52:46.460 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:53:16.557 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:53:16.561 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:53:46.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:53:46.739 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:54:16.810 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:54:16.814 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:54:46.873 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:54:46.877 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:55:16.962 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:55:16.966 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:55:47.018 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:55:47.021 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:56:17.334 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:56:17.339 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:56:47.446 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:56:47.450 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:57:17.519 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:57:17.523 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:57:48.016 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:57:48.020 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:58:18.071 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:58:18.074 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:58:48.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:58:48.155 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:59:18.290 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:59:18.293 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:59:48.422 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T04:59:48.425 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:00:18.477 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:00:18.481 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:00:48.574 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:00:48.578 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:01:18.780 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:01:18.784 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:01:48.836 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:01:48.839 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:02:18.975 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:02:18.978 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:02:19.020 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T05:02:19.026+0000 7fef9122a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 382330) UID: 0 2024-05-14T05:02:19.020 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-05-14T05:02:19.026+0000 7f7af66da640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 382330) UID: 0 2024-05-14T05:02:19.021 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-05-14T05:02:19.026+0000 7f7aa7691640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 382330) UID: 0 2024-05-14T05:02:19.021 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T05:02:19.026+0000 7fa1653a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 382330) UID: 0 2024-05-14T05:04:32.733 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:04:32.737 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:05:02.838 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:05:02.840 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:05:03.956 INFO:teuthology.orchestra.run.smithi154.stdout:generic/521 5846s 2024-05-14T05:05:04.030 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/521 2024-05-14T05:05:04.030 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T05:05:04.038 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T05:05:04.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T05:05:04.051 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2024-05-14T05:05:04.968 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T05:05:04.973 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T05:05:04.973 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T05:05:32.976 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:05:32.980 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:06:03.024 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:06:03.028 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:06:33.137 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:06:33.140 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:07:03.209 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:07:03.213 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:07:33.331 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:07:33.334 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:08:03.495 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:08:03.499 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:08:33.668 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:08:33.671 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:09:03.715 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:09:03.718 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:09:33.811 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:09:33.815 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:10:03.926 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:10:03.929 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:10:34.024 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:10:34.028 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:11:04.129 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:11:04.132 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:11:34.218 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:11:34.222 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:12:04.297 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:12:04.300 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:12:34.362 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:12:34.365 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:13:04.441 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:13:04.445 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:13:34.556 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:13:34.560 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:14:04.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:14:04.722 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:14:34.768 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:14:34.771 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:15:04.820 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:15:05.445 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:15:35.487 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:15:35.491 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:16:05.586 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:16:05.590 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:16:35.791 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:16:35.794 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:17:05.841 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:17:05.845 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:17:35.948 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:17:35.951 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:18:06.115 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:18:06.118 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:18:36.162 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:18:36.166 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:19:06.233 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:19:06.236 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:19:36.300 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:19:36.303 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:20:06.415 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:20:06.418 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:20:36.621 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:20:36.625 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:21:06.688 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:21:06.692 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:21:36.736 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:21:36.739 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:22:06.856 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:22:06.859 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:22:36.930 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:22:36.933 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:23:07.005 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:23:07.008 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:23:37.135 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:23:37.139 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:24:07.257 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:24:07.261 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:24:37.489 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:24:37.492 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:25:07.561 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:25:07.575 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:25:37.840 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:25:37.843 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:26:07.928 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:26:07.931 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:26:38.003 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:26:38.007 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:27:08.142 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:27:08.145 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:27:38.291 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:27:38.295 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:28:08.362 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:28:08.366 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:28:38.424 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:28:38.428 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:29:08.530 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:29:08.533 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:29:38.613 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:29:38.617 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:30:08.669 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:30:08.673 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:30:38.775 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:30:38.778 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:31:09.130 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:31:09.134 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:31:39.244 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:31:39.248 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:32:09.324 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:32:09.328 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:32:39.447 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:32:39.451 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:33:09.527 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:33:09.531 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:33:39.591 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:33:39.594 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:34:09.736 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:34:09.739 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:34:39.777 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:34:39.781 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:35:09.906 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:35:09.909 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:35:40.022 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:35:40.025 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:36:10.136 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:36:10.140 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:36:10.160 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-05-14T05:36:10.157+0000 7fc439c46640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 382982) UID: 0 2024-05-14T05:36:10.161 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-05-14T05:36:10.157+0000 7f3b88d8a640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 382982) UID: 0 2024-05-14T05:38:38.687 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:38:38.690 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:39:08.815 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:39:08.818 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:39:38.861 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:39:38.864 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:40:08.978 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:40:08.981 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:40:39.031 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:40:39.035 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:41:09.141 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:41:09.145 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:41:39.250 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:41:39.253 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:42:09.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:42:09.351 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:42:39.398 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:42:39.401 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:43:09.517 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:43:09.521 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:43:39.592 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:43:39.595 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:44:09.678 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:44:09.681 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:44:39.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:44:39.825 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:45:10.086 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:45:10.090 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:45:40.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:45:40.136 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:46:10.291 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:46:10.294 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:46:40.335 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:46:40.338 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:47:10.463 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:47:10.466 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:47:40.585 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:47:40.589 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:48:10.632 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:48:10.634 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:48:40.704 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:48:40.707 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:49:10.976 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:49:10.979 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:49:41.023 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:49:41.026 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:50:11.148 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:50:11.152 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:50:41.275 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:50:41.278 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:51:11.379 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:51:11.383 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:51:41.427 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:51:41.431 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:52:11.583 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:52:11.590 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:52:41.689 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:52:41.693 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:53:11.751 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:53:11.754 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:53:41.847 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:53:41.850 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:54:12.203 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:54:12.206 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:54:42.250 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:54:42.259 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:55:12.373 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:55:12.376 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:55:42.553 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:55:42.557 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:56:12.600 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:56:12.603 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:56:42.722 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:56:42.725 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:57:12.844 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:57:12.847 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:57:42.974 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:57:42.978 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:58:13.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:58:13.024 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:58:43.119 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:58:43.123 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:59:13.499 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:59:13.502 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:59:43.546 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T05:59:43.550 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:00:13.643 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:00:13.647 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:00:43.758 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:00:43.761 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:00:43.793 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-05-14T06:00:43.785+0000 7f396d567640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35763) UID: 0 2024-05-14T06:00:43.794 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-05-14T06:00:43.785+0000 7f75626b8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35763) UID: 0 2024-05-14T06:00:43.794 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T06:00:43.785+0000 7f9bb37f5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35763) UID: 0 2024-05-14T06:00:43.794 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-05-14T06:00:43.785+0000 7f01ba1e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35763) UID: 0 2024-05-14T06:03:00.948 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:03:00.951 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:03:30.998 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:03:31.001 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:04:01.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:04:01.155 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:04:31.312 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:04:31.316 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:05:01.367 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:05:01.370 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:05:31.415 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:05:31.419 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:06:01.540 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:06:01.543 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:06:31.634 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:06:31.638 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:07:01.705 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:07:01.709 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:07:31.786 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:07:31.790 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:07:31.811 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T06:07:31.805+0000 7f9bb37f5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35866) UID: 0 2024-05-14T06:07:31.811 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-05-14T06:07:31.805+0000 7f396d567640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35866) UID: 0 2024-05-14T06:07:31.811 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-05-14T06:07:31.805+0000 7f75626b8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35866) UID: 0 2024-05-14T06:07:31.812 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-05-14T06:07:31.805+0000 7f01ba1e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 35866) UID: 0 2024-05-14T06:09:55.146 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:09:55.149 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:10:25.282 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:10:25.286 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:10:55.325 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:10:55.328 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:11:25.380 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:11:25.384 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:11:55.500 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:11:55.504 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:12:25.545 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:12:25.549 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:12:55.654 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:12:55.657 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:13:25.707 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:13:25.710 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:13:55.779 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:13:55.783 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:14:25.826 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:14:25.829 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:14:55.889 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:14:55.893 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:15:25.954 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:15:25.958 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:15:56.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:15:56.031 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:16:26.075 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:16:26.078 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:16:56.372 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:16:56.375 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:17:26.469 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:17:26.473 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:17:56.516 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:17:56.519 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:18:26.723 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:18:26.726 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:18:56.828 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:18:56.831 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:19:27.055 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:19:27.058 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:19:57.129 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:19:57.133 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:20:27.411 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:20:27.414 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:20:57.457 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:20:57.460 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:21:27.504 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:21:27.508 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:21:30.909 INFO:teuthology.orchestra.run.smithi154.stdout:generic/522 4586s 2024-05-14T06:21:30.921 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/522 2024-05-14T06:21:30.922 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T06:21:30.925 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:30.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T06:21:30.939 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2024-05-14T06:21:31.133 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T06:21:31.137 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T06:21:31.137 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:31.263 INFO:teuthology.orchestra.run.smithi154.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T06:21:31.267 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/523 2024-05-14T06:21:31.267 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/523 2024-05-14T06:21:31.267 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T06:21:31.270 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:31.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T06:21:31.280 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2024-05-14T06:21:31.457 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T06:21:31.462 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T06:21:31.462 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:31.584 INFO:teuthology.orchestra.run.smithi154.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T06:21:31.588 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/524 2024-05-14T06:21:31.588 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/524 2024-05-14T06:21:31.588 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T06:21:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:31.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T06:21:31.601 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2024-05-14T06:21:31.777 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T06:21:31.781 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T06:21:31.782 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:31.908 INFO:teuthology.orchestra.run.smithi154.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T06:21:31.912 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/525 2024-05-14T06:21:31.912 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/525 2024-05-14T06:21:31.912 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T06:21:31.915 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:31.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T06:21:31.925 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2024-05-14T06:21:32.098 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T06:21:32.103 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T06:21:32.103 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:32.263 INFO:teuthology.orchestra.run.smithi154.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T06:21:32.267 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/526 2024-05-14T06:21:32.267 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/526 2024-05-14T06:21:32.267 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T06:21:32.270 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:32.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T06:21:32.278 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2024-05-14T06:21:32.430 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T06:21:32.434 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T06:21:32.434 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:32.555 INFO:teuthology.orchestra.run.smithi154.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T06:21:32.558 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/527 2024-05-14T06:21:32.559 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/527 2024-05-14T06:21:32.559 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T06:21:32.561 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:32.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T06:21:32.569 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2024-05-14T06:21:32.718 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T06:21:32.722 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T06:21:32.722 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:32.853 INFO:teuthology.orchestra.run.smithi154.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2024-05-14T06:21:32.857 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/528 2024-05-14T06:21:32.857 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/528 2024-05-14T06:21:32.857 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T06:21:32.859 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:32.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T06:21:32.867 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2024-05-14T06:21:33.015 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T06:21:33.019 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T06:21:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:33.161 INFO:teuthology.orchestra.run.smithi154.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-14T06:21:33.164 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/529 2024-05-14T06:21:33.164 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/529 2024-05-14T06:21:33.164 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T06:21:33.167 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:33.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T06:21:33.175 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2024-05-14T06:21:33.326 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T06:21:33.330 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T06:21:33.330 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:33.431 INFO:teuthology.orchestra.run.smithi154.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T06:21:33.435 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/530 2024-05-14T06:21:33.435 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/530 2024-05-14T06:21:33.436 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T06:21:33.438 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:33.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T06:21:33.447 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2024-05-14T06:21:33.595 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T06:21:33.599 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T06:21:33.599 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:33.700 INFO:teuthology.orchestra.run.smithi154.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T06:21:33.704 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/531 2024-05-14T06:21:33.704 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/531 2024-05-14T06:21:33.704 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T06:21:33.706 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:33.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T06:21:33.715 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2024-05-14T06:21:33.861 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T06:21:33.865 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T06:21:33.865 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:34.015 INFO:teuthology.orchestra.run.smithi154.stdout:generic/532 1s 2024-05-14T06:21:34.020 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/532 2024-05-14T06:21:34.021 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T06:21:34.023 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:34.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T06:21:34.031 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2024-05-14T06:21:34.181 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T06:21:34.186 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T06:21:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:34.555 INFO:teuthology.orchestra.run.smithi154.stdout:generic/533 0s 2024-05-14T06:21:34.560 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/533 2024-05-14T06:21:34.560 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T06:21:34.562 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:34.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T06:21:34.570 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2024-05-14T06:21:34.717 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T06:21:34.721 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T06:21:34.722 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:34.835 INFO:teuthology.orchestra.run.smithi154.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T06:21:34.838 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/534 2024-05-14T06:21:34.838 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/534 2024-05-14T06:21:34.838 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T06:21:34.840 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:34.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T06:21:34.849 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2024-05-14T06:21:34.997 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T06:21:35.001 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T06:21:35.001 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:35.115 INFO:teuthology.orchestra.run.smithi154.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T06:21:35.118 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/535 2024-05-14T06:21:35.118 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/535 2024-05-14T06:21:35.118 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T06:21:35.120 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:35.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T06:21:35.129 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2024-05-14T06:21:35.275 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T06:21:35.279 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T06:21:35.280 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:35.380 INFO:teuthology.orchestra.run.smithi154.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T06:21:35.385 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/536 2024-05-14T06:21:35.385 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/536 2024-05-14T06:21:35.385 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T06:21:35.388 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:35.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T06:21:35.396 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2024-05-14T06:21:35.542 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T06:21:35.546 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T06:21:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:35.650 INFO:teuthology.orchestra.run.smithi154.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T06:21:35.654 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/537 2024-05-14T06:21:35.654 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/537 2024-05-14T06:21:35.654 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T06:21:35.656 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:35.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T06:21:35.664 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2024-05-14T06:21:35.811 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T06:21:35.816 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T06:21:35.816 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T06:21:57.601 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:21:57.604 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:22:27.725 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:22:27.728 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:22:57.769 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:22:57.773 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:23:27.895 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:23:27.898 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:23:57.998 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:23:58.001 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:24:28.044 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:24:28.048 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:24:58.136 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:24:58.139 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:25:28.191 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:25:28.194 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:25:58.348 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:25:58.351 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:26:28.520 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:26:28.524 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:26:58.639 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:26:58.642 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:27:28.745 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:27:28.748 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:27:58.793 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:27:58.797 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:28:28.882 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:28:28.886 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:28:58.996 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:28:58.999 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:29:29.082 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:29:29.085 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:29:59.154 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:29:59.157 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:30:29.261 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:30:29.264 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:30:59.524 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:30:59.528 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:31:29.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:31:29.668 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:31:59.744 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:31:59.747 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:32:29.789 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:32:29.792 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:33:00.053 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:33:00.056 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:33:30.167 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:33:30.183 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:34:00.238 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:34:00.241 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:34:30.329 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:34:30.333 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:35:00.426 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:35:00.430 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:35:30.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:35:30.494 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:36:00.618 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:36:00.622 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:36:30.732 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:36:30.736 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:37:00.787 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:37:00.790 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:37:30.878 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:37:30.882 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:38:00.926 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:38:00.930 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:38:30.989 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:38:30.992 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:39:01.061 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:39:01.064 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:39:31.122 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:39:31.125 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:40:01.223 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:40:01.229 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:40:31.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:40:31.290 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:41:01.533 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:41:01.537 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:41:31.655 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:41:31.658 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:42:01.741 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:42:01.744 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:42:31.997 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:42:32.000 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:43:02.119 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:43:02.123 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:43:32.282 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:43:32.285 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:44:02.328 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:44:02.332 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:44:32.412 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:44:32.415 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:45:02.740 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:45:02.744 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:45:32.806 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:45:32.809 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:46:02.867 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:46:02.871 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:46:32.998 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:46:33.002 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:47:03.045 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:47:03.052 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:47:33.097 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:47:33.101 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:48:03.194 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:48:03.197 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:48:33.291 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:48:33.294 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:49:03.414 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:49:03.417 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:49:33.803 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:49:33.807 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:50:03.928 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:50:03.931 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:50:34.055 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:50:34.059 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:51:04.165 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:51:04.168 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:51:34.241 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:51:34.244 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:52:04.359 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:52:04.363 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:52:34.481 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:52:34.483 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:53:04.603 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:53:04.607 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:53:34.649 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:53:34.652 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:54:04.760 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:54:04.763 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:54:34.877 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:54:34.881 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:55:04.971 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:55:04.974 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:55:35.044 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:55:35.047 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:56:05.102 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:56:05.106 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:56:35.188 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:56:35.191 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:57:05.318 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:57:05.321 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:57:35.444 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:57:35.448 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:58:05.520 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:58:05.524 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T06:58:05.547 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-05-14T06:58:05.546+0000 7f396d567640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36200) UID: 0 2024-05-14T06:58:05.547 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-05-14T06:58:05.546+0000 7f75626b8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36200) UID: 0 2024-05-14T06:58:05.547 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-05-14T06:58:05.546+0000 7f01ba1e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36200) UID: 0 2024-05-14T06:58:05.548 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T06:58:05.546+0000 7f9bb37f5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36200) UID: 0 2024-05-14T07:00:19.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:00:19.856 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:00:49.973 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:00:49.976 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:01:20.184 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:01:20.188 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:01:50.417 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:01:50.420 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:02:20.472 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:02:20.475 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:02:50.627 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:02:50.630 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:03:20.889 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:03:20.893 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:03:50.945 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:03:50.952 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:04:21.093 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:04:21.097 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:04:51.206 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:04:51.209 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:04:51.227 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T07:04:51.223+0000 7fef9122a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 393485) UID: 0 2024-05-14T07:04:51.227 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T07:04:51.223+0000 7fa1653a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 393485) UID: 0 2024-05-14T07:04:51.228 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-05-14T07:04:51.223+0000 7f7aa7691640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 393485) UID: 0 2024-05-14T07:04:51.228 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-05-14T07:04:51.223+0000 7f7af66da640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 393485) UID: 0 2024-05-14T07:07:16.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:07:16.232 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:07:46.282 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:07:46.286 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:08:16.395 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:08:16.398 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:08:46.510 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:08:46.513 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:09:16.631 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:09:16.634 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:09:46.737 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:09:46.741 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:10:16.784 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:10:16.791 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:10:46.848 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:10:46.851 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:11:17.076 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:11:17.079 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:11:47.124 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:11:47.127 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:12:17.245 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:12:17.249 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:12:47.370 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:12:47.373 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:13:17.418 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:13:17.421 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:13:47.504 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:13:47.508 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:14:17.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:14:17.599 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:14:47.725 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:14:47.728 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:15:17.772 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:15:17.776 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:15:47.884 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:15:47.888 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:16:17.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:16:17.945 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:16:48.014 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:16:48.017 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:17:18.120 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:17:18.124 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:17:48.226 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:17:48.229 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:18:18.272 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:18:18.276 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:18:48.368 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:18:48.371 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:19:18.414 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:19:18.418 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:19:48.454 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:19:48.458 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:20:18.528 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:20:18.531 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:20:48.607 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:20:48.610 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:21:18.689 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:21:18.694 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:21:48.844 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:21:48.847 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:22:18.914 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:22:18.918 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:22:48.972 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:22:48.975 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:23:19.059 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:23:19.063 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:23:49.172 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:23:49.175 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:24:19.303 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:24:19.307 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:24:49.409 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:24:49.412 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:25:19.700 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:25:19.704 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:25:49.780 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:25:49.784 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:26:19.843 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:26:19.846 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:26:49.891 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:26:49.918 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:27:20.004 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:27:20.009 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:27:50.111 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:27:50.114 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:28:20.240 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:28:20.244 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:28:50.296 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:28:50.300 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:29:20.343 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:29:20.346 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:29:50.441 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:29:50.445 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:30:20.588 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:30:20.591 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:30:50.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:30:50.668 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:31:20.833 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:31:20.837 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:31:50.879 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:31:50.882 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:32:20.940 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:32:20.943 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:32:51.073 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:32:51.077 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:33:21.179 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:33:21.183 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:33:51.310 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:33:51.313 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:34:21.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:34:21.668 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:34:51.712 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:34:51.715 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:35:21.767 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:35:21.770 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:35:51.894 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:35:51.897 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:36:22.004 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:36:22.007 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:36:52.110 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:36:52.113 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:37:22.384 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:37:22.387 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:37:52.428 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:37:52.432 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:38:22.475 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:38:22.479 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:38:52.539 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:38:52.541 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:39:22.669 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:39:22.672 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:39:52.734 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:39:52.738 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:40:22.847 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:40:22.850 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:40:52.911 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:40:52.914 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:41:22.994 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:41:22.997 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:41:53.110 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:41:53.113 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:42:23.182 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:42:23.187 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:42:53.234 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:42:53.237 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:43:23.288 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:43:23.292 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:43:53.381 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:43:53.384 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:44:23.496 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:44:23.499 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:44:53.634 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:44:53.637 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:45:23.722 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:45:23.726 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:45:53.917 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:45:53.920 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:46:23.964 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:46:23.967 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:46:54.086 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:46:54.089 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:47:24.153 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:47:24.157 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:47:54.300 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:47:54.304 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:48:24.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:48:24.350 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:48:54.466 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:48:54.469 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:49:24.572 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:49:24.576 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:49:54.654 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:49:54.657 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:50:24.707 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:50:24.711 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:50:54.787 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:50:54.790 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:50:56.780 INFO:teuthology.orchestra.run.smithi154.stdout:generic/538 5361s 2024-05-14T07:50:56.797 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/538 2024-05-14T07:50:56.797 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:50:56.800 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:50:56.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:50:56.812 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2024-05-14T07:50:57.352 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:50:57.356 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:50:57.356 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:50:59.842 INFO:teuthology.orchestra.run.smithi154.stdout:generic/539 2s 2024-05-14T07:50:59.848 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/539 2024-05-14T07:50:59.848 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:50:59.851 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:50:59.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:50:59.866 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2024-05-14T07:51:00.404 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:00.408 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:00.408 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:00.544 INFO:teuthology.orchestra.run.smithi154.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:00.548 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/540 2024-05-14T07:51:00.548 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/540 2024-05-14T07:51:00.548 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:00.551 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:00.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:00.561 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2024-05-14T07:51:00.726 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:00.730 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:00.731 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:00.838 INFO:teuthology.orchestra.run.smithi154.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:00.842 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/541 2024-05-14T07:51:00.842 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/541 2024-05-14T07:51:00.842 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:00.844 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:00.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:00.852 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2024-05-14T07:51:01.001 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:01.005 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:01.005 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:01.107 INFO:teuthology.orchestra.run.smithi154.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:01.111 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/542 2024-05-14T07:51:01.111 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/542 2024-05-14T07:51:01.111 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:01.113 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:01.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:01.122 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2024-05-14T07:51:01.270 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:01.274 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:01.377 INFO:teuthology.orchestra.run.smithi154.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:01.380 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/543 2024-05-14T07:51:01.380 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/543 2024-05-14T07:51:01.380 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:01.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:01.391 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2024-05-14T07:51:01.539 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:01.543 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:01.543 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:01.649 INFO:teuthology.orchestra.run.smithi154.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:01.653 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/544 2024-05-14T07:51:01.653 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/544 2024-05-14T07:51:01.653 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:01.656 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:01.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:01.664 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2024-05-14T07:51:01.815 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:01.819 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:01.819 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:01.990 INFO:teuthology.orchestra.run.smithi154.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-05-14T07:51:01.994 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/545 2024-05-14T07:51:01.994 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/545 2024-05-14T07:51:01.994 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:01.996 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:02.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:02.005 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2024-05-14T07:51:02.154 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:02.158 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:02.158 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:02.343 INFO:teuthology.orchestra.run.smithi154.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:02.347 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/546 2024-05-14T07:51:02.347 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/546 2024-05-14T07:51:02.347 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:02.349 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:02.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:02.358 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2024-05-14T07:51:02.506 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:02.511 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:02.511 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:02.637 INFO:teuthology.orchestra.run.smithi154.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:02.640 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/547 2024-05-14T07:51:02.641 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/547 2024-05-14T07:51:02.641 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:02.643 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:02.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:02.651 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2024-05-14T07:51:02.799 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:02.804 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:02.804 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:02.937 INFO:teuthology.orchestra.run.smithi154.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:02.941 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/548 2024-05-14T07:51:02.941 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/548 2024-05-14T07:51:02.941 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:02.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:02.951 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2024-05-14T07:51:03.101 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:03.105 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:03.105 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:03.235 INFO:teuthology.orchestra.run.smithi154.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:03.239 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/549 2024-05-14T07:51:03.239 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/549 2024-05-14T07:51:03.239 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:03.241 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:03.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:03.250 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2024-05-14T07:51:03.398 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:03.403 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:03.403 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:03.532 INFO:teuthology.orchestra.run.smithi154.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:03.538 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/550 2024-05-14T07:51:03.538 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/550 2024-05-14T07:51:03.538 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:03.538 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:03.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:03.546 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2024-05-14T07:51:03.697 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:03.701 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:03.701 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:03.806 INFO:teuthology.orchestra.run.smithi154.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:03.810 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/551 2024-05-14T07:51:03.810 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/551 2024-05-14T07:51:03.810 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:03.812 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:03.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:03.820 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2024-05-14T07:51:03.971 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:03.975 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:03.975 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:04.088 INFO:teuthology.orchestra.run.smithi154.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:04.092 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/552 2024-05-14T07:51:04.092 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/552 2024-05-14T07:51:04.092 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:04.094 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:04.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:04.103 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2024-05-14T07:51:04.252 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:04.256 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:04.256 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:04.430 INFO:teuthology.orchestra.run.smithi154.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2024-05-14T07:51:04.433 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/553 2024-05-14T07:51:04.433 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/553 2024-05-14T07:51:04.434 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:04.436 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:04.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:04.444 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2024-05-14T07:51:04.941 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:04.944 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:04.945 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:05.047 INFO:teuthology.orchestra.run.smithi154.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:05.051 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/554 2024-05-14T07:51:05.051 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/554 2024-05-14T07:51:05.051 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:05.054 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:05.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:05.063 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2024-05-14T07:51:05.212 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:05.217 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:05.217 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:05.378 INFO:teuthology.orchestra.run.smithi154.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2024-05-14T07:51:05.382 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/555 2024-05-14T07:51:05.382 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/555 2024-05-14T07:51:05.382 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:05.384 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:05.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:05.393 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2024-05-14T07:51:05.882 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:05.886 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:05.886 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:05.991 INFO:teuthology.orchestra.run.smithi154.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:05.995 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/556 2024-05-14T07:51:05.995 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/556 2024-05-14T07:51:05.995 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:05.997 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:06.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:06.006 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2024-05-14T07:51:06.157 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:06.161 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:06.161 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:06.276 INFO:teuthology.orchestra.run.smithi154.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:06.280 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/557 2024-05-14T07:51:06.280 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/557 2024-05-14T07:51:06.280 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:06.282 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:06.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:06.291 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2024-05-14T07:51:06.439 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:06.443 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:06.443 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:06.684 INFO:teuthology.orchestra.run.smithi154.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:06.689 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/558 2024-05-14T07:51:06.689 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/558 2024-05-14T07:51:06.689 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:06.693 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:06.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:06.704 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2024-05-14T07:51:06.884 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:06.888 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:06.888 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:06.993 INFO:teuthology.orchestra.run.smithi154.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:06.996 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/559 2024-05-14T07:51:06.997 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/559 2024-05-14T07:51:06.997 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:06.999 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:07.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:07.007 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2024-05-14T07:51:07.154 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:07.158 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:07.158 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:07.260 INFO:teuthology.orchestra.run.smithi154.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:07.264 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/560 2024-05-14T07:51:07.264 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/560 2024-05-14T07:51:07.264 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:07.266 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:07.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:07.275 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2024-05-14T07:51:07.421 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:07.426 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:07.426 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:07.528 INFO:teuthology.orchestra.run.smithi154.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:07.531 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/561 2024-05-14T07:51:07.531 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/561 2024-05-14T07:51:07.531 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:07.534 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:07.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:07.542 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2024-05-14T07:51:07.693 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:07.697 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:07.697 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:07.800 INFO:teuthology.orchestra.run.smithi154.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:07.804 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/562 2024-05-14T07:51:07.804 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/562 2024-05-14T07:51:07.804 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:07.807 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:07.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:07.815 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2024-05-14T07:51:07.966 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:07.970 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:07.970 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:08.113 INFO:teuthology.orchestra.run.smithi154.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:08.116 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/563 2024-05-14T07:51:08.116 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/563 2024-05-14T07:51:08.116 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:08.119 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:08.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:08.127 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2024-05-14T07:51:08.275 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:08.279 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:08.279 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:08.955 INFO:teuthology.orchestra.run.smithi154.stdout:generic/564 0s 2024-05-14T07:51:08.961 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/564 2024-05-14T07:51:08.961 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:08.964 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:09.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:09.049 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2024-05-14T07:51:09.520 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:09.524 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:09.525 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:09.632 INFO:teuthology.orchestra.run.smithi154.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:09.635 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/565 2024-05-14T07:51:09.636 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/565 2024-05-14T07:51:09.636 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:09.638 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:09.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:09.647 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2024-05-14T07:51:09.803 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:09.807 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:09.808 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:09.911 INFO:teuthology.orchestra.run.smithi154.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:09.915 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/566 2024-05-14T07:51:09.915 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/566 2024-05-14T07:51:09.915 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:09.917 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:09.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:09.926 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2024-05-14T07:51:10.075 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:10.079 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:10.079 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:10.181 INFO:teuthology.orchestra.run.smithi154.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:10.184 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/567 2024-05-14T07:51:10.185 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/567 2024-05-14T07:51:10.185 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:10.187 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:10.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:10.196 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2024-05-14T07:51:10.344 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:10.349 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:10.349 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:10.519 INFO:teuthology.orchestra.run.smithi154.stdout:generic/568 0s 2024-05-14T07:51:10.554 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/568 2024-05-14T07:51:10.554 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:10.557 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:10.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:10.630 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2024-05-14T07:51:11.028 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:11.033 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:11.033 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:11.175 INFO:teuthology.orchestra.run.smithi154.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:11.178 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/569 2024-05-14T07:51:11.178 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/569 2024-05-14T07:51:11.178 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:11.181 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:11.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:11.189 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2024-05-14T07:51:11.337 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:11.341 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:11.341 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:11.444 INFO:teuthology.orchestra.run.smithi154.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:11.447 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/570 2024-05-14T07:51:11.447 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/570 2024-05-14T07:51:11.447 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:11.449 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:11.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:11.457 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2024-05-14T07:51:11.604 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:11.608 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:11.608 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:17.832 INFO:teuthology.orchestra.run.smithi154.stdout:generic/571 6s 2024-05-14T07:51:17.840 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/571 2024-05-14T07:51:17.840 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:17.844 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:18.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:18.007 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2024-05-14T07:51:18.392 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:18.396 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:18.397 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:18.503 INFO:teuthology.orchestra.run.smithi154.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:18.507 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/572 2024-05-14T07:51:18.507 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/572 2024-05-14T07:51:18.507 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:18.509 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:18.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:18.517 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2024-05-14T07:51:18.668 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:18.672 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:18.672 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:18.776 INFO:teuthology.orchestra.run.smithi154.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:18.780 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/573 2024-05-14T07:51:18.780 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/573 2024-05-14T07:51:18.780 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:18.782 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:18.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:18.790 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2024-05-14T07:51:18.937 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:18.941 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:18.942 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:19.045 INFO:teuthology.orchestra.run.smithi154.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:19.048 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/574 2024-05-14T07:51:19.049 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/574 2024-05-14T07:51:19.049 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:19.051 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:19.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:19.059 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2024-05-14T07:51:19.206 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:19.210 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:19.210 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:19.316 INFO:teuthology.orchestra.run.smithi154.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:19.320 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/575 2024-05-14T07:51:19.320 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/575 2024-05-14T07:51:19.320 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:19.322 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:19.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:19.330 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2024-05-14T07:51:19.477 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:19.481 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:19.481 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:19.611 INFO:teuthology.orchestra.run.smithi154.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:19.614 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/576 2024-05-14T07:51:19.615 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/576 2024-05-14T07:51:19.615 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:19.617 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:19.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:19.625 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2024-05-14T07:51:19.773 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:19.777 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:19.777 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:19.884 INFO:teuthology.orchestra.run.smithi154.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:19.887 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/577 2024-05-14T07:51:19.887 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/577 2024-05-14T07:51:19.887 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:19.890 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:19.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:19.899 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2024-05-14T07:51:20.047 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:20.052 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:20.052 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:20.196 INFO:teuthology.orchestra.run.smithi154.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T07:51:20.199 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/578 2024-05-14T07:51:20.200 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/578 2024-05-14T07:51:20.200 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:20.202 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:20.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:20.211 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2024-05-14T07:51:20.362 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:20.366 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:20.366 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:20.474 INFO:teuthology.orchestra.run.smithi154.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:20.478 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/579 2024-05-14T07:51:20.478 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/579 2024-05-14T07:51:20.478 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:20.480 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:20.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:20.488 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2024-05-14T07:51:20.638 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:20.643 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:20.643 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:20.770 INFO:teuthology.orchestra.run.smithi154.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:20.774 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/580 2024-05-14T07:51:20.774 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/580 2024-05-14T07:51:20.774 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:20.776 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:20.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:20.784 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2024-05-14T07:51:20.932 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:20.936 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:20.936 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:21.479 INFO:teuthology.orchestra.run.smithi154.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:21.484 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/581 2024-05-14T07:51:21.484 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/581 2024-05-14T07:51:21.484 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:21.488 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:21.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:21.501 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2024-05-14T07:51:21.679 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:21.683 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:21.683 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:21.822 INFO:teuthology.orchestra.run.smithi154.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:21.825 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/582 2024-05-14T07:51:21.825 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/582 2024-05-14T07:51:21.826 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:21.828 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:21.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:21.836 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2024-05-14T07:51:21.990 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:21.994 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:21.994 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:22.131 INFO:teuthology.orchestra.run.smithi154.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:22.134 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/583 2024-05-14T07:51:22.134 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/583 2024-05-14T07:51:22.134 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:22.137 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:22.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:22.145 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2024-05-14T07:51:22.297 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:22.301 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:22.301 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:22.435 INFO:teuthology.orchestra.run.smithi154.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:22.439 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/584 2024-05-14T07:51:22.439 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/584 2024-05-14T07:51:22.439 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:22.441 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:22.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:22.450 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2024-05-14T07:51:22.602 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:22.606 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:22.606 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:22.711 INFO:teuthology.orchestra.run.smithi154.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:51:22.715 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/585 2024-05-14T07:51:22.715 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/585 2024-05-14T07:51:22.715 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:51:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:22.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:51:22.726 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2024-05-14T07:51:22.876 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:51:22.880 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:51:22.880 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:51:24.870 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:51:24.873 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:51:54.967 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:51:54.970 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:52:06.370 INFO:teuthology.orchestra.run.smithi154.stdout:generic/586 44s 2024-05-14T07:52:06.377 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/586 2024-05-14T07:52:06.377 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:06.381 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:06.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:06.393 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2024-05-14T07:52:06.924 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:06.928 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:06.928 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:07.150 INFO:teuthology.orchestra.run.smithi154.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-14T07:52:07.154 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/587 2024-05-14T07:52:07.154 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/587 2024-05-14T07:52:07.155 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:07.157 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:07.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:07.168 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2024-05-14T07:52:07.336 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:07.341 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:07.341 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:07.477 INFO:teuthology.orchestra.run.smithi154.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:07.481 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/588 2024-05-14T07:52:07.481 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/588 2024-05-14T07:52:07.481 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:07.484 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:07.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:07.493 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2024-05-14T07:52:07.644 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:07.648 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:07.648 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:07.757 INFO:teuthology.orchestra.run.smithi154.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:07.761 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/589 2024-05-14T07:52:07.761 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/589 2024-05-14T07:52:07.761 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:07.763 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:07.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:07.772 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2024-05-14T07:52:07.922 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:07.926 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:07.926 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:08.032 INFO:teuthology.orchestra.run.smithi154.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:08.036 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/590 2024-05-14T07:52:08.036 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/590 2024-05-14T07:52:08.036 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:08.038 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:08.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:08.047 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2024-05-14T07:52:08.192 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:08.197 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:08.197 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:08.569 INFO:teuthology.orchestra.run.smithi154.stdout:generic/591 0s 2024-05-14T07:52:08.575 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/591 2024-05-14T07:52:08.575 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:08.578 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:08.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:08.589 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2024-05-14T07:52:09.073 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:09.077 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:09.077 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:09.208 INFO:teuthology.orchestra.run.smithi154.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:09.212 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/592 2024-05-14T07:52:09.212 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/592 2024-05-14T07:52:09.212 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:09.214 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:09.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:09.223 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2024-05-14T07:52:09.371 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:09.376 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:09.507 INFO:teuthology.orchestra.run.smithi154.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:09.511 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/593 2024-05-14T07:52:09.511 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/593 2024-05-14T07:52:09.511 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:09.513 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:09.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:09.522 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2024-05-14T07:52:09.669 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:09.673 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:09.673 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:09.784 INFO:teuthology.orchestra.run.smithi154.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:09.788 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/594 2024-05-14T07:52:09.788 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/594 2024-05-14T07:52:09.788 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:09.790 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:09.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:09.799 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2024-05-14T07:52:09.949 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:09.953 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:09.953 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:10.250 INFO:teuthology.orchestra.run.smithi154.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:10.255 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/595 2024-05-14T07:52:10.255 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/595 2024-05-14T07:52:10.255 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:10.258 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:10.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:10.270 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2024-05-14T07:52:10.438 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:10.442 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:10.442 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:10.550 INFO:teuthology.orchestra.run.smithi154.stdout:generic/596 [not run] accton utility required, skipped this test 2024-05-14T07:52:10.553 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/596 2024-05-14T07:52:10.554 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/596 2024-05-14T07:52:10.554 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:10.556 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:10.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:10.565 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2024-05-14T07:52:10.714 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:10.718 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:10.718 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:11.163 INFO:teuthology.orchestra.run.smithi154.stdout:generic/597 - output mismatch (see /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/597.out.bad) 2024-05-14T07:52:11.165 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/597.out 2024-05-14 01:24:47.268292631 +0000 2024-05-14T07:52:11.165 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/597.out.bad 2024-05-14 07:52:11.160519354 +0000 2024-05-14T07:52:11.165 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -4,11 +4,11 @@ 2024-05-14T07:52:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: fs.protected_symlinks = 0 2024-05-14T07:52:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: successfully followed symlink 2024-05-14T07:52:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: fs.protected_symlinks = 1 2024-05-14T07:52:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: -Permission denied 2024-05-14T07:52:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: +successfully followed symlink 2024-05-14T07:52:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: == Test hardlink create protection when 2024-05-14T07:52:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: == process != target owner and process cannot read target 2024-05-14T07:52:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: fs.protected_hardlinks = 0 2024-05-14T07:52:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: -successfully created hardlink 2024-05-14T07:52:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: +Permission denied 2024-05-14T07:52:11.166 INFO:teuthology.orchestra.run.smithi154.stdout: fs.protected_hardlinks = 1 2024-05-14T07:52:11.167 INFO:teuthology.orchestra.run.smithi154.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2024-05-14T07:52:11.167 INFO:teuthology.orchestra.run.smithi154.stdout: +Permission denied 2024-05-14T07:52:11.168 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/597 2024-05-14T07:52:11.168 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/597 2024-05-14T07:52:11.168 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2024-05-14T07:52:11.170 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:11.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T07:52:11.179 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-14T07:52:11.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-14T07:52:11.179 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2024-05-14T07:52:11.672 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:11.676 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:11.676 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:12.119 INFO:teuthology.orchestra.run.smithi154.stdout:generic/598 - output mismatch (see /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/598.out.bad) 2024-05-14T07:52:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/598.out 2024-05-14 01:24:47.268292631 +0000 2024-05-14T07:52:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/598.out.bad 2024-05-14 07:52:12.116494142 +0000 2024-05-14T07:52:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -5,13 +5,10 @@ 2024-05-14T07:52:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: = only group writable dir 2024-05-14T07:52:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: fs.protected_regular = 1 2024-05-14T07:52:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: = group & world writable dir 2024-05-14T07:52:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: -Permission denied 2024-05-14T07:52:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: = only group writable dir 2024-05-14T07:52:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: fs.protected_regular = 2 2024-05-14T07:52:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: = group & world writable dir 2024-05-14T07:52:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: -Permission denied 2024-05-14T07:52:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: = only group writable dir 2024-05-14T07:52:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: -Permission denied 2024-05-14T07:52:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2024-05-14T07:52:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: fs.protected_fifos = 0 2024-05-14T07:52:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -19,10 +16,7 @@ 2024-05-14T07:52:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: = only group writable dir 2024-05-14T07:52:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: fs.protected_fifos = 1 2024-05-14T07:52:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: = group & world writable dir 2024-05-14T07:52:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: -Permission denied 2024-05-14T07:52:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: = only group writable dir 2024-05-14T07:52:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: fs.protected_fifos = 2 2024-05-14T07:52:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: = group & world writable dir 2024-05-14T07:52:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: -Permission denied 2024-05-14T07:52:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: = only group writable dir 2024-05-14T07:52:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: -Permission denied 2024-05-14T07:52:12.124 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/598 2024-05-14T07:52:12.124 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/598 2024-05-14T07:52:12.124 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2024-05-14T07:52:12.126 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:12.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T07:52:12.135 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-14T07:52:12.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-14T07:52:12.135 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2024-05-14T07:52:12.637 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:12.641 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:12.641 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:12.744 INFO:teuthology.orchestra.run.smithi154.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:12.747 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/599 2024-05-14T07:52:12.747 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/599 2024-05-14T07:52:12.748 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:12.750 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:12.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:12.759 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2024-05-14T07:52:12.906 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:12.911 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:12.911 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:13.013 INFO:teuthology.orchestra.run.smithi154.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:13.017 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/600 2024-05-14T07:52:13.017 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/600 2024-05-14T07:52:13.017 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:13.019 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:13.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:13.028 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2024-05-14T07:52:13.175 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:13.179 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:13.179 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:13.290 INFO:teuthology.orchestra.run.smithi154.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:13.292 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/601 2024-05-14T07:52:13.292 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/601 2024-05-14T07:52:13.292 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:13.295 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:13.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:13.304 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2024-05-14T07:52:13.450 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:13.454 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:13.455 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:13.584 INFO:teuthology.orchestra.run.smithi154.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:13.588 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/602 2024-05-14T07:52:13.588 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/602 2024-05-14T07:52:13.588 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:13.590 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:13.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:13.601 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2024-05-14T07:52:13.751 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:13.755 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:13.755 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:13.861 INFO:teuthology.orchestra.run.smithi154.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:13.864 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/603 2024-05-14T07:52:13.864 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/603 2024-05-14T07:52:13.864 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:13.867 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:13.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:13.875 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2024-05-14T07:52:14.021 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:14.025 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:14.025 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:14.128 INFO:teuthology.orchestra.run.smithi154.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:14.131 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/604 2024-05-14T07:52:14.131 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/604 2024-05-14T07:52:14.131 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:14.133 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:14.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:14.142 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2024-05-14T07:52:14.289 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:14.293 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:14.293 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:14.397 INFO:teuthology.orchestra.run.smithi154.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:14.401 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/605 2024-05-14T07:52:14.401 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/605 2024-05-14T07:52:14.401 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:14.403 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:14.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:14.411 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2024-05-14T07:52:14.555 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:14.559 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:14.560 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:14.663 INFO:teuthology.orchestra.run.smithi154.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:14.667 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/606 2024-05-14T07:52:14.667 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/606 2024-05-14T07:52:14.667 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:14.669 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:14.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:14.678 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2024-05-14T07:52:14.824 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:14.828 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:14.828 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:14.930 INFO:teuthology.orchestra.run.smithi154.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:14.934 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/607 2024-05-14T07:52:14.934 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/607 2024-05-14T07:52:14.934 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:14.936 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:14.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:14.945 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2024-05-14T07:52:15.092 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:15.096 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:15.096 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:15.200 INFO:teuthology.orchestra.run.smithi154.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:15.203 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/608 2024-05-14T07:52:15.204 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/608 2024-05-14T07:52:15.204 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:15.206 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:15.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:15.215 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2024-05-14T07:52:15.361 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:15.365 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:15.365 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:15.978 INFO:teuthology.orchestra.run.smithi154.stdout:generic/609 0s 2024-05-14T07:52:15.986 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/609 2024-05-14T07:52:15.986 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:15.990 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:16.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:16.002 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2024-05-14T07:52:16.516 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:16.520 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:16.520 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:16.623 INFO:teuthology.orchestra.run.smithi154.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:16.626 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/610 2024-05-14T07:52:16.627 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/610 2024-05-14T07:52:16.627 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:16.628 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:16.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:16.637 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2024-05-14T07:52:16.787 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:16.791 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:16.791 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:16.915 INFO:teuthology.orchestra.run.smithi154.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:16.919 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/611 2024-05-14T07:52:16.919 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/611 2024-05-14T07:52:16.919 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:16.921 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:16.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:16.930 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2024-05-14T07:52:17.080 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:17.084 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:17.084 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:17.241 INFO:teuthology.orchestra.run.smithi154.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T07:52:17.245 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/612 2024-05-14T07:52:17.245 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/612 2024-05-14T07:52:17.245 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:17.247 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:17.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:17.256 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2024-05-14T07:52:17.760 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:17.764 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:17.764 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:17.897 INFO:teuthology.orchestra.run.smithi154.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:17.901 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/613 2024-05-14T07:52:17.901 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/613 2024-05-14T07:52:17.901 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:17.904 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:17.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:17.912 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2024-05-14T07:52:18.059 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:18.063 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:18.063 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:18.167 INFO:teuthology.orchestra.run.smithi154.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:18.170 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/614 2024-05-14T07:52:18.171 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/614 2024-05-14T07:52:18.171 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:18.173 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:18.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:18.181 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2024-05-14T07:52:18.329 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:18.333 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:18.333 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:18.435 INFO:teuthology.orchestra.run.smithi154.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T07:52:18.439 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/615 2024-05-14T07:52:18.439 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/615 2024-05-14T07:52:18.439 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:52:18.441 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:18.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:52:18.449 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2024-05-14T07:52:18.596 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:52:18.601 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:52:18.601 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:52:25.088 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:52:25.091 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:52:55.220 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:52:55.224 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:53:25.484 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:53:25.487 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:53:55.561 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:53:55.565 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:54:25.751 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:54:25.754 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:54:55.791 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:54:55.795 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:55:25.847 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:55:25.850 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:55:55.984 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:55:55.988 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:56:26.033 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:56:26.036 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:56:56.081 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:56:56.085 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:57:26.159 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:57:26.163 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:57:56.200 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:57:56.203 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:58:26.490 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:58:26.493 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:58:56.610 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:58:56.614 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:59:26.657 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:59:26.661 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:59:56.713 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:59:56.717 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T07:59:58.748 INFO:teuthology.orchestra.run.smithi154.stdout:generic/616 460s 2024-05-14T07:59:58.755 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/616 2024-05-14T07:59:58.756 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T07:59:58.759 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T07:59:58.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T07:59:58.772 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2024-05-14T07:59:58.950 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T07:59:58.955 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T07:59:58.955 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:00:26.836 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:00:26.839 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:00:56.908 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:00:56.912 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:01:27.005 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:01:27.009 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:01:57.119 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:01:57.123 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:02:21.740 INFO:teuthology.orchestra.run.smithi154.stdout:generic/617 143s 2024-05-14T08:02:21.748 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/617 2024-05-14T08:02:21.748 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:21.752 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:21.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:21.882 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2024-05-14T08:02:22.323 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:22.327 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:22.463 INFO:teuthology.orchestra.run.smithi154.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:22.468 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/618 2024-05-14T08:02:22.468 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/618 2024-05-14T08:02:22.468 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:22.470 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:22.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:22.480 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2024-05-14T08:02:22.638 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:22.642 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:22.746 INFO:teuthology.orchestra.run.smithi154.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:22.750 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/619 2024-05-14T08:02:22.751 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/619 2024-05-14T08:02:22.751 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:22.753 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:22.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:22.761 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2024-05-14T08:02:22.917 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:22.921 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:22.921 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:23.102 INFO:teuthology.orchestra.run.smithi154.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:23.107 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/620 2024-05-14T08:02:23.107 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/620 2024-05-14T08:02:23.107 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:23.110 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:23.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:23.120 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2024-05-14T08:02:23.275 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:23.279 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:23.279 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:23.412 INFO:teuthology.orchestra.run.smithi154.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:23.416 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/621 2024-05-14T08:02:23.416 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/621 2024-05-14T08:02:23.416 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:23.418 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:23.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:23.426 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2024-05-14T08:02:23.579 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:23.583 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:23.583 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:23.688 INFO:teuthology.orchestra.run.smithi154.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:23.691 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/622 2024-05-14T08:02:23.691 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/622 2024-05-14T08:02:23.691 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:23.693 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:23.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:23.702 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2024-05-14T08:02:23.854 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:23.858 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:23.859 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:23.961 INFO:teuthology.orchestra.run.smithi154.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:23.965 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/623 2024-05-14T08:02:23.965 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/623 2024-05-14T08:02:23.965 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:23.967 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:23.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:23.976 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2024-05-14T08:02:24.124 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:24.128 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:24.129 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:24.230 INFO:teuthology.orchestra.run.smithi154.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:24.234 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/624 2024-05-14T08:02:24.234 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/624 2024-05-14T08:02:24.234 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:24.236 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:24.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:24.244 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2024-05-14T08:02:24.395 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:24.399 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:24.399 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:24.502 INFO:teuthology.orchestra.run.smithi154.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:24.506 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/625 2024-05-14T08:02:24.506 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/625 2024-05-14T08:02:24.507 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:24.508 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:24.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:24.516 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2024-05-14T08:02:24.665 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:24.669 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:24.669 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:24.775 INFO:teuthology.orchestra.run.smithi154.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:24.779 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/626 2024-05-14T08:02:24.779 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/626 2024-05-14T08:02:24.779 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:24.781 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:24.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:24.789 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2024-05-14T08:02:24.941 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:24.945 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:24.945 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:25.052 INFO:teuthology.orchestra.run.smithi154.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:25.056 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/627 2024-05-14T08:02:25.056 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/627 2024-05-14T08:02:25.056 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:25.058 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:25.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:25.067 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2024-05-14T08:02:25.219 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:25.223 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:25.223 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:25.340 INFO:teuthology.orchestra.run.smithi154.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:25.344 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/628 2024-05-14T08:02:25.344 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/628 2024-05-14T08:02:25.344 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:25.346 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:25.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:25.355 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2024-05-14T08:02:25.505 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:25.508 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:25.509 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:25.637 INFO:teuthology.orchestra.run.smithi154.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:25.640 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/629 2024-05-14T08:02:25.640 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/629 2024-05-14T08:02:25.641 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:25.644 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:25.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:25.652 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2024-05-14T08:02:25.812 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:25.816 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:25.816 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:25.920 INFO:teuthology.orchestra.run.smithi154.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:25.923 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/630 2024-05-14T08:02:25.923 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/630 2024-05-14T08:02:25.923 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:25.925 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:25.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:25.934 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2024-05-14T08:02:26.084 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:26.088 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:26.088 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:26.202 INFO:teuthology.orchestra.run.smithi154.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:26.206 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/631 2024-05-14T08:02:26.206 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/631 2024-05-14T08:02:26.206 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:26.208 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:26.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:26.217 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2024-05-14T08:02:26.365 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:26.370 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:26.370 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:27.242 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:02:27.244 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:02:32.360 INFO:teuthology.orchestra.run.smithi154.stdout:generic/632 6s 2024-05-14T08:02:32.410 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/632 2024-05-14T08:02:32.410 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:32.413 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:32.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:32.425 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2024-05-14T08:02:32.611 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:32.615 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:32.615 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:33.374 INFO:teuthology.orchestra.run.smithi154.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/633.out.bad) 2024-05-14T08:02:33.377 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/633.out 2024-05-14 01:24:47.272292559 +0000 2024-05-14T08:02:33.377 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/633.out.bad 2024-05-14 08:02:33.371965294 +0000 2024-05-14T08:02:33.377 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,2 +1,5 @@ 2024-05-14T08:02:33.377 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 633 2024-05-14T08:02:33.377 INFO:teuthology.orchestra.run.smithi154.stdout: Silence is golden 2024-05-14T08:02:33.377 INFO:teuthology.orchestra.run.smithi154.stdout: +vfstest.c: 1164: protected_symlinks - Success - failure: openat 2024-05-14T08:02:33.378 INFO:teuthology.orchestra.run.smithi154.stdout: +vfstest.c: 1171: protected_symlinks - Success - failure: wait_for_pid 2024-05-14T08:02:33.378 INFO:teuthology.orchestra.run.smithi154.stdout: +vfstest.c: 2418: run_test - Success - failure: following protected symlinks on regular mounts 2024-05-14T08:02:33.381 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/633 2024-05-14T08:02:33.381 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/633 2024-05-14T08:02:33.381 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2024-05-14T08:02:33.385 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:33.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T08:02:33.450 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-14T08:02:33.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-14T08:02:33.450 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2024-05-14T08:02:33.917 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:33.921 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:33.921 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:34.032 INFO:teuthology.orchestra.run.smithi154.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:34.036 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/634 2024-05-14T08:02:34.036 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/634 2024-05-14T08:02:34.036 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:34.038 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:34.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:34.046 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2024-05-14T08:02:34.196 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:34.200 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:34.200 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:34.302 INFO:teuthology.orchestra.run.smithi154.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:34.305 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/635 2024-05-14T08:02:34.306 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/635 2024-05-14T08:02:34.306 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:34.308 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:34.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:34.316 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2024-05-14T08:02:34.469 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:34.473 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:34.473 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:34.630 INFO:teuthology.orchestra.run.smithi154.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:34.634 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/636 2024-05-14T08:02:34.634 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/636 2024-05-14T08:02:34.634 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:34.636 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:34.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:34.644 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2024-05-14T08:02:34.798 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:34.802 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:34.802 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:36.885 INFO:teuthology.orchestra.run.smithi154.stdout:generic/637 2s 2024-05-14T08:02:36.892 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/637 2024-05-14T08:02:36.892 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:36.896 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:36.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:36.928 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2024-05-14T08:02:37.491 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:37.495 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:37.495 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:37.697 INFO:teuthology.orchestra.run.smithi154.stdout:generic/638 0s 2024-05-14T08:02:37.704 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/638 2024-05-14T08:02:37.704 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:37.706 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:37.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:37.716 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2024-05-14T08:02:37.883 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:37.888 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:37.888 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:42.589 INFO:teuthology.orchestra.run.smithi154.stdout:generic/639 5s 2024-05-14T08:02:42.597 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/639 2024-05-14T08:02:42.597 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:42.600 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:42.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:42.612 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2024-05-14T08:02:42.808 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:42.813 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:42.813 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:43.032 INFO:teuthology.orchestra.run.smithi154.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:43.037 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/640 2024-05-14T08:02:43.037 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/640 2024-05-14T08:02:43.037 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:43.040 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:43.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:43.052 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2024-05-14T08:02:43.243 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:43.248 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:43.248 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:43.359 INFO:teuthology.orchestra.run.smithi154.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:43.363 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/641 2024-05-14T08:02:43.363 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/641 2024-05-14T08:02:43.363 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:43.366 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:43.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:43.374 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2024-05-14T08:02:43.528 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:43.532 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:43.532 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:43.641 INFO:teuthology.orchestra.run.smithi154.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:43.644 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/642 2024-05-14T08:02:43.644 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/642 2024-05-14T08:02:43.644 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:43.646 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:43.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:43.655 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2024-05-14T08:02:43.811 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:43.815 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:43.815 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:43.923 INFO:teuthology.orchestra.run.smithi154.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:43.927 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/643 2024-05-14T08:02:43.927 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/643 2024-05-14T08:02:43.927 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:43.929 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:43.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:43.938 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2024-05-14T08:02:44.088 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:44.093 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:44.093 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:44.221 INFO:teuthology.orchestra.run.smithi154.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2024-05-14T08:02:44.225 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/644 2024-05-14T08:02:44.225 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/644 2024-05-14T08:02:44.225 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:44.227 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:44.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:44.236 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2024-05-14T08:02:44.389 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:44.393 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:44.393 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:44.498 INFO:teuthology.orchestra.run.smithi154.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2024-05-14T08:02:44.502 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/645 2024-05-14T08:02:44.502 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/645 2024-05-14T08:02:44.502 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:44.505 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:44.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:44.513 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2024-05-14T08:02:44.662 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:44.666 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:44.666 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:44.767 INFO:teuthology.orchestra.run.smithi154.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:44.771 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/646 2024-05-14T08:02:44.771 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/646 2024-05-14T08:02:44.771 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:44.773 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:44.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:44.782 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2024-05-14T08:02:44.937 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:44.941 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:44.941 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:45.339 INFO:teuthology.orchestra.run.smithi154.stdout:generic/647 1s 2024-05-14T08:02:45.345 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/647 2024-05-14T08:02:45.345 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:45.348 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:45.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:45.358 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2024-05-14T08:02:45.873 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:45.877 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:45.877 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:46.020 INFO:teuthology.orchestra.run.smithi154.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T08:02:46.024 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/648 2024-05-14T08:02:46.024 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/648 2024-05-14T08:02:46.024 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:46.026 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:46.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:46.035 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2024-05-14T08:02:46.188 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:46.192 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:46.192 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:46.360 INFO:teuthology.orchestra.run.smithi154.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T08:02:46.364 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/649 2024-05-14T08:02:46.364 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/649 2024-05-14T08:02:46.364 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T08:02:46.366 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:46.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T08:02:46.377 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2024-05-14T08:02:46.884 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T08:02:46.888 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T08:02:46.888 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T08:02:57.479 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:02:57.484 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:03:27.569 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:03:27.580 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:03:57.734 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:03:57.736 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:04:28.155 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:04:28.158 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:04:58.205 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:04:58.207 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:05:28.752 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:05:28.758 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:05:59.256 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:05:59.258 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:06:29.444 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:06:29.446 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:06:59.557 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:06:59.560 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:07:29.979 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:07:29.981 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:08:00.292 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:08:00.295 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:08:30.373 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:08:30.376 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:09:00.693 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:09:00.696 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:09:30.940 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:09:30.944 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:10:01.015 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:10:01.018 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:10:31.094 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:10:31.101 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:11:01.384 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:11:01.389 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:11:01.405 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-05-14T08:11:01.402+0000 7f3b88d8a640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 447510) UID: 0 2024-05-14T08:11:01.406 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-05-14T08:11:01.402+0000 7fc439c46640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 447510) UID: 0 2024-05-14T08:18:11.979 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:18:11.982 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:18:42.843 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:18:42.846 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:19:13.049 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:19:13.052 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:19:43.244 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:19:43.247 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:20:13.504 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:20:13.507 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:20:43.584 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:20:43.589 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:21:13.691 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:21:13.695 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:21:44.342 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:21:44.344 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:22:14.688 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:22:14.694 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:22:45.186 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:22:45.191 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:23:15.270 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:23:15.273 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:23:45.472 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:23:45.475 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:24:15.780 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:24:15.783 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:24:15.809 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-05-14T08:24:15.803+0000 7f75626b8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36740) UID: 0 2024-05-14T08:24:15.809 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-05-14T08:24:15.807+0000 7f396d567640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36740) UID: 0 2024-05-14T08:24:15.809 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T08:24:15.807+0000 7f9bb37f5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36740) UID: 0 2024-05-14T08:24:15.810 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-05-14T08:24:15.807+0000 7f01ba1e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36740) UID: 0 2024-05-14T08:27:14.754 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:27:14.759 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:27:44.924 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:27:44.929 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:28:15.025 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:28:15.028 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:28:45.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:28:45.236 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:29:15.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:29:15.379 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:29:45.429 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:29:45.433 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:29:45.630 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-05-14T08:29:45.624+0000 7f3b88d8a640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 450036) UID: 0 2024-05-14T08:29:45.630 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-05-14T08:29:45.624+0000 7fc439c46640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 450036) UID: 0 2024-05-14T08:36:27.224 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T08:36:27.222+0000 7fef9122a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 450914) UID: 0 2024-05-14T08:36:27.225 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-05-14T08:36:27.222+0000 7f7af66da640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 450914) UID: 0 2024-05-14T08:36:27.225 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T08:36:27.222+0000 7fa1653a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 450914) UID: 0 2024-05-14T08:36:27.226 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-05-14T08:36:27.222+0000 7f7aa7691640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 450914) UID: 0 2024-05-14T08:45:51.926 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:45:51.929 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:45:51.953 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T08:45:51.947+0000 7f9bb37f5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36836) UID: 0 2024-05-14T08:45:51.953 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-05-14T08:45:51.947+0000 7f75626b8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36836) UID: 0 2024-05-14T08:45:51.953 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-05-14T08:45:51.947+0000 7f396d567640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36836) UID: 0 2024-05-14T08:45:51.955 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-05-14T08:45:51.947+0000 7f01ba1e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36836) UID: 0 2024-05-14T08:45:52.478 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T08:45:52.471+0000 7fef9122a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 452168) UID: 0 2024-05-14T08:45:52.479 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T08:45:52.471+0000 7fa1653a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 452168) UID: 0 2024-05-14T08:45:52.479 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-05-14T08:45:52.471+0000 7f7af66da640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 452168) UID: 0 2024-05-14T08:45:52.480 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-05-14T08:45:52.471+0000 7f7aa7691640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 452168) UID: 0 2024-05-14T08:54:20.525 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:54:20.529 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T08:54:20.637 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-05-14T08:54:20.633+0000 7f3b88d8a640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 453259) UID: 0 2024-05-14T08:54:20.638 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-05-14T08:54:20.633+0000 7fc439c46640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 453259) UID: 0 2024-05-14T08:54:20.711 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-05-14T08:54:20.706+0000 7f75626b8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36868) UID: 0 2024-05-14T08:54:20.711 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T08:54:20.706+0000 7f9bb37f5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36868) UID: 0 2024-05-14T08:54:20.712 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-05-14T08:54:20.706+0000 7f396d567640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36868) UID: 0 2024-05-14T08:54:20.712 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-05-14T08:54:20.706+0000 7f01ba1e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36868) UID: 0 2024-05-14T09:03:15.742 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-05-14T09:03:15.735+0000 7f7aa7691640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 454260) UID: 0 2024-05-14T09:03:15.743 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-05-14T09:03:15.735+0000 7f7af66da640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 454260) UID: 0 2024-05-14T09:03:15.743 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T09:03:15.735+0000 7fa1653a2640 -1 Fail to open '/proc/454260/cmdline' error = (2) No such file or directory 2024-05-14T09:03:15.744 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T09:03:15.735+0000 7fa1653a2640 -1 received signal: Hangup from (PID: 454260) UID: 0 2024-05-14T09:03:15.744 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T09:03:15.735+0000 7fef9122a640 -1 Fail to open '/proc/454260/cmdline' error = (2) No such file or directory 2024-05-14T09:03:15.744 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T09:03:15.735+0000 7fef9122a640 -1 received signal: Hangup from (PID: 454260) UID: 0 2024-05-14T09:04:48.861 INFO:teuthology.orchestra.run.smithi154.stdout:generic/650 3722s 2024-05-14T09:04:49.187 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/650 2024-05-14T09:04:49.188 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:04:49.195 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:49.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:04:49.217 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2024-05-14T09:04:50.578 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:04:50.582 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:04:50.582 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:50.845 INFO:teuthology.orchestra.run.smithi154.stdout:generic/651 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:04:50.850 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/651 2024-05-14T09:04:50.850 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/651 2024-05-14T09:04:50.850 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:04:50.851 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:50.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:04:50.868 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2024-05-14T09:04:51.162 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:04:51.166 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:04:51.167 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:51.361 INFO:teuthology.orchestra.run.smithi154.stdout:generic/652 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:04:51.365 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/652 2024-05-14T09:04:51.365 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/652 2024-05-14T09:04:51.365 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:04:51.376 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:51.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:04:51.402 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2024-05-14T09:04:51.708 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:04:51.712 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:04:51.712 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:51.895 INFO:teuthology.orchestra.run.smithi154.stdout:generic/653 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:04:51.899 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/653 2024-05-14T09:04:51.899 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/653 2024-05-14T09:04:51.899 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:04:51.902 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:51.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:04:51.916 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2024-05-14T09:04:52.242 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:04:52.255 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:04:52.255 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:52.457 INFO:teuthology.orchestra.run.smithi154.stdout:generic/654 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:04:52.461 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/654 2024-05-14T09:04:52.461 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/654 2024-05-14T09:04:52.462 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:04:52.464 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:52.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:04:52.486 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2024-05-14T09:04:52.804 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:04:52.808 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:04:52.808 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:53.105 INFO:teuthology.orchestra.run.smithi154.stdout:generic/655 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:04:53.115 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/655 2024-05-14T09:04:53.115 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/655 2024-05-14T09:04:53.115 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:04:53.119 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:53.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:04:53.140 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2024-05-14T09:04:53.411 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:04:53.419 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:04:53.420 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:53.674 INFO:teuthology.orchestra.run.smithi154.stdout:generic/656 [not run] vfstest not support by ceph-fuse 2024-05-14T09:04:53.679 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/656 2024-05-14T09:04:53.679 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/656 2024-05-14T09:04:53.679 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:04:53.682 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:53.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:04:53.704 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2024-05-14T09:04:53.972 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:04:53.976 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:04:53.976 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:54.178 INFO:teuthology.orchestra.run.smithi154.stdout:generic/657 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:04:54.183 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/657 2024-05-14T09:04:54.183 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/657 2024-05-14T09:04:54.183 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:04:54.186 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:54.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:04:54.199 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2024-05-14T09:04:54.436 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:04:54.441 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:04:54.441 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:54.607 INFO:teuthology.orchestra.run.smithi154.stdout:generic/658 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:04:54.611 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/658 2024-05-14T09:04:54.611 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/658 2024-05-14T09:04:54.612 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:04:54.615 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:54.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:04:54.628 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2024-05-14T09:04:54.908 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:04:54.913 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:04:54.913 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:55.096 INFO:teuthology.orchestra.run.smithi154.stdout:generic/659 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:04:55.101 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/659 2024-05-14T09:04:55.101 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/659 2024-05-14T09:04:55.101 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:04:55.104 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:55.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:04:55.122 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2024-05-14T09:04:55.443 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:04:55.449 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:04:55.449 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:55.636 INFO:teuthology.orchestra.run.smithi154.stdout:generic/660 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:04:55.647 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/660 2024-05-14T09:04:55.647 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/660 2024-05-14T09:04:55.647 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:04:55.649 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:55.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:04:55.662 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2024-05-14T09:04:55.975 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:04:56.002 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:04:56.002 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:56.179 INFO:teuthology.orchestra.run.smithi154.stdout:generic/661 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:04:56.184 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/661 2024-05-14T09:04:56.184 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/661 2024-05-14T09:04:56.184 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:04:56.187 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:56.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:04:56.200 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2024-05-14T09:04:56.445 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:04:56.449 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:04:56.449 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:56.622 INFO:teuthology.orchestra.run.smithi154.stdout:generic/662 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:04:56.629 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/662 2024-05-14T09:04:56.630 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/662 2024-05-14T09:04:56.630 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:04:56.630 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:56.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:04:56.639 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2024-05-14T09:04:56.969 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:04:56.990 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:04:56.990 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:57.171 INFO:teuthology.orchestra.run.smithi154.stdout:generic/663 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:04:57.182 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/663 2024-05-14T09:04:57.182 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/663 2024-05-14T09:04:57.182 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:04:57.184 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:57.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:04:57.203 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2024-05-14T09:04:57.522 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:04:57.536 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:04:57.536 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:57.709 INFO:teuthology.orchestra.run.smithi154.stdout:generic/664 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:04:57.715 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/664 2024-05-14T09:04:57.715 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/664 2024-05-14T09:04:57.715 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:04:57.718 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:57.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:04:57.727 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2024-05-14T09:04:58.037 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:04:58.041 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:04:58.042 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:58.191 INFO:teuthology.orchestra.run.smithi154.stdout:generic/665 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:04:58.197 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/665 2024-05-14T09:04:58.197 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/665 2024-05-14T09:04:58.197 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:04:58.200 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:58.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:04:58.219 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2024-05-14T09:04:58.609 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:04:58.614 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:04:58.614 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:58.800 INFO:teuthology.orchestra.run.smithi154.stdout:generic/666 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:04:58.804 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/666 2024-05-14T09:04:58.805 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/666 2024-05-14T09:04:58.805 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:04:58.808 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:58.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:04:58.822 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2024-05-14T09:04:59.183 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:04:59.189 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:04:59.189 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:59.491 INFO:teuthology.orchestra.run.smithi154.stdout:generic/667 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:04:59.497 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/667 2024-05-14T09:04:59.497 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/667 2024-05-14T09:04:59.497 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:04:59.501 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:04:59.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:04:59.515 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2024-05-14T09:04:59.847 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:04:59.852 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:04:59.852 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:05:00.034 INFO:teuthology.orchestra.run.smithi154.stdout:generic/668 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:05:00.049 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/668 2024-05-14T09:05:00.049 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/668 2024-05-14T09:05:00.049 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:05:00.052 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:05:00.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:05:00.097 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2024-05-14T09:05:00.411 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:05:00.428 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:05:00.428 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:05:00.626 INFO:teuthology.orchestra.run.smithi154.stdout:generic/669 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:05:00.630 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/669 2024-05-14T09:05:00.630 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/669 2024-05-14T09:05:00.630 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:05:00.633 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:05:00.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:05:00.645 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2024-05-14T09:05:00.971 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:05:00.976 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:05:00.976 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:05:01.155 INFO:teuthology.orchestra.run.smithi154.stdout:generic/670 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:05:01.159 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/670 2024-05-14T09:05:01.160 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/670 2024-05-14T09:05:01.160 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:05:01.163 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:05:01.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:05:01.178 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2024-05-14T09:05:01.498 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:05:01.503 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:05:01.503 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:05:01.684 INFO:teuthology.orchestra.run.smithi154.stdout:generic/671 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:05:01.688 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/671 2024-05-14T09:05:01.688 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/671 2024-05-14T09:05:01.688 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:05:01.696 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:05:01.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:05:01.722 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2024-05-14T09:05:01.999 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:05:02.009 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:05:02.009 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:05:02.194 INFO:teuthology.orchestra.run.smithi154.stdout:generic/672 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:05:02.198 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/672 2024-05-14T09:05:02.198 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/672 2024-05-14T09:05:02.198 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:05:02.201 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:05:02.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:05:02.215 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2024-05-14T09:05:02.546 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:05:02.555 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:05:02.556 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:05:03.863 INFO:teuthology.orchestra.run.smithi154.stdout:generic/673 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:05:03.867 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/673 2024-05-14T09:05:03.867 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/673 2024-05-14T09:05:03.867 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:05:03.870 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:05:03.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:05:03.897 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2024-05-14T09:05:04.129 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:05:04.134 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:05:04.134 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:05:04.335 INFO:teuthology.orchestra.run.smithi154.stdout:generic/674 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:05:04.339 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/674 2024-05-14T09:05:04.339 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/674 2024-05-14T09:05:04.340 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:05:04.342 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:05:04.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:05:04.366 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2024-05-14T09:05:04.672 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:05:04.677 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:05:04.677 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:05:04.906 INFO:teuthology.orchestra.run.smithi154.stdout:generic/675 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:05:04.919 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/675 2024-05-14T09:05:04.919 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/675 2024-05-14T09:05:04.920 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:05:04.922 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:05:04.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:05:04.934 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2024-05-14T09:05:05.288 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:05:05.294 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:05:05.294 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:10:12.794 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:10:12.796 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:10:13.906 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-05-14T09:10:13.901+0000 7f3b88d8a640 -1 Fail to open '/proc/464974/cmdline' error = (2) No such file or directory 2024-05-14T09:10:13.906 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-05-14T09:10:13.901+0000 7f3b88d8a640 -1 received signal: Hangup from (PID: 464974) UID: 0 2024-05-14T09:10:13.906 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-05-14T09:10:13.901+0000 7fc439c46640 -1 Fail to open '/proc/464974/cmdline' error = (2) No such file or directory 2024-05-14T09:10:13.906 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-05-14T09:10:13.901+0000 7fc439c46640 -1 received signal: Hangup from (PID: 464974) UID: 0 2024-05-14T09:20:08.762 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T09:20:08.753+0000 7fef9122a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464998) UID: 0 2024-05-14T09:20:08.763 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-05-14T09:20:08.753+0000 7f7af66da640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464998) UID: 0 2024-05-14T09:20:08.764 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-05-14T09:20:08.753+0000 7f7aa7691640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464998) UID: 0 2024-05-14T09:20:08.764 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T09:20:08.753+0000 7fa1653a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464998) UID: 0 2024-05-14T09:27:19.997 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:27:20.000 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:27:20.208 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-05-14T09:27:20.198+0000 7fc439c46640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 465015) UID: 0 2024-05-14T09:27:20.210 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-05-14T09:27:20.202+0000 7f3b88d8a640 -1 Fail to open '/proc/465015/cmdline' error = (2) No such file or directory 2024-05-14T09:27:20.210 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-05-14T09:27:20.202+0000 7f3b88d8a640 -1 received signal: Hangup from (PID: 465015) UID: 0 2024-05-14T09:27:20.244 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T09:27:20.238+0000 7f9bb37f5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36953) UID: 0 2024-05-14T09:27:20.244 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-05-14T09:27:20.238+0000 7f75626b8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36953) UID: 0 2024-05-14T09:27:20.244 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-05-14T09:27:20.238+0000 7f01ba1e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36953) UID: 0 2024-05-14T09:27:20.247 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-05-14T09:27:20.238+0000 7f396d567640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36953) UID: 0 2024-05-14T09:33:41.885 INFO:teuthology.orchestra.run.smithi154.stdout:generic/676 1716s 2024-05-14T09:33:42.478 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/676 2024-05-14T09:33:42.478 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:33:42.510 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:42.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:33:42.528 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2024-05-14T09:33:43.884 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:33:43.889 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:33:43.889 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:44.369 INFO:teuthology.orchestra.run.smithi154.stdout:generic/677 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:33:44.374 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/677 2024-05-14T09:33:44.374 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/677 2024-05-14T09:33:44.374 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:33:44.377 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:44.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:33:44.386 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2024-05-14T09:33:44.731 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:33:44.742 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:33:44.742 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:45.349 INFO:teuthology.orchestra.run.smithi154.stdout:generic/678 1s 2024-05-14T09:33:45.370 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/678 2024-05-14T09:33:45.370 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:33:45.371 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:45.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:33:45.385 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2024-05-14T09:33:46.009 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:33:46.028 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:33:46.028 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:46.553 INFO:teuthology.orchestra.run.smithi154.stdout:generic/679 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:33:46.564 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/679 2024-05-14T09:33:46.564 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/679 2024-05-14T09:33:46.564 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:33:46.568 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:46.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:33:46.587 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2024-05-14T09:33:46.866 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:33:46.871 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:33:46.871 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:50.903 INFO:teuthology.orchestra.run.smithi154.stdout:generic/680 4s 2024-05-14T09:33:50.909 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/680 2024-05-14T09:33:50.909 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:33:50.911 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:50.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:33:50.929 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2024-05-14T09:33:51.651 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:33:51.678 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:33:51.678 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:51.914 INFO:teuthology.orchestra.run.smithi154.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-14T09:33:51.922 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/681 2024-05-14T09:33:51.922 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/681 2024-05-14T09:33:51.922 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:33:51.922 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:51.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:33:51.932 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2024-05-14T09:33:52.320 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:33:52.326 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:33:52.326 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:52.529 INFO:teuthology.orchestra.run.smithi154.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-14T09:33:52.534 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/682 2024-05-14T09:33:52.534 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/682 2024-05-14T09:33:52.534 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:33:52.536 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:52.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:33:52.551 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2024-05-14T09:33:52.859 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:33:52.866 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:33:52.867 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:53.650 INFO:teuthology.orchestra.run.smithi154.stdout:generic/683 [not run] /tmp/tmp.v73wnydYBctest: file alloc unit 4194304 larger than op length 65536 2024-05-14T09:33:53.654 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/683 2024-05-14T09:33:53.654 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/683 2024-05-14T09:33:53.654 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:33:53.657 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:53.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:33:53.670 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2024-05-14T09:33:53.960 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:33:53.980 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:33:53.980 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:55.569 INFO:teuthology.orchestra.run.smithi154.stdout:generic/684 [not run] /tmp/tmp.v73wnydYBctest: file alloc unit 4194304 larger than op length 65536 2024-05-14T09:33:55.574 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/684 2024-05-14T09:33:55.574 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/684 2024-05-14T09:33:55.575 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:33:55.577 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:55.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:33:55.590 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2024-05-14T09:33:55.936 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:33:55.942 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:33:55.942 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:57.537 INFO:teuthology.orchestra.run.smithi154.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-14T09:33:57.541 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/685 2024-05-14T09:33:57.541 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/685 2024-05-14T09:33:57.541 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:33:57.544 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:57.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:33:57.558 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2024-05-14T09:33:57.842 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:33:57.847 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:33:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:59.347 INFO:teuthology.orchestra.run.smithi154.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-05-14T09:33:59.351 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/686 2024-05-14T09:33:59.351 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/686 2024-05-14T09:33:59.351 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:33:59.353 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:33:59.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:33:59.362 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2024-05-14T09:33:59.588 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:33:59.593 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:33:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:02.220 INFO:teuthology.orchestra.run.smithi154.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-05-14T09:34:02.229 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/687 2024-05-14T09:34:02.229 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/687 2024-05-14T09:34:02.230 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:02.232 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:02.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:02.275 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2024-05-14T09:34:02.956 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:02.967 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:03.472 INFO:teuthology.orchestra.run.smithi154.stdout:generic/688 [not run] /tmp/tmp.v73wnydYBctest: file alloc unit 4194304 larger than op length 65536 2024-05-14T09:34:03.476 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/688 2024-05-14T09:34:03.476 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/688 2024-05-14T09:34:03.476 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:03.479 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:03.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:03.492 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2024-05-14T09:34:03.795 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:03.799 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:03.799 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:04.083 INFO:teuthology.orchestra.run.smithi154.stdout:generic/689 [not run] vfstest not support by ceph-fuse 2024-05-14T09:34:04.089 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/689 2024-05-14T09:34:04.089 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/689 2024-05-14T09:34:04.089 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:04.091 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:04.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:04.106 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2024-05-14T09:34:04.358 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:04.364 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:04.364 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:04.786 INFO:teuthology.orchestra.run.smithi154.stdout:generic/690 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:34:04.793 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/690 2024-05-14T09:34:04.793 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/690 2024-05-14T09:34:04.793 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:04.796 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:04.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:04.807 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2024-05-14T09:34:05.656 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:05.661 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:05.661 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:05.901 INFO:teuthology.orchestra.run.smithi154.stdout:generic/691 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:34:05.905 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/691 2024-05-14T09:34:05.905 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/691 2024-05-14T09:34:05.905 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:05.907 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:05.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:05.917 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2024-05-14T09:34:06.546 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:06.551 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:06.551 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:06.795 INFO:teuthology.orchestra.run.smithi154.stdout:generic/692 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:34:06.799 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/692 2024-05-14T09:34:06.800 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/692 2024-05-14T09:34:06.800 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:06.806 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:06.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:06.833 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2024-05-14T09:34:07.356 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:07.378 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:07.378 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:07.684 INFO:teuthology.orchestra.run.smithi154.stdout:generic/693 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:34:07.689 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/693 2024-05-14T09:34:07.689 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/693 2024-05-14T09:34:07.689 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:07.693 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:07.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:07.741 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2024-05-14T09:34:08.118 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:08.123 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:08.123 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:09.278 INFO:teuthology.orchestra.run.smithi154.stdout:generic/694 1s 2024-05-14T09:34:09.287 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/694 2024-05-14T09:34:09.288 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:09.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:09.299 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2024-05-14T09:34:09.684 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:09.689 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:09.689 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:10.034 INFO:teuthology.orchestra.run.smithi154.stdout:generic/695 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:34:10.038 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/695 2024-05-14T09:34:10.038 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/695 2024-05-14T09:34:10.039 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:10.041 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:10.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:10.058 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2024-05-14T09:34:10.446 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:10.451 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:10.451 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:10.714 INFO:teuthology.orchestra.run.smithi154.stdout:generic/696 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:34:10.718 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/696 2024-05-14T09:34:10.718 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/696 2024-05-14T09:34:10.718 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:10.721 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:10.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:10.731 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2024-05-14T09:34:11.036 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:11.047 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:11.047 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:11.427 INFO:teuthology.orchestra.run.smithi154.stdout:generic/697 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-14T09:34:11.431 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/697 2024-05-14T09:34:11.431 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/697 2024-05-14T09:34:11.432 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:11.434 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:11.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:11.445 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2024-05-14T09:34:11.748 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:11.755 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:11.755 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:11.998 INFO:teuthology.orchestra.run.smithi154.stdout:generic/698 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:34:12.002 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/698 2024-05-14T09:34:12.003 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/698 2024-05-14T09:34:12.003 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:12.005 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:12.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:12.024 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2024-05-14T09:34:12.382 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:12.387 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:12.387 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:12.933 INFO:teuthology.orchestra.run.smithi154.stdout:generic/699 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:34:12.937 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/699 2024-05-14T09:34:12.937 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/699 2024-05-14T09:34:12.937 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:12.940 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:12.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:12.961 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2024-05-14T09:34:13.274 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:13.279 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:13.279 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:13.475 INFO:teuthology.orchestra.run.smithi154.stdout:generic/700 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:34:13.480 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/700 2024-05-14T09:34:13.480 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/700 2024-05-14T09:34:13.480 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:13.483 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:13.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:13.500 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2024-05-14T09:34:13.807 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:13.812 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:13.812 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:14.445 INFO:teuthology.orchestra.run.smithi154.stdout:generic/701 1s 2024-05-14T09:34:14.457 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/701 2024-05-14T09:34:14.457 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:14.459 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:14.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:14.469 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2024-05-14T09:34:15.231 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:15.240 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:15.240 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:15.494 INFO:teuthology.orchestra.run.smithi154.stdout:generic/702 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:34:15.498 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/702 2024-05-14T09:34:15.498 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/702 2024-05-14T09:34:15.499 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:15.502 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:15.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:15.513 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2024-05-14T09:34:15.863 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:15.867 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:15.868 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:16.530 INFO:teuthology.orchestra.run.smithi154.stdout:generic/703 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:34:16.534 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/703 2024-05-14T09:34:16.534 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/703 2024-05-14T09:34:16.534 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:16.544 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:16.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:16.564 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2024-05-14T09:34:16.833 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:16.838 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:16.838 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:17.510 INFO:teuthology.orchestra.run.smithi154.stdout:generic/704 [not run] require ceph-fuse to be valid block disk 2024-05-14T09:34:17.515 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/704 2024-05-14T09:34:17.515 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/704 2024-05-14T09:34:17.516 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:17.518 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:17.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:17.536 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2024-05-14T09:34:17.856 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:17.862 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:17.862 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:18.146 INFO:teuthology.orchestra.run.smithi154.stdout:generic/705 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:34:18.155 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/705 2024-05-14T09:34:18.155 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/705 2024-05-14T09:34:18.155 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:18.176 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:18.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:18.220 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2024-05-14T09:34:18.545 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:18.563 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:18.563 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:20.847 INFO:teuthology.orchestra.run.smithi154.stdout:generic/706 2s 2024-05-14T09:34:20.852 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/706 2024-05-14T09:34:20.852 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:20.854 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:20.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:20.865 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2024-05-14T09:34:21.543 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:21.549 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:21.549 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:21.731 INFO:teuthology.orchestra.run.smithi154.stdout:generic/707 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:34:21.743 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/707 2024-05-14T09:34:21.743 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/707 2024-05-14T09:34:21.743 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:21.750 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:21.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:21.774 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2024-05-14T09:34:22.065 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:22.072 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:22.072 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:22.812 INFO:teuthology.orchestra.run.smithi154.stdout:generic/708 0s 2024-05-14T09:34:22.829 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/708 2024-05-14T09:34:22.829 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:22.832 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:22.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:22.844 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2024-05-14T09:34:23.447 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:23.459 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:23.459 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:23.834 INFO:teuthology.orchestra.run.smithi154.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-14T09:34:23.840 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/709 2024-05-14T09:34:23.840 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/709 2024-05-14T09:34:23.840 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:23.849 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:23.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:23.863 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2024-05-14T09:34:24.569 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:24.575 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:24.575 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:25.078 INFO:teuthology.orchestra.run.smithi154.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-14T09:34:25.082 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/710 2024-05-14T09:34:25.082 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/710 2024-05-14T09:34:25.082 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:25.088 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:25.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:25.108 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2024-05-14T09:34:25.774 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:25.780 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:25.780 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:26.060 INFO:teuthology.orchestra.run.smithi154.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-14T09:34:26.064 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/711 2024-05-14T09:34:26.065 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/711 2024-05-14T09:34:26.065 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:26.072 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:26.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:26.081 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2024-05-14T09:34:26.662 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:26.666 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:26.667 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:27.111 INFO:teuthology.orchestra.run.smithi154.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-14T09:34:27.114 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/712 2024-05-14T09:34:27.115 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/712 2024-05-14T09:34:27.115 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:27.117 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:27.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:27.150 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2024-05-14T09:34:27.913 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:27.918 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:27.918 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:28.219 INFO:teuthology.orchestra.run.smithi154.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2024-05-14T09:34:28.224 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/713 2024-05-14T09:34:28.224 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/713 2024-05-14T09:34:28.225 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:28.228 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:28.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:28.253 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2024-05-14T09:34:28.980 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:28.985 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:28.985 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:29.261 INFO:teuthology.orchestra.run.smithi154.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-14T09:34:29.265 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/714 2024-05-14T09:34:29.265 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/714 2024-05-14T09:34:29.265 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:29.267 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:29.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:29.278 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2024-05-14T09:34:30.007 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:30.012 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:30.012 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:30.802 INFO:teuthology.orchestra.run.smithi154.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2024-05-14T09:34:30.805 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/715 2024-05-14T09:34:30.806 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/715 2024-05-14T09:34:30.806 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:30.808 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:30.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:30.827 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2024-05-14T09:34:31.578 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:31.592 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:32.087 INFO:teuthology.orchestra.run.smithi154.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-14T09:34:32.093 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/716 2024-05-14T09:34:32.093 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/716 2024-05-14T09:34:32.093 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:32.096 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:32.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:32.118 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2024-05-14T09:34:32.819 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:32.830 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:32.830 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:33.123 INFO:teuthology.orchestra.run.smithi154.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-14T09:34:33.139 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/717 2024-05-14T09:34:33.139 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/717 2024-05-14T09:34:33.139 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:33.142 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:33.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:33.381 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2024-05-14T09:34:33.865 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:33.876 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:33.876 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:34.207 INFO:teuthology.orchestra.run.smithi154.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-14T09:34:34.218 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/718 2024-05-14T09:34:34.218 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/718 2024-05-14T09:34:34.218 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:34.227 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:34.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:34.236 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2024-05-14T09:34:34.898 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:34.903 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:34.903 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:35.422 INFO:teuthology.orchestra.run.smithi154.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-14T09:34:35.428 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/719 2024-05-14T09:34:35.428 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/719 2024-05-14T09:34:35.428 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:35.436 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:35.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:35.456 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2024-05-14T09:34:36.153 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:36.158 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:36.158 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:36.444 INFO:teuthology.orchestra.run.smithi154.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-14T09:34:36.448 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/720 2024-05-14T09:34:36.448 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/720 2024-05-14T09:34:36.448 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:36.457 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:36.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:36.468 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2024-05-14T09:34:37.094 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:37.099 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:37.099 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:37.429 INFO:teuthology.orchestra.run.smithi154.stdout:generic/721 [not run] xfs_io startupdate support is missing 2024-05-14T09:34:37.434 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/721 2024-05-14T09:34:37.434 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/721 2024-05-14T09:34:37.434 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:37.437 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:37.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:37.452 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2024-05-14T09:34:37.706 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:37.712 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:37.713 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:37.978 INFO:teuthology.orchestra.run.smithi154.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-05-14T09:34:37.982 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/722 2024-05-14T09:34:37.982 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/722 2024-05-14T09:34:37.982 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:38.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:38.022 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2024-05-14T09:34:38.748 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:38.753 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:38.753 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:39.033 INFO:teuthology.orchestra.run.smithi154.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-14T09:34:39.042 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/723 2024-05-14T09:34:39.042 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/723 2024-05-14T09:34:39.042 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:39.042 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:39.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:39.059 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2024-05-14T09:34:39.720 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:39.725 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:39.725 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:40.008 INFO:teuthology.orchestra.run.smithi154.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-05-14T09:34:40.012 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/724 2024-05-14T09:34:40.012 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/724 2024-05-14T09:34:40.012 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:40.015 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:40.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:40.028 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2024-05-14T09:34:40.655 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:40.659 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:40.659 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:40.887 INFO:teuthology.orchestra.run.smithi154.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-05-14T09:34:40.892 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/725 2024-05-14T09:34:40.892 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/725 2024-05-14T09:34:40.892 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:40.894 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:40.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:40.908 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2024-05-14T09:34:41.587 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:41.593 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:41.593 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:43.347 INFO:teuthology.orchestra.run.smithi154.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-05-14T09:34:43.351 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/726 2024-05-14T09:34:43.351 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/726 2024-05-14T09:34:43.351 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:43.358 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:43.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:43.373 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2024-05-14T09:34:43.955 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:43.960 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:43.960 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:44.280 INFO:teuthology.orchestra.run.smithi154.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-05-14T09:34:44.284 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/727 2024-05-14T09:34:44.285 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/727 2024-05-14T09:34:44.285 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:44.287 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:44.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:44.302 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2024-05-14T09:34:45.031 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:45.036 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:45.036 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:49.518 INFO:teuthology.orchestra.run.smithi154.stdout:generic/728 4s 2024-05-14T09:34:49.523 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/728 2024-05-14T09:34:49.524 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:49.526 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:49.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:49.569 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2024-05-14T09:34:49.933 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:49.939 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:49.939 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:50.906 INFO:teuthology.orchestra.run.smithi154.stdout:generic/729 1s 2024-05-14T09:34:50.920 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/729 2024-05-14T09:34:50.920 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:50.932 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:50.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:50.949 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2024-05-14T09:34:51.633 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:51.645 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:51.863 INFO:teuthology.orchestra.run.smithi154.stdout:generic/730 [not run] require ceph-fuse to be valid block disk 2024-05-14T09:34:51.867 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/730 2024-05-14T09:34:51.867 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/730 2024-05-14T09:34:51.867 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:51.870 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:51.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:51.888 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2024-05-14T09:34:52.308 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:52.313 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:52.313 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:52.548 INFO:teuthology.orchestra.run.smithi154.stdout:generic/731 [not run] require ceph-fuse to be valid block disk 2024-05-14T09:34:52.558 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/731 2024-05-14T09:34:52.559 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/731 2024-05-14T09:34:52.559 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:52.565 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:52.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:52.593 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2024-05-14T09:34:52.886 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:52.897 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:52.897 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:53.147 INFO:teuthology.orchestra.run.smithi154.stdout:generic/732 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:34:53.153 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/732 2024-05-14T09:34:53.154 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/732 2024-05-14T09:34:53.154 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:53.155 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:53.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:53.169 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/733) 2024-05-14T09:34:53.530 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:53.537 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:53.537 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:53.747 INFO:teuthology.orchestra.run.smithi154.stdout:generic/733 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:34:53.751 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/733 2024-05-14T09:34:53.751 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/733 2024-05-14T09:34:53.751 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:53.754 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:53.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:53.764 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/734) 2024-05-14T09:34:54.137 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:54.143 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:54.143 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:54.418 INFO:teuthology.orchestra.run.smithi154.stdout:generic/734 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-14T09:34:54.423 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/734 2024-05-14T09:34:54.423 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/734 2024-05-14T09:34:54.423 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:54.426 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:54.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:54.451 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/735) 2024-05-14T09:34:55.167 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:55.177 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:55.177 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:57.120 INFO:teuthology.orchestra.run.smithi154.stdout:generic/735 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-05-14T09:34:57.125 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/735 2024-05-14T09:34:57.125 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/735 2024-05-14T09:34:57.125 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:34:57.128 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:34:57.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:34:57.141 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/736) 2024-05-14T09:34:57.787 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:34:57.792 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:34:57.792 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:38:38.539 INFO:teuthology.orchestra.run.smithi154.stdout:generic/736 221s 2024-05-14T09:38:38.554 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/736 2024-05-14T09:38:38.554 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:38:38.558 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:38:38.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:38:38.573 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/737) 2024-05-14T09:38:39.276 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:38:39.295 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:38:39.295 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:38:39.490 INFO:teuthology.orchestra.run.smithi154.stdout:generic/737 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:38:39.495 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/737 2024-05-14T09:38:39.495 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/737 2024-05-14T09:38:39.495 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:38:39.499 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:38:39.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:38:39.535 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/738) 2024-05-14T09:38:39.913 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:38:39.918 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:38:39.918 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:38:40.192 INFO:teuthology.orchestra.run.smithi154.stdout:generic/738 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:38:40.197 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/738 2024-05-14T09:38:40.197 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/738 2024-05-14T09:38:40.197 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:38:40.200 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:38:40.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:38:40.211 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/739) 2024-05-14T09:38:40.581 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:38:40.585 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:38:40.585 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:38:41.239 INFO:teuthology.orchestra.run.smithi154.stdout:generic/739 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:38:41.243 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/739 2024-05-14T09:38:41.244 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/739 2024-05-14T09:38:41.244 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:38:41.246 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:38:41.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:38:41.258 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/741) 2024-05-14T09:38:41.518 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:38:41.523 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:38:41.523 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:38:42.476 INFO:teuthology.orchestra.run.smithi154.stdout:generic/741 [not run] this test requires a valid $SCRATCH_DEV 2024-05-14T09:38:42.480 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/741 2024-05-14T09:38:42.480 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/741 2024-05-14T09:38:42.481 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T09:38:42.484 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:38:42.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T09:38:42.496 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/742) 2024-05-14T09:38:42.753 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T09:38:42.758 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T09:38:42.758 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T09:39:19.508 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T09:39:19.500+0000 7fa1653a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493037) UID: 0 2024-05-14T09:39:19.509 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-05-14T09:39:19.500+0000 7f7aa7691640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493037) UID: 0 2024-05-14T09:39:19.509 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T09:39:19.500+0000 7fef9122a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493037) UID: 0 2024-05-14T09:39:19.510 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-05-14T09:39:19.500+0000 7f7af66da640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493037) UID: 0 2024-05-14T09:43:32.693 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:43:32.696 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:43:32.726 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-05-14T09:43:32.718+0000 7f75626b8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37001) UID: 0 2024-05-14T09:43:32.727 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T09:43:32.718+0000 7f9bb37f5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37001) UID: 0 2024-05-14T09:43:32.727 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-05-14T09:43:32.718+0000 7f396d567640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37001) UID: 0 2024-05-14T09:43:32.729 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-05-14T09:43:32.718+0000 7f01ba1e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37001) UID: 0 2024-05-14T09:43:32.995 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-05-14T09:43:32.989+0000 7f3b88d8a640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 493091) UID: 0 2024-05-14T09:43:32.995 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-05-14T09:43:32.989+0000 7fc439c46640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 493091) UID: 0 2024-05-14T09:48:37.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:48:37.856 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:49:08.025 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:49:08.028 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:49:38.509 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:49:38.511 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:50:08.564 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:50:08.567 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:50:38.795 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:50:38.797 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:51:08.892 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:51:08.898 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:51:08.912 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-05-14T09:51:08.902+0000 7f75626b8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37034) UID: 0 2024-05-14T09:51:08.912 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T09:51:08.902+0000 7f9bb37f5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37034) UID: 0 2024-05-14T09:51:08.913 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-05-14T09:51:08.906+0000 7f01ba1e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37034) UID: 0 2024-05-14T09:51:08.913 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-05-14T09:51:08.906+0000 7f396d567640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37034) UID: 0 2024-05-14T09:53:55.989 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:53:55.992 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:53:56.422 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T09:53:56.417+0000 7fa1653a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493201) UID: 0 2024-05-14T09:53:56.423 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T09:53:56.417+0000 7fef9122a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493201) UID: 0 2024-05-14T09:53:56.423 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-05-14T09:53:56.417+0000 7f7aa7691640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493201) UID: 0 2024-05-14T09:53:56.424 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-05-14T09:53:56.417+0000 7f7af66da640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493201) UID: 0 2024-05-14T09:58:01.749 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:58:01.752 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:58:32.410 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:58:32.413 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:59:02.760 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:59:02.762 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:59:32.879 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:59:32.881 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:59:32.899 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-05-14T09:59:32.893+0000 7fef9122a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493225) UID: 0 2024-05-14T09:59:32.899 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-05-14T09:59:32.893+0000 7f7af66da640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493225) UID: 0 2024-05-14T09:59:32.901 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-05-14T09:59:32.893+0000 7fa1653a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493225) UID: 0 2024-05-14T09:59:32.904 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-05-14T09:59:32.893+0000 7f7aa7691640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493225) UID: 0 2024-05-14T10:03:38.839 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:03:38.842 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:04:08.918 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:04:08.925 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:04:38.988 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:04:38.991 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:05:09.047 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:05:09.050 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:05:39.311 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:05:39.313 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:06:09.367 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:06:09.370 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:06:39.428 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:06:39.431 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:07:09.492 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:07:09.494 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:07:39.614 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:07:39.617 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:08:09.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:08:09.667 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:08:39.894 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:08:39.897 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:09:09.943 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:09:09.946 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:09:40.072 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:09:40.076 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:10:10.459 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:10:10.462 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:10:40.735 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:10:40.739 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:11:10.789 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:11:10.792 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:11:40.897 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:11:40.900 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:12:11.334 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:12:11.337 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:12:41.632 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:12:41.638 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:13:11.905 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:13:11.907 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:13:41.975 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:13:41.977 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:14:12.544 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:14:12.547 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:14:42.653 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:14:42.656 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:15:12.704 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:15:12.706 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:15:42.777 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:15:42.779 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:16:13.280 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:16:13.283 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:16:43.597 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:16:43.600 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:17:13.657 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:17:13.660 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:17:43.714 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:17:43.716 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:18:13.845 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:18:13.849 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:18:43.928 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:18:43.930 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:19:13.981 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:19:13.983 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:19:14.015 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-05-14T10:19:14.005+0000 7f75626b8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37664) UID: 0 2024-05-14T10:19:14.015 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-05-14T10:19:14.005+0000 7f9bb37f5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37664) UID: 0 2024-05-14T10:19:14.016 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-05-14T10:19:14.005+0000 7f396d567640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37664) UID: 0 2024-05-14T10:19:14.016 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-05-14T10:19:14.005+0000 7f01ba1e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 37664) UID: 0 2024-05-14T10:19:48.674 INFO:teuthology.orchestra.run.smithi154.stdout:generic/742 [failed, exit status 1]- output mismatch (see /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/742.out.bad) 2024-05-14T10:19:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/742.out 2024-05-14 01:24:47.276292487 +0000 2024-05-14T10:19:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.E8tkN6FrZCxfstests-dev/results//generic/742.out.bad 2024-05-14 10:19:48.642040029 +0000 2024-05-14T10:19:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,2 +1,3 @@ 2024-05-14T10:19:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 742 2024-05-14T10:19:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: Silence is golden 2024-05-14T10:19:48.737 INFO:teuthology.orchestra.run.smithi154.stdout: +fiemap-fault: fiemap failed 95: Operation not supported 2024-05-14T10:19:48.750 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/742 2024-05-14T10:19:48.750 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/742 2024-05-14T10:19:48.750 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2024-05-14T10:19:48.777 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:19:48.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T10:19:48.793 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-14T10:19:48.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-14T10:19:48.793 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/743) 2024-05-14T10:19:49.642 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T10:19:49.648 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T10:19:49.648 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:19:49.944 INFO:teuthology.orchestra.run.smithi154.stdout:generic/743 [not run] xfs_io madvise doesn't support -R 2024-05-14T10:19:49.948 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/743 2024-05-14T10:19:49.948 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/743 2024-05-14T10:19:49.948 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T10:19:49.951 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:19:49.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T10:19:49.970 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.E8tkN6FrZCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/744) 2024-05-14T10:19:50.250 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2024-05-14T10:19:50.254 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 2024-05-14T10:19:50.254 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:19:50.418 INFO:teuthology.orchestra.run.smithi154.stdout:generic/744 [not run] ceph-fuse does not support duplicate fsid 2024-05-14T10:19:50.423 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/744 2024-05-14T10:19:50.423 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/744 2024-05-14T10:19:50.423 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2024-05-14T10:19:50.426 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:19:50.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T10:19:50.437 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 17========================================================= 2024-05-14T10:19:50.437 DEBUG:teuthology.orchestra.run.smithi154:> sudo userdel --force --remove fsgqa 2024-05-14T10:19:50.610 INFO:teuthology.orchestra.run.smithi154.stderr:userdel: fsgqa mail spool (/var/mail/fsgqa) not found 2024-05-14T10:19:50.972 DEBUG:teuthology.orchestra.run.smithi154:> sudo userdel --force --remove 123456-fsgqa 2024-05-14T10:19:51.011 INFO:teuthology.orchestra.run.smithi154.stderr:userdel: 123456-fsgqa mail spool (/var/mail/123456-fsgqa) not found 2024-05-14T10:19:51.012 INFO:teuthology.orchestra.run.smithi154.stderr:userdel: 123456-fsgqa home directory (/home/123456-fsgqa) not found 2024-05-14T10:19:51.369 DEBUG:teuthology.orchestra.run.smithi154:> sudo groupdel fsgqa 2024-05-14T10:19:51.506 INFO:teuthology.orchestra.run.smithi154.stderr:groupdel: group 'fsgqa' does not exist 2024-05-14T10:19:51.507 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-14T10:19:51.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T10:19:51.508 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.E8tkN6FrZCxfstests-dev/results) 2024-05-14T10:19:51.535 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2024-05-14T10:19:51.536 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T10:19:51.536 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.E8tkN6FrZCxfstests-dev 2024-05-14T10:19:51.536 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf /tmp/tmp.E8tkN6FrZCxfstests-dev 2024-05-14T10:19:51.896 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-14T10:19:51.896 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-14T10:19:52.043 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-14T10:19:53.401 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-14T10:19:53.401 INFO:tasks.cephfs.mount:Terminating background process 2024-05-14T10:19:53.401 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T10:19:53.401 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T10:19:53.418 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16184 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274688k,nr_inodes=818672,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-14T10:19:53.419 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-05-14T10:19:53.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T10:19:53.419 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-14T10:19:53.477 INFO:tasks.cephfs.mount:Terminating background process 2024-05-14T10:19:53.478 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T10:19:53.478 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T10:19:53.578 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336508k,nr_inodes=4084127,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274692k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16957 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274688k,nr_inodes=818672,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274692k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-14T10:19:53.578 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-05-14T10:19:53.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T10:19:53.579 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-14T10:19:53.706 INFO:teuthology.orchestra.run.smithi176.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-05-14T10:19:53.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T10:19:53.720 INFO:tasks.cephfs.mount:Terminating background process 2024-05-14T10:19:53.721 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T10:19:53.721 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T10:19:53.726 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16184 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274688k,nr_inodes=818672,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-14T10:19:53.726 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-05-14T10:19:53.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T10:19:53.726 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-14T10:19:53.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T10:19:53.774 INFO:teuthology.orchestra.run.smithi154.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-05-14T10:19:53.774 INFO:tasks.cephfs.mount:Terminating background process 2024-05-14T10:19:53.774 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T10:19:53.774 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T10:19:53.784 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336508k,nr_inodes=4084127,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274692k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16957 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274688k,nr_inodes=818672,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274692k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-14T10:19:53.785 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-05-14T10:19:53.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T10:19:53.785 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-14T10:19:53.830 INFO:teuthology.orchestra.run.smithi176.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-05-14T10:19:53.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T10:19:53.832 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T10:19:54.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.621+0000 7f99bcf4e640 1 Processor -- start 2024-05-14T10:19:54.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.621+0000 7f99bcf4e640 1 -- start start 2024-05-14T10:19:54.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.625+0000 7f99bcf4e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f99b80d22e0 0x7f99b80b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:54.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.625+0000 7f99bcf4e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f99b80d02f0 0x7f99b80d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:54.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.625+0000 7f99bcf4e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b815e5c0 con 0x7f99b815e1e0 2024-05-14T10:19:54.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.625+0000 7f99bcf4e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f99b80cfe10 con 0x7f99b80d02f0 2024-05-14T10:19:54.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.625+0000 7f99bcf4e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f99b8162110 con 0x7f99b80d22e0 2024-05-14T10:19:54.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.625+0000 7f99b6d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f99b80d02f0 0x7f99b80d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:54.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.625+0000 7f99b6d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f99b80d02f0 0x7f99b80d0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44886/0 (socket says 172.21.15.154:44886) 2024-05-14T10:19:54.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.625+0000 7f99b6d9d640 1 -- 172.21.15.154:0/4029370060 learned_addr learned my addr 172.21.15.154:0/4029370060 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:19:54.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.625+0000 7f99b5d9b640 1 --2- 172.21.15.154:0/4029370060 >> v2:172.21.15.176:3300/0 conn(0x7f99b80d22e0 0x7f99b80b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:54.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.625+0000 7f99b6d9d640 1 -- 172.21.15.154:0/4029370060 >> v2:172.21.15.176:3300/0 conn(0x7f99b80d22e0 msgr2=0x7f99b80b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:19:54.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.625+0000 7f99b6d9d640 1 --2- 172.21.15.154:0/4029370060 >> v2:172.21.15.176:3300/0 conn(0x7f99b80d22e0 0x7f99b80b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:54.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.625+0000 7f99b6d9d640 1 -- 172.21.15.154:0/4029370060 >> v1:172.21.15.176:6789/0 conn(0x7f99b815e1e0 legacy=0x7f99b80d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:54.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.625+0000 7f99b6d9d640 1 -- 172.21.15.154:0/4029370060 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b81623f0 con 0x7f99b80d02f0 2024-05-14T10:19:54.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.625+0000 7f99b6d9d640 1 --2- 172.21.15.154:0/4029370060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b80d02f0 0x7f99b80d0720 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f99b80734d0 tx=0x7f99b001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335d705ea9838ecd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:54.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.625+0000 7f99b559a640 1 -- 172.21.15.154:0/4029370060 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b00a57a0 con 0x7f99b80d02f0 2024-05-14T10:19:54.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.625+0000 7f99b559a640 1 -- 172.21.15.154:0/4029370060 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b00a5940 con 0x7f99b80d02f0 2024-05-14T10:19:54.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.625+0000 7f99b559a640 1 -- 172.21.15.154:0/4029370060 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b00a5d10 con 0x7f99b80d02f0 2024-05-14T10:19:54.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99bcf4e640 1 -- 172.21.15.154:0/4029370060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b80d02f0 msgr2=0x7f99b80d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:54.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99bcf4e640 1 --2- 172.21.15.154:0/4029370060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b80d02f0 0x7f99b80d0720 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f99b80734d0 tx=0x7f99b001c9f0 comp rx=0 tx=0).stop 2024-05-14T10:19:54.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99bcf4e640 1 -- 172.21.15.154:0/4029370060 shutdown_connections 2024-05-14T10:19:54.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99bcf4e640 1 --2- 172.21.15.154:0/4029370060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b80d02f0 0x7f99b80d0720 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:54.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99bcf4e640 1 --2- 172.21.15.154:0/4029370060 >> v2:172.21.15.176:3300/0 conn(0x7f99b80d22e0 0x7f99b80b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:54.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99bcf4e640 1 -- 172.21.15.154:0/4029370060 >> 172.21.15.154:0/4029370060 conn(0x7f99b809aa10 msgr2=0x7f99b809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:19:54.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99bcf4e640 1 -- 172.21.15.154:0/4029370060 shutdown_connections 2024-05-14T10:19:54.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99bcf4e640 1 -- 172.21.15.154:0/4029370060 wait complete. 2024-05-14T10:19:54.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99bcf4e640 1 Processor -- start 2024-05-14T10:19:54.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99bcf4e640 1 -- start start 2024-05-14T10:19:54.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99bcf4e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b80d02f0 0x7f99b80b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:54.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99bcf4e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99b80d22e0 0x7f99b814f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:54.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99bcf4e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b815e1e0 0x7f99b809adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:54.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99bcf4e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f99b8161e60 con 0x7f99b815e1e0 2024-05-14T10:19:54.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99bcf4e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f99b8161ce0 con 0x7f99b80d22e0 2024-05-14T10:19:54.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99bcf4e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f99b80b1720 con 0x7f99b80d02f0 2024-05-14T10:19:54.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99b6d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b815e1e0 0x7f99b809adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:54.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99b6d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b815e1e0 0x7f99b809adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44890/0 (socket says 172.21.15.154:44890) 2024-05-14T10:19:54.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99b6d9d640 1 -- 172.21.15.154:0/2352011150 learned_addr learned my addr 172.21.15.154:0/2352011150 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:19:54.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99b659c640 1 --2- 172.21.15.154:0/2352011150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b80d02f0 0x7f99b80b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:54.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.629+0000 7f99b5d9b640 1 --2- 172.21.15.154:0/2352011150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99b80d22e0 0x7f99b814f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:54.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.633+0000 7f99b6d9d640 1 -- 172.21.15.154:0/2352011150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b80d02f0 msgr2=0x7f99b80b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:54.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.633+0000 7f99b6d9d640 1 --2- 172.21.15.154:0/2352011150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b80d02f0 0x7f99b80b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:54.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.633+0000 7f99b6d9d640 1 -- 172.21.15.154:0/2352011150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99b80d22e0 msgr2=0x7f99b814f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:54.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.633+0000 7f99b6d9d640 1 --2- 172.21.15.154:0/2352011150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99b80d22e0 0x7f99b814f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:54.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.633+0000 7f99b6d9d640 1 -- 172.21.15.154:0/2352011150 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b8157560 con 0x7f99b815e1e0 2024-05-14T10:19:54.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.633+0000 7f99b6d9d640 1 --2- 172.21.15.154:0/2352011150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b815e1e0 0x7f99b809adf0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f99b00af040 tx=0x7f99b0019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:54.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.633+0000 7f99a6ffd640 1 -- 172.21.15.154:0/2352011150 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b00bc020 con 0x7f99b815e1e0 2024-05-14T10:19:54.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.633+0000 7f99a6ffd640 1 -- 172.21.15.154:0/2352011150 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b00b8670 con 0x7f99b815e1e0 2024-05-14T10:19:54.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.633+0000 7f99a6ffd640 1 -- 172.21.15.154:0/2352011150 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b00b8a60 con 0x7f99b815e1e0 2024-05-14T10:19:54.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.641+0000 7f99bcf4e640 1 -- 172.21.15.154:0/2352011150 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b80b39c0 con 0x7f99b815e1e0 2024-05-14T10:19:54.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.641+0000 7f99bcf4e640 1 -- 172.21.15.154:0/2352011150 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b80b1d40 con 0x7f99b815e1e0 2024-05-14T10:19:54.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.645+0000 7f99bcf4e640 1 -- 172.21.15.154:0/2352011150 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99b8068360 con 0x7f99b815e1e0 2024-05-14T10:19:54.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.693+0000 7f99a6ffd640 1 -- 172.21.15.154:0/2352011150 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f99b00bf020 con 0x7f99b815e1e0 2024-05-14T10:19:54.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.693+0000 7f99a6ffd640 1 --2- 172.21.15.154:0/2352011150 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99980678f0 0x7f9998069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:54.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.693+0000 7f99a6ffd640 1 -- 172.21.15.154:0/2352011150 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f99b01209c0 con 0x7f99b815e1e0 2024-05-14T10:19:54.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.693+0000 7f99b659c640 1 --2- 172.21.15.154:0/2352011150 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99980678f0 0x7f9998069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:54.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:54.693+0000 7f99b659c640 1 --2- 172.21.15.154:0/2352011150 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99980678f0 0x7f9998069db0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f99b80b0b00 tx=0x7f99a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:55.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.045+0000 7f99a6ffd640 1 -- 172.21.15.154:0/2352011150 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f99b00165e0 con 0x7f99b815e1e0 2024-05-14T10:19:55.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.349+0000 7f99bcf4e640 1 -- 172.21.15.154:0/2352011150 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99b806c130 con 0x7f99b815e1e0 2024-05-14T10:19:55.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.409+0000 7f99a6ffd640 1 -- 172.21.15.154:0/2352011150 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5190 (secure 0 0 0) 0x7f99b00a5910 con 0x7f99b815e1e0 2024-05-14T10:19:55.417 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:19:55.417 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3153095738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3153095738},{"type":"v1","addr":"172.21.15.176:6835","nonce":3153095738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1660216913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":1660216913},{"type":"v1","addr":"172.21.15.176:6834","nonce":1660216913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1431439777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1431439777},{"type":"v1","addr":"172.21.15.154:6837","nonce":1431439777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T01:24:32.952086+0000","modified":"2024-05-14T01:24:36.000491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5124":{"gid":5124,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6836/848393842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":848393842},{"type":"v1","addr":"172.21.15.154:6836","nonce":848393842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5124,"qdb_cluster":[5124]},"id":2}]} 2024-05-14T10:19:55.417 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 17 2024-05-14T10:19:55.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.413+0000 7f99bcf4e640 1 -- 172.21.15.154:0/2352011150 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99980678f0 msgr2=0x7f9998069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:55.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.413+0000 7f99bcf4e640 1 --2- 172.21.15.154:0/2352011150 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99980678f0 0x7f9998069db0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f99b80b0b00 tx=0x7f99a8009040 comp rx=0 tx=0).stop 2024-05-14T10:19:55.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.413+0000 7f99bcf4e640 1 -- 172.21.15.154:0/2352011150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b815e1e0 msgr2=0x7f99b809adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:55.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.413+0000 7f99bcf4e640 1 --2- 172.21.15.154:0/2352011150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b815e1e0 0x7f99b809adf0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f99b00af040 tx=0x7f99b0019790 comp rx=0 tx=0).stop 2024-05-14T10:19:55.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.413+0000 7f99bcf4e640 1 -- 172.21.15.154:0/2352011150 shutdown_connections 2024-05-14T10:19:55.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.413+0000 7f99bcf4e640 1 --2- 172.21.15.154:0/2352011150 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99980678f0 0x7f9998069db0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:55.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.413+0000 7f99bcf4e640 1 --2- 172.21.15.154:0/2352011150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b815e1e0 0x7f99b809adf0 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:55.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.413+0000 7f99bcf4e640 1 --2- 172.21.15.154:0/2352011150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99b80d22e0 0x7f99b814f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:55.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.413+0000 7f99bcf4e640 1 --2- 172.21.15.154:0/2352011150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b80d02f0 0x7f99b80b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:55.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.413+0000 7f99bcf4e640 1 -- 172.21.15.154:0/2352011150 >> 172.21.15.154:0/2352011150 conn(0x7f99b809aa10 msgr2=0x7f99b80b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:19:55.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.413+0000 7f99bcf4e640 1 -- 172.21.15.154:0/2352011150 shutdown_connections 2024-05-14T10:19:55.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.413+0000 7f99bcf4e640 1 -- 172.21.15.154:0/2352011150 wait complete. 2024-05-14T10:19:55.446 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T10:19:55.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.589+0000 7fc75a53e640 1 Processor -- start 2024-05-14T10:19:55.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.589+0000 7fc75a53e640 1 -- start start 2024-05-14T10:19:55.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.589+0000 7fc75a53e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc75415bf30 0x7fc7540b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:55.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.589+0000 7fc75a53e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc75415c310 0x7fc7540d1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:55.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.589+0000 7fc75a53e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7540b30b0 con 0x7fc7540d08e0 2024-05-14T10:19:55.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.589+0000 7fc75a53e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc7540b3390 con 0x7fc75415c310 2024-05-14T10:19:55.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.589+0000 7fc75a53e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc7540b3670 con 0x7fc75415bf30 2024-05-14T10:19:55.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.589+0000 7fc74bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc75415c310 0x7fc7540d1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:55.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.589+0000 7fc74bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc75415c310 0x7fc7540d1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44900/0 (socket says 172.21.15.154:44900) 2024-05-14T10:19:55.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.589+0000 7fc74bfff640 1 -- 172.21.15.154:0/107752390 learned_addr learned my addr 172.21.15.154:0/107752390 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:19:55.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.589+0000 7fc753fff640 1 --2- 172.21.15.154:0/107752390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc75415bf30 0x7fc7540b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:55.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.589+0000 7fc74bfff640 1 -- 172.21.15.154:0/107752390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc75415bf30 msgr2=0x7fc7540b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:19:55.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.589+0000 7fc74bfff640 1 --2- 172.21.15.154:0/107752390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc75415bf30 0x7fc7540b27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:55.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.589+0000 7fc74bfff640 1 -- 172.21.15.154:0/107752390 >> v1:172.21.15.176:6789/0 conn(0x7fc7540d08e0 legacy=0x7fc75415fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:55.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.589+0000 7fc74bfff640 1 -- 172.21.15.154:0/107752390 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7540aec10 con 0x7fc75415c310 2024-05-14T10:19:55.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.589+0000 7fc74bfff640 1 --2- 172.21.15.154:0/107752390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75415c310 0x7fc7540d1c90 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009870 tx=0x7fc73c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503cdde2d724a585 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:55.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.593+0000 7fc7537fe640 1 -- 172.21.15.154:0/107752390 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73c0b5070 con 0x7fc75415c310 2024-05-14T10:19:55.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.593+0000 7fc7537fe640 1 -- 172.21.15.154:0/107752390 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc73c0a8a50 con 0x7fc75415c310 2024-05-14T10:19:55.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.593+0000 7fc7537fe640 1 -- 172.21.15.154:0/107752390 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73c0a8e20 con 0x7fc75415c310 2024-05-14T10:19:55.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.593+0000 7fc75a53e640 1 -- 172.21.15.154:0/107752390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75415c310 msgr2=0x7fc7540d1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:55.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.593+0000 7fc75a53e640 1 --2- 172.21.15.154:0/107752390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75415c310 0x7fc7540d1c90 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009870 tx=0x7fc73c01ed50 comp rx=0 tx=0).stop 2024-05-14T10:19:55.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc75a53e640 1 -- 172.21.15.154:0/107752390 shutdown_connections 2024-05-14T10:19:55.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc75a53e640 1 --2- 172.21.15.154:0/107752390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75415c310 0x7fc7540d1c90 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:55.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc75a53e640 1 --2- 172.21.15.154:0/107752390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc75415bf30 0x7fc7540b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:55.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc75a53e640 1 -- 172.21.15.154:0/107752390 >> 172.21.15.154:0/107752390 conn(0x7fc75409aa10 msgr2=0x7fc75409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:19:55.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc75a53e640 1 -- 172.21.15.154:0/107752390 shutdown_connections 2024-05-14T10:19:55.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc75a53e640 1 -- 172.21.15.154:0/107752390 wait complete. 2024-05-14T10:19:55.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc75a53e640 1 Processor -- start 2024-05-14T10:19:55.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc75a53e640 1 -- start start 2024-05-14T10:19:55.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc75a53e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7540d08e0 0x7fc754152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:55.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc75a53e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75415bf30 0x7fc7540b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:55.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc75a53e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc75415c310 0x7fc7540b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:55.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc75a53e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc7540b05a0 con 0x7fc75415bf30 2024-05-14T10:19:55.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc75a53e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc7540b0420 con 0x7fc7540d08e0 2024-05-14T10:19:55.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc75a53e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc7540b0720 con 0x7fc75415c310 2024-05-14T10:19:55.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc753fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7540d08e0 0x7fc754152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:55.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc758adb640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc75415c310 0x7fc7540b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:55.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc753fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7540d08e0 0x7fc754152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:50488/0 (socket says 172.21.15.154:50488) 2024-05-14T10:19:55.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc753fff640 1 -- 172.21.15.154:0/3452358190 learned_addr learned my addr 172.21.15.154:0/3452358190 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:19:55.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc753fff640 1 -- 172.21.15.154:0/3452358190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc75415c310 msgr2=0x7fc7540b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:55.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc753fff640 1 --2- 172.21.15.154:0/3452358190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc75415c310 0x7fc7540b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:55.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc753fff640 1 -- 172.21.15.154:0/3452358190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75415bf30 msgr2=0x7fc7540b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:55.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc753fff640 1 --2- 172.21.15.154:0/3452358190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75415bf30 0x7fc7540b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:55.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc753fff640 1 -- 172.21.15.154:0/3452358190 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7541537d0 con 0x7fc7540d08e0 2024-05-14T10:19:55.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc758adb640 1 --2- 172.21.15.154:0/3452358190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc75415c310 0x7fc7540b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T10:19:55.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc753fff640 1 --2- 172.21.15.154:0/3452358190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7540d08e0 0x7fc754152e10 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc74400e930 tx=0x7fc74400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:55.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc7517fa640 1 -- 172.21.15.154:0/3452358190 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc744017070 con 0x7fc7540d08e0 2024-05-14T10:19:55.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc7517fa640 1 -- 172.21.15.154:0/3452358190 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc74400ca00 con 0x7fc7540d08e0 2024-05-14T10:19:55.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc7517fa640 1 -- 172.21.15.154:0/3452358190 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74400cdb0 con 0x7fc7540d08e0 2024-05-14T10:19:55.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc75a53e640 1 -- 172.21.15.154:0/3452358190 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7540b5560 con 0x7fc7540d08e0 2024-05-14T10:19:55.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.597+0000 7fc75a53e640 1 -- 172.21.15.154:0/3452358190 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7540b5b20 con 0x7fc7540d08e0 2024-05-14T10:19:55.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.601+0000 7fc75a53e640 1 -- 172.21.15.154:0/3452358190 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc754068360 con 0x7fc7540d08e0 2024-05-14T10:19:55.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.673+0000 7fc7517fa640 1 -- 172.21.15.154:0/3452358190 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc74401a070 con 0x7fc7540d08e0 2024-05-14T10:19:55.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.677+0000 7fc7517fa640 1 --2- 172.21.15.154:0/3452358190 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc7340678c0 0x7fc734069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:55.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.677+0000 7fc7517fa640 1 -- 172.21.15.154:0/3452358190 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc7440864c0 con 0x7fc7540d08e0 2024-05-14T10:19:55.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.677+0000 7fc74bfff640 1 --2- 172.21.15.154:0/3452358190 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc7340678c0 0x7fc734069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:55.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.677+0000 7fc74bfff640 1 --2- 172.21.15.154:0/3452358190 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc7340678c0 0x7fc734069d80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc73c0b2000 tx=0x7fc73c004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:55.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:55.913+0000 7fc7517fa640 1 -- 172.21.15.154:0/3452358190 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fc744056990 con 0x7fc7540d08e0 2024-05-14T10:19:56.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.149+0000 7fc75a53e640 1 -- 172.21.15.154:0/3452358190 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7540b7d40 con 0x7fc7540d08e0 2024-05-14T10:19:56.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.233+0000 7fc7517fa640 1 -- 172.21.15.154:0/3452358190 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16717 (secure 0 0 0) 0x7fc74405be20 con 0x7fc7540d08e0 2024-05-14T10:19:56.241 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:19:56.241 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":34,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:24:34.630046+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:24:31.391789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-14T01:24:31.927579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T10:19:56.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.237+0000 7fc75a53e640 1 -- 172.21.15.154:0/3452358190 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc7340678c0 msgr2=0x7fc734069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:56.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.237+0000 7fc75a53e640 1 --2- 172.21.15.154:0/3452358190 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc7340678c0 0x7fc734069d80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc73c0b2000 tx=0x7fc73c004740 comp rx=0 tx=0).stop 2024-05-14T10:19:56.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.237+0000 7fc75a53e640 1 -- 172.21.15.154:0/3452358190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7540d08e0 msgr2=0x7fc754152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:56.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.237+0000 7fc75a53e640 1 --2- 172.21.15.154:0/3452358190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7540d08e0 0x7fc754152e10 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc74400e930 tx=0x7fc74400edf0 comp rx=0 tx=0).stop 2024-05-14T10:19:56.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.237+0000 7fc75a53e640 1 -- 172.21.15.154:0/3452358190 shutdown_connections 2024-05-14T10:19:56.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.237+0000 7fc75a53e640 1 --2- 172.21.15.154:0/3452358190 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc7340678c0 0x7fc734069d80 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:56.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.237+0000 7fc75a53e640 1 --2- 172.21.15.154:0/3452358190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc75415c310 0x7fc7540b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:56.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.237+0000 7fc75a53e640 1 --2- 172.21.15.154:0/3452358190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75415bf30 0x7fc7540b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:56.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.237+0000 7fc75a53e640 1 --2- 172.21.15.154:0/3452358190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7540d08e0 0x7fc754152e10 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:56.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.237+0000 7fc75a53e640 1 -- 172.21.15.154:0/3452358190 >> 172.21.15.154:0/3452358190 conn(0x7fc75409aa10 msgr2=0x7fc7540704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:19:56.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.237+0000 7fc75a53e640 1 -- 172.21.15.154:0/3452358190 shutdown_connections 2024-05-14T10:19:56.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.237+0000 7fc75a53e640 1 -- 172.21.15.154:0/3452358190 wait complete. 2024-05-14T10:19:56.268 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T01:23:23.183062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T01:24:31.391789+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T01:24:31.927579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T10:19:56.269 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T10:19:56.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.421+0000 7fda34e10640 1 Processor -- start 2024-05-14T10:19:56.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.421+0000 7fda34e10640 1 -- start start 2024-05-14T10:19:56.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.421+0000 7fda34e10640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda3006bc90 0x7fda300d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:56.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.421+0000 7fda34e10640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda300cfe00 con 0x7fda300d1cd0 2024-05-14T10:19:56.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.421+0000 7fda34e10640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda3006c270 con 0x7fda300b31e0 2024-05-14T10:19:56.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.421+0000 7fda34e10640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fda3006c550 con 0x7fda3006bc90 2024-05-14T10:19:56.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.421+0000 7fda2e59c640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fda300b31e0 0x7fda300cf020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:33704/0 (socket says 172.21.15.154:33704) 2024-05-14T10:19:56.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.421+0000 7fda2e59c640 1 -- 172.21.15.154:0/3606128973 learned_addr learned my addr 172.21.15.154:0/3606128973 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:19:56.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.421+0000 7fda2dd9b640 1 --2- 172.21.15.154:0/3606128973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda3006bc90 0x7fda300d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:56.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.421+0000 7fda2dd9b640 1 -- 172.21.15.154:0/3606128973 >> v1:172.21.15.176:6789/0 conn(0x7fda300b31e0 legacy=0x7fda300cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:56.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.421+0000 7fda2dd9b640 1 -- 172.21.15.154:0/3606128973 >> v1:172.21.15.154:6789/0 conn(0x7fda300d1cd0 legacy=0x7fda300b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:56.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.421+0000 7fda2dd9b640 1 -- 172.21.15.154:0/3606128973 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda300d00a0 con 0x7fda3006bc90 2024-05-14T10:19:56.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.425+0000 7fda2dd9b640 1 --2- 172.21.15.154:0/3606128973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda3006bc90 0x7fda300d0b80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fda200097f0 tx=0x7fda2001c220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8c421d02602f705 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:56.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.425+0000 7fda2d59a640 1 -- 172.21.15.154:0/3606128973 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda200b0070 con 0x7fda3006bc90 2024-05-14T10:19:56.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.425+0000 7fda2d59a640 1 -- 172.21.15.154:0/3606128973 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda200a4e50 con 0x7fda3006bc90 2024-05-14T10:19:56.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.425+0000 7fda2d59a640 1 -- 172.21.15.154:0/3606128973 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda200ab820 con 0x7fda3006bc90 2024-05-14T10:19:56.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda34e10640 1 -- 172.21.15.154:0/3606128973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda3006bc90 msgr2=0x7fda300d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:56.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda34e10640 1 --2- 172.21.15.154:0/3606128973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda3006bc90 0x7fda300d0b80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fda200097f0 tx=0x7fda2001c220 comp rx=0 tx=0).stop 2024-05-14T10:19:56.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda34e10640 1 -- 172.21.15.154:0/3606128973 shutdown_connections 2024-05-14T10:19:56.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda34e10640 1 --2- 172.21.15.154:0/3606128973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda3006bc90 0x7fda300d0b80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:56.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda34e10640 1 -- 172.21.15.154:0/3606128973 >> 172.21.15.154:0/3606128973 conn(0x7fda3009aa10 msgr2=0x7fda3009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:19:56.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda34e10640 1 -- 172.21.15.154:0/3606128973 shutdown_connections 2024-05-14T10:19:56.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda34e10640 1 -- 172.21.15.154:0/3606128973 wait complete. 2024-05-14T10:19:56.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda34e10640 1 Processor -- start 2024-05-14T10:19:56.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda34e10640 1 -- start start 2024-05-14T10:19:56.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda34e10640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda3006bc90 0x7fda3009ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:56.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda34e10640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda300b31e0 0x7fda3009c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:56.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda34e10640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda300d1cd0 0x7fda300af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:56.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda34e10640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fda300b35c0 con 0x7fda300d1cd0 2024-05-14T10:19:56.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda34e10640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fda300d0660 con 0x7fda3006bc90 2024-05-14T10:19:56.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda34e10640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fda300d10c0 con 0x7fda300b31e0 2024-05-14T10:19:56.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda2e59c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda3006bc90 0x7fda3009ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:56.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda2ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda300d1cd0 0x7fda300af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:56.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda2e59c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda3006bc90 0x7fda3009ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:50500/0 (socket says 172.21.15.154:50500) 2024-05-14T10:19:56.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda2ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda300d1cd0 0x7fda300af650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44916/0 (socket says 172.21.15.154:44916) 2024-05-14T10:19:56.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda2e59c640 1 -- 172.21.15.154:0/2934634199 learned_addr learned my addr 172.21.15.154:0/2934634199 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:19:56.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.429+0000 7fda2dd9b640 1 --2- 172.21.15.154:0/2934634199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda300b31e0 0x7fda3009c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:56.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.433+0000 7fda2e59c640 1 -- 172.21.15.154:0/2934634199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda300b31e0 msgr2=0x7fda3009c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:56.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.433+0000 7fda2e59c640 1 --2- 172.21.15.154:0/2934634199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda300b31e0 0x7fda3009c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:56.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.433+0000 7fda2e59c640 1 -- 172.21.15.154:0/2934634199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda300d1cd0 msgr2=0x7fda300af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:56.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.433+0000 7fda2e59c640 1 --2- 172.21.15.154:0/2934634199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda300d1cd0 0x7fda300af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:56.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.433+0000 7fda2e59c640 1 -- 172.21.15.154:0/2934634199 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3009ce70 con 0x7fda3006bc90 2024-05-14T10:19:56.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.433+0000 7fda2dd9b640 1 --2- 172.21.15.154:0/2934634199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda300b31e0 0x7fda3009c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T10:19:56.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.433+0000 7fda2e59c640 1 --2- 172.21.15.154:0/2934634199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda3006bc90 0x7fda3009ee60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fda240507c0 tx=0x7fda24050c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:56.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.433+0000 7fda1effd640 1 -- 172.21.15.154:0/2934634199 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2405c070 con 0x7fda3006bc90 2024-05-14T10:19:56.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.433+0000 7fda1effd640 1 -- 172.21.15.154:0/2934634199 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda240070d0 con 0x7fda3006bc90 2024-05-14T10:19:56.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.433+0000 7fda1effd640 1 -- 172.21.15.154:0/2934634199 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda240074c0 con 0x7fda3006bc90 2024-05-14T10:19:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.433+0000 7fda34e10640 1 -- 172.21.15.154:0/2934634199 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3009f480 con 0x7fda3006bc90 2024-05-14T10:19:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.433+0000 7fda34e10640 1 -- 172.21.15.154:0/2934634199 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3009fa40 con 0x7fda3006bc90 2024-05-14T10:19:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.437+0000 7fda1effd640 1 -- 172.21.15.154:0/2934634199 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fda2405f070 con 0x7fda3006bc90 2024-05-14T10:19:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.437+0000 7fda1effd640 1 --2- 172.21.15.154:0/2934634199 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fda100679c0 0x7fda10069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.437+0000 7fda1effd640 1 -- 172.21.15.154:0/2934634199 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fda240c8e90 con 0x7fda3006bc90 2024-05-14T10:19:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.437+0000 7fda2dd9b640 1 --2- 172.21.15.154:0/2934634199 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fda100679c0 0x7fda10069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.437+0000 7fda2dd9b640 1 --2- 172.21.15.154:0/2934634199 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fda100679c0 0x7fda10069e80 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fda200ad000 tx=0x7fda200a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.437+0000 7fda34e10640 1 -- 172.21.15.154:0/2934634199 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda30068360 con 0x7fda3006bc90 2024-05-14T10:19:56.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.445+0000 7fda1effd640 1 -- 172.21.15.154:0/2934634199 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fda240916d0 con 0x7fda3006bc90 2024-05-14T10:19:56.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.705+0000 7fda34e10640 1 -- 172.21.15.154:0/2934634199 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fda300ce7e0 con 0x7fda3006bc90 2024-05-14T10:19:56.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.813+0000 7fda1effd640 1 -- 172.21.15.154:0/2934634199 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) ==== 93+0+10 (secure 0 0 0) 0x7fda24007660 con 0x7fda3006bc90 2024-05-14T10:19:56.820 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-05-14T10:19:56.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.817+0000 7fda34e10640 1 -- 172.21.15.154:0/2934634199 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fda100679c0 msgr2=0x7fda10069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:56.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.817+0000 7fda34e10640 1 --2- 172.21.15.154:0/2934634199 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fda100679c0 0x7fda10069e80 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fda200ad000 tx=0x7fda200a6000 comp rx=0 tx=0).stop 2024-05-14T10:19:56.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.817+0000 7fda34e10640 1 -- 172.21.15.154:0/2934634199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda3006bc90 msgr2=0x7fda3009ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:56.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.817+0000 7fda34e10640 1 --2- 172.21.15.154:0/2934634199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda3006bc90 0x7fda3009ee60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fda240507c0 tx=0x7fda24050c80 comp rx=0 tx=0).stop 2024-05-14T10:19:56.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.817+0000 7fda34e10640 1 -- 172.21.15.154:0/2934634199 shutdown_connections 2024-05-14T10:19:56.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.817+0000 7fda34e10640 1 --2- 172.21.15.154:0/2934634199 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fda100679c0 0x7fda10069e80 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:56.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.817+0000 7fda34e10640 1 --2- 172.21.15.154:0/2934634199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda300d1cd0 0x7fda300af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:56.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.817+0000 7fda34e10640 1 --2- 172.21.15.154:0/2934634199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda300b31e0 0x7fda3009c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:56.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.817+0000 7fda34e10640 1 --2- 172.21.15.154:0/2934634199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda3006bc90 0x7fda3009ee60 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:56.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.817+0000 7fda34e10640 1 -- 172.21.15.154:0/2934634199 >> 172.21.15.154:0/2934634199 conn(0x7fda3009aa10 msgr2=0x7fda3006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:19:56.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.817+0000 7fda34e10640 1 -- 172.21.15.154:0/2934634199 shutdown_connections 2024-05-14T10:19:56.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.817+0000 7fda34e10640 1 -- 172.21.15.154:0/2934634199 wait complete. 2024-05-14T10:19:56.843 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T10:19:56.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.969+0000 7f8f30a65640 1 Processor -- start 2024-05-14T10:19:56.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.969+0000 7f8f30a65640 1 -- start start 2024-05-14T10:19:56.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.973+0000 7f8f30a65640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8f2c151c30 0x7f8f2c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:56.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.973+0000 7f8f2a59c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8f2c151c30 0x7f8f2c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:56.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.973+0000 7f8f2a59c640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8f2c151c30 0x7f8f2c0ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:50504/0 (socket says 172.21.15.154:50504) 2024-05-14T10:19:56.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.973+0000 7f8f2a59c640 1 -- 172.21.15.154:0/3736779522 learned_addr learned my addr 172.21.15.154:0/3736779522 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:19:56.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.977+0000 7f8f30a65640 1 --2- 172.21.15.154:0/3736779522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2c15e8c0 0x7f8f2c15ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:56.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.977+0000 7f8f30a65640 1 --2- 172.21.15.154:0/3736779522 >> v2:172.21.15.154:3300/0 conn(0x7f8f2c15b2d0 0x7f8f2c15b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:56.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.977+0000 7f8f30a65640 1 -- 172.21.15.154:0/3736779522 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8f2c15f260 con 0x7f8f2c15b2d0 2024-05-14T10:19:56.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.977+0000 7f8f30a65640 1 -- 172.21.15.154:0/3736779522 --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8f2c0cfc60 con 0x7f8f2c151c30 2024-05-14T10:19:56.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.977+0000 7f8f30a65640 1 -- 172.21.15.154:0/3736779522 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8f2c0ced80 con 0x7f8f2c15e8c0 2024-05-14T10:19:56.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.977+0000 7f8f29d9b640 1 --2- 172.21.15.154:0/3736779522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2c15e8c0 0x7f8f2c15ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:56.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.977+0000 7f8f2ad9d640 1 --2- 172.21.15.154:0/3736779522 >> v2:172.21.15.154:3300/0 conn(0x7f8f2c15b2d0 0x7f8f2c15b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:56.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.977+0000 7f8f2ad9d640 1 -- 172.21.15.154:0/3736779522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2c15e8c0 msgr2=0x7f8f2c15ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:19:56.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.977+0000 7f8f2ad9d640 1 --2- 172.21.15.154:0/3736779522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2c15e8c0 0x7f8f2c15ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:56.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.977+0000 7f8f2ad9d640 1 -- 172.21.15.154:0/3736779522 >> v2:172.21.15.176:3300/0 conn(0x7f8f2c151c30 msgr2=0x7f8f2c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:19:56.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.977+0000 7f8f2ad9d640 1 --2- 172.21.15.154:0/3736779522 >> v2:172.21.15.176:3300/0 conn(0x7f8f2c151c30 0x7f8f2c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:56.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.977+0000 7f8f2ad9d640 1 -- 172.21.15.154:0/3736779522 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2c0cf050 con 0x7f8f2c15b2d0 2024-05-14T10:19:56.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.977+0000 7f8f2a59c640 1 --2- 172.21.15.154:0/3736779522 >> v2:172.21.15.176:3300/0 conn(0x7f8f2c151c30 0x7f8f2c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T10:19:56.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.977+0000 7f8f29d9b640 1 --2- 172.21.15.154:0/3736779522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2c15e8c0 0x7f8f2c15ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T10:19:56.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.977+0000 7f8f2ad9d640 1 --2- 172.21.15.154:0/3736779522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f2c15b2d0 0x7f8f2c15b760 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0b6e20 tx=0x7f8f2401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d4bee4cb322e92 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:56.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.985+0000 7f8f2959a640 1 -- 172.21.15.154:0/3736779522 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f240b2070 con 0x7f8f2c15b2d0 2024-05-14T10:19:56.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.985+0000 7f8f2959a640 1 -- 172.21.15.154:0/3736779522 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f240a5980 con 0x7f8f2c15b2d0 2024-05-14T10:19:56.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.985+0000 7f8f2959a640 1 -- 172.21.15.154:0/3736779522 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f240a5d50 con 0x7f8f2c15b2d0 2024-05-14T10:19:56.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.985+0000 7f8f30a65640 1 -- 172.21.15.154:0/3736779522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f2c15b2d0 msgr2=0x7f8f2c15b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:56.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.985+0000 7f8f30a65640 1 --2- 172.21.15.154:0/3736779522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f2c15b2d0 0x7f8f2c15b760 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0b6e20 tx=0x7f8f2401c900 comp rx=0 tx=0).stop 2024-05-14T10:19:56.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.985+0000 7f8f30a65640 1 -- 172.21.15.154:0/3736779522 shutdown_connections 2024-05-14T10:19:56.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.985+0000 7f8f30a65640 1 --2- 172.21.15.154:0/3736779522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2c15e8c0 0x7f8f2c15ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:56.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.985+0000 7f8f30a65640 1 --2- 172.21.15.154:0/3736779522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f2c15b2d0 0x7f8f2c15b760 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:56.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.985+0000 7f8f30a65640 1 --2- 172.21.15.154:0/3736779522 >> v2:172.21.15.176:3300/0 conn(0x7f8f2c151c30 0x7f8f2c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:56.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.985+0000 7f8f30a65640 1 -- 172.21.15.154:0/3736779522 >> 172.21.15.154:0/3736779522 conn(0x7f8f2c0cd6f0 msgr2=0x7f8f2c0cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:19:57.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.993+0000 7f8f30a65640 1 -- 172.21.15.154:0/3736779522 shutdown_connections 2024-05-14T10:19:57.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.993+0000 7f8f30a65640 1 -- 172.21.15.154:0/3736779522 wait complete. 2024-05-14T10:19:57.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f30a65640 1 Processor -- start 2024-05-14T10:19:57.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f30a65640 1 -- start start 2024-05-14T10:19:57.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f30a65640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f2c151c30 0x7f8f2c14d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:57.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f30a65640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2c15b2d0 0x7f8f2c0b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:57.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f30a65640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f2c15e8c0 0x7f8f2c0b3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:57.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f30a65640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c152010 con 0x7f8f2c151c30 2024-05-14T10:19:57.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f30a65640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c15c0b0 con 0x7f8f2c15e8c0 2024-05-14T10:19:57.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f30a65640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8f2c152190 con 0x7f8f2c15b2d0 2024-05-14T10:19:57.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f2a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f2c151c30 0x7f8f2c14d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:57.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f2a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f2c151c30 0x7f8f2c14d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44924/0 (socket says 172.21.15.154:44924) 2024-05-14T10:19:57.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f2a59c640 1 -- 172.21.15.154:0/2965575519 learned_addr learned my addr 172.21.15.154:0/2965575519 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:19:57.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f2ad9d640 1 --2- 172.21.15.154:0/2965575519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f2c15e8c0 0x7f8f2c0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:57.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f29d9b640 1 --2- 172.21.15.154:0/2965575519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2c15b2d0 0x7f8f2c0b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:57.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f2a59c640 1 -- 172.21.15.154:0/2965575519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2c15b2d0 msgr2=0x7f8f2c0b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:57.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f2a59c640 1 --2- 172.21.15.154:0/2965575519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2c15b2d0 0x7f8f2c0b50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f2a59c640 1 -- 172.21.15.154:0/2965575519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f2c15e8c0 msgr2=0x7f8f2c0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:57.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f2a59c640 1 --2- 172.21.15.154:0/2965575519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f2c15e8c0 0x7f8f2c0b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f2a59c640 1 -- 172.21.15.154:0/2965575519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2c0b4000 con 0x7f8f2c151c30 2024-05-14T10:19:57.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f2a59c640 1 --2- 172.21.15.154:0/2965575519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f2c151c30 0x7f8f2c14d3e0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00e930 tx=0x7f8f1c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:57.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f1affd640 1 -- 172.21.15.154:0/2965575519 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c017070 con 0x7f8f2c151c30 2024-05-14T10:19:57.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f1affd640 1 -- 172.21.15.154:0/2965575519 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1c00ca00 con 0x7f8f2c151c30 2024-05-14T10:19:57.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f30a65640 1 -- 172.21.15.154:0/2965575519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f2c0b42e0 con 0x7f8f2c151c30 2024-05-14T10:19:57.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:56.997+0000 7f8f30a65640 1 -- 172.21.15.154:0/2965575519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f2c0b48a0 con 0x7f8f2c151c30 2024-05-14T10:19:57.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.001+0000 7f8f1affd640 1 -- 172.21.15.154:0/2965575519 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c00cdd0 con 0x7f8f2c151c30 2024-05-14T10:19:57.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.001+0000 7f8f30a65640 1 -- 172.21.15.154:0/2965575519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f2c067cd0 con 0x7f8f2c151c30 2024-05-14T10:19:57.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.001+0000 7f8f1affd640 1 -- 172.21.15.154:0/2965575519 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f1c01a070 con 0x7f8f2c151c30 2024-05-14T10:19:57.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.001+0000 7f8f1affd640 1 --2- 172.21.15.154:0/2965575519 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8f0c0678c0 0x7f8f0c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:57.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.001+0000 7f8f1affd640 1 -- 172.21.15.154:0/2965575519 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8f1c085f30 con 0x7f8f2c151c30 2024-05-14T10:19:57.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.001+0000 7f8f29d9b640 1 --2- 172.21.15.154:0/2965575519 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8f0c0678c0 0x7f8f0c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:57.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.001+0000 7f8f29d9b640 1 --2- 172.21.15.154:0/2965575519 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8f0c0678c0 0x7f8f0c069d80 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009580 tx=0x7f8f20009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:57.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.041+0000 7f8f1affd640 1 -- 172.21.15.154:0/2965575519 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f8f1c056380 con 0x7f8f2c151c30 2024-05-14T10:19:57.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.285+0000 7f8f30a65640 1 -- 172.21.15.154:0/2965575519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8f2c166a40 con 0x7f8f2c151c30 2024-05-14T10:19:57.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.349+0000 7f8f1affd640 1 -- 172.21.15.154:0/2965575519 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) ==== 104+0+11 (secure 0 0 0) 0x7f8f1c05a680 con 0x7f8f2c151c30 2024-05-14T10:19:57.358 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-05-14T10:19:57.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.353+0000 7f8f30a65640 1 -- 172.21.15.154:0/2965575519 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8f0c0678c0 msgr2=0x7f8f0c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:57.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.353+0000 7f8f30a65640 1 --2- 172.21.15.154:0/2965575519 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8f0c0678c0 0x7f8f0c069d80 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009580 tx=0x7f8f20009190 comp rx=0 tx=0).stop 2024-05-14T10:19:57.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.353+0000 7f8f30a65640 1 -- 172.21.15.154:0/2965575519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f2c151c30 msgr2=0x7f8f2c14d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:57.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.353+0000 7f8f30a65640 1 --2- 172.21.15.154:0/2965575519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f2c151c30 0x7f8f2c14d3e0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00e930 tx=0x7f8f1c00edf0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.357+0000 7f8f30a65640 1 -- 172.21.15.154:0/2965575519 shutdown_connections 2024-05-14T10:19:57.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.357+0000 7f8f30a65640 1 --2- 172.21.15.154:0/2965575519 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8f0c0678c0 0x7f8f0c069d80 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.357+0000 7f8f30a65640 1 --2- 172.21.15.154:0/2965575519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f2c15e8c0 0x7f8f2c0b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.357+0000 7f8f30a65640 1 --2- 172.21.15.154:0/2965575519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2c15b2d0 0x7f8f2c0b50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.357+0000 7f8f30a65640 1 --2- 172.21.15.154:0/2965575519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f2c151c30 0x7f8f2c14d3e0 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.357+0000 7f8f30a65640 1 -- 172.21.15.154:0/2965575519 >> 172.21.15.154:0/2965575519 conn(0x7f8f2c0cd6f0 msgr2=0x7f8f2c0cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:19:57.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.357+0000 7f8f30a65640 1 -- 172.21.15.154:0/2965575519 shutdown_connections 2024-05-14T10:19:57.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.357+0000 7f8f30a65640 1 -- 172.21.15.154:0/2965575519 wait complete. 2024-05-14T10:19:57.382 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T10:19:57.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.521+0000 7f57eac43640 1 Processor -- start 2024-05-14T10:19:57.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.521+0000 7f57eac43640 1 -- start start 2024-05-14T10:19:57.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.521+0000 7f57eac43640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f57e415e530 0x7f57e40d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:57.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.521+0000 7f57eac43640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57e4162a60 0x7f57e40d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:57.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.521+0000 7f57eac43640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f57e40b3590 0x7f57e40718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:57.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.521+0000 7f57eac43640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f57e415e910 con 0x7f57e40b3590 2024-05-14T10:19:57.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.521+0000 7f57eac43640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f57e40cec20 con 0x7f57e415e530 2024-05-14T10:19:57.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.521+0000 7f57eac43640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f57e40cef00 con 0x7f57e4162a60 2024-05-14T10:19:57.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.521+0000 7f57e89df640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f57e415e530 0x7f57e40d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:57.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.521+0000 7f57e91e0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f57e40b3590 0x7f57e40718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:57.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.521+0000 7f57e89df640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f57e415e530 0x7f57e40d0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:52660/0 (socket says 172.21.15.154:52660) 2024-05-14T10:19:57.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.521+0000 7f57e89df640 1 -- 172.21.15.154:0/1042550555 learned_addr learned my addr 172.21.15.154:0/1042550555 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:19:57.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.521+0000 7f57e3fff640 1 --2- 172.21.15.154:0/1042550555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57e4162a60 0x7f57e40d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:57.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.521+0000 7f57e91e0640 1 -- 172.21.15.154:0/1042550555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57e4162a60 msgr2=0x7f57e40d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:19:57.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.521+0000 7f57e91e0640 1 --2- 172.21.15.154:0/1042550555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57e4162a60 0x7f57e40d0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.521+0000 7f57e91e0640 1 -- 172.21.15.154:0/1042550555 >> v2:172.21.15.176:3300/0 conn(0x7f57e415e530 msgr2=0x7f57e40d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:19:57.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.521+0000 7f57e91e0640 1 --2- 172.21.15.154:0/1042550555 >> v2:172.21.15.176:3300/0 conn(0x7f57e415e530 0x7f57e40d0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.521+0000 7f57e91e0640 1 -- 172.21.15.154:0/1042550555 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e40cf1e0 con 0x7f57e40b3590 2024-05-14T10:19:57.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.525+0000 7f57e91e0640 1 --2- 172.21.15.154:0/1042550555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e40b3590 0x7f57e40718a0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f57e40d5190 tx=0x7f57dc01c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8a1cdaa0b1e04a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:57.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.525+0000 7f57e37fe640 1 -- 172.21.15.154:0/1042550555 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0ad070 con 0x7f57e40b3590 2024-05-14T10:19:57.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.525+0000 7f57e37fe640 1 -- 172.21.15.154:0/1042550555 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57dc0a9400 con 0x7f57e40b3590 2024-05-14T10:19:57.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.525+0000 7f57e37fe640 1 -- 172.21.15.154:0/1042550555 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0a97d0 con 0x7f57e40b3590 2024-05-14T10:19:57.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.525+0000 7f57eac43640 1 -- 172.21.15.154:0/1042550555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e40b3590 msgr2=0x7f57e40718a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:57.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.525+0000 7f57eac43640 1 --2- 172.21.15.154:0/1042550555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e40b3590 0x7f57e40718a0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f57e40d5190 tx=0x7f57dc01c690 comp rx=0 tx=0).stop 2024-05-14T10:19:57.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.525+0000 7f57eac43640 1 -- 172.21.15.154:0/1042550555 shutdown_connections 2024-05-14T10:19:57.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.525+0000 7f57eac43640 1 --2- 172.21.15.154:0/1042550555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57e4162a60 0x7f57e40d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.525+0000 7f57eac43640 1 --2- 172.21.15.154:0/1042550555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e40b3590 0x7f57e40718a0 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.525+0000 7f57eac43640 1 --2- 172.21.15.154:0/1042550555 >> v2:172.21.15.176:3300/0 conn(0x7f57e415e530 0x7f57e40d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.525+0000 7f57eac43640 1 -- 172.21.15.154:0/1042550555 >> 172.21.15.154:0/1042550555 conn(0x7f57e40b5b80 msgr2=0x7f57e40b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:19:57.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.525+0000 7f57eac43640 1 -- 172.21.15.154:0/1042550555 shutdown_connections 2024-05-14T10:19:57.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.525+0000 7f57eac43640 1 -- 172.21.15.154:0/1042550555 wait complete. 2024-05-14T10:19:57.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57eac43640 1 Processor -- start 2024-05-14T10:19:57.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57eac43640 1 -- start start 2024-05-14T10:19:57.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57eac43640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57e40b3590 0x7f57e4152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:57.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57eac43640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57e415e530 0x7f57e40cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:57.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57eac43640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e4162a60 0x7f57e4153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:57.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57eac43640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f57e40d2430 con 0x7f57e4162a60 2024-05-14T10:19:57.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57eac43640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f57e40d25b0 con 0x7f57e415e530 2024-05-14T10:19:57.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57eac43640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f57e40d2730 con 0x7f57e40b3590 2024-05-14T10:19:57.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57e89df640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57e40b3590 0x7f57e4152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:57.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57e89df640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57e40b3590 0x7f57e4152720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:45154/0 (socket says 172.21.15.154:45154) 2024-05-14T10:19:57.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57e89df640 1 -- 172.21.15.154:0/413426085 learned_addr learned my addr 172.21.15.154:0/413426085 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:19:57.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57e3fff640 1 --2- 172.21.15.154:0/413426085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57e415e530 0x7f57e40cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:57.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57e91e0640 1 --2- 172.21.15.154:0/413426085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e4162a60 0x7f57e4153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:57.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57e89df640 1 -- 172.21.15.154:0/413426085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57e415e530 msgr2=0x7f57e40cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:57.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57e89df640 1 --2- 172.21.15.154:0/413426085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57e415e530 0x7f57e40cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57e89df640 1 -- 172.21.15.154:0/413426085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e4162a60 msgr2=0x7f57e4153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:57.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57e89df640 1 --2- 172.21.15.154:0/413426085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e4162a60 0x7f57e4153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57e89df640 1 -- 172.21.15.154:0/413426085 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e415bcc0 con 0x7f57e40b3590 2024-05-14T10:19:57.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57e91e0640 1 --2- 172.21.15.154:0/413426085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e4162a60 0x7f57e4153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:19:57.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57e89df640 1 --2- 172.21.15.154:0/413426085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57e40b3590 0x7f57e4152720 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f57d800e8e0 tx=0x7f57d800eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:57.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57e17fa640 1 -- 172.21.15.154:0/413426085 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8017070 con 0x7f57e40b3590 2024-05-14T10:19:57.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57e17fa640 1 -- 172.21.15.154:0/413426085 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57d800ca00 con 0x7f57e40b3590 2024-05-14T10:19:57.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.529+0000 7f57e17fa640 1 -- 172.21.15.154:0/413426085 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d800cdb0 con 0x7f57e40b3590 2024-05-14T10:19:57.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.533+0000 7f57eac43640 1 -- 172.21.15.154:0/413426085 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e415bfa0 con 0x7f57e40b3590 2024-05-14T10:19:57.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.537+0000 7f57eac43640 1 -- 172.21.15.154:0/413426085 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e415c560 con 0x7f57e40b3590 2024-05-14T10:19:57.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.541+0000 7f57eac43640 1 -- 172.21.15.154:0/413426085 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e4075470 con 0x7f57e40b3590 2024-05-14T10:19:57.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.541+0000 7f57e17fa640 1 -- 172.21.15.154:0/413426085 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f57d801a070 con 0x7f57e40b3590 2024-05-14T10:19:57.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.541+0000 7f57e17fa640 1 --2- 172.21.15.154:0/413426085 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f57c80678f0 0x7f57c8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:57.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.541+0000 7f57e17fa640 1 -- 172.21.15.154:0/413426085 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f57d8085bb0 con 0x7f57e40b3590 2024-05-14T10:19:57.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.541+0000 7f57e3fff640 1 --2- 172.21.15.154:0/413426085 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f57c80678f0 0x7f57c8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:57.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.545+0000 7f57e3fff640 1 --2- 172.21.15.154:0/413426085 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f57c80678f0 0x7f57c8069db0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f57e40ce740 tx=0x7f57d0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:57.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.633+0000 7f57e17fa640 1 -- 172.21.15.154:0/413426085 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f57d8056210 con 0x7f57e40b3590 2024-05-14T10:19:57.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.849+0000 7f57eac43640 1 -- 172.21.15.154:0/413426085 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f57e415f780 con 0x7f57e40b3590 2024-05-14T10:19:57.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.901+0000 7f57e17fa640 1 -- 172.21.15.154:0/413426085 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) ==== 100+0+11 (secure 0 0 0) 0x7f57d805a510 con 0x7f57e40b3590 2024-05-14T10:19:57.909 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-05-14T10:19:57.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.905+0000 7f57eac43640 1 -- 172.21.15.154:0/413426085 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f57c80678f0 msgr2=0x7f57c8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:57.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.905+0000 7f57eac43640 1 --2- 172.21.15.154:0/413426085 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f57c80678f0 0x7f57c8069db0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f57e40ce740 tx=0x7f57d0009190 comp rx=0 tx=0).stop 2024-05-14T10:19:57.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.905+0000 7f57eac43640 1 -- 172.21.15.154:0/413426085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57e40b3590 msgr2=0x7f57e4152720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:57.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.905+0000 7f57eac43640 1 --2- 172.21.15.154:0/413426085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57e40b3590 0x7f57e4152720 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f57d800e8e0 tx=0x7f57d800eda0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.905+0000 7f57eac43640 1 -- 172.21.15.154:0/413426085 shutdown_connections 2024-05-14T10:19:57.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.905+0000 7f57eac43640 1 --2- 172.21.15.154:0/413426085 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f57c80678f0 0x7f57c8069db0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.905+0000 7f57eac43640 1 --2- 172.21.15.154:0/413426085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e4162a60 0x7f57e4153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.905+0000 7f57eac43640 1 --2- 172.21.15.154:0/413426085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57e415e530 0x7f57e40cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.905+0000 7f57eac43640 1 --2- 172.21.15.154:0/413426085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57e40b3590 0x7f57e4152720 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:57.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.905+0000 7f57eac43640 1 -- 172.21.15.154:0/413426085 >> 172.21.15.154:0/413426085 conn(0x7f57e40b5b80 msgr2=0x7f57e40b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:19:57.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.905+0000 7f57eac43640 1 -- 172.21.15.154:0/413426085 shutdown_connections 2024-05-14T10:19:57.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:57.905+0000 7f57eac43640 1 -- 172.21.15.154:0/413426085 wait complete. 2024-05-14T10:19:57.934 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T10:19:58.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd3b27640 1 Processor -- start 2024-05-14T10:19:58.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd3b27640 1 -- start start 2024-05-14T10:19:58.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd3b27640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7febcc0cf7a0 0x7febcc166d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:58.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd3b27640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febcc0b5080 con 0x7febcc1456c0 2024-05-14T10:19:58.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd3b27640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febcc0b40d0 con 0x7febcc0b3b30 2024-05-14T10:19:58.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd3b27640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7febcc0ce2d0 con 0x7febcc0cf7a0 2024-05-14T10:19:58.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd18c3640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7febcc1456c0 0x7febcc06cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52252/0 (socket says 172.21.15.154:52252) 2024-05-14T10:19:58.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd18c3640 1 -- 172.21.15.154:0/400224251 learned_addr learned my addr 172.21.15.154:0/400224251 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:19:58.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd20c4640 1 --2- 172.21.15.154:0/400224251 >> v2:172.21.15.176:3300/0 conn(0x7febcc0cf7a0 0x7febcc166d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:58.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd08c1640 1 -- 172.21.15.154:0/400224251 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3489985322 0 0) 0x7febcc0b5080 con 0x7febcc1456c0 2024-05-14T10:19:58.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd08c1640 1 -- 172.21.15.154:0/400224251 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febb8003530 con 0x7febcc1456c0 2024-05-14T10:19:58.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd08c1640 1 -- 172.21.15.154:0/400224251 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 259333197 0 0) 0x7febb8003530 con 0x7febcc1456c0 2024-05-14T10:19:58.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd08c1640 1 -- 172.21.15.154:0/400224251 >> v2:172.21.15.176:3300/0 conn(0x7febcc0cf7a0 msgr2=0x7febcc166d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:19:58.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd08c1640 1 --2- 172.21.15.154:0/400224251 >> v2:172.21.15.176:3300/0 conn(0x7febcc0cf7a0 0x7febcc166d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:58.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd08c1640 1 -- 172.21.15.154:0/400224251 >> v1:172.21.15.176:6789/0 conn(0x7febcc0b3b30 legacy=0x7febcc0cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:58.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd08c1640 1 -- 172.21.15.154:0/400224251 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febcc0ce5b0 con 0x7febcc1456c0 2024-05-14T10:19:58.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd08c1640 1 -- 172.21.15.154:0/400224251 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7febc8001680 con 0x7febcc1456c0 2024-05-14T10:19:58.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd08c1640 1 -- 172.21.15.154:0/400224251 >> v1:172.21.15.154:6789/0 conn(0x7febcc1456c0 legacy=0x7febcc06cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:58.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd08c1640 1 --2- 172.21.15.154:0/400224251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febb80039c0 0x7febb8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:58.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd08c1640 1 --2- 172.21.15.154:0/400224251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febb8004810 0x7febb8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:58.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd08c1640 1 --2- 172.21.15.154:0/400224251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb80051d0 0x7febb800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:58.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd08c1640 1 -- 172.21.15.154:0/400224251 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7febcc0ce2d0 con 0x7febb80039c0 2024-05-14T10:19:58.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd08c1640 1 -- 172.21.15.154:0/400224251 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7febb800c070 con 0x7febb80051d0 2024-05-14T10:19:58.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd08c1640 1 -- 172.21.15.154:0/400224251 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7febb800c270 con 0x7febb8004810 2024-05-14T10:19:58.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd18c3640 1 --2- 172.21.15.154:0/400224251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febb80039c0 0x7febb8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:58.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd20c4640 1 --2- 172.21.15.154:0/400224251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb80051d0 0x7febb800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:58.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd10c2640 1 --2- 172.21.15.154:0/400224251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febb8004810 0x7febb8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:58.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd18c3640 1 -- 172.21.15.154:0/400224251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febb8004810 msgr2=0x7febb8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:19:58.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd18c3640 1 --2- 172.21.15.154:0/400224251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febb8004810 0x7febb8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:58.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd18c3640 1 -- 172.21.15.154:0/400224251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb80051d0 msgr2=0x7febb800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:19:58.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd18c3640 1 --2- 172.21.15.154:0/400224251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb80051d0 0x7febb800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:58.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd18c3640 1 -- 172.21.15.154:0/400224251 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb8003530 con 0x7febb80039c0 2024-05-14T10:19:58.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd20c4640 1 --2- 172.21.15.154:0/400224251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb80051d0 0x7febb800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:19:58.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.061+0000 7febd20c4640 1 -- 172.21.15.154:0/400224251 reap_dead start 2024-05-14T10:19:58.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.065+0000 7febd18c3640 1 --2- 172.21.15.154:0/400224251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febb80039c0 0x7febb8003de0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7febc800c1c0 tx=0x7febc801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef58ac858ff7b56 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:58.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.065+0000 7febd08c1640 1 -- 172.21.15.154:0/400224251 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8007d00 con 0x7febb80039c0 2024-05-14T10:19:58.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.065+0000 7febd08c1640 1 -- 172.21.15.154:0/400224251 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc80a9020 con 0x7febb80039c0 2024-05-14T10:19:58.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.065+0000 7febd08c1640 1 -- 172.21.15.154:0/400224251 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febcc06d3f0 con 0x7febb80039c0 2024-05-14T10:19:58.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.065+0000 7febd3b27640 1 -- 172.21.15.154:0/400224251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febb80039c0 msgr2=0x7febb8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:58.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.065+0000 7febd3b27640 1 --2- 172.21.15.154:0/400224251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febb80039c0 0x7febb8003de0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7febc800c1c0 tx=0x7febc801cc20 comp rx=0 tx=0).stop 2024-05-14T10:19:58.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.065+0000 7febd3b27640 1 -- 172.21.15.154:0/400224251 shutdown_connections 2024-05-14T10:19:58.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.065+0000 7febd3b27640 1 --2- 172.21.15.154:0/400224251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febb80039c0 0x7febb8003de0 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:58.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.065+0000 7febd3b27640 1 -- 172.21.15.154:0/400224251 >> 172.21.15.154:0/400224251 conn(0x7febcc0b1850 msgr2=0x7febcc0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:19:58.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.065+0000 7febd3b27640 1 -- 172.21.15.154:0/400224251 shutdown_connections 2024-05-14T10:19:58.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.065+0000 7febd3b27640 1 -- 172.21.15.154:0/400224251 wait complete. 2024-05-14T10:19:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.065+0000 7febd3b27640 1 Processor -- start 2024-05-14T10:19:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd3b27640 1 -- start start 2024-05-14T10:19:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd3b27640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febb80039c0 0x7febcc139300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd3b27640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febcc13be20 0x7febcc139840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd3b27640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febcc137a70 0x7febcc137ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd3b27640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7febcc0cf620 con 0x7febcc13be20 2024-05-14T10:19:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd3b27640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7febcc0cf4a0 con 0x7febcc137a70 2024-05-14T10:19:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd3b27640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7febcc15c420 con 0x7febb80039c0 2024-05-14T10:19:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd10c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febcc13be20 0x7febcc139840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd10c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febcc13be20 0x7febcc139840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56562/0 (socket says 172.21.15.154:56562) 2024-05-14T10:19:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd10c2640 1 -- 172.21.15.154:0/3373842046 learned_addr learned my addr 172.21.15.154:0/3373842046 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:19:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd20c4640 1 --2- 172.21.15.154:0/3373842046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febcc137a70 0x7febcc137ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd10c2640 1 -- 172.21.15.154:0/3373842046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febb80039c0 msgr2=0x7febcc139300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd10c2640 1 --2- 172.21.15.154:0/3373842046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febb80039c0 0x7febcc139300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd10c2640 1 -- 172.21.15.154:0/3373842046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febcc137a70 msgr2=0x7febcc137ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd10c2640 1 --2- 172.21.15.154:0/3373842046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febcc137a70 0x7febcc137ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd10c2640 1 -- 172.21.15.154:0/3373842046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febcc13b080 con 0x7febcc13be20 2024-05-14T10:19:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd10c2640 1 --2- 172.21.15.154:0/3373842046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febcc13be20 0x7febcc139840 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7febbc00e580 tx=0x7febbc00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febc27fc640 1 -- 172.21.15.154:0/3373842046 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc0052e0 con 0x7febcc13be20 2024-05-14T10:19:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febc27fc640 1 -- 172.21.15.154:0/3373842046 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febbc018070 con 0x7febcc13be20 2024-05-14T10:19:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd3b27640 1 -- 172.21.15.154:0/3373842046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febcc151390 con 0x7febcc13be20 2024-05-14T10:19:58.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febc27fc640 1 -- 172.21.15.154:0/3373842046 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc003820 con 0x7febcc13be20 2024-05-14T10:19:58.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd3b27640 1 -- 172.21.15.154:0/3373842046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febcc13b620 con 0x7febcc13be20 2024-05-14T10:19:58.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.069+0000 7febd3b27640 1 -- 172.21.15.154:0/3373842046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febcc075470 con 0x7febcc13be20 2024-05-14T10:19:58.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.229+0000 7febc27fc640 1 -- 172.21.15.154:0/3373842046 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7febbc0039c0 con 0x7febcc13be20 2024-05-14T10:19:58.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.229+0000 7febc27fc640 1 --2- 172.21.15.154:0/3373842046 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7febb00678c0 0x7febb0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:58.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.229+0000 7febc27fc640 1 -- 172.21.15.154:0/3373842046 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7febbc0863e0 con 0x7febcc13be20 2024-05-14T10:19:58.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.229+0000 7febd18c3640 1 --2- 172.21.15.154:0/3373842046 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7febb00678c0 0x7febb0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:58.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.229+0000 7febd18c3640 1 --2- 172.21.15.154:0/3373842046 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7febb00678c0 0x7febb0069d80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7febc80aa000 tx=0x7febcc0ce780 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:58.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.229+0000 7febc27fc640 1 -- 172.21.15.154:0/3373842046 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7febbc056fb0 con 0x7febcc13be20 2024-05-14T10:19:58.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.513+0000 7febd3b27640 1 -- 172.21.15.154:0/3373842046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febcc0b11f0 con 0x7febcc13be20 2024-05-14T10:19:58.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.513+0000 7febc27fc640 1 -- 172.21.15.154:0/3373842046 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5190 (secure 0 0 0) 0x7febbc005480 con 0x7febcc13be20 2024-05-14T10:19:58.521 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:19:58.521 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3153095738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3153095738},{"type":"v1","addr":"172.21.15.176:6835","nonce":3153095738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1660216913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":1660216913},{"type":"v1","addr":"172.21.15.176:6834","nonce":1660216913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1431439777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1431439777},{"type":"v1","addr":"172.21.15.154:6837","nonce":1431439777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T01:24:32.952086+0000","modified":"2024-05-14T01:24:36.000491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5124":{"gid":5124,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6836/848393842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":848393842},{"type":"v1","addr":"172.21.15.154:6836","nonce":848393842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5124,"qdb_cluster":[5124]},"id":2}]} 2024-05-14T10:19:58.521 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 17 2024-05-14T10:19:58.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.517+0000 7febd3b27640 1 -- 172.21.15.154:0/3373842046 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7febb00678c0 msgr2=0x7febb0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:58.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.517+0000 7febd3b27640 1 --2- 172.21.15.154:0/3373842046 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7febb00678c0 0x7febb0069d80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7febc80aa000 tx=0x7febcc0ce780 comp rx=0 tx=0).stop 2024-05-14T10:19:58.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.517+0000 7febd3b27640 1 -- 172.21.15.154:0/3373842046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febcc13be20 msgr2=0x7febcc139840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:58.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.517+0000 7febd3b27640 1 --2- 172.21.15.154:0/3373842046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febcc13be20 0x7febcc139840 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7febbc00e580 tx=0x7febbc00ea40 comp rx=0 tx=0).stop 2024-05-14T10:19:58.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.517+0000 7febd3b27640 1 -- 172.21.15.154:0/3373842046 shutdown_connections 2024-05-14T10:19:58.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.517+0000 7febd3b27640 1 --2- 172.21.15.154:0/3373842046 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7febb00678c0 0x7febb0069d80 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:58.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.517+0000 7febd3b27640 1 --2- 172.21.15.154:0/3373842046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febcc137a70 0x7febcc137ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:58.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.517+0000 7febd3b27640 1 --2- 172.21.15.154:0/3373842046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febcc13be20 0x7febcc139840 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:58.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.517+0000 7febd3b27640 1 --2- 172.21.15.154:0/3373842046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febb80039c0 0x7febcc139300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:58.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.517+0000 7febd3b27640 1 -- 172.21.15.154:0/3373842046 >> 172.21.15.154:0/3373842046 conn(0x7febcc0b1850 msgr2=0x7febcc0b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:19:58.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.517+0000 7febd3b27640 1 -- 172.21.15.154:0/3373842046 shutdown_connections 2024-05-14T10:19:58.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.517+0000 7febd3b27640 1 -- 172.21.15.154:0/3373842046 wait complete. 2024-05-14T10:19:58.548 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T10:19:58.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.677+0000 7f7d3c142640 1 Processor -- start 2024-05-14T10:19:58.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.677+0000 7f7d3c142640 1 -- start start 2024-05-14T10:19:58.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.677+0000 7f7d3c142640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7d3415ae90 0x7f7d340aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:58.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.677+0000 7f7d3c142640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3415b270 0x7f7d3406c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:58.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.677+0000 7f7d3c142640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d340cc420 con 0x7f7d340aeff0 2024-05-14T10:19:58.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.677+0000 7f7d3c142640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7d3415ebc0 con 0x7f7d3415ae90 2024-05-14T10:19:58.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.677+0000 7f7d3c142640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7d340cc700 con 0x7f7d3415b270 2024-05-14T10:19:58.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.677+0000 7f7d39ede640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7d3415ae90 0x7f7d340aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:58.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.677+0000 7f7d3a6df640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3415b270 0x7f7d3406c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:58.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.677+0000 7f7d3a6df640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3415b270 0x7f7d3406c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:45180/0 (socket says 172.21.15.154:45180) 2024-05-14T10:19:58.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.677+0000 7f7d3a6df640 1 -- 172.21.15.154:0/1346862326 learned_addr learned my addr 172.21.15.154:0/1346862326 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:19:58.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.681+0000 7f7d39ede640 1 -- 172.21.15.154:0/1346862326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3415b270 msgr2=0x7f7d3406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:19:58.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.681+0000 7f7d39ede640 1 --2- 172.21.15.154:0/1346862326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3415b270 0x7f7d3406c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:58.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.681+0000 7f7d39ede640 1 -- 172.21.15.154:0/1346862326 >> v1:172.21.15.176:6789/0 conn(0x7f7d340aeff0 legacy=0x7f7d340cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:19:58.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.681+0000 7f7d39ede640 1 -- 172.21.15.154:0/1346862326 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d340cc9e0 con 0x7f7d3415ae90 2024-05-14T10:19:58.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.681+0000 7f7d39ede640 1 --2- 172.21.15.154:0/1346862326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d3415ae90 0x7f7d340aeab0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f7d300097c0 tx=0x7f7d3001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af1df13cf12778b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:58.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.681+0000 7f7d38edc640 1 -- 172.21.15.154:0/1346862326 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d300b0070 con 0x7f7d3415ae90 2024-05-14T10:19:58.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.681+0000 7f7d38edc640 1 -- 172.21.15.154:0/1346862326 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d300ab600 con 0x7f7d3415ae90 2024-05-14T10:19:58.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.681+0000 7f7d38edc640 1 -- 172.21.15.154:0/1346862326 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d300ab9d0 con 0x7f7d3415ae90 2024-05-14T10:19:58.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.685+0000 7f7d3c142640 1 -- 172.21.15.154:0/1346862326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d3415ae90 msgr2=0x7f7d340aeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:58.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.685+0000 7f7d3c142640 1 --2- 172.21.15.154:0/1346862326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d3415ae90 0x7f7d340aeab0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f7d300097c0 tx=0x7f7d3001c430 comp rx=0 tx=0).stop 2024-05-14T10:19:58.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.685+0000 7f7d3c142640 1 -- 172.21.15.154:0/1346862326 shutdown_connections 2024-05-14T10:19:58.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.685+0000 7f7d3c142640 1 --2- 172.21.15.154:0/1346862326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3415b270 0x7f7d3406c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:58.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.685+0000 7f7d3c142640 1 --2- 172.21.15.154:0/1346862326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d3415ae90 0x7f7d340aeab0 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:58.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.685+0000 7f7d3c142640 1 -- 172.21.15.154:0/1346862326 >> 172.21.15.154:0/1346862326 conn(0x7f7d34072050 msgr2=0x7f7d34072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:19:58.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.685+0000 7f7d3c142640 1 -- 172.21.15.154:0/1346862326 shutdown_connections 2024-05-14T10:19:58.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.685+0000 7f7d3c142640 1 -- 172.21.15.154:0/1346862326 wait complete. 2024-05-14T10:19:58.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.685+0000 7f7d3c142640 1 Processor -- start 2024-05-14T10:19:58.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d3c142640 1 -- start start 2024-05-14T10:19:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d3c142640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d340aeff0 0x7f7d34151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d3c142640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3415ae90 0x7f7d3415c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d3c142640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3415b270 0x7f7d34153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d3c142640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3415f9e0 con 0x7f7d340aeff0 2024-05-14T10:19:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d3c142640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3415f860 con 0x7f7d3415b270 2024-05-14T10:19:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d3c142640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7d34165ef0 con 0x7f7d3415ae90 2024-05-14T10:19:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d39ede640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d340aeff0 0x7f7d34151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d39ede640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d340aeff0 0x7f7d34151a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56590/0 (socket says 172.21.15.154:56590) 2024-05-14T10:19:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d39ede640 1 -- 172.21.15.154:0/3125666851 learned_addr learned my addr 172.21.15.154:0/3125666851 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:19:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d3a6df640 1 --2- 172.21.15.154:0/3125666851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3415b270 0x7f7d34153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d39ede640 1 -- 172.21.15.154:0/3125666851 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3415ae90 msgr2=0x7f7d3415c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d39ede640 1 --2- 172.21.15.154:0/3125666851 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3415ae90 0x7f7d3415c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d39ede640 1 -- 172.21.15.154:0/3125666851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3415b270 msgr2=0x7f7d34153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d39ede640 1 --2- 172.21.15.154:0/3125666851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3415b270 0x7f7d34153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d39ede640 1 -- 172.21.15.154:0/3125666851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d340b1340 con 0x7f7d340aeff0 2024-05-14T10:19:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d39ede640 1 --2- 172.21.15.154:0/3125666851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d340aeff0 0x7f7d34151a60 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f7d300ae040 tx=0x7f7d3001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d2a7fc640 1 -- 172.21.15.154:0/3125666851 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d300b0050 con 0x7f7d340aeff0 2024-05-14T10:19:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d3c142640 1 -- 172.21.15.154:0/3125666851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3415b910 con 0x7f7d340aeff0 2024-05-14T10:19:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d2a7fc640 1 -- 172.21.15.154:0/3125666851 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d300bc070 con 0x7f7d340aeff0 2024-05-14T10:19:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d2a7fc640 1 -- 172.21.15.154:0/3125666851 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d300b5850 con 0x7f7d340aeff0 2024-05-14T10:19:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d3c142640 1 -- 172.21.15.154:0/3125666851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d3415bed0 con 0x7f7d340aeff0 2024-05-14T10:19:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.689+0000 7f7d3c142640 1 -- 172.21.15.154:0/3125666851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d34068360 con 0x7f7d340aeff0 2024-05-14T10:19:58.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.833+0000 7f7d2a7fc640 1 -- 172.21.15.154:0/3125666851 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7d300b59f0 con 0x7f7d340aeff0 2024-05-14T10:19:58.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.833+0000 7f7d2a7fc640 1 --2- 172.21.15.154:0/3125666851 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7d20067a20 0x7f7d20069ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:58.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.833+0000 7f7d2a7fc640 1 -- 172.21.15.154:0/3125666851 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7d30120fd0 con 0x7f7d340aeff0 2024-05-14T10:19:58.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.833+0000 7f7d396dd640 1 --2- 172.21.15.154:0/3125666851 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7d20067a20 0x7f7d20069ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.833+0000 7f7d396dd640 1 --2- 172.21.15.154:0/3125666851 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7d20067a20 0x7f7d20069ee0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f7d340cf990 tx=0x7f7d240079e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:58.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:58.837+0000 7f7d2a7fc640 1 -- 172.21.15.154:0/3125666851 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f7d30016050 con 0x7f7d340aeff0 2024-05-14T10:19:59.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.077+0000 7f7d3c142640 1 -- 172.21.15.154:0/3125666851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d340730f0 con 0x7f7d340aeff0 2024-05-14T10:19:59.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.113+0000 7f7d2a7fc640 1 -- 172.21.15.154:0/3125666851 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16717 (secure 0 0 0) 0x7f7d300f19e0 con 0x7f7d340aeff0 2024-05-14T10:19:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:19:59.120 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":34,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:24:34.630046+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:24:31.391789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-14T01:24:31.927579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T10:19:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.117+0000 7f7d3c142640 1 -- 172.21.15.154:0/3125666851 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7d20067a20 msgr2=0x7f7d20069ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.117+0000 7f7d3c142640 1 --2- 172.21.15.154:0/3125666851 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7d20067a20 0x7f7d20069ee0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f7d340cf990 tx=0x7f7d240079e0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.117+0000 7f7d3c142640 1 -- 172.21.15.154:0/3125666851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d340aeff0 msgr2=0x7f7d34151a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.117+0000 7f7d3c142640 1 --2- 172.21.15.154:0/3125666851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d340aeff0 0x7f7d34151a60 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f7d300ae040 tx=0x7f7d3001ac70 comp rx=0 tx=0).stop 2024-05-14T10:19:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.117+0000 7f7d3c142640 1 -- 172.21.15.154:0/3125666851 shutdown_connections 2024-05-14T10:19:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.117+0000 7f7d3c142640 1 --2- 172.21.15.154:0/3125666851 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f7d20067a20 0x7f7d20069ee0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.117+0000 7f7d3c142640 1 --2- 172.21.15.154:0/3125666851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3415b270 0x7f7d34153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.117+0000 7f7d3c142640 1 --2- 172.21.15.154:0/3125666851 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3415ae90 0x7f7d3415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.117+0000 7f7d3c142640 1 --2- 172.21.15.154:0/3125666851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d340aeff0 0x7f7d34151a60 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.117+0000 7f7d3c142640 1 -- 172.21.15.154:0/3125666851 >> 172.21.15.154:0/3125666851 conn(0x7f7d34072050 msgr2=0x7f7d340b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:19:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.117+0000 7f7d3c142640 1 -- 172.21.15.154:0/3125666851 shutdown_connections 2024-05-14T10:19:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.117+0000 7f7d3c142640 1 -- 172.21.15.154:0/3125666851 wait complete. 2024-05-14T10:19:59.150 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-14T10:19:59.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T10:19:59.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.293+0000 7f04a6b02640 1 Processor -- start 2024-05-14T10:19:59.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.293+0000 7f04a6b02640 1 -- start start 2024-05-14T10:19:59.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.293+0000 7f04a6b02640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04a015b270 0x7f04a00cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:59.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.293+0000 7f04a489e640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f04a015ae90 0x7f04a00aeab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:55090/0 (socket says 172.21.15.154:55090) 2024-05-14T10:19:59.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.293+0000 7f049ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04a015b270 0x7f04a00cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:59.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.293+0000 7f049ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04a015b270 0x7f04a00cb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56598/0 (socket says 172.21.15.154:56598) 2024-05-14T10:19:59.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.293+0000 7f04a509f640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f04a00cbb60 0x7f04a006c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52266/0 (socket says 172.21.15.154:52266) 2024-05-14T10:19:59.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.293+0000 7f04a6b02640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04a00cc420 con 0x7f04a00cbb60 2024-05-14T10:19:59.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.293+0000 7f04a6b02640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04a00cc700 con 0x7f04a015ae90 2024-05-14T10:19:59.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.293+0000 7f04a6b02640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f04a015ebc0 con 0x7f04a015b270 2024-05-14T10:19:59.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.293+0000 7f04a489e640 1 -- 172.21.15.154:0/3884763722 learned_addr learned my addr 172.21.15.154:0/3884763722 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:19:59.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.293+0000 7f049ffff640 1 -- 172.21.15.154:0/3884763722 >> v1:172.21.15.176:6789/0 conn(0x7f04a015ae90 legacy=0x7f04a00aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:59.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.293+0000 7f049f7fe640 1 -- 172.21.15.154:0/3884763722 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2524097383 0 0) 0x7f04a00cc700 con 0x7f04a015ae90 2024-05-14T10:19:59.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.293+0000 7f049ffff640 1 -- 172.21.15.154:0/3884763722 >> v1:172.21.15.154:6789/0 conn(0x7f04a00cbb60 legacy=0x7f04a006c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:59.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.293+0000 7f049ffff640 1 -- 172.21.15.154:0/3884763722 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a00cc9e0 con 0x7f04a015b270 2024-05-14T10:19:59.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.297+0000 7f049ffff640 1 --2- 172.21.15.154:0/3884763722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04a015b270 0x7f04a00cb620 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f048c0097c0 tx=0x7f048c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8dbf66dfeb35733 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.301+0000 7f049f7fe640 1 -- 172.21.15.154:0/3884763722 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c0b0070 con 0x7f04a015b270 2024-05-14T10:19:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.301+0000 7f049f7fe640 1 -- 172.21.15.154:0/3884763722 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048c0ab600 con 0x7f04a015b270 2024-05-14T10:19:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.301+0000 7f049f7fe640 1 -- 172.21.15.154:0/3884763722 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c0ab9d0 con 0x7f04a015b270 2024-05-14T10:19:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.305+0000 7f04a6b02640 1 -- 172.21.15.154:0/3884763722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04a015b270 msgr2=0x7f04a00cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.305+0000 7f04a6b02640 1 --2- 172.21.15.154:0/3884763722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04a015b270 0x7f04a00cb620 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f048c0097c0 tx=0x7f048c01c330 comp rx=0 tx=0).stop 2024-05-14T10:19:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.305+0000 7f04a6b02640 1 -- 172.21.15.154:0/3884763722 shutdown_connections 2024-05-14T10:19:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.305+0000 7f04a6b02640 1 --2- 172.21.15.154:0/3884763722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04a015b270 0x7f04a00cb620 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.305+0000 7f04a6b02640 1 -- 172.21.15.154:0/3884763722 >> 172.21.15.154:0/3884763722 conn(0x7f04a0072050 msgr2=0x7f04a0072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:19:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.305+0000 7f04a6b02640 1 -- 172.21.15.154:0/3884763722 shutdown_connections 2024-05-14T10:19:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.305+0000 7f04a6b02640 1 -- 172.21.15.154:0/3884763722 wait complete. 2024-05-14T10:19:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.305+0000 7f04a6b02640 1 Processor -- start 2024-05-14T10:19:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.305+0000 7f04a6b02640 1 -- start start 2024-05-14T10:19:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a6b02640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04a00cbb60 0x7f04a006f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a6b02640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04a015ae90 0x7f04a014ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a6b02640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04a015b270 0x7f04a014b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a6b02640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f04a00cc0b0 con 0x7f04a00cbb60 2024-05-14T10:19:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a489e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04a00cbb60 0x7f04a006f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a489e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04a00cbb60 0x7f04a006f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56600/0 (socket says 172.21.15.154:56600) 2024-05-14T10:19:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a489e640 1 -- 172.21.15.154:0/3176786862 learned_addr learned my addr 172.21.15.154:0/3176786862 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:19:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f049ffff640 1 --2- 172.21.15.154:0/3176786862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04a015ae90 0x7f04a014ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a6b02640 1 -- 172.21.15.154:0/3176786862 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f04a00af1c0 con 0x7f04a015b270 2024-05-14T10:19:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a6b02640 1 -- 172.21.15.154:0/3176786862 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f04a006c9a0 con 0x7f04a015ae90 2024-05-14T10:19:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a509f640 1 --2- 172.21.15.154:0/3176786862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04a015b270 0x7f04a014b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:59.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a489e640 1 -- 172.21.15.154:0/3176786862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04a015ae90 msgr2=0x7f04a014ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:59.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a489e640 1 --2- 172.21.15.154:0/3176786862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04a015ae90 0x7f04a014ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a489e640 1 -- 172.21.15.154:0/3176786862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04a015b270 msgr2=0x7f04a014b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:59.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a489e640 1 --2- 172.21.15.154:0/3176786862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04a015b270 0x7f04a014b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a489e640 1 -- 172.21.15.154:0/3176786862 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a00b6440 con 0x7f04a00cbb60 2024-05-14T10:19:59.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f049ffff640 1 --2- 172.21.15.154:0/3176786862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04a015ae90 0x7f04a014ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T10:19:59.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a509f640 1 --2- 172.21.15.154:0/3176786862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04a015b270 0x7f04a014b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T10:19:59.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a489e640 1 --2- 172.21.15.154:0/3176786862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04a00cbb60 0x7f04a006f490 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f049400c4a0 tx=0x7f049400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:59.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f049d7fa640 1 -- 172.21.15.154:0/3176786862 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494018070 con 0x7f04a00cbb60 2024-05-14T10:19:59.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f049d7fa640 1 -- 172.21.15.154:0/3176786862 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04940074e0 con 0x7f04a00cbb60 2024-05-14T10:19:59.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f049d7fa640 1 -- 172.21.15.154:0/3176786862 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494004a30 con 0x7f04a00cbb60 2024-05-14T10:19:59.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a6b02640 1 -- 172.21.15.154:0/3176786862 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a00b6720 con 0x7f04a00cbb60 2024-05-14T10:19:59.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.309+0000 7f04a6b02640 1 -- 172.21.15.154:0/3176786862 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a01340c0 con 0x7f04a00cbb60 2024-05-14T10:19:59.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.313+0000 7f04a6b02640 1 -- 172.21.15.154:0/3176786862 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a0068360 con 0x7f04a00cbb60 2024-05-14T10:19:59.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.361+0000 7f049d7fa640 1 -- 172.21.15.154:0/3176786862 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0494004bd0 con 0x7f04a00cbb60 2024-05-14T10:19:59.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.361+0000 7f049d7fa640 1 --2- 172.21.15.154:0/3176786862 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f04840678c0 0x7f0484069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:59.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.361+0000 7f049d7fa640 1 -- 172.21.15.154:0/3176786862 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f04940853c0 con 0x7f04a00cbb60 2024-05-14T10:19:59.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.365+0000 7f049ffff640 1 --2- 172.21.15.154:0/3176786862 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f04840678c0 0x7f0484069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:59.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.369+0000 7f049ffff640 1 --2- 172.21.15.154:0/3176786862 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f04840678c0 0x7f0484069d80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f048c0ad000 tx=0x7f048c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:59.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.369+0000 7f049d7fa640 1 -- 172.21.15.154:0/3176786862 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f0494021020 con 0x7f04a00cbb60 2024-05-14T10:19:59.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.669+0000 7f04a6b02640 1 -- 172.21.15.154:0/3176786862 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04a00730f0 con 0x7f04a00cbb60 2024-05-14T10:19:59.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.669+0000 7f049d7fa640 1 -- 172.21.15.154:0/3176786862 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5190 (secure 0 0 0) 0x7f0494055920 con 0x7f04a00cbb60 2024-05-14T10:19:59.675 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:19:59.675 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3153095738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3153095738},{"type":"v1","addr":"172.21.15.176:6835","nonce":3153095738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1660216913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":1660216913},{"type":"v1","addr":"172.21.15.176:6834","nonce":1660216913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1431439777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1431439777},{"type":"v1","addr":"172.21.15.154:6837","nonce":1431439777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T01:24:32.952086+0000","modified":"2024-05-14T01:24:36.000491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5124":{"gid":5124,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6836/848393842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":848393842},{"type":"v1","addr":"172.21.15.154:6836","nonce":848393842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5124,"qdb_cluster":[5124]},"id":2}]} 2024-05-14T10:19:59.675 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 17 2024-05-14T10:19:59.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.673+0000 7f04a6b02640 1 -- 172.21.15.154:0/3176786862 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f04840678c0 msgr2=0x7f0484069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:59.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.673+0000 7f04a6b02640 1 --2- 172.21.15.154:0/3176786862 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f04840678c0 0x7f0484069d80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f048c0ad000 tx=0x7f048c0a6000 comp rx=0 tx=0).stop 2024-05-14T10:19:59.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.673+0000 7f04a6b02640 1 -- 172.21.15.154:0/3176786862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04a00cbb60 msgr2=0x7f04a006f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:59.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.673+0000 7f04a6b02640 1 --2- 172.21.15.154:0/3176786862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04a00cbb60 0x7f04a006f490 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f049400c4a0 tx=0x7f049400c960 comp rx=0 tx=0).stop 2024-05-14T10:19:59.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.677+0000 7f04a6b02640 1 -- 172.21.15.154:0/3176786862 shutdown_connections 2024-05-14T10:19:59.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.677+0000 7f04a6b02640 1 --2- 172.21.15.154:0/3176786862 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f04840678c0 0x7f0484069d80 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.677+0000 7f04a6b02640 1 --2- 172.21.15.154:0/3176786862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04a015b270 0x7f04a014b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.677+0000 7f04a6b02640 1 --2- 172.21.15.154:0/3176786862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04a015ae90 0x7f04a014ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.677+0000 7f04a6b02640 1 --2- 172.21.15.154:0/3176786862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04a00cbb60 0x7f04a006f490 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.677+0000 7f04a6b02640 1 -- 172.21.15.154:0/3176786862 >> 172.21.15.154:0/3176786862 conn(0x7f04a0072050 msgr2=0x7f04a00b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:19:59.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.677+0000 7f04a6b02640 1 -- 172.21.15.154:0/3176786862 shutdown_connections 2024-05-14T10:19:59.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.677+0000 7f04a6b02640 1 -- 172.21.15.154:0/3176786862 wait complete. 2024-05-14T10:19:59.705 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T10:19:59.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.841+0000 7f1c283e6640 1 Processor -- start 2024-05-14T10:19:59.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.841+0000 7f1c283e6640 1 -- start start 2024-05-14T10:19:59.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c283e6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c2015ae90 0x7f1c200aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:59.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c283e6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c200aeff0 0x7f1c200cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:59.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c283e6640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1c2015b270 0x7f1c2006c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:59.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c283e6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1c2015ebc0 con 0x7f1c2015ae90 2024-05-14T10:19:59.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c283e6640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1c200cc420 con 0x7f1c2015b270 2024-05-14T10:19:59.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c283e6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1c200cc700 con 0x7f1c200aeff0 2024-05-14T10:19:59.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c26182640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c2015ae90 0x7f1c200aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:59.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c26182640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c2015ae90 0x7f1c200aeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56610/0 (socket says 172.21.15.154:56610) 2024-05-14T10:19:59.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c26182640 1 -- 172.21.15.154:0/840335321 learned_addr learned my addr 172.21.15.154:0/840335321 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:19:59.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c25981640 1 --2- 172.21.15.154:0/840335321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c200aeff0 0x7f1c200cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:59.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c26983640 1 --2- 172.21.15.154:0/840335321 >> v2:172.21.15.176:3300/0 conn(0x7f1c2015b270 0x7f1c2006c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:59.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c26182640 1 -- 172.21.15.154:0/840335321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c200aeff0 msgr2=0x7f1c200cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:19:59.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c26182640 1 --2- 172.21.15.154:0/840335321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c200aeff0 0x7f1c200cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c26182640 1 -- 172.21.15.154:0/840335321 >> v2:172.21.15.176:3300/0 conn(0x7f1c2015b270 msgr2=0x7f1c2006c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:19:59.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c26182640 1 --2- 172.21.15.154:0/840335321 >> v2:172.21.15.176:3300/0 conn(0x7f1c2015b270 0x7f1c2006c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c26182640 1 -- 172.21.15.154:0/840335321 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c200cc9e0 con 0x7f1c2015ae90 2024-05-14T10:19:59.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c26983640 1 --2- 172.21.15.154:0/840335321 >> v2:172.21.15.176:3300/0 conn(0x7f1c2015b270 0x7f1c2006c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:19:59.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c26182640 1 --2- 172.21.15.154:0/840335321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2015ae90 0x7f1c200aeab0 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f1c200ce820 tx=0x7f1c1c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe9688a29f88084 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:59.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c25180640 1 -- 172.21.15.154:0/840335321 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0ab610 con 0x7f1c2015ae90 2024-05-14T10:19:59.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c25180640 1 -- 172.21.15.154:0/840335321 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1c0b0070 con 0x7f1c2015ae90 2024-05-14T10:19:59.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c25180640 1 -- 172.21.15.154:0/840335321 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0ab9d0 con 0x7f1c2015ae90 2024-05-14T10:19:59.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c283e6640 1 -- 172.21.15.154:0/840335321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2015ae90 msgr2=0x7f1c200aeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:59.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c283e6640 1 --2- 172.21.15.154:0/840335321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2015ae90 0x7f1c200aeab0 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f1c200ce820 tx=0x7f1c1c01c4f0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c283e6640 1 -- 172.21.15.154:0/840335321 shutdown_connections 2024-05-14T10:19:59.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c283e6640 1 --2- 172.21.15.154:0/840335321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c200aeff0 0x7f1c200cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c283e6640 1 --2- 172.21.15.154:0/840335321 >> v2:172.21.15.176:3300/0 conn(0x7f1c2015b270 0x7f1c2006c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c283e6640 1 --2- 172.21.15.154:0/840335321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2015ae90 0x7f1c200aeab0 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.845+0000 7f1c283e6640 1 -- 172.21.15.154:0/840335321 >> 172.21.15.154:0/840335321 conn(0x7f1c20072050 msgr2=0x7f1c20072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:19:59.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c283e6640 1 -- 172.21.15.154:0/840335321 shutdown_connections 2024-05-14T10:19:59.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c283e6640 1 -- 172.21.15.154:0/840335321 wait complete. 2024-05-14T10:19:59.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c283e6640 1 Processor -- start 2024-05-14T10:19:59.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c283e6640 1 -- start start 2024-05-14T10:19:59.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c283e6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c200aeff0 0x7f1c20150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:59.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c283e6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2015ae90 0x7f1c2009c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:59.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c283e6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c2015b270 0x7f1c2015de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:59.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c283e6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2006cbe0 con 0x7f1c2015ae90 2024-05-14T10:19:59.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c283e6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2015fa70 con 0x7f1c2015b270 2024-05-14T10:19:59.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c283e6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1c200ce870 con 0x7f1c200aeff0 2024-05-14T10:19:59.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c25981640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2015ae90 0x7f1c2009c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:59.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c26983640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c2015b270 0x7f1c2015de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:59.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c25981640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2015ae90 0x7f1c2009c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56626/0 (socket says 172.21.15.154:56626) 2024-05-14T10:19:59.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c25981640 1 -- 172.21.15.154:0/3049466402 learned_addr learned my addr 172.21.15.154:0/3049466402 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:19:59.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c26182640 1 --2- 172.21.15.154:0/3049466402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c200aeff0 0x7f1c20150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:59.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c25981640 1 -- 172.21.15.154:0/3049466402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c200aeff0 msgr2=0x7f1c20150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:59.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c25981640 1 --2- 172.21.15.154:0/3049466402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c200aeff0 0x7f1c20150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c25981640 1 -- 172.21.15.154:0/3049466402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c2015b270 msgr2=0x7f1c2015de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:19:59.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c25981640 1 --2- 172.21.15.154:0/3049466402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c2015b270 0x7f1c2015de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:19:59.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c25981640 1 -- 172.21.15.154:0/3049466402 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c201f75e0 con 0x7f1c2015ae90 2024-05-14T10:19:59.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.849+0000 7f1c25981640 1 --2- 172.21.15.154:0/3049466402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2015ae90 0x7f1c2009c5e0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000e900 tx=0x7f1c1000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:19:59.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.853+0000 7f1c16ffd640 1 -- 172.21.15.154:0/3049466402 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c10017070 con 0x7f1c2015ae90 2024-05-14T10:19:59.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.853+0000 7f1c16ffd640 1 -- 172.21.15.154:0/3049466402 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1000ca00 con 0x7f1c2015ae90 2024-05-14T10:19:59.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.853+0000 7f1c16ffd640 1 -- 172.21.15.154:0/3049466402 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1000cdb0 con 0x7f1c2015ae90 2024-05-14T10:19:59.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.853+0000 7f1c283e6640 1 -- 172.21.15.154:0/3049466402 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c2009cf10 con 0x7f1c2015ae90 2024-05-14T10:19:59.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.853+0000 7f1c283e6640 1 -- 172.21.15.154:0/3049466402 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c201f7b80 con 0x7f1c2015ae90 2024-05-14T10:19:59.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.853+0000 7f1c283e6640 1 -- 172.21.15.154:0/3049466402 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c201f7fc0 con 0x7f1c2015ae90 2024-05-14T10:19:59.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.873+0000 7f1c16ffd640 1 -- 172.21.15.154:0/3049466402 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1c1001a070 con 0x7f1c2015ae90 2024-05-14T10:19:59.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.877+0000 7f1c16ffd640 1 --2- 172.21.15.154:0/3049466402 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1c040678c0 0x7f1c04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:19:59.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.877+0000 7f1c16ffd640 1 -- 172.21.15.154:0/3049466402 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1c100863a0 con 0x7f1c2015ae90 2024-05-14T10:19:59.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.877+0000 7f1c26182640 1 --2- 172.21.15.154:0/3049466402 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1c040678c0 0x7f1c04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:19:59.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.877+0000 7f1c16ffd640 1 -- 172.21.15.154:0/3049466402 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1c10056900 con 0x7f1c2015ae90 2024-05-14T10:19:59.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:19:59.881+0000 7f1c26182640 1 --2- 172.21.15.154:0/3049466402 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1c040678c0 0x7f1c04069d80 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0af000 tx=0x7f1c1c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:00.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.149+0000 7f1c283e6640 1 -- 172.21.15.154:0/3049466402 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c20068360 con 0x7f1c2015ae90 2024-05-14T10:20:00.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.149+0000 7f1c16ffd640 1 -- 172.21.15.154:0/3049466402 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5190 (secure 0 0 0) 0x7f1c1005ac00 con 0x7f1c2015ae90 2024-05-14T10:20:00.154 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:20:00.155 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3153095738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3153095738},{"type":"v1","addr":"172.21.15.176:6835","nonce":3153095738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1660216913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":1660216913},{"type":"v1","addr":"172.21.15.176:6834","nonce":1660216913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1431439777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1431439777},{"type":"v1","addr":"172.21.15.154:6837","nonce":1431439777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T01:24:32.952086+0000","modified":"2024-05-14T01:24:36.000491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5124":{"gid":5124,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6836/848393842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":848393842},{"type":"v1","addr":"172.21.15.154:6836","nonce":848393842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5124,"qdb_cluster":[5124]},"id":2}]} 2024-05-14T10:20:00.155 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 17 2024-05-14T10:20:00.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.149+0000 7f1c283e6640 1 -- 172.21.15.154:0/3049466402 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1c040678c0 msgr2=0x7f1c04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:00.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.149+0000 7f1c283e6640 1 --2- 172.21.15.154:0/3049466402 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1c040678c0 0x7f1c04069d80 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0af000 tx=0x7f1c1c0a7000 comp rx=0 tx=0).stop 2024-05-14T10:20:00.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.149+0000 7f1c283e6640 1 -- 172.21.15.154:0/3049466402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2015ae90 msgr2=0x7f1c2009c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:00.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.149+0000 7f1c283e6640 1 --2- 172.21.15.154:0/3049466402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2015ae90 0x7f1c2009c5e0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000e900 tx=0x7f1c1000edc0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.149+0000 7f1c283e6640 1 -- 172.21.15.154:0/3049466402 shutdown_connections 2024-05-14T10:20:00.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.149+0000 7f1c283e6640 1 --2- 172.21.15.154:0/3049466402 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f1c040678c0 0x7f1c04069d80 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.149+0000 7f1c283e6640 1 --2- 172.21.15.154:0/3049466402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c2015b270 0x7f1c2015de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.149+0000 7f1c283e6640 1 --2- 172.21.15.154:0/3049466402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2015ae90 0x7f1c2009c5e0 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.149+0000 7f1c283e6640 1 --2- 172.21.15.154:0/3049466402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c200aeff0 0x7f1c20150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.149+0000 7f1c283e6640 1 -- 172.21.15.154:0/3049466402 >> 172.21.15.154:0/3049466402 conn(0x7f1c20072050 msgr2=0x7f1c200b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:00.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.157+0000 7f1c283e6640 1 -- 172.21.15.154:0/3049466402 shutdown_connections 2024-05-14T10:20:00.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.157+0000 7f1c283e6640 1 -- 172.21.15.154:0/3049466402 wait complete. 2024-05-14T10:20:00.188 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T10:20:00.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.313+0000 7f475c4d7640 1 Processor -- start 2024-05-14T10:20:00.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f475c4d7640 1 -- start start 2024-05-14T10:20:00.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f475c4d7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4754158940 0x7f47540adf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:00.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f475c4d7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47540b4370 con 0x7f47540b3ec0 2024-05-14T10:20:00.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f475c4d7640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47540ae660 con 0x7f475406c290 2024-05-14T10:20:00.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f475c4d7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f475415e6a0 con 0x7f4754158940 2024-05-14T10:20:00.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f475aa74640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f475406c290 0x7f475406c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:55094/0 (socket says 172.21.15.154:55094) 2024-05-14T10:20:00.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f475aa74640 1 -- 172.21.15.154:0/709031522 learned_addr learned my addr 172.21.15.154:0/709031522 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:20:00.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f4759271640 1 -- 172.21.15.154:0/709031522 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2291316702 0 0) 0x7f47540ae660 con 0x7f475406c290 2024-05-14T10:20:00.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f4759271640 1 -- 172.21.15.154:0/709031522 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4740003530 con 0x7f475406c290 2024-05-14T10:20:00.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f4759271640 1 -- 172.21.15.154:0/709031522 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2890789931 0 0) 0x7f4740003530 con 0x7f475406c290 2024-05-14T10:20:00.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f4759271640 1 -- 172.21.15.154:0/709031522 >> v2:172.21.15.154:3300/0 conn(0x7f4754158940 msgr2=0x7f47540adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:00.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f4759271640 1 --2- 172.21.15.154:0/709031522 >> v2:172.21.15.154:3300/0 conn(0x7f4754158940 0x7f47540adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f4759271640 1 -- 172.21.15.154:0/709031522 >> v1:172.21.15.154:6789/0 conn(0x7f47540b3ec0 legacy=0x7f475415f100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T10:20:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f4759271640 1 -- 172.21.15.154:0/709031522 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47540ae940 con 0x7f475406c290 2024-05-14T10:20:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f4759271640 1 -- 172.21.15.154:0/709031522 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f474c001a00 con 0x7f475406c290 2024-05-14T10:20:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f4759271640 1 -- 172.21.15.154:0/709031522 >> v1:172.21.15.176:6789/0 conn(0x7f475406c290 legacy=0x7f475406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f4759271640 1 --2- 172.21.15.154:0/709031522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47400039c0 0x7f4740003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f4759271640 1 --2- 172.21.15.154:0/709031522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4740004810 0x7f4740004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f4759271640 1 --2- 172.21.15.154:0/709031522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47400052f0 0x7f474000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f4759271640 1 -- 172.21.15.154:0/709031522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f475415e6a0 con 0x7f4740004810 2024-05-14T10:20:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f4759271640 1 -- 172.21.15.154:0/709031522 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f474000c240 con 0x7f47400052f0 2024-05-14T10:20:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f4759271640 1 -- 172.21.15.154:0/709031522 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f474000c440 con 0x7f47400039c0 2024-05-14T10:20:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f475aa74640 1 --2- 172.21.15.154:0/709031522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47400052f0 0x7f474000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f475a273640 1 --2- 172.21.15.154:0/709031522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47400039c0 0x7f4740003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f475aa74640 1 -- 172.21.15.154:0/709031522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47400039c0 msgr2=0x7f4740003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f475aa74640 1 --2- 172.21.15.154:0/709031522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47400039c0 0x7f4740003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f475aa74640 1 -- 172.21.15.154:0/709031522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4740004810 msgr2=0x7f4740004c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T10:20:00.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f475aa74640 1 --2- 172.21.15.154:0/709031522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4740004810 0x7f4740004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f475aa74640 1 -- 172.21.15.154:0/709031522 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47540ae940 con 0x7f47400052f0 2024-05-14T10:20:00.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.321+0000 7f475a273640 1 --2- 172.21.15.154:0/709031522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47400039c0 0x7f4740003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T10:20:00.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.325+0000 7f475aa74640 1 -- 172.21.15.154:0/709031522 reap_dead start 2024-05-14T10:20:00.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.325+0000 7f475aa74640 1 --2- 172.21.15.154:0/709031522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47400052f0 0x7f474000b9d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f474c00a990 tx=0x7f474c01d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e64f4e4fa8030fdb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:00.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.325+0000 7f4759271640 1 -- 172.21.15.154:0/709031522 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4744009460 con 0x7f47400052f0 2024-05-14T10:20:00.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.325+0000 7f4759271640 1 -- 172.21.15.154:0/709031522 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f474c0ac620 con 0x7f47400052f0 2024-05-14T10:20:00.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.325+0000 7f4759271640 1 -- 172.21.15.154:0/709031522 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c00a590 con 0x7f47400052f0 2024-05-14T10:20:00.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.325+0000 7f475c4d7640 1 -- 172.21.15.154:0/709031522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47400052f0 msgr2=0x7f474000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:00.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.325+0000 7f475c4d7640 1 --2- 172.21.15.154:0/709031522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47400052f0 0x7f474000b9d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f474c00a990 tx=0x7f474c01d4a0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.325+0000 7f475c4d7640 1 -- 172.21.15.154:0/709031522 shutdown_connections 2024-05-14T10:20:00.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.325+0000 7f475c4d7640 1 --2- 172.21.15.154:0/709031522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47400052f0 0x7f474000b9d0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.325+0000 7f475c4d7640 1 -- 172.21.15.154:0/709031522 >> 172.21.15.154:0/709031522 conn(0x7f4754072000 msgr2=0x7f4754072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:00.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475c4d7640 1 -- 172.21.15.154:0/709031522 shutdown_connections 2024-05-14T10:20:00.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475c4d7640 1 -- 172.21.15.154:0/709031522 wait complete. 2024-05-14T10:20:00.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475c4d7640 1 Processor -- start 2024-05-14T10:20:00.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475c4d7640 1 -- start start 2024-05-14T10:20:00.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475c4d7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47400052f0 0x7f4754141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:00.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475c4d7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f475406f700 0x7f4754151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:00.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475c4d7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f475406fb80 0x7f4754151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:00.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475c4d7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f47540ae2f0 con 0x7f475406fb80 2024-05-14T10:20:00.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475c4d7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f47540ae170 con 0x7f475406f700 2024-05-14T10:20:00.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475c4d7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f47540b4dd0 con 0x7f47400052f0 2024-05-14T10:20:00.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475aa74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f475406fb80 0x7f4754151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:00.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475aa74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f475406fb80 0x7f4754151680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56648/0 (socket says 172.21.15.154:56648) 2024-05-14T10:20:00.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475aa74640 1 -- 172.21.15.154:0/725865662 learned_addr learned my addr 172.21.15.154:0/725865662 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:00.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475a273640 1 --2- 172.21.15.154:0/725865662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47400052f0 0x7f4754141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:00.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f4759a72640 1 --2- 172.21.15.154:0/725865662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f475406f700 0x7f4754151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:00.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475aa74640 1 -- 172.21.15.154:0/725865662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47400052f0 msgr2=0x7f4754141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:00.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475aa74640 1 --2- 172.21.15.154:0/725865662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47400052f0 0x7f4754141e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475aa74640 1 -- 172.21.15.154:0/725865662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f475406f700 msgr2=0x7f4754151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:00.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475aa74640 1 --2- 172.21.15.154:0/725865662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f475406f700 0x7f4754151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475aa74640 1 -- 172.21.15.154:0/725865662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4754142340 con 0x7f475406fb80 2024-05-14T10:20:00.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475aa74640 1 --2- 172.21.15.154:0/725865662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f475406fb80 0x7f4754151680 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f474c000f90 tx=0x7f4740005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:00.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f474affd640 1 -- 172.21.15.154:0/725865662 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c00a590 con 0x7f475406fb80 2024-05-14T10:20:00.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f474affd640 1 -- 172.21.15.154:0/725865662 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f474c0017c0 con 0x7f475406fb80 2024-05-14T10:20:00.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f474affd640 1 -- 172.21.15.154:0/725865662 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c0ac7d0 con 0x7f475406fb80 2024-05-14T10:20:00.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475c4d7640 1 -- 172.21.15.154:0/725865662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f475414e5e0 con 0x7f475406fb80 2024-05-14T10:20:00.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.329+0000 7f475c4d7640 1 -- 172.21.15.154:0/725865662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f475415ff90 con 0x7f475406fb80 2024-05-14T10:20:00.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.333+0000 7f475c4d7640 1 -- 172.21.15.154:0/725865662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4754068360 con 0x7f475406fb80 2024-05-14T10:20:00.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.349+0000 7f474affd640 1 -- 172.21.15.154:0/725865662 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f474c0be060 con 0x7f475406fb80 2024-05-14T10:20:00.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.349+0000 7f474affd640 1 --2- 172.21.15.154:0/725865662 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f47380678c0 0x7f4738069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:00.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.349+0000 7f474affd640 1 -- 172.21.15.154:0/725865662 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f474c11f1b0 con 0x7f475406fb80 2024-05-14T10:20:00.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.349+0000 7f475a273640 1 --2- 172.21.15.154:0/725865662 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f47380678c0 0x7f4738069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:00.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.349+0000 7f475a273640 1 --2- 172.21.15.154:0/725865662 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f47380678c0 0x7f4738069d80 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f4744004710 tx=0x7f4744009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:00.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.353+0000 7f474affd640 1 -- 172.21.15.154:0/725865662 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f474c0171b0 con 0x7f475406fb80 2024-05-14T10:20:00.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.589+0000 7f475c4d7640 1 -- 172.21.15.154:0/725865662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4754158e40 con 0x7f475406fb80 2024-05-14T10:20:00.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.589+0000 7f474affd640 1 -- 172.21.15.154:0/725865662 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16717 (secure 0 0 0) 0x7f474c11c160 con 0x7f475406fb80 2024-05-14T10:20:00.595 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:20:00.595 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":34,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T01:24:34.630046+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-14T01:24:31.391789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-14T01:24:31.927579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T10:20:00.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.589+0000 7f475c4d7640 1 -- 172.21.15.154:0/725865662 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f47380678c0 msgr2=0x7f4738069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:00.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.589+0000 7f475c4d7640 1 --2- 172.21.15.154:0/725865662 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f47380678c0 0x7f4738069d80 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f4744004710 tx=0x7f4744009060 comp rx=0 tx=0).stop 2024-05-14T10:20:00.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.589+0000 7f475c4d7640 1 -- 172.21.15.154:0/725865662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f475406fb80 msgr2=0x7f4754151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:00.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.589+0000 7f475c4d7640 1 --2- 172.21.15.154:0/725865662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f475406fb80 0x7f4754151680 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f474c000f90 tx=0x7f4740005840 comp rx=0 tx=0).stop 2024-05-14T10:20:00.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.589+0000 7f475c4d7640 1 -- 172.21.15.154:0/725865662 shutdown_connections 2024-05-14T10:20:00.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.589+0000 7f475c4d7640 1 --2- 172.21.15.154:0/725865662 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f47380678c0 0x7f4738069d80 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.589+0000 7f475c4d7640 1 --2- 172.21.15.154:0/725865662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f475406fb80 0x7f4754151680 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.589+0000 7f475c4d7640 1 --2- 172.21.15.154:0/725865662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f475406f700 0x7f4754151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.589+0000 7f475c4d7640 1 --2- 172.21.15.154:0/725865662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47400052f0 0x7f4754141e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.589+0000 7f475c4d7640 1 -- 172.21.15.154:0/725865662 >> 172.21.15.154:0/725865662 conn(0x7f4754072000 msgr2=0x7f4754074280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:00.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.589+0000 7f475c4d7640 1 -- 172.21.15.154:0/725865662 shutdown_connections 2024-05-14T10:20:00.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.589+0000 7f475c4d7640 1 -- 172.21.15.154:0/725865662 wait complete. 2024-05-14T10:20:00.619 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-14T10:20:00.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.769+0000 7f417e564640 1 Processor -- start 2024-05-14T10:20:00.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.769+0000 7f417e564640 1 -- start start 2024-05-14T10:20:00.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.769+0000 7f417e564640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f41780cb670 0x7f41780af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:00.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.769+0000 7f417e564640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4178067f90 con 0x7f41781600f0 2024-05-14T10:20:00.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.769+0000 7f417e564640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41781604d0 con 0x7f4178071e30 2024-05-14T10:20:00.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.769+0000 7f417e564640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f41780afcb0 con 0x7f41780cb670 2024-05-14T10:20:00.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.769+0000 7f417cb01640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f41780cb670 0x7f41780af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:00.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.769+0000 7f417cb01640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f41780cb670 0x7f41780af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:52754/0 (socket says 172.21.15.154:52754) 2024-05-14T10:20:00.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.769+0000 7f417cb01640 1 -- 172.21.15.154:0/240623456 learned_addr learned my addr 172.21.15.154:0/240623456 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:00.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.769+0000 7f417cb01640 1 -- 172.21.15.154:0/240623456 >> v1:172.21.15.176:6789/0 conn(0x7f4178071e30 legacy=0x7f41780cdfd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T10:20:00.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.769+0000 7f417cb01640 1 -- 172.21.15.154:0/240623456 >> v1:172.21.15.154:6789/0 conn(0x7f41781600f0 legacy=0x7f4178071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:00.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.773+0000 7f417cb01640 1 -- 172.21.15.154:0/240623456 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4178162da0 con 0x7f41780cb670 2024-05-14T10:20:00.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.777+0000 7f417cb01640 1 --2- 172.21.15.154:0/240623456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41780cb670 0x7f41780af770 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f416c009870 tx=0x7f416c01c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e51bea74030edead server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:00.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.777+0000 7f4176ffd640 1 -- 172.21.15.154:0/240623456 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c0b0070 con 0x7f41780cb670 2024-05-14T10:20:00.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.777+0000 7f4176ffd640 1 -- 172.21.15.154:0/240623456 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416c0ab600 con 0x7f41780cb670 2024-05-14T10:20:00.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.777+0000 7f4176ffd640 1 -- 172.21.15.154:0/240623456 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c0ab9d0 con 0x7f41780cb670 2024-05-14T10:20:00.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.777+0000 7f417e564640 1 -- 172.21.15.154:0/240623456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41780cb670 msgr2=0x7f41780af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:00.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.777+0000 7f417e564640 1 --2- 172.21.15.154:0/240623456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41780cb670 0x7f41780af770 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f416c009870 tx=0x7f416c01c2d0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.777+0000 7f417e564640 1 -- 172.21.15.154:0/240623456 shutdown_connections 2024-05-14T10:20:00.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.777+0000 7f417e564640 1 --2- 172.21.15.154:0/240623456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41780cb670 0x7f41780af770 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.777+0000 7f417e564640 1 -- 172.21.15.154:0/240623456 >> 172.21.15.154:0/240623456 conn(0x7f41780cce80 msgr2=0x7f41780cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:00.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.785+0000 7f417e564640 1 -- 172.21.15.154:0/240623456 shutdown_connections 2024-05-14T10:20:00.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.785+0000 7f417e564640 1 -- 172.21.15.154:0/240623456 wait complete. 2024-05-14T10:20:00.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f417e564640 1 Processor -- start 2024-05-14T10:20:00.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f417e564640 1 -- start start 2024-05-14T10:20:00.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f417e564640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41780cb670 0x7f4178152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:00.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f417e564640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41781600f0 0x7f417806eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:00.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f417e564640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4178156f00 0x7f4178157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:00.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f417e564640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f41780ceef0 con 0x7f41781600f0 2024-05-14T10:20:00.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f417e564640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4178162a90 con 0x7f41780cb670 2024-05-14T10:20:00.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f417e564640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f41780cf070 con 0x7f4178156f00 2024-05-14T10:20:00.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f41777fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41781600f0 0x7f417806eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:00.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f417cb01640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4178156f00 0x7f4178157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:00.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f41777fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41781600f0 0x7f417806eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56662/0 (socket says 172.21.15.154:56662) 2024-05-14T10:20:00.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f41777fe640 1 -- 172.21.15.154:0/950281232 learned_addr learned my addr 172.21.15.154:0/950281232 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:00.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f4177fff640 1 --2- 172.21.15.154:0/950281232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41780cb670 0x7f4178152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:00.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f4177fff640 1 -- 172.21.15.154:0/950281232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4178156f00 msgr2=0x7f4178157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:00.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f4177fff640 1 --2- 172.21.15.154:0/950281232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4178156f00 0x7f4178157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f4177fff640 1 -- 172.21.15.154:0/950281232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41781600f0 msgr2=0x7f417806eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:00.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f4177fff640 1 --2- 172.21.15.154:0/950281232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41781600f0 0x7f417806eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:00.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f4177fff640 1 -- 172.21.15.154:0/950281232 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4178163fa0 con 0x7f41780cb670 2024-05-14T10:20:00.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f417cb01640 1 --2- 172.21.15.154:0/950281232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4178156f00 0x7f4178157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T10:20:00.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f41777fe640 1 --2- 172.21.15.154:0/950281232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41781600f0 0x7f417806eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T10:20:00.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f4177fff640 1 --2- 172.21.15.154:0/950281232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41780cb670 0x7f4178152b80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f416800c3e0 tx=0x7f416800c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:00.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f4174ff9640 1 -- 172.21.15.154:0/950281232 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168011790 con 0x7f41780cb670 2024-05-14T10:20:00.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f4174ff9640 1 -- 172.21.15.154:0/950281232 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4168017070 con 0x7f41780cb670 2024-05-14T10:20:00.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f417e564640 1 -- 172.21.15.154:0/950281232 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4178164280 con 0x7f41780cb670 2024-05-14T10:20:00.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f4174ff9640 1 -- 172.21.15.154:0/950281232 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168011b70 con 0x7f41780cb670 2024-05-14T10:20:00.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.789+0000 7f417e564640 1 -- 172.21.15.154:0/950281232 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4178164840 con 0x7f41780cb670 2024-05-14T10:20:00.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.793+0000 7f4174ff9640 1 -- 172.21.15.154:0/950281232 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f416801c460 con 0x7f41780cb670 2024-05-14T10:20:00.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.793+0000 7f417e564640 1 -- 172.21.15.154:0/950281232 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4178068360 con 0x7f41780cb670 2024-05-14T10:20:00.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.793+0000 7f4174ff9640 1 --2- 172.21.15.154:0/950281232 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f41640678c0 0x7f4164069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:00.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.793+0000 7f4174ff9640 1 -- 172.21.15.154:0/950281232 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f41680850e0 con 0x7f41780cb670 2024-05-14T10:20:00.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.801+0000 7f41777fe640 1 --2- 172.21.15.154:0/950281232 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f41640678c0 0x7f4164069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:00.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.801+0000 7f4174ff9640 1 -- 172.21.15.154:0/950281232 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f41680555d0 con 0x7f41780cb670 2024-05-14T10:20:00.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:00.801+0000 7f41777fe640 1 --2- 172.21.15.154:0/950281232 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f41640678c0 0x7f4164069d80 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f41781fe7c0 tx=0x7f417000d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:01.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.057+0000 7f417e564640 1 -- 172.21.15.154:0/950281232 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f417815b340 con 0x7f41780cb670 2024-05-14T10:20:01.192 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-05-14T10:20:01.185+0000 7f81568cc640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-14T10:20:01.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.277+0000 7f4174ff9640 1 -- 172.21.15.154:0/950281232 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7f41680598d0 con 0x7f41780cb670 2024-05-14T10:20:01.282 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-14T10:20:01.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.277+0000 7f417e564640 1 -- 172.21.15.154:0/950281232 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f41640678c0 msgr2=0x7f4164069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:01.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.277+0000 7f417e564640 1 --2- 172.21.15.154:0/950281232 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f41640678c0 0x7f4164069d80 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f41781fe7c0 tx=0x7f417000d040 comp rx=0 tx=0).stop 2024-05-14T10:20:01.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.277+0000 7f417e564640 1 -- 172.21.15.154:0/950281232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41780cb670 msgr2=0x7f4178152b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:01.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.277+0000 7f417e564640 1 --2- 172.21.15.154:0/950281232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41780cb670 0x7f4178152b80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f416800c3e0 tx=0x7f416800c8a0 comp rx=0 tx=0).stop 2024-05-14T10:20:01.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.277+0000 7f417e564640 1 -- 172.21.15.154:0/950281232 shutdown_connections 2024-05-14T10:20:01.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.277+0000 7f417e564640 1 --2- 172.21.15.154:0/950281232 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f41640678c0 0x7f4164069d80 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:01.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.277+0000 7f417e564640 1 --2- 172.21.15.154:0/950281232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4178156f00 0x7f4178157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:01.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.277+0000 7f417e564640 1 --2- 172.21.15.154:0/950281232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41781600f0 0x7f417806eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:01.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.277+0000 7f417e564640 1 --2- 172.21.15.154:0/950281232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41780cb670 0x7f4178152b80 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:01.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.277+0000 7f417e564640 1 -- 172.21.15.154:0/950281232 >> 172.21.15.154:0/950281232 conn(0x7f41780cce80 msgr2=0x7f417815b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:01.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.277+0000 7f417e564640 1 -- 172.21.15.154:0/950281232 shutdown_connections 2024-05-14T10:20:01.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.277+0000 7f417e564640 1 -- 172.21.15.154:0/950281232 wait complete. 2024-05-14T10:20:01.307 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-14T10:20:01.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.441+0000 7f9929947640 1 Processor -- start 2024-05-14T10:20:01.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.441+0000 7f9929947640 1 -- start start 2024-05-14T10:20:01.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.441+0000 7f9929947640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992406fad0 0x7f99240ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:01.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.441+0000 7f9929947640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9924074280 0x7f99240746f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:01.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.441+0000 7f9929947640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f992406feb0 con 0x7f99240b0250 2024-05-14T10:20:01.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.441+0000 7f9929947640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f99240d0a50 con 0x7f9924074280 2024-05-14T10:20:01.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.441+0000 7f9929947640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9924074c30 con 0x7f992406fad0 2024-05-14T10:20:01.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.441+0000 7f9922ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992406fad0 0x7f99240ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:01.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.441+0000 7f99237fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9924074280 0x7f99240746f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:01.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.441+0000 7f99237fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9924074280 0x7f99240746f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56664/0 (socket says 172.21.15.154:56664) 2024-05-14T10:20:01.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.441+0000 7f99237fe640 1 -- 172.21.15.154:0/2931837696 learned_addr learned my addr 172.21.15.154:0/2931837696 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:01.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.441+0000 7f9922ffd640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992406fad0 0x7f99240ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:45270/0 (socket says 172.21.15.154:45270) 2024-05-14T10:20:01.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.441+0000 7f99237fe640 1 -- 172.21.15.154:0/2931837696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992406fad0 msgr2=0x7f99240ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:01.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.441+0000 7f99237fe640 1 --2- 172.21.15.154:0/2931837696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992406fad0 0x7f99240ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:01.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.441+0000 7f99237fe640 1 -- 172.21.15.154:0/2931837696 >> v1:172.21.15.154:6789/0 conn(0x7f99240b0250 legacy=0x7f99241625c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:01.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.441+0000 7f99237fe640 1 -- 172.21.15.154:0/2931837696 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99240d01f0 con 0x7f9924074280 2024-05-14T10:20:01.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.445+0000 7f99237fe640 1 --2- 172.21.15.154:0/2931837696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9924074280 0x7f99240746f0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f991c009e50 tx=0x7f991c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb7386964d601bb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.445+0000 7f9921ffb640 1 -- 172.21.15.154:0/2931837696 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c0a5720 con 0x7f9924074280 2024-05-14T10:20:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.445+0000 7f9921ffb640 1 -- 172.21.15.154:0/2931837696 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f991c0a58c0 con 0x7f9924074280 2024-05-14T10:20:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.445+0000 7f9921ffb640 1 -- 172.21.15.154:0/2931837696 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c0a5c90 con 0x7f9924074280 2024-05-14T10:20:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.445+0000 7f9929947640 1 -- 172.21.15.154:0/2931837696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9924074280 msgr2=0x7f99240746f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.445+0000 7f9929947640 1 --2- 172.21.15.154:0/2931837696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9924074280 0x7f99240746f0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f991c009e50 tx=0x7f991c01ca50 comp rx=0 tx=0).stop 2024-05-14T10:20:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.445+0000 7f9929947640 1 -- 172.21.15.154:0/2931837696 shutdown_connections 2024-05-14T10:20:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.445+0000 7f9929947640 1 --2- 172.21.15.154:0/2931837696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9924074280 0x7f99240746f0 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.445+0000 7f9929947640 1 --2- 172.21.15.154:0/2931837696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992406fad0 0x7f99240ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.445+0000 7f9929947640 1 -- 172.21.15.154:0/2931837696 >> 172.21.15.154:0/2931837696 conn(0x7f99240cd6f0 msgr2=0x7f99240cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.445+0000 7f9929947640 1 -- 172.21.15.154:0/2931837696 shutdown_connections 2024-05-14T10:20:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.445+0000 7f9929947640 1 -- 172.21.15.154:0/2931837696 wait complete. 2024-05-14T10:20:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.449+0000 7f9929947640 1 Processor -- start 2024-05-14T10:20:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.449+0000 7f9929947640 1 -- start start 2024-05-14T10:20:01.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f9929947640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992406fad0 0x7f9924151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:01.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f9929947640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9924074280 0x7f9924150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:01.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f9929947640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99240b0250 0x7f992415ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:01.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f9929947640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f992406bc10 con 0x7f9924074280 2024-05-14T10:20:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f9929947640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f992406ba90 con 0x7f99240b0250 2024-05-14T10:20:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f9929947640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f992406bd90 con 0x7f992406fad0 2024-05-14T10:20:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f99227fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9924074280 0x7f9924150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f99227fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9924074280 0x7f9924150a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56678/0 (socket says 172.21.15.154:56678) 2024-05-14T10:20:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f99227fc640 1 -- 172.21.15.154:0/3637821133 learned_addr learned my addr 172.21.15.154:0/3637821133 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f9922ffd640 1 --2- 172.21.15.154:0/3637821133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992406fad0 0x7f9924151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f99237fe640 1 --2- 172.21.15.154:0/3637821133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99240b0250 0x7f992415ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f99227fc640 1 -- 172.21.15.154:0/3637821133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992406fad0 msgr2=0x7f9924151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f99227fc640 1 --2- 172.21.15.154:0/3637821133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992406fad0 0x7f9924151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f99227fc640 1 -- 172.21.15.154:0/3637821133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99240b0250 msgr2=0x7f992415ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f99227fc640 1 --2- 172.21.15.154:0/3637821133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99240b0250 0x7f992415ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f99227fc640 1 -- 172.21.15.154:0/3637821133 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9924150fa0 con 0x7f9924074280 2024-05-14T10:20:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f99227fc640 1 --2- 172.21.15.154:0/3637821133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9924074280 0x7f9924150a60 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f991800c3a0 tx=0x7f991800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f990bfff640 1 -- 172.21.15.154:0/3637821133 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99180052d0 con 0x7f9924074280 2024-05-14T10:20:01.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f990bfff640 1 -- 172.21.15.154:0/3637821133 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9918005470 con 0x7f9924074280 2024-05-14T10:20:01.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f9929947640 1 -- 172.21.15.154:0/3637821133 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99240c4770 con 0x7f9924074280 2024-05-14T10:20:01.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f990bfff640 1 -- 172.21.15.154:0/3637821133 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9918007260 con 0x7f9924074280 2024-05-14T10:20:01.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f9929947640 1 -- 172.21.15.154:0/3637821133 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99240c4d30 con 0x7f9924074280 2024-05-14T10:20:01.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f990bfff640 1 -- 172.21.15.154:0/3637821133 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9918007400 con 0x7f9924074280 2024-05-14T10:20:01.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f990bfff640 1 --2- 172.21.15.154:0/3637821133 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99100678f0 0x7f9910069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:01.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f990bfff640 1 -- 172.21.15.154:0/3637821133 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f9918085110 con 0x7f9924074280 2024-05-14T10:20:01.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f9922ffd640 1 --2- 172.21.15.154:0/3637821133 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99100678f0 0x7f9910069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:01.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.453+0000 7f9922ffd640 1 --2- 172.21.15.154:0/3637821133 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99100678f0 0x7f9910069db0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f992415e5c0 tx=0x7f9914009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:01.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.457+0000 7f9929947640 1 -- 172.21.15.154:0/3637821133 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9924067cd0 con 0x7f9924074280 2024-05-14T10:20:01.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.465+0000 7f990bfff640 1 -- 172.21.15.154:0/3637821133 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f99180555a0 con 0x7f9924074280 2024-05-14T10:20:01.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:01.673+0000 7f9929947640 1 -- 172.21.15.154:0/3637821133 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9924068360 con 0x7f9924074280 2024-05-14T10:20:01.954 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2024-05-14T10:20:02.298 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.293+0000 7f990bfff640 1 -- 172.21.15.154:0/3637821133 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f99180598a0 con 0x7f9924074280 2024-05-14T10:20:02.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.297+0000 7f9929947640 1 -- 172.21.15.154:0/3637821133 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99100678f0 msgr2=0x7f9910069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:02.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.297+0000 7f9929947640 1 --2- 172.21.15.154:0/3637821133 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99100678f0 0x7f9910069db0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f992415e5c0 tx=0x7f9914009190 comp rx=0 tx=0).stop 2024-05-14T10:20:02.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.297+0000 7f9929947640 1 -- 172.21.15.154:0/3637821133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9924074280 msgr2=0x7f9924150a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:02.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.297+0000 7f9929947640 1 --2- 172.21.15.154:0/3637821133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9924074280 0x7f9924150a60 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f991800c3a0 tx=0x7f991800c860 comp rx=0 tx=0).stop 2024-05-14T10:20:02.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.297+0000 7f9929947640 1 -- 172.21.15.154:0/3637821133 shutdown_connections 2024-05-14T10:20:02.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.297+0000 7f9929947640 1 --2- 172.21.15.154:0/3637821133 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99100678f0 0x7f9910069db0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:02.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.297+0000 7f9929947640 1 --2- 172.21.15.154:0/3637821133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99240b0250 0x7f992415ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:02.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.297+0000 7f9929947640 1 --2- 172.21.15.154:0/3637821133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9924074280 0x7f9924150a60 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:02.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.297+0000 7f9929947640 1 --2- 172.21.15.154:0/3637821133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f992406fad0 0x7f9924151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:02.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.297+0000 7f9929947640 1 -- 172.21.15.154:0/3637821133 >> 172.21.15.154:0/3637821133 conn(0x7f99240cd6f0 msgr2=0x7f9924161280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:02.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.297+0000 7f9929947640 1 -- 172.21.15.154:0/3637821133 shutdown_connections 2024-05-14T10:20:02.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.297+0000 7f9929947640 1 -- 172.21.15.154:0/3637821133 wait complete. 2024-05-14T10:20:02.325 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-14T10:20:02.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.445+0000 7f6a239e3640 1 Processor -- start 2024-05-14T10:20:02.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.445+0000 7f6a239e3640 1 -- start start 2024-05-14T10:20:02.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.445+0000 7f6a239e3640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6a1c1457c0 0x7f6a1c0b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:02.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.445+0000 7f6a239e3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a1c15fa20 0x7f6a1c15fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:02.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.445+0000 7f6a239e3640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a1c0b2df0 con 0x7f6a1c0b3120 2024-05-14T10:20:02.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.445+0000 7f6a239e3640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6a1c145ba0 con 0x7f6a1c1457c0 2024-05-14T10:20:02.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.445+0000 7f6a239e3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6a1c06cdb0 con 0x7f6a1c15fa20 2024-05-14T10:20:02.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.445+0000 7f6a2177f640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6a1c1457c0 0x7f6a1c0b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:02.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.445+0000 7f6a20f7e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a1c15fa20 0x7f6a1c15fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:02.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.445+0000 7f6a20f7e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a1c15fa20 0x7f6a1c15fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.154:45302/0 (socket says 172.21.15.154:45302) 2024-05-14T10:20:02.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.445+0000 7f6a20f7e640 1 -- 172.21.15.154:0/3229227011 learned_addr learned my addr 172.21.15.154:0/3229227011 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:02.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.445+0000 7f6a2177f640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6a1c1457c0 0x7f6a1c0b4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:52782/0 (socket says 172.21.15.154:52782) 2024-05-14T10:20:02.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.445+0000 7f6a21f80640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f6a1c0b3120 0x7f6a1c0b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:55098/0 (socket says 172.21.15.154:55098) 2024-05-14T10:20:02.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.445+0000 7f6a20f7e640 1 -- 172.21.15.154:0/3229227011 >> v2:172.21.15.176:3300/0 conn(0x7f6a1c1457c0 msgr2=0x7f6a1c0b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:02.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.445+0000 7f6a20f7e640 1 --2- 172.21.15.154:0/3229227011 >> v2:172.21.15.176:3300/0 conn(0x7f6a1c1457c0 0x7f6a1c0b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:02.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.445+0000 7f6a20f7e640 1 -- 172.21.15.154:0/3229227011 >> v1:172.21.15.176:6789/0 conn(0x7f6a1c0b3120 legacy=0x7f6a1c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:02.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.445+0000 7f6a20f7e640 1 -- 172.21.15.154:0/3229227011 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1c0cf230 con 0x7f6a1c15fa20 2024-05-14T10:20:02.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.445+0000 7f6a2177f640 1 --2- 172.21.15.154:0/3229227011 >> v2:172.21.15.176:3300/0 conn(0x7f6a1c1457c0 0x7f6a1c0b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T10:20:02.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.449+0000 7f6a20f7e640 1 --2- 172.21.15.154:0/3229227011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a1c15fa20 0x7f6a1c15fea0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6a10009870 tx=0x7f6a1001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef970c3f8cf35ab server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:02.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.449+0000 7f6a1bfff640 1 -- 172.21.15.154:0/3229227011 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a100b0070 con 0x7f6a1c15fa20 2024-05-14T10:20:02.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.449+0000 7f6a1bfff640 1 -- 172.21.15.154:0/3229227011 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a100ab600 con 0x7f6a1c15fa20 2024-05-14T10:20:02.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.449+0000 7f6a1bfff640 1 -- 172.21.15.154:0/3229227011 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a100ab9d0 con 0x7f6a1c15fa20 2024-05-14T10:20:02.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.449+0000 7f6a239e3640 1 -- 172.21.15.154:0/3229227011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a1c15fa20 msgr2=0x7f6a1c15fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:02.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.449+0000 7f6a239e3640 1 --2- 172.21.15.154:0/3229227011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a1c15fa20 0x7f6a1c15fea0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6a10009870 tx=0x7f6a1001c4d0 comp rx=0 tx=0).stop 2024-05-14T10:20:02.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.449+0000 7f6a239e3640 1 -- 172.21.15.154:0/3229227011 shutdown_connections 2024-05-14T10:20:02.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.449+0000 7f6a239e3640 1 --2- 172.21.15.154:0/3229227011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a1c15fa20 0x7f6a1c15fea0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:02.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.449+0000 7f6a239e3640 1 --2- 172.21.15.154:0/3229227011 >> v2:172.21.15.176:3300/0 conn(0x7f6a1c1457c0 0x7f6a1c0b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:02.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.449+0000 7f6a239e3640 1 -- 172.21.15.154:0/3229227011 >> 172.21.15.154:0/3229227011 conn(0x7f6a1c0b1850 msgr2=0x7f6a1c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:02.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.449+0000 7f6a239e3640 1 -- 172.21.15.154:0/3229227011 shutdown_connections 2024-05-14T10:20:02.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.449+0000 7f6a239e3640 1 -- 172.21.15.154:0/3229227011 wait complete. 2024-05-14T10:20:02.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.449+0000 7f6a239e3640 1 Processor -- start 2024-05-14T10:20:02.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.449+0000 7f6a239e3640 1 -- start start 2024-05-14T10:20:02.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a239e3640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a1c0b3120 0x7f6a1c144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:02.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a239e3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a1c1457c0 0x7f6a1c15a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:02.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a239e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a1c15fa20 0x7f6a1c0ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:02.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a239e3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c1695d0 con 0x7f6a1c15fa20 2024-05-14T10:20:02.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a239e3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c0cf010 con 0x7f6a1c1457c0 2024-05-14T10:20:02.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a239e3640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6a1c169750 con 0x7f6a1c0b3120 2024-05-14T10:20:02.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a21f80640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a1c15fa20 0x7f6a1c0ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:02.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a21f80640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a1c15fa20 0x7f6a1c0ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56704/0 (socket says 172.21.15.154:56704) 2024-05-14T10:20:02.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a21f80640 1 -- 172.21.15.154:0/3910016122 learned_addr learned my addr 172.21.15.154:0/3910016122 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:02.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a20f7e640 1 --2- 172.21.15.154:0/3910016122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a1c1457c0 0x7f6a1c15a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:02.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a2177f640 1 --2- 172.21.15.154:0/3910016122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a1c0b3120 0x7f6a1c144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:02.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a21f80640 1 -- 172.21.15.154:0/3910016122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a1c0b3120 msgr2=0x7f6a1c144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:02.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a21f80640 1 --2- 172.21.15.154:0/3910016122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a1c0b3120 0x7f6a1c144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:02.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a21f80640 1 -- 172.21.15.154:0/3910016122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a1c1457c0 msgr2=0x7f6a1c15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:02.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a21f80640 1 --2- 172.21.15.154:0/3910016122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a1c1457c0 0x7f6a1c15a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:02.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a21f80640 1 -- 172.21.15.154:0/3910016122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1c142cb0 con 0x7f6a1c15fa20 2024-05-14T10:20:02.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a21f80640 1 --2- 172.21.15.154:0/3910016122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a1c15fa20 0x7f6a1c0ad880 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f6a1400c700 tx=0x7f6a1400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:02.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a19ffb640 1 -- 172.21.15.154:0/3910016122 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a14017070 con 0x7f6a1c15fa20 2024-05-14T10:20:02.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a19ffb640 1 -- 172.21.15.154:0/3910016122 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a1400ce10 con 0x7f6a1c15fa20 2024-05-14T10:20:02.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a239e3640 1 -- 172.21.15.154:0/3910016122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a1c142130 con 0x7f6a1c15fa20 2024-05-14T10:20:02.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a19ffb640 1 -- 172.21.15.154:0/3910016122 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1400a840 con 0x7f6a1c15fa20 2024-05-14T10:20:02.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a239e3640 1 -- 172.21.15.154:0/3910016122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a1c1426f0 con 0x7f6a1c15fa20 2024-05-14T10:20:02.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a239e3640 1 -- 172.21.15.154:0/3910016122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a1c075470 con 0x7f6a1c15fa20 2024-05-14T10:20:02.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a19ffb640 1 -- 172.21.15.154:0/3910016122 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6a1401a070 con 0x7f6a1c15fa20 2024-05-14T10:20:02.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a19ffb640 1 --2- 172.21.15.154:0/3910016122 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6a080678c0 0x7f6a08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:02.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a19ffb640 1 -- 172.21.15.154:0/3910016122 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f6a14085100 con 0x7f6a1c15fa20 2024-05-14T10:20:02.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a2177f640 1 --2- 172.21.15.154:0/3910016122 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6a080678c0 0x7f6a08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:02.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.453+0000 7f6a2177f640 1 --2- 172.21.15.154:0/3910016122 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6a080678c0 0x7f6a08069d80 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009580 tx=0x7f6a0c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:02.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.457+0000 7f6a19ffb640 1 -- 172.21.15.154:0/3910016122 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f6a14055620 con 0x7f6a1c15fa20 2024-05-14T10:20:02.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:02.609+0000 7f6a239e3640 1 -- 172.21.15.154:0/3910016122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6a1c06e890 con 0x7f6a1c15fa20 2024-05-14T10:20:03.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.305+0000 7f6a19ffb640 1 -- 172.21.15.154:0/3910016122 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7f6a14059920 con 0x7f6a1c15fa20 2024-05-14T10:20:03.313 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2024-05-14T10:20:03.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.309+0000 7f6a239e3640 1 -- 172.21.15.154:0/3910016122 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6a080678c0 msgr2=0x7f6a08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:03.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.309+0000 7f6a239e3640 1 --2- 172.21.15.154:0/3910016122 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6a080678c0 0x7f6a08069d80 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009580 tx=0x7f6a0c009190 comp rx=0 tx=0).stop 2024-05-14T10:20:03.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.309+0000 7f6a239e3640 1 -- 172.21.15.154:0/3910016122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a1c15fa20 msgr2=0x7f6a1c0ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:03.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.309+0000 7f6a239e3640 1 --2- 172.21.15.154:0/3910016122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a1c15fa20 0x7f6a1c0ad880 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f6a1400c700 tx=0x7f6a1400cbc0 comp rx=0 tx=0).stop 2024-05-14T10:20:03.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.309+0000 7f6a239e3640 1 -- 172.21.15.154:0/3910016122 shutdown_connections 2024-05-14T10:20:03.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.309+0000 7f6a239e3640 1 --2- 172.21.15.154:0/3910016122 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f6a080678c0 0x7f6a08069d80 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:03.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.309+0000 7f6a239e3640 1 --2- 172.21.15.154:0/3910016122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a1c15fa20 0x7f6a1c0ad880 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:03.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.309+0000 7f6a239e3640 1 --2- 172.21.15.154:0/3910016122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a1c1457c0 0x7f6a1c15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:03.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.309+0000 7f6a239e3640 1 --2- 172.21.15.154:0/3910016122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a1c0b3120 0x7f6a1c144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:03.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.309+0000 7f6a239e3640 1 -- 172.21.15.154:0/3910016122 >> 172.21.15.154:0/3910016122 conn(0x7f6a1c0b1850 msgr2=0x7f6a1c0aeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:03.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.309+0000 7f6a239e3640 1 -- 172.21.15.154:0/3910016122 shutdown_connections 2024-05-14T10:20:03.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.309+0000 7f6a239e3640 1 -- 172.21.15.154:0/3910016122 wait complete. 2024-05-14T10:20:03.339 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-14T10:20:03.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.453+0000 7f16c9400640 1 Processor -- start 2024-05-14T10:20:03.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.453+0000 7f16c9400640 1 -- start start 2024-05-14T10:20:03.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.453+0000 7f16c9400640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16c415e460 0x7f16c40d1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:03.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.453+0000 7f16c9400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f16c40d2290 0x7f16c40cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:03.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.453+0000 7f16c9400640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16c40d0dd0 con 0x7f16c40d04e0 2024-05-14T10:20:03.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.453+0000 7f16c9400640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f16c40d19e0 con 0x7f16c415e460 2024-05-14T10:20:03.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.453+0000 7f16c9400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f16c40d26d0 con 0x7f16c40d2290 2024-05-14T10:20:03.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.453+0000 7f16c37fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f16c40d04e0 0x7f16c40ce690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52298/0 (socket says 172.21.15.154:52298) 2024-05-14T10:20:03.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.453+0000 7f16c2ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16c415e460 0x7f16c40d1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:03.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.453+0000 7f16c37fe640 1 -- 172.21.15.154:0/3224086696 learned_addr learned my addr 172.21.15.154:0/3224086696 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:20:03.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.453+0000 7f16ba7fc640 1 --2- 172.21.15.154:0/3224086696 >> v2:172.21.15.176:3300/0 conn(0x7f16c40d2290 0x7f16c40cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:03.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.453+0000 7f16c27fc640 1 -- 172.21.15.154:0/3224086696 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 584432497 0 0) 0x7f16c40d0dd0 con 0x7f16c40d04e0 2024-05-14T10:20:03.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.453+0000 7f16c27fc640 1 -- 172.21.15.154:0/3224086696 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16b0003530 con 0x7f16c40d04e0 2024-05-14T10:20:03.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.457+0000 7f16c2ffd640 1 -- 172.21.15.154:0/3224086696 >> v2:172.21.15.176:3300/0 conn(0x7f16c40d2290 msgr2=0x7f16c40cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:03.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.457+0000 7f16c2ffd640 1 --2- 172.21.15.154:0/3224086696 >> v2:172.21.15.176:3300/0 conn(0x7f16c40d2290 0x7f16c40cffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:03.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.457+0000 7f16c2ffd640 1 -- 172.21.15.154:0/3224086696 >> v1:172.21.15.154:6789/0 conn(0x7f16c40d04e0 legacy=0x7f16c40ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:03.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.457+0000 7f16c2ffd640 1 -- 172.21.15.154:0/3224086696 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c40d10b0 con 0x7f16c415e460 2024-05-14T10:20:03.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.457+0000 7f16c2ffd640 1 --2- 172.21.15.154:0/3224086696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16c415e460 0x7f16c40d1d50 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f16c409fdc0 tx=0x7f16b401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b5c28bab1b69eb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:03.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.457+0000 7f16c27fc640 1 -- 172.21.15.154:0/3224086696 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b40b5070 con 0x7f16c415e460 2024-05-14T10:20:03.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.457+0000 7f16c27fc640 1 -- 172.21.15.154:0/3224086696 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b40a8970 con 0x7f16c415e460 2024-05-14T10:20:03.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.457+0000 7f16c27fc640 1 -- 172.21.15.154:0/3224086696 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b40a8d40 con 0x7f16c415e460 2024-05-14T10:20:03.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.457+0000 7f16c9400640 1 -- 172.21.15.154:0/3224086696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16c415e460 msgr2=0x7f16c40d1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:03.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.457+0000 7f16c9400640 1 --2- 172.21.15.154:0/3224086696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16c415e460 0x7f16c40d1d50 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f16c409fdc0 tx=0x7f16b401ec70 comp rx=0 tx=0).stop 2024-05-14T10:20:03.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.457+0000 7f16c9400640 1 -- 172.21.15.154:0/3224086696 shutdown_connections 2024-05-14T10:20:03.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.457+0000 7f16c9400640 1 --2- 172.21.15.154:0/3224086696 >> v2:172.21.15.176:3300/0 conn(0x7f16c40d2290 0x7f16c40cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:03.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.457+0000 7f16c9400640 1 --2- 172.21.15.154:0/3224086696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16c415e460 0x7f16c40d1d50 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:03.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.457+0000 7f16c9400640 1 -- 172.21.15.154:0/3224086696 >> 172.21.15.154:0/3224086696 conn(0x7f16c409aa10 msgr2=0x7f16c409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:03.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.457+0000 7f16c9400640 1 -- 172.21.15.154:0/3224086696 shutdown_connections 2024-05-14T10:20:03.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.457+0000 7f16c9400640 1 -- 172.21.15.154:0/3224086696 wait complete. 2024-05-14T10:20:03.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c9400640 1 Processor -- start 2024-05-14T10:20:03.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c9400640 1 -- start start 2024-05-14T10:20:03.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c9400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16c40d04e0 0x7f16c40cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:03.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c9400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16c40d2290 0x7f16c40cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:03.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c9400640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16c415e460 0x7f16c41f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:03.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c9400640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16c40d0950 con 0x7f16c415e460 2024-05-14T10:20:03.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c9400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f16c40d1670 con 0x7f16c40d2290 2024-05-14T10:20:03.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c9400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f16c40d0ad0 con 0x7f16c40d04e0 2024-05-14T10:20:03.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16c415e460 0x7f16c41f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:03.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16c415e460 0x7f16c41f6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56724/0 (socket says 172.21.15.154:56724) 2024-05-14T10:20:03.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c37fe640 1 -- 172.21.15.154:0/391203266 learned_addr learned my addr 172.21.15.154:0/391203266 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:03.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c2ffd640 1 --2- 172.21.15.154:0/391203266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16c40d04e0 0x7f16c40cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:03.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16ba7fc640 1 --2- 172.21.15.154:0/391203266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16c40d2290 0x7f16c40cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:03.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c37fe640 1 -- 172.21.15.154:0/391203266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16c40d04e0 msgr2=0x7f16c40cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:03.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c37fe640 1 --2- 172.21.15.154:0/391203266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16c40d04e0 0x7f16c40cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:03.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c37fe640 1 -- 172.21.15.154:0/391203266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16c40d2290 msgr2=0x7f16c40cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:03.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c37fe640 1 --2- 172.21.15.154:0/391203266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16c40d2290 0x7f16c40cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:03.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c37fe640 1 -- 172.21.15.154:0/391203266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c41490d0 con 0x7f16c415e460 2024-05-14T10:20:03.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16ba7fc640 1 --2- 172.21.15.154:0/391203266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16c40d2290 0x7f16c40cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T10:20:03.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c37fe640 1 --2- 172.21.15.154:0/391203266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16c415e460 0x7f16c41f6ff0 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00caa0 tx=0x7f16bc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:03.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16bbfff640 1 -- 172.21.15.154:0/391203266 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc017070 con 0x7f16c415e460 2024-05-14T10:20:03.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16bbfff640 1 -- 172.21.15.154:0/391203266 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16bc00ac00 con 0x7f16c415e460 2024-05-14T10:20:03.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16bbfff640 1 -- 172.21.15.154:0/391203266 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc012400 con 0x7f16c415e460 2024-05-14T10:20:03.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c9400640 1 -- 172.21.15.154:0/391203266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c40cbef0 con 0x7f16c415e460 2024-05-14T10:20:03.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c9400640 1 -- 172.21.15.154:0/391203266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c40cbc10 con 0x7f16c415e460 2024-05-14T10:20:03.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16c9400640 1 -- 172.21.15.154:0/391203266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16c40b6850 con 0x7f16c415e460 2024-05-14T10:20:03.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16bbfff640 1 -- 172.21.15.154:0/391203266 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f16bc01a070 con 0x7f16c415e460 2024-05-14T10:20:03.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.461+0000 7f16bbfff640 1 --2- 172.21.15.154:0/391203266 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16a40678c0 0x7f16a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:03.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.465+0000 7f16bbfff640 1 -- 172.21.15.154:0/391203266 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5357+0+0 (secure 0 0 0) 0x7f16bc0858b0 con 0x7f16c415e460 2024-05-14T10:20:03.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.465+0000 7f16c2ffd640 1 --2- 172.21.15.154:0/391203266 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16a40678c0 0x7f16a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:03.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.465+0000 7f16c2ffd640 1 --2- 172.21.15.154:0/391203266 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16a40678c0 0x7f16a4069d80 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f16b40b2000 tx=0x7f16b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:03.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.469+0000 7f16bbfff640 1 -- 172.21.15.154:0/391203266 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f16bc056550 con 0x7f16c415e460 2024-05-14T10:20:03.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:03.673+0000 7f16c9400640 1 -- 172.21.15.154:0/391203266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f16c4068360 con 0x7f16c415e460 2024-05-14T10:20:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.317+0000 7f16bbfff640 1 -- 172.21.15.154:0/391203266 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7f16bc055e50 con 0x7f16c415e460 2024-05-14T10:20:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2024-05-14T10:20:04.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.321+0000 7f16c9400640 1 -- 172.21.15.154:0/391203266 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16a40678c0 msgr2=0x7f16a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:04.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.321+0000 7f16c9400640 1 --2- 172.21.15.154:0/391203266 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16a40678c0 0x7f16a4069d80 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f16b40b2000 tx=0x7f16b4008040 comp rx=0 tx=0).stop 2024-05-14T10:20:04.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.321+0000 7f16c9400640 1 -- 172.21.15.154:0/391203266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16c415e460 msgr2=0x7f16c41f6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:04.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.321+0000 7f16c9400640 1 --2- 172.21.15.154:0/391203266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16c415e460 0x7f16c41f6ff0 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00caa0 tx=0x7f16bc00cf60 comp rx=0 tx=0).stop 2024-05-14T10:20:04.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.321+0000 7f16c9400640 1 -- 172.21.15.154:0/391203266 shutdown_connections 2024-05-14T10:20:04.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.321+0000 7f16c9400640 1 --2- 172.21.15.154:0/391203266 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16a40678c0 0x7f16a4069d80 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:04.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.321+0000 7f16c9400640 1 --2- 172.21.15.154:0/391203266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16c415e460 0x7f16c41f6ff0 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:04.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.321+0000 7f16c9400640 1 --2- 172.21.15.154:0/391203266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16c40d2290 0x7f16c40cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:04.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.321+0000 7f16c9400640 1 --2- 172.21.15.154:0/391203266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16c40d04e0 0x7f16c40cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:04.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.321+0000 7f16c9400640 1 -- 172.21.15.154:0/391203266 >> 172.21.15.154:0/391203266 conn(0x7f16c409aa10 msgr2=0x7f16c409adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:04.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.321+0000 7f16c9400640 1 -- 172.21.15.154:0/391203266 shutdown_connections 2024-05-14T10:20:04.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.321+0000 7f16c9400640 1 -- 172.21.15.154:0/391203266 wait complete. 2024-05-14T10:20:04.360 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-14T10:20:04.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.577+0000 7ff869e51640 1 Processor -- start 2024-05-14T10:20:04.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.577+0000 7ff869e51640 1 -- start start 2024-05-14T10:20:04.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.581+0000 7ff869e51640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8640ca880 0x7ff8640719d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:04.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.581+0000 7ff869e51640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8640cadf0 con 0x7ff864159f90 2024-05-14T10:20:04.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.581+0000 7ff869e51640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8640cb0d0 con 0x7ff86415dbc0 2024-05-14T10:20:04.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.581+0000 7ff869e51640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff8640cb3b0 con 0x7ff8640ca880 2024-05-14T10:20:04.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.581+0000 7ff863fff640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7ff86415dbc0 0x7ff86406d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.154:55102/0 (socket says 172.21.15.154:55102) 2024-05-14T10:20:04.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.581+0000 7ff863fff640 1 -- 172.21.15.154:0/1957124807 learned_addr learned my addr 172.21.15.154:0/1957124807 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:20:04.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.581+0000 7ff8627fc640 1 -- 172.21.15.154:0/1957124807 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 648379893 0 0) 0x7ff8640cb0d0 con 0x7ff86415dbc0 2024-05-14T10:20:04.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.585+0000 7ff862ffd640 1 --2- 172.21.15.154:0/1957124807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8640ca880 0x7ff8640719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:04.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.585+0000 7ff8627fc640 1 -- 172.21.15.154:0/1957124807 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff84c003530 con 0x7ff86415dbc0 2024-05-14T10:20:04.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.585+0000 7ff862ffd640 1 -- 172.21.15.154:0/1957124807 >> v1:172.21.15.176:6789/0 conn(0x7ff86415dbc0 legacy=0x7ff86406d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:04.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.585+0000 7ff862ffd640 1 -- 172.21.15.154:0/1957124807 >> v1:172.21.15.154:6789/0 conn(0x7ff864159f90 legacy=0x7ff8640cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:04.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.585+0000 7ff862ffd640 1 -- 172.21.15.154:0/1957124807 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8640cb690 con 0x7ff8640ca880 2024-05-14T10:20:04.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.593+0000 7ff862ffd640 1 --2- 172.21.15.154:0/1957124807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8640ca880 0x7ff8640719d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff85c009dc0 tx=0x7ff85c020c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd56ac9fd56739c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:04.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.597+0000 7ff8627fc640 1 -- 172.21.15.154:0/1957124807 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0b6070 con 0x7ff8640ca880 2024-05-14T10:20:04.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.601+0000 7ff8627fc640 1 -- 172.21.15.154:0/1957124807 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff85c0a9bb0 con 0x7ff8640ca880 2024-05-14T10:20:04.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.601+0000 7ff8627fc640 1 -- 172.21.15.154:0/1957124807 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0b1440 con 0x7ff8640ca880 2024-05-14T10:20:04.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.609+0000 7ff869e51640 1 -- 172.21.15.154:0/1957124807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8640ca880 msgr2=0x7ff8640719d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:04.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.609+0000 7ff869e51640 1 --2- 172.21.15.154:0/1957124807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8640ca880 0x7ff8640719d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff85c009dc0 tx=0x7ff85c020c00 comp rx=0 tx=0).stop 2024-05-14T10:20:04.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.629+0000 7ff869e51640 1 -- 172.21.15.154:0/1957124807 shutdown_connections 2024-05-14T10:20:04.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.629+0000 7ff869e51640 1 --2- 172.21.15.154:0/1957124807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8640ca880 0x7ff8640719d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:04.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.629+0000 7ff869e51640 1 -- 172.21.15.154:0/1957124807 >> 172.21.15.154:0/1957124807 conn(0x7ff8640cfb10 msgr2=0x7ff8640cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:04.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.633+0000 7ff869e51640 1 -- 172.21.15.154:0/1957124807 shutdown_connections 2024-05-14T10:20:04.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.633+0000 7ff869e51640 1 -- 172.21.15.154:0/1957124807 wait complete. 2024-05-14T10:20:04.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.633+0000 7ff869e51640 1 Processor -- start 2024-05-14T10:20:04.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.633+0000 7ff869e51640 1 -- start start 2024-05-14T10:20:04.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.633+0000 7ff869e51640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8640ca880 0x7ff864157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:04.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.633+0000 7ff869e51640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff864159f90 0x7ff864149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:04.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.633+0000 7ff869e51640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff86415dbc0 0x7ff8640c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:04.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.633+0000 7ff869e51640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff864072090 con 0x7ff86415dbc0 2024-05-14T10:20:04.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.633+0000 7ff869e51640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff864071f10 con 0x7ff8640ca880 2024-05-14T10:20:04.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.633+0000 7ff869e51640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff86406d760 con 0x7ff864159f90 2024-05-14T10:20:04.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.633+0000 7ff863fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff86415dbc0 0x7ff8640c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:04.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.633+0000 7ff863fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff86415dbc0 0x7ff8640c9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56732/0 (socket says 172.21.15.154:56732) 2024-05-14T10:20:04.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.633+0000 7ff863fff640 1 -- 172.21.15.154:0/3942297345 learned_addr learned my addr 172.21.15.154:0/3942297345 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:04.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.633+0000 7ff8637fe640 1 --2- 172.21.15.154:0/3942297345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8640ca880 0x7ff864157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:04.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.637+0000 7ff863fff640 1 -- 172.21.15.154:0/3942297345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff864159f90 msgr2=0x7ff864149fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-14T10:20:04.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.637+0000 7ff863fff640 1 --2- 172.21.15.154:0/3942297345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff864159f90 0x7ff864149fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:04.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.637+0000 7ff863fff640 1 -- 172.21.15.154:0/3942297345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8640ca880 msgr2=0x7ff864157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:04.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.637+0000 7ff863fff640 1 --2- 172.21.15.154:0/3942297345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8640ca880 0x7ff864157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:04.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.637+0000 7ff863fff640 1 -- 172.21.15.154:0/3942297345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff864157960 con 0x7ff86415dbc0 2024-05-14T10:20:04.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.637+0000 7ff863fff640 1 --2- 172.21.15.154:0/3942297345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff86415dbc0 0x7ff8640c9560 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7ff85400c3c0 tx=0x7ff85400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:04.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.637+0000 7ff8637fe640 1 --2- 172.21.15.154:0/3942297345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8640ca880 0x7ff864157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T10:20:04.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.709+0000 7ff84bfff640 1 -- 172.21.15.154:0/3942297345 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854017070 con 0x7ff86415dbc0 2024-05-14T10:20:04.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.709+0000 7ff869e51640 1 -- 172.21.15.154:0/3942297345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff864157c40 con 0x7ff86415dbc0 2024-05-14T10:20:04.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.709+0000 7ff869e51640 1 -- 172.21.15.154:0/3942297345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff864158200 con 0x7ff86415dbc0 2024-05-14T10:20:04.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.709+0000 7ff84bfff640 1 -- 172.21.15.154:0/3942297345 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff854005db0 con 0x7ff86415dbc0 2024-05-14T10:20:04.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.709+0000 7ff84bfff640 1 -- 172.21.15.154:0/3942297345 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854007310 con 0x7ff86415dbc0 2024-05-14T10:20:04.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.721+0000 7ff84bfff640 1 -- 172.21.15.154:0/3942297345 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff85401a070 con 0x7ff86415dbc0 2024-05-14T10:20:04.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.721+0000 7ff84bfff640 1 --2- 172.21.15.154:0/3942297345 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff850067990 0x7ff850069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:04.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.721+0000 7ff84bfff640 1 -- 172.21.15.154:0/3942297345 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7ff854084d90 con 0x7ff86415dbc0 2024-05-14T10:20:04.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.721+0000 7ff8637fe640 1 --2- 172.21.15.154:0/3942297345 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff850067990 0x7ff850069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:04.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.729+0000 7ff869e51640 1 -- 172.21.15.154:0/3942297345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8440052a0 con 0x7ff86415dbc0 2024-05-14T10:20:04.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.741+0000 7ff8637fe640 1 --2- 172.21.15.154:0/3942297345 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff850067990 0x7ff850069e50 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff8580019a0 tx=0x7ff858009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:04.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:04.741+0000 7ff84bfff640 1 -- 172.21.15.154:0/3942297345 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7ff854055bb0 con 0x7ff86415dbc0 2024-05-14T10:20:05.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.585+0000 7ff869e51640 1 -- 172.21.15.154:0/3942297345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7ff844005da0 con 0x7ff86415dbc0 2024-05-14T10:20:05.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.621+0000 7ff84bfff640 1 -- 172.21.15.154:0/3942297345 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7ff8540554b0 con 0x7ff86415dbc0 2024-05-14T10:20:05.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.649+0000 7ff869e51640 1 -- 172.21.15.154:0/3942297345 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff850067990 msgr2=0x7ff850069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:05.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.649+0000 7ff869e51640 1 --2- 172.21.15.154:0/3942297345 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff850067990 0x7ff850069e50 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff8580019a0 tx=0x7ff858009040 comp rx=0 tx=0).stop 2024-05-14T10:20:05.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.649+0000 7ff869e51640 1 -- 172.21.15.154:0/3942297345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff86415dbc0 msgr2=0x7ff8640c9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:05.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.649+0000 7ff869e51640 1 --2- 172.21.15.154:0/3942297345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff86415dbc0 0x7ff8640c9560 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7ff85400c3c0 tx=0x7ff85400c880 comp rx=0 tx=0).stop 2024-05-14T10:20:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.649+0000 7ff869e51640 1 -- 172.21.15.154:0/3942297345 shutdown_connections 2024-05-14T10:20:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.649+0000 7ff869e51640 1 --2- 172.21.15.154:0/3942297345 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7ff850067990 0x7ff850069e50 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.649+0000 7ff869e51640 1 --2- 172.21.15.154:0/3942297345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff86415dbc0 0x7ff8640c9560 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.649+0000 7ff869e51640 1 --2- 172.21.15.154:0/3942297345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff864159f90 0x7ff864149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.649+0000 7ff869e51640 1 --2- 172.21.15.154:0/3942297345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8640ca880 0x7ff864157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.649+0000 7ff869e51640 1 -- 172.21.15.154:0/3942297345 >> 172.21.15.154:0/3942297345 conn(0x7ff8640cfb10 msgr2=0x7ff8640cbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.649+0000 7ff869e51640 1 -- 172.21.15.154:0/3942297345 shutdown_connections 2024-05-14T10:20:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.649+0000 7ff869e51640 1 -- 172.21.15.154:0/3942297345 wait complete. 2024-05-14T10:20:05.735 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-05-14T10:20:06.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.997+0000 7fcd42ce7640 1 Processor -- start 2024-05-14T10:20:06.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.997+0000 7fcd42ce7640 1 -- start start 2024-05-14T10:20:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.997+0000 7fcd42ce7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd3c15ae10 0x7fcd3c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.997+0000 7fcd42ce7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd3c06e410 0x7fcd3c070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.997+0000 7fcd42ce7640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd3c13dee0 con 0x7fcd3c13ce00 2024-05-14T10:20:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.997+0000 7fcd42ce7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fcd3c06ce30 con 0x7fcd3c15ae10 2024-05-14T10:20:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.997+0000 7fcd42ce7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcd3c06d110 con 0x7fcd3c06e410 2024-05-14T10:20:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.997+0000 7fcd3bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd3c15ae10 0x7fcd3c06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:05.997+0000 7fcd3bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd3c15ae10 0x7fcd3c06ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56738/0 (socket says 172.21.15.154:56738) 2024-05-14T10:20:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.001+0000 7fcd3bfff640 1 -- 172.21.15.154:0/1774831658 learned_addr learned my addr 172.21.15.154:0/1774831658 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.001+0000 7fcd41284640 1 --2- 172.21.15.154:0/1774831658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd3c06e410 0x7fcd3c070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:06.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.001+0000 7fcd3bfff640 1 -- 172.21.15.154:0/1774831658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd3c06e410 msgr2=0x7fcd3c070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:06.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.001+0000 7fcd3bfff640 1 --2- 172.21.15.154:0/1774831658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd3c06e410 0x7fcd3c070f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:06.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.001+0000 7fcd3bfff640 1 -- 172.21.15.154:0/1774831658 >> v1:172.21.15.176:6789/0 conn(0x7fcd3c13ce00 legacy=0x7fcd3c13d670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T10:20:06.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.001+0000 7fcd3bfff640 1 -- 172.21.15.154:0/1774831658 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3c06d3f0 con 0x7fcd3c15ae10 2024-05-14T10:20:06.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.001+0000 7fcd3bfff640 1 --2- 172.21.15.154:0/1774831658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3c15ae10 0x7fcd3c06ded0 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009da0 tx=0x7fcd3401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db750c0055049b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:06.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.009+0000 7fcd3b7fe640 1 -- 172.21.15.154:0/1774831658 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd340a5860 con 0x7fcd3c15ae10 2024-05-14T10:20:06.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.009+0000 7fcd3b7fe640 1 -- 172.21.15.154:0/1774831658 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd340a5a00 con 0x7fcd3c15ae10 2024-05-14T10:20:06.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.009+0000 7fcd3b7fe640 1 -- 172.21.15.154:0/1774831658 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd340a5db0 con 0x7fcd3c15ae10 2024-05-14T10:20:06.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.013+0000 7fcd42ce7640 1 -- 172.21.15.154:0/1774831658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3c15ae10 msgr2=0x7fcd3c06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:06.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.013+0000 7fcd42ce7640 1 --2- 172.21.15.154:0/1774831658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3c15ae10 0x7fcd3c06ded0 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009da0 tx=0x7fcd3401c9e0 comp rx=0 tx=0).stop 2024-05-14T10:20:06.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.013+0000 7fcd42ce7640 1 -- 172.21.15.154:0/1774831658 shutdown_connections 2024-05-14T10:20:06.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.013+0000 7fcd42ce7640 1 --2- 172.21.15.154:0/1774831658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd3c06e410 0x7fcd3c070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:06.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.013+0000 7fcd42ce7640 1 --2- 172.21.15.154:0/1774831658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3c15ae10 0x7fcd3c06ded0 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:06.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.013+0000 7fcd42ce7640 1 -- 172.21.15.154:0/1774831658 >> 172.21.15.154:0/1774831658 conn(0x7fcd3c0b1670 msgr2=0x7fcd3c0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:06.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.021+0000 7fcd42ce7640 1 -- 172.21.15.154:0/1774831658 shutdown_connections 2024-05-14T10:20:06.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.025+0000 7fcd42ce7640 1 -- 172.21.15.154:0/1774831658 wait complete. 2024-05-14T10:20:06.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.025+0000 7fcd42ce7640 1 Processor -- start 2024-05-14T10:20:06.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.025+0000 7fcd42ce7640 1 -- start start 2024-05-14T10:20:06.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.029+0000 7fcd42ce7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd3c06e410 0x7fcd3c0cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:06.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.029+0000 7fcd42ce7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3c13ce00 0x7fcd3c13c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:06.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.029+0000 7fcd42ce7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd3c14f4e0 0x7fcd3c14f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:06.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.029+0000 7fcd42ce7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3c15eb20 con 0x7fcd3c13ce00 2024-05-14T10:20:06.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.029+0000 7fcd42ce7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3c15e9a0 con 0x7fcd3c06e410 2024-05-14T10:20:06.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.029+0000 7fcd42ce7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcd3c0714a0 con 0x7fcd3c14f4e0 2024-05-14T10:20:06.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.029+0000 7fcd40a83640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd3c06e410 0x7fcd3c0cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:06.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.029+0000 7fcd40a83640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd3c06e410 0x7fcd3c0cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.154:52826/0 (socket says 172.21.15.154:52826) 2024-05-14T10:20:06.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.029+0000 7fcd40a83640 1 -- 172.21.15.154:0/671757294 learned_addr learned my addr 172.21.15.154:0/671757294 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:06.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.029+0000 7fcd40a83640 1 -- 172.21.15.154:0/671757294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd3c14f4e0 msgr2=0x7fcd3c14f990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T10:20:06.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.029+0000 7fcd40a83640 1 --2- 172.21.15.154:0/671757294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd3c14f4e0 0x7fcd3c14f990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:06.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.029+0000 7fcd40a83640 1 -- 172.21.15.154:0/671757294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3c13ce00 msgr2=0x7fcd3c13c5b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T10:20:06.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.029+0000 7fcd40a83640 1 --2- 172.21.15.154:0/671757294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3c13ce00 0x7fcd3c13c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:06.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.029+0000 7fcd40a83640 1 -- 172.21.15.154:0/671757294 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3c13b7b0 con 0x7fcd3c06e410 2024-05-14T10:20:06.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.029+0000 7fcd40a83640 1 --2- 172.21.15.154:0/671757294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd3c06e410 0x7fcd3c0cc570 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00b4d0 tx=0x7fcd2c00b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:06.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.049+0000 7fcd397fa640 1 -- 172.21.15.154:0/671757294 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c014070 con 0x7fcd3c06e410 2024-05-14T10:20:06.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.049+0000 7fcd397fa640 1 -- 172.21.15.154:0/671757294 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd2c010870 con 0x7fcd3c06e410 2024-05-14T10:20:06.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.049+0000 7fcd42ce7640 1 -- 172.21.15.154:0/671757294 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd3c0ccc70 con 0x7fcd3c06e410 2024-05-14T10:20:06.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.049+0000 7fcd42ce7640 1 -- 172.21.15.154:0/671757294 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd3c0cd230 con 0x7fcd3c06e410 2024-05-14T10:20:06.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.049+0000 7fcd397fa640 1 -- 172.21.15.154:0/671757294 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c010c60 con 0x7fcd3c06e410 2024-05-14T10:20:06.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.053+0000 7fcd42ce7640 1 -- 172.21.15.154:0/671757294 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd1c0052a0 con 0x7fcd3c06e410 2024-05-14T10:20:06.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.053+0000 7fcd397fa640 1 -- 172.21.15.154:0/671757294 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcd2c017070 con 0x7fcd3c06e410 2024-05-14T10:20:06.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.053+0000 7fcd397fa640 1 --2- 172.21.15.154:0/671757294 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fcd28067940 0x7fcd28069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:06.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.053+0000 7fcd397fa640 1 -- 172.21.15.154:0/671757294 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fcd2c085b00 con 0x7fcd3c06e410 2024-05-14T10:20:06.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.053+0000 7fcd3bfff640 1 --2- 172.21.15.154:0/671757294 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fcd28067940 0x7fcd28069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:06.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.053+0000 7fcd3bfff640 1 --2- 172.21.15.154:0/671757294 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fcd28067940 0x7fcd28069e00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fcd340ae000 tx=0x7fcd340a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:06.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.157+0000 7fcd397fa640 1 -- 172.21.15.154:0/671757294 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fcd2c01e070 con 0x7fcd3c06e410 2024-05-14T10:20:06.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:06.749+0000 7fcd42ce7640 1 -- 172.21.15.154:0/671757294 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7fcd1c005590 con 0x7fcd3c06e410 2024-05-14T10:20:07.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:07.357+0000 7fcd397fa640 1 -- 172.21.15.154:0/671757294 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v16176) ==== 144+0+0 (secure 0 0 0) 0x7fcd2c018e90 con 0x7fcd3c06e410 2024-05-14T10:20:07.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:07.357+0000 7fcd42ce7640 1 -- 172.21.15.154:0/671757294 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fcd28067940 msgr2=0x7fcd28069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:07.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:07.357+0000 7fcd42ce7640 1 --2- 172.21.15.154:0/671757294 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fcd28067940 0x7fcd28069e00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fcd340ae000 tx=0x7fcd340a7070 comp rx=0 tx=0).stop 2024-05-14T10:20:07.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:07.357+0000 7fcd42ce7640 1 -- 172.21.15.154:0/671757294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd3c06e410 msgr2=0x7fcd3c0cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:07.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:07.357+0000 7fcd42ce7640 1 --2- 172.21.15.154:0/671757294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd3c06e410 0x7fcd3c0cc570 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00b4d0 tx=0x7fcd2c00b990 comp rx=0 tx=0).stop 2024-05-14T10:20:07.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:07.357+0000 7fcd42ce7640 1 -- 172.21.15.154:0/671757294 shutdown_connections 2024-05-14T10:20:07.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:07.357+0000 7fcd42ce7640 1 --2- 172.21.15.154:0/671757294 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fcd28067940 0x7fcd28069e00 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:07.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:07.357+0000 7fcd42ce7640 1 --2- 172.21.15.154:0/671757294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd3c14f4e0 0x7fcd3c14f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:07.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:07.357+0000 7fcd42ce7640 1 --2- 172.21.15.154:0/671757294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3c13ce00 0x7fcd3c13c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:07.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:07.357+0000 7fcd42ce7640 1 --2- 172.21.15.154:0/671757294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd3c06e410 0x7fcd3c0cc570 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:07.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:07.357+0000 7fcd42ce7640 1 -- 172.21.15.154:0/671757294 >> 172.21.15.154:0/671757294 conn(0x7fcd3c0b1670 msgr2=0x7fcd3c158240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:07.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:07.357+0000 7fcd42ce7640 1 -- 172.21.15.154:0/671757294 shutdown_connections 2024-05-14T10:20:07.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:07.357+0000 7fcd42ce7640 1 -- 172.21.15.154:0/671757294 wait complete. 2024-05-14T10:20:07.421 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2024-05-14T10:20:07.421 INFO:tasks.cephfs_test_runner: 2024-05-14T10:20:07.422 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-14T10:20:07.422 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-05-14T10:20:07.422 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-14T10:20:07.422 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-14T10:20:07.422 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_2ba596c3826798bb3a2f22bc9b02848b92dbe579/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-05-14T10:20:07.422 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2024-05-14T10:20:07.422 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_2ba596c3826798bb3a2f22bc9b02848b92dbe579/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-05-14T10:20:07.422 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2024-05-14T10:20:07.422 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_2ba596c3826798bb3a2f22bc9b02848b92dbe579/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-05-14T10:20:07.422 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2024-05-14T10:20:07.422 INFO:tasks.cephfs_test_runner:AssertionError: 17 != 0 2024-05-14T10:20:07.422 INFO:tasks.cephfs_test_runner: 2024-05-14T10:20:07.422 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-14T10:20:07.422 INFO:tasks.cephfs_test_runner:Ran 1 test in 32162.800s 2024-05-14T10:20:07.423 INFO:tasks.cephfs_test_runner: 2024-05-14T10:20:07.423 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-05-14T10:20:07.423 INFO:tasks.cephfs_test_runner: 2024-05-14T10:20:07.423 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-14T10:20:07.423 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-05-14T10:20:07.423 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-14T10:20:07.423 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-14T10:20:07.423 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_2ba596c3826798bb3a2f22bc9b02848b92dbe579/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-05-14T10:20:07.423 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2024-05-14T10:20:07.423 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_2ba596c3826798bb3a2f22bc9b02848b92dbe579/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-05-14T10:20:07.423 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2024-05-14T10:20:07.423 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_2ba596c3826798bb3a2f22bc9b02848b92dbe579/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-05-14T10:20:07.423 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2024-05-14T10:20:07.424 INFO:tasks.cephfs_test_runner:AssertionError: 17 != 0 2024-05-14T10:20:07.424 INFO:tasks.cephfs_test_runner: 2024-05-14T10:20:07.424 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_2ba596c3826798bb3a2f22bc9b02848b92dbe579/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-05-14T10:20:07.672 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=00be41d5421a42af9c049f8edc168864 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_2ba596c3826798bb3a2f22bc9b02848b92dbe579/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-05-14T10:20:07.673 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-14T10:20:07.685 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-14T10:20:07.698 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-14T10:20:07.698 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T10:20:07.698 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T10:20:07.712 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16184 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274688k,nr_inodes=818672,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-14T10:20:07.712 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-14T10:20:07.712 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T10:20:07.758 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16184 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274688k,nr_inodes=818672,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274688k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-14T10:20:07.758 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T10:20:07.758 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T10:20:07.836 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336508k,nr_inodes=4084127,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274692k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16957 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274688k,nr_inodes=818672,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274692k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-14T10:20:07.836 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-05-14T10:20:07.836 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T10:20:07.842 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336508k,nr_inodes=4084127,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274692k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16957 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274688k,nr_inodes=818672,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274692k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-14T10:20:07.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T10:20:07.842 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-05-14T10:20:07.925 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-14T10:20:07.926 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-14T10:20:07.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T10:20:07.926 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-14T10:20:07.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T10:20:07.981 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T10:20:08.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T10:20:08.036 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-05-14T10:20:08.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T10:20:08.258 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-05-14T10:20:08.292 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-14T10:20:08.292 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-14T10:20:08.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T10:20:08.293 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T10:20:08.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T10:20:08.348 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T10:20:08.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T10:20:08.430 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2024-05-14T10:20:08.628 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-14T10:20:08.638 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-14T10:20:08.638 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T10:20:08.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.753+0000 7f992f198640 1 Processor -- start 2024-05-14T10:20:08.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.753+0000 7f992f198640 1 -- start start 2024-05-14T10:20:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.757+0000 7f992f198640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9928141d00 0x7f99280ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.757+0000 7f992f198640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f99280ce880 0x7f992806d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.757+0000 7f992f198640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99280cf100 con 0x7f992813ede0 2024-05-14T10:20:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.757+0000 7f992f198640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f992806cff0 con 0x7f99280ce880 2024-05-14T10:20:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.757+0000 7f992f198640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f99280cf3e0 con 0x7f9928141d00 2024-05-14T10:20:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.757+0000 7f992d735640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f99280ce880 0x7f992806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.757+0000 7f992cf34640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f992813ede0 0x7f99281415f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46714/0 (socket says 172.21.15.154:46714) 2024-05-14T10:20:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.757+0000 7f992cf34640 1 -- 172.21.15.154:0/3646116282 learned_addr learned my addr 172.21.15.154:0/3646116282 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:20:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.757+0000 7f9927fff640 1 --2- 172.21.15.154:0/3646116282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9928141d00 0x7f99280ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.757+0000 7f992d735640 1 -- 172.21.15.154:0/3646116282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9928141d00 msgr2=0x7f99280ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.757+0000 7f992d735640 1 --2- 172.21.15.154:0/3646116282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9928141d00 0x7f99280ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.757+0000 7f992d735640 1 -- 172.21.15.154:0/3646116282 >> v1:172.21.15.154:6789/0 conn(0x7f992813ede0 legacy=0x7f99281415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.757+0000 7f99277fe640 1 -- 172.21.15.154:0/3646116282 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135890203 0 0) 0x7f99280cf100 con 0x7f992813ede0 2024-05-14T10:20:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.757+0000 7f992d735640 1 -- 172.21.15.154:0/3646116282 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992806cc80 con 0x7f99280ce880 2024-05-14T10:20:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.757+0000 7f992d735640 1 --2- 172.21.15.154:0/3646116282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99280ce880 0x7f992806d480 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f99200097c0 tx=0x7f992001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9bcae651df6ad6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.757+0000 7f99277fe640 1 -- 172.21.15.154:0/3646116282 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99200ab430 con 0x7f99280ce880 2024-05-14T10:20:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.757+0000 7f99277fe640 1 -- 172.21.15.154:0/3646116282 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99200b0070 con 0x7f99280ce880 2024-05-14T10:20:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.757+0000 7f99277fe640 1 -- 172.21.15.154:0/3646116282 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99200ab7f0 con 0x7f99280ce880 2024-05-14T10:20:08.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992f198640 1 -- 172.21.15.154:0/3646116282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99280ce880 msgr2=0x7f992806d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:08.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992f198640 1 --2- 172.21.15.154:0/3646116282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99280ce880 0x7f992806d480 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f99200097c0 tx=0x7f992001c460 comp rx=0 tx=0).stop 2024-05-14T10:20:08.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992f198640 1 -- 172.21.15.154:0/3646116282 shutdown_connections 2024-05-14T10:20:08.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992f198640 1 --2- 172.21.15.154:0/3646116282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99280ce880 0x7f992806d480 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:08.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992f198640 1 --2- 172.21.15.154:0/3646116282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9928141d00 0x7f99280ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:08.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992f198640 1 -- 172.21.15.154:0/3646116282 >> 172.21.15.154:0/3646116282 conn(0x7f99280b1850 msgr2=0x7f99280b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:08.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992f198640 1 -- 172.21.15.154:0/3646116282 shutdown_connections 2024-05-14T10:20:08.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992f198640 1 -- 172.21.15.154:0/3646116282 wait complete. 2024-05-14T10:20:08.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992f198640 1 Processor -- start 2024-05-14T10:20:08.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992f198640 1 -- start start 2024-05-14T10:20:08.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992f198640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99280ce880 0x7f9928138810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:08.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992f198640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f992813ede0 0x7f9928139450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:08.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992f198640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9928141d00 0x7f9928139990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:08.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992f198640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f992806e350 con 0x7f9928141d00 2024-05-14T10:20:08.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992f198640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f992806e1d0 con 0x7f992813ede0 2024-05-14T10:20:08.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992f198640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f992806e4d0 con 0x7f99280ce880 2024-05-14T10:20:08.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992d735640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9928141d00 0x7f9928139990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:08.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992d735640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9928141d00 0x7f9928139990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55684/0 (socket says 172.21.15.154:55684) 2024-05-14T10:20:08.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992d735640 1 -- 172.21.15.154:0/4147824883 learned_addr learned my addr 172.21.15.154:0/4147824883 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:08.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f9927fff640 1 --2- 172.21.15.154:0/4147824883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f992813ede0 0x7f9928139450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:08.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992cf34640 1 --2- 172.21.15.154:0/4147824883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99280ce880 0x7f9928138810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:08.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992d735640 1 -- 172.21.15.154:0/4147824883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99280ce880 msgr2=0x7f9928138810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:08.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992d735640 1 --2- 172.21.15.154:0/4147824883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99280ce880 0x7f9928138810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:08.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992d735640 1 -- 172.21.15.154:0/4147824883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f992813ede0 msgr2=0x7f9928139450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:08.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992d735640 1 --2- 172.21.15.154:0/4147824883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f992813ede0 0x7f9928139450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:08.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992d735640 1 -- 172.21.15.154:0/4147824883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992815b1b0 con 0x7f9928141d00 2024-05-14T10:20:08.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992cf34640 1 --2- 172.21.15.154:0/4147824883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99280ce880 0x7f9928138810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:20:08.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f992d735640 1 --2- 172.21.15.154:0/4147824883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9928141d00 0x7f9928139990 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f99200ad040 tx=0x7f9920019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:08.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f99257fa640 1 -- 172.21.15.154:0/4147824883 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99200bc420 con 0x7f9928141d00 2024-05-14T10:20:08.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f99257fa640 1 -- 172.21.15.154:0/4147824883 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99200bc5c0 con 0x7f9928141d00 2024-05-14T10:20:08.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.761+0000 7f99257fa640 1 -- 172.21.15.154:0/4147824883 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99200bc990 con 0x7f9928141d00 2024-05-14T10:20:08.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.765+0000 7f992f198640 1 -- 172.21.15.154:0/4147824883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9928166630 con 0x7f9928141d00 2024-05-14T10:20:08.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.765+0000 7f992f198640 1 -- 172.21.15.154:0/4147824883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9928159350 con 0x7f9928141d00 2024-05-14T10:20:08.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.765+0000 7f992f198640 1 -- 172.21.15.154:0/4147824883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9928075470 con 0x7f9928141d00 2024-05-14T10:20:08.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.765+0000 7f99257fa640 1 -- 172.21.15.154:0/4147824883 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f99200c3060 con 0x7f9928141d00 2024-05-14T10:20:08.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.765+0000 7f99257fa640 1 --2- 172.21.15.154:0/4147824883 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99080678c0 0x7f9908069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:08.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.765+0000 7f99257fa640 1 -- 172.21.15.154:0/4147824883 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f992011fb60 con 0x7f9928141d00 2024-05-14T10:20:08.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.765+0000 7f992cf34640 1 --2- 172.21.15.154:0/4147824883 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99080678c0 0x7f9908069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:08.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.765+0000 7f992cf34640 1 --2- 172.21.15.154:0/4147824883 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99080678c0 0x7f9908069d80 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f9918005fd0 tx=0x7f9918005b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:08.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.769+0000 7f99257fa640 1 -- 172.21.15.154:0/4147824883 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f9920016050 con 0x7f9928141d00 2024-05-14T10:20:08.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.913+0000 7f992f198640 1 -- 172.21.15.154:0/4147824883 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f992806f180 con 0x7f99080678c0 2024-05-14T10:20:08.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.945+0000 7f99257fa640 1 -- 172.21.15.154:0/4147824883 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13757 (secure 0 0 0) 0x7f992806f180 con 0x7f99080678c0 2024-05-14T10:20:08.950 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:20:08.951 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-05-14T10:20:08.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.945+0000 7f992f198640 1 -- 172.21.15.154:0/4147824883 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99080678c0 msgr2=0x7f9908069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:08.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.945+0000 7f992f198640 1 --2- 172.21.15.154:0/4147824883 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99080678c0 0x7f9908069d80 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f9918005fd0 tx=0x7f9918005b80 comp rx=0 tx=0).stop 2024-05-14T10:20:08.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.945+0000 7f992f198640 1 -- 172.21.15.154:0/4147824883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9928141d00 msgr2=0x7f9928139990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:08.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.945+0000 7f992f198640 1 --2- 172.21.15.154:0/4147824883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9928141d00 0x7f9928139990 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f99200ad040 tx=0x7f9920019200 comp rx=0 tx=0).stop 2024-05-14T10:20:08.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.945+0000 7f992f198640 1 -- 172.21.15.154:0/4147824883 shutdown_connections 2024-05-14T10:20:08.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.945+0000 7f992f198640 1 --2- 172.21.15.154:0/4147824883 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f99080678c0 0x7f9908069d80 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:08.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.945+0000 7f992f198640 1 --2- 172.21.15.154:0/4147824883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9928141d00 0x7f9928139990 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:08.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.945+0000 7f992f198640 1 --2- 172.21.15.154:0/4147824883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f992813ede0 0x7f9928139450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:08.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.945+0000 7f992f198640 1 --2- 172.21.15.154:0/4147824883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99280ce880 0x7f9928138810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:08.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.945+0000 7f992f198640 1 -- 172.21.15.154:0/4147824883 >> 172.21.15.154:0/4147824883 conn(0x7f99280b1850 msgr2=0x7f9928140700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:08.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.945+0000 7f992f198640 1 -- 172.21.15.154:0/4147824883 shutdown_connections 2024-05-14T10:20:08.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:08.945+0000 7f992f198640 1 -- 172.21.15.154:0/4147824883 wait complete. 2024-05-14T10:20:08.968 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":16127,"stamp":"2024-05-14T10:20:08.647221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":57544596,"kb_used_data":45499440,"kb_used_omap":5312,"kb_used_meta":11994687,"kb_avail":697430124,"statfs":{"total":773094113280,"available":714168446976,"internally_reserved":0,"allocated":46591426560,"data_stored":46581446160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5439617,"internal_metadata":12282560383},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,3,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-24994256957,"num_objects":-13859,"num_object_clones":0,"num_object_copies":-27718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13859,"num_whiteouts":0,"num_read":-1943171,"num_read_kb":-134102132,"num_write":-7546986,"num_write_kb":-203932194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-233,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.083781"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":465,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T10:20:03.423974+0000","last_change":"2024-05-14T01:23:25.487525+0000","last_active":"2024-05-14T10:20:03.423974+0000","last_peered":"2024-05-14T10:20:03.423974+0000","last_clean":"2024-05-14T10:20:03.423974+0000","last_became_active":"2024-05-14T01:23:25.485622+0000","last_became_peered":"2024-05-14T01:23:25.485622+0000","last_unstale":"2024-05-14T10:20:03.423974+0000","last_undegraded":"2024-05-14T10:20:03.423974+0000","last_fullsized":"2024-05-14T10:20:03.423974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_clean_scrub_stamp":"2024-05-14T01:23:24.138255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:26:23.884962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834581285,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8232408,"kb_used_data":6610508,"kb_used_omap":1194,"kb_used_meta":1620693,"kb_avail":86139432,"statfs":{"total":96636764160,"available":88206778368,"internally_reserved":0,"allocated":6769160192,"data_stored":6767644738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1223070,"internal_metadata":1659590242},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834581289,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6121736,"kb_used_data":4449980,"kb_used_omap":352,"kb_used_meta":1671391,"kb_avail":88250104,"statfs":{"total":96636764160,"available":90368106496,"internally_reserved":0,"allocated":4556779520,"data_stored":4555796822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":361293,"internal_metadata":1711504563},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834581290,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7463464,"kb_used_data":6030748,"kb_used_omap":181,"kb_used_meta":1432522,"kb_avail":86908376,"statfs":{"total":96636764160,"available":88994177024,"internally_reserved":0,"allocated":6175485952,"data_stored":6174120157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":185918,"internal_metadata":1466902978},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581292,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5567048,"kb_used_data":4128888,"kb_used_omap":656,"kb_used_meta":1437487,"kb_avail":88804792,"statfs":{"total":96636764160,"available":90936107008,"internally_reserved":0,"allocated":4227981312,"data_stored":4226956589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":672060,"internal_metadata":1471987396},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581291,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7749220,"kb_used_data":6087896,"kb_used_omap":593,"kb_used_meta":1660718,"kb_avail":86622620,"statfs":{"total":96636764160,"available":88701562880,"internally_reserved":0,"allocated":6234005504,"data_stored":6232825278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":608131,"internal_metadata":1700575357},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581292,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8059244,"kb_used_data":6732320,"kb_used_omap":821,"kb_used_meta":1326090,"kb_avail":86312596,"statfs":{"total":96636764160,"available":88384098304,"internally_reserved":0,"allocated":6893895680,"data_stored":6892393638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":841622,"internal_metadata":1357916266},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834581277,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8516024,"kb_used_data":6947052,"kb_used_omap":1168,"kb_used_meta":1567791,"kb_avail":85855816,"statfs":{"total":96636764160,"available":87916355584,"internally_reserved":0,"allocated":7113781248,"data_stored":7112405378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1196755,"internal_metadata":1605418285},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834581285,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5835452,"kb_used_data":4512048,"kb_used_omap":342,"kb_used_meta":1277993,"kb_avail":88536388,"statfs":{"total":96636764160,"available":90661261312,"internally_reserved":0,"allocated":4620337152,"data_stored":4619303560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":350768,"internal_metadata":1308665296},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T10:20:08.969 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T10:20:09.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.073+0000 7fd17f7f6640 1 Processor -- start 2024-05-14T10:20:09.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.073+0000 7fd17f7f6640 1 -- start start 2024-05-14T10:20:09.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.073+0000 7fd17f7f6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd17813ede0 0x7fd1781415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:09.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.073+0000 7fd17f7f6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1780cf100 con 0x7fd178141b30 2024-05-14T10:20:09.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.073+0000 7fd17f7f6640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1780cf3e0 con 0x7fd1780cea50 2024-05-14T10:20:09.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.073+0000 7fd17f7f6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd1780ceee0 con 0x7fd17813ede0 2024-05-14T10:20:09.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.073+0000 7fd17d592640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd17813ede0 0x7fd1781415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:09.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.073+0000 7fd17cd91640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd178141b30 0x7fd1780ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46730/0 (socket says 172.21.15.154:46730) 2024-05-14T10:20:09.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.073+0000 7fd17cd91640 1 -- 172.21.15.154:0/1281469192 learned_addr learned my addr 172.21.15.154:0/1281469192 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:20:09.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.073+0000 7fd17d592640 1 -- 172.21.15.154:0/1281469192 >> v1:172.21.15.176:6789/0 conn(0x7fd1780cea50 legacy=0x7fd17806d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:09.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.073+0000 7fd17d592640 1 -- 172.21.15.154:0/1281469192 >> v1:172.21.15.154:6789/0 conn(0x7fd178141b30 legacy=0x7fd1780ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:09.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.073+0000 7fd17d592640 1 -- 172.21.15.154:0/1281469192 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17806cc80 con 0x7fd17813ede0 2024-05-14T10:20:09.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.073+0000 7fd16bfff640 1 -- 172.21.15.154:0/1281469192 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123468374 0 0) 0x7fd1780cf100 con 0x7fd178141b30 2024-05-14T10:20:09.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.073+0000 7fd17d592640 1 --2- 172.21.15.154:0/1281469192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd17813ede0 0x7fd1781415f0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7fd1740097f0 tx=0x7fd17401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505dae8f2b68fb5e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:09.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.073+0000 7fd16bfff640 1 -- 172.21.15.154:0/1281469192 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1740b0070 con 0x7fd17813ede0 2024-05-14T10:20:09.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.073+0000 7fd16bfff640 1 -- 172.21.15.154:0/1281469192 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1740ab600 con 0x7fd17813ede0 2024-05-14T10:20:09.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.073+0000 7fd16bfff640 1 -- 172.21.15.154:0/1281469192 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1740ab9d0 con 0x7fd17813ede0 2024-05-14T10:20:09.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17f7f6640 1 -- 172.21.15.154:0/1281469192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd17813ede0 msgr2=0x7fd1781415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:09.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17f7f6640 1 --2- 172.21.15.154:0/1281469192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd17813ede0 0x7fd1781415f0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7fd1740097f0 tx=0x7fd17401c4a0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17f7f6640 1 -- 172.21.15.154:0/1281469192 shutdown_connections 2024-05-14T10:20:09.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17f7f6640 1 --2- 172.21.15.154:0/1281469192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd17813ede0 0x7fd1781415f0 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17f7f6640 1 -- 172.21.15.154:0/1281469192 >> 172.21.15.154:0/1281469192 conn(0x7fd1780b1850 msgr2=0x7fd1780b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:09.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17f7f6640 1 -- 172.21.15.154:0/1281469192 shutdown_connections 2024-05-14T10:20:09.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17f7f6640 1 -- 172.21.15.154:0/1281469192 wait complete. 2024-05-14T10:20:09.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17f7f6640 1 Processor -- start 2024-05-14T10:20:09.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17f7f6640 1 -- start start 2024-05-14T10:20:09.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17f7f6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1780cea50 0x7fd178159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:09.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17f7f6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd17813ede0 0x7fd17813ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:09.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17f7f6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd178141b30 0x7fd178151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:09.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17f7f6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd17806e730 con 0x7fd17813ede0 2024-05-14T10:20:09.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17f7f6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd17806e5b0 con 0x7fd1780cea50 2024-05-14T10:20:09.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17f7f6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd178169db0 con 0x7fd178141b30 2024-05-14T10:20:09.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17cd91640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd17813ede0 0x7fd17813ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:09.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17cd91640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd17813ede0 0x7fd17813ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55700/0 (socket says 172.21.15.154:55700) 2024-05-14T10:20:09.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17cd91640 1 -- 172.21.15.154:0/2417410291 learned_addr learned my addr 172.21.15.154:0/2417410291 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:09.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17d592640 1 --2- 172.21.15.154:0/2417410291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1780cea50 0x7fd178159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:09.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17dd93640 1 --2- 172.21.15.154:0/2417410291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd178141b30 0x7fd178151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:09.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17cd91640 1 -- 172.21.15.154:0/2417410291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd178141b30 msgr2=0x7fd178151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:09.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17cd91640 1 --2- 172.21.15.154:0/2417410291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd178141b30 0x7fd178151a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17cd91640 1 -- 172.21.15.154:0/2417410291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1780cea50 msgr2=0x7fd178159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:09.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17cd91640 1 --2- 172.21.15.154:0/2417410291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1780cea50 0x7fd178159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17cd91640 1 -- 172.21.15.154:0/2417410291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17813d290 con 0x7fd17813ede0 2024-05-14T10:20:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17cd91640 1 --2- 172.21.15.154:0/2417410291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd17813ede0 0x7fd17813ca70 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00c4a0 tx=0x7fd16c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd169ffb640 1 -- 172.21.15.154:0/2417410291 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c018070 con 0x7fd17813ede0 2024-05-14T10:20:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd169ffb640 1 -- 172.21.15.154:0/2417410291 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd16c0074e0 con 0x7fd17813ede0 2024-05-14T10:20:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17f7f6640 1 -- 172.21.15.154:0/2417410291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd17813d570 con 0x7fd17813ede0 2024-05-14T10:20:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd169ffb640 1 -- 172.21.15.154:0/2417410291 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c004a30 con 0x7fd17813ede0 2024-05-14T10:20:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.077+0000 7fd17f7f6640 1 -- 172.21.15.154:0/2417410291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd17813db30 con 0x7fd17813ede0 2024-05-14T10:20:09.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.081+0000 7fd17f7f6640 1 -- 172.21.15.154:0/2417410291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd17813d010 con 0x7fd17813ede0 2024-05-14T10:20:09.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.081+0000 7fd169ffb640 1 -- 172.21.15.154:0/2417410291 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd16c01b070 con 0x7fd17813ede0 2024-05-14T10:20:09.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.081+0000 7fd169ffb640 1 --2- 172.21.15.154:0/2417410291 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd15c0678c0 0x7fd15c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:09.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.081+0000 7fd169ffb640 1 -- 172.21.15.154:0/2417410291 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fd16c084ca0 con 0x7fd17813ede0 2024-05-14T10:20:09.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.081+0000 7fd17d592640 1 --2- 172.21.15.154:0/2417410291 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd15c0678c0 0x7fd15c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:09.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.081+0000 7fd17d592640 1 --2- 172.21.15.154:0/2417410291 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd15c0678c0 0x7fd15c069d80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fd1740ad000 tx=0x7fd1740a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:09.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.085+0000 7fd169ffb640 1 -- 172.21.15.154:0/2417410291 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fd17813d010 con 0x7fd17813ede0 2024-05-14T10:20:09.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.229+0000 7fd17f7f6640 1 -- 172.21.15.154:0/2417410291 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd178075470 con 0x7fd15c0678c0 2024-05-14T10:20:09.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.233+0000 7fd169ffb640 1 -- 172.21.15.154:0/2417410291 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13757 (secure 0 0 0) 0x7fd178075470 con 0x7fd15c0678c0 2024-05-14T10:20:09.238 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:20:09.239 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-05-14T10:20:09.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.233+0000 7fd17f7f6640 1 -- 172.21.15.154:0/2417410291 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd15c0678c0 msgr2=0x7fd15c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:09.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.233+0000 7fd17f7f6640 1 --2- 172.21.15.154:0/2417410291 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd15c0678c0 0x7fd15c069d80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fd1740ad000 tx=0x7fd1740a6000 comp rx=0 tx=0).stop 2024-05-14T10:20:09.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.233+0000 7fd17f7f6640 1 -- 172.21.15.154:0/2417410291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd17813ede0 msgr2=0x7fd17813ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:09.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.233+0000 7fd17f7f6640 1 --2- 172.21.15.154:0/2417410291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd17813ede0 0x7fd17813ca70 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00c4a0 tx=0x7fd16c00c960 comp rx=0 tx=0).stop 2024-05-14T10:20:09.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.233+0000 7fd17f7f6640 1 -- 172.21.15.154:0/2417410291 shutdown_connections 2024-05-14T10:20:09.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.233+0000 7fd17f7f6640 1 --2- 172.21.15.154:0/2417410291 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd15c0678c0 0x7fd15c069d80 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.233+0000 7fd17f7f6640 1 --2- 172.21.15.154:0/2417410291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd178141b30 0x7fd178151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.233+0000 7fd17f7f6640 1 --2- 172.21.15.154:0/2417410291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd17813ede0 0x7fd17813ca70 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.233+0000 7fd17f7f6640 1 --2- 172.21.15.154:0/2417410291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1780cea50 0x7fd178159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.233+0000 7fd17f7f6640 1 -- 172.21.15.154:0/2417410291 >> 172.21.15.154:0/2417410291 conn(0x7fd1780b1850 msgr2=0x7fd1780d0500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:09.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.233+0000 7fd17f7f6640 1 -- 172.21.15.154:0/2417410291 shutdown_connections 2024-05-14T10:20:09.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.233+0000 7fd17f7f6640 1 -- 172.21.15.154:0/2417410291 wait complete. 2024-05-14T10:20:09.256 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":16127,"stamp":"2024-05-14T10:20:08.647221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":57544596,"kb_used_data":45499440,"kb_used_omap":5312,"kb_used_meta":11994687,"kb_avail":697430124,"statfs":{"total":773094113280,"available":714168446976,"internally_reserved":0,"allocated":46591426560,"data_stored":46581446160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5439617,"internal_metadata":12282560383},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,3,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-24994256957,"num_objects":-13859,"num_object_clones":0,"num_object_copies":-27718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13859,"num_whiteouts":0,"num_read":-1943171,"num_read_kb":-134102132,"num_write":-7546986,"num_write_kb":-203932194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-233,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.083781"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":465,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T10:20:03.423974+0000","last_change":"2024-05-14T01:23:25.487525+0000","last_active":"2024-05-14T10:20:03.423974+0000","last_peered":"2024-05-14T10:20:03.423974+0000","last_clean":"2024-05-14T10:20:03.423974+0000","last_became_active":"2024-05-14T01:23:25.485622+0000","last_became_peered":"2024-05-14T01:23:25.485622+0000","last_unstale":"2024-05-14T10:20:03.423974+0000","last_undegraded":"2024-05-14T10:20:03.423974+0000","last_fullsized":"2024-05-14T10:20:03.423974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_clean_scrub_stamp":"2024-05-14T01:23:24.138255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:26:23.884962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834581285,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8232408,"kb_used_data":6610508,"kb_used_omap":1194,"kb_used_meta":1620693,"kb_avail":86139432,"statfs":{"total":96636764160,"available":88206778368,"internally_reserved":0,"allocated":6769160192,"data_stored":6767644738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1223070,"internal_metadata":1659590242},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834581289,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6121736,"kb_used_data":4449980,"kb_used_omap":352,"kb_used_meta":1671391,"kb_avail":88250104,"statfs":{"total":96636764160,"available":90368106496,"internally_reserved":0,"allocated":4556779520,"data_stored":4555796822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":361293,"internal_metadata":1711504563},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834581290,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7463464,"kb_used_data":6030748,"kb_used_omap":181,"kb_used_meta":1432522,"kb_avail":86908376,"statfs":{"total":96636764160,"available":88994177024,"internally_reserved":0,"allocated":6175485952,"data_stored":6174120157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":185918,"internal_metadata":1466902978},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581292,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5567048,"kb_used_data":4128888,"kb_used_omap":656,"kb_used_meta":1437487,"kb_avail":88804792,"statfs":{"total":96636764160,"available":90936107008,"internally_reserved":0,"allocated":4227981312,"data_stored":4226956589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":672060,"internal_metadata":1471987396},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581291,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7749220,"kb_used_data":6087896,"kb_used_omap":593,"kb_used_meta":1660718,"kb_avail":86622620,"statfs":{"total":96636764160,"available":88701562880,"internally_reserved":0,"allocated":6234005504,"data_stored":6232825278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":608131,"internal_metadata":1700575357},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581292,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8059244,"kb_used_data":6732320,"kb_used_omap":821,"kb_used_meta":1326090,"kb_avail":86312596,"statfs":{"total":96636764160,"available":88384098304,"internally_reserved":0,"allocated":6893895680,"data_stored":6892393638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":841622,"internal_metadata":1357916266},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834581277,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8516024,"kb_used_data":6947052,"kb_used_omap":1168,"kb_used_meta":1567791,"kb_avail":85855816,"statfs":{"total":96636764160,"available":87916355584,"internally_reserved":0,"allocated":7113781248,"data_stored":7112405378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1196755,"internal_metadata":1605418285},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834581285,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5835452,"kb_used_data":4512048,"kb_used_omap":342,"kb_used_meta":1277993,"kb_avail":88536388,"statfs":{"total":96636764160,"available":90661261312,"internally_reserved":0,"allocated":4620337152,"data_stored":4619303560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":350768,"internal_metadata":1308665296},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T10:20:09.256 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-14T10:20:09.257 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T10:20:09.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f1675900640 1 Processor -- start 2024-05-14T10:20:09.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f1675900640 1 -- start start 2024-05-14T10:20:09.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f1675900640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f16701513c0 0x7f16700cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:09.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f1675900640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f167006d470 0x7f167006d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:09.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f1675900640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f167006cbe0 0x7f167015e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:09.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f1675900640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f16700cf9d0 con 0x7f167006d470 2024-05-14T10:20:09.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f1675900640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f16700b3ad0 con 0x7f16701513c0 2024-05-14T10:20:09.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f1675900640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f16700b2ec0 con 0x7f167006cbe0 2024-05-14T10:20:09.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f166e7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f167006d470 0x7f167006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:09.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f166e7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f167006d470 0x7f167006d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55712/0 (socket says 172.21.15.154:55712) 2024-05-14T10:20:09.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f166e7fc640 1 -- 172.21.15.154:0/3593468193 learned_addr learned my addr 172.21.15.154:0/3593468193 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:09.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f166f7fe640 1 --2- 172.21.15.154:0/3593468193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f167006cbe0 0x7f167015e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:09.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f166effd640 1 --2- 172.21.15.154:0/3593468193 >> v2:172.21.15.176:3300/0 conn(0x7f16701513c0 0x7f16700cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:09.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f166e7fc640 1 -- 172.21.15.154:0/3593468193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f167006cbe0 msgr2=0x7f167015e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:09.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f166e7fc640 1 --2- 172.21.15.154:0/3593468193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f167006cbe0 0x7f167015e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f166e7fc640 1 -- 172.21.15.154:0/3593468193 >> v2:172.21.15.176:3300/0 conn(0x7f16701513c0 msgr2=0x7f16700cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:09.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f166e7fc640 1 --2- 172.21.15.154:0/3593468193 >> v2:172.21.15.176:3300/0 conn(0x7f16701513c0 0x7f16700cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f166e7fc640 1 -- 172.21.15.154:0/3593468193 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16700b31a0 con 0x7f167006d470 2024-05-14T10:20:09.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.369+0000 7f166effd640 1 --2- 172.21.15.154:0/3593468193 >> v2:172.21.15.176:3300/0 conn(0x7f16701513c0 0x7f16700cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:20:09.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f166e7fc640 1 --2- 172.21.15.154:0/3593468193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f167006d470 0x7f167006d900 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f16700d0c10 tx=0x7f166801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0fdff7da3369ac server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:09.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f166dffb640 1 -- 172.21.15.154:0/3593468193 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16680a5760 con 0x7f167006d470 2024-05-14T10:20:09.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f166dffb640 1 -- 172.21.15.154:0/3593468193 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16680a5900 con 0x7f167006d470 2024-05-14T10:20:09.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f166dffb640 1 -- 172.21.15.154:0/3593468193 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16680a5cd0 con 0x7f167006d470 2024-05-14T10:20:09.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f1675900640 1 -- 172.21.15.154:0/3593468193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f167006d470 msgr2=0x7f167006d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:09.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f1675900640 1 --2- 172.21.15.154:0/3593468193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f167006d470 0x7f167006d900 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f16700d0c10 tx=0x7f166801c9f0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f1675900640 1 -- 172.21.15.154:0/3593468193 shutdown_connections 2024-05-14T10:20:09.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f1675900640 1 --2- 172.21.15.154:0/3593468193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f167006cbe0 0x7f167015e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f1675900640 1 --2- 172.21.15.154:0/3593468193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f167006d470 0x7f167006d900 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f1675900640 1 --2- 172.21.15.154:0/3593468193 >> v2:172.21.15.176:3300/0 conn(0x7f16701513c0 0x7f16700cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f1675900640 1 -- 172.21.15.154:0/3593468193 >> 172.21.15.154:0/3593468193 conn(0x7f16700b1850 msgr2=0x7f16700b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:09.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f1675900640 1 -- 172.21.15.154:0/3593468193 shutdown_connections 2024-05-14T10:20:09.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f1675900640 1 -- 172.21.15.154:0/3593468193 wait complete. 2024-05-14T10:20:09.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f1675900640 1 Processor -- start 2024-05-14T10:20:09.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f1675900640 1 -- start start 2024-05-14T10:20:09.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f1675900640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f167006cbe0 0x7f1670143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:09.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f1675900640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f167006d470 0x7f1670142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:09.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f1675900640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16701513c0 0x7f1670142560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:09.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f1675900640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f167006e990 con 0x7f16701513c0 2024-05-14T10:20:09.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f1675900640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f167006e810 con 0x7f167006d470 2024-05-14T10:20:09.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f1675900640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f16700b3f40 con 0x7f167006cbe0 2024-05-14T10:20:09.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f166f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16701513c0 0x7f1670142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:09.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f166f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16701513c0 0x7f1670142560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55728/0 (socket says 172.21.15.154:55728) 2024-05-14T10:20:09.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f166f7fe640 1 -- 172.21.15.154:0/554390518 learned_addr learned my addr 172.21.15.154:0/554390518 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:09.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.373+0000 7f166effd640 1 --2- 172.21.15.154:0/554390518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f167006cbe0 0x7f1670143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:09.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.377+0000 7f166e7fc640 1 --2- 172.21.15.154:0/554390518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f167006d470 0x7f1670142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:09.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.377+0000 7f166f7fe640 1 -- 172.21.15.154:0/554390518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f167006cbe0 msgr2=0x7f1670143630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:09.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.377+0000 7f166f7fe640 1 --2- 172.21.15.154:0/554390518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f167006cbe0 0x7f1670143630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.377+0000 7f166f7fe640 1 -- 172.21.15.154:0/554390518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f167006d470 msgr2=0x7f1670142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:09.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.377+0000 7f166f7fe640 1 --2- 172.21.15.154:0/554390518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f167006d470 0x7f1670142020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.377+0000 7f166f7fe640 1 -- 172.21.15.154:0/554390518 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1670143420 con 0x7f16701513c0 2024-05-14T10:20:09.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.377+0000 7f166f7fe640 1 --2- 172.21.15.154:0/554390518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16701513c0 0x7f1670142560 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f165800e960 tx=0x7f165800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:09.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.377+0000 7f1667fff640 1 -- 172.21.15.154:0/554390518 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658017070 con 0x7f16701513c0 2024-05-14T10:20:09.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.377+0000 7f1667fff640 1 -- 172.21.15.154:0/554390518 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f165800c9a0 con 0x7f16701513c0 2024-05-14T10:20:09.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.377+0000 7f1675900640 1 -- 172.21.15.154:0/554390518 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1670144a00 con 0x7f16701513c0 2024-05-14T10:20:09.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.377+0000 7f1667fff640 1 -- 172.21.15.154:0/554390518 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165800cd70 con 0x7f16701513c0 2024-05-14T10:20:09.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.377+0000 7f1675900640 1 -- 172.21.15.154:0/554390518 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1670144fc0 con 0x7f16701513c0 2024-05-14T10:20:09.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.377+0000 7f1675900640 1 -- 172.21.15.154:0/554390518 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1670075470 con 0x7f16701513c0 2024-05-14T10:20:09.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.377+0000 7f1667fff640 1 -- 172.21.15.154:0/554390518 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f165801a070 con 0x7f16701513c0 2024-05-14T10:20:09.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.377+0000 7f1667fff640 1 --2- 172.21.15.154:0/554390518 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16500678f0 0x7f1650069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:09.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.377+0000 7f1667fff640 1 -- 172.21.15.154:0/554390518 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f1658085d70 con 0x7f16701513c0 2024-05-14T10:20:09.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.377+0000 7f166effd640 1 --2- 172.21.15.154:0/554390518 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16500678f0 0x7f1650069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:09.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.377+0000 7f166effd640 1 --2- 172.21.15.154:0/554390518 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16500678f0 0x7f1650069db0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f1660006e90 tx=0x7f1660008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:09.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.381+0000 7f1667fff640 1 -- 172.21.15.154:0/554390518 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1658056430 con 0x7f16701513c0 2024-05-14T10:20:09.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.525+0000 7f1675900640 1 -- 172.21.15.154:0/554390518 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f167006e3d0 con 0x7f16500678f0 2024-05-14T10:20:09.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.549+0000 7f1667fff640 1 -- 172.21.15.154:0/554390518 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13757 (secure 0 0 0) 0x7f167006e3d0 con 0x7f16500678f0 2024-05-14T10:20:09.556 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:20:09.556 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-05-14T10:20:09.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.553+0000 7f1675900640 1 -- 172.21.15.154:0/554390518 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16500678f0 msgr2=0x7f1650069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:09.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.553+0000 7f1675900640 1 --2- 172.21.15.154:0/554390518 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16500678f0 0x7f1650069db0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f1660006e90 tx=0x7f1660008040 comp rx=0 tx=0).stop 2024-05-14T10:20:09.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.553+0000 7f1675900640 1 -- 172.21.15.154:0/554390518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16701513c0 msgr2=0x7f1670142560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:09.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.553+0000 7f1675900640 1 --2- 172.21.15.154:0/554390518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16701513c0 0x7f1670142560 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f165800e960 tx=0x7f165800ee20 comp rx=0 tx=0).stop 2024-05-14T10:20:09.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.553+0000 7f1675900640 1 -- 172.21.15.154:0/554390518 shutdown_connections 2024-05-14T10:20:09.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.553+0000 7f1675900640 1 --2- 172.21.15.154:0/554390518 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16500678f0 0x7f1650069db0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.553+0000 7f1675900640 1 --2- 172.21.15.154:0/554390518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16701513c0 0x7f1670142560 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.553+0000 7f1675900640 1 --2- 172.21.15.154:0/554390518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f167006d470 0x7f1670142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.553+0000 7f1675900640 1 --2- 172.21.15.154:0/554390518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f167006cbe0 0x7f1670143630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.553+0000 7f1675900640 1 -- 172.21.15.154:0/554390518 >> 172.21.15.154:0/554390518 conn(0x7f16700b1850 msgr2=0x7f1670070e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:09.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.553+0000 7f1675900640 1 -- 172.21.15.154:0/554390518 shutdown_connections 2024-05-14T10:20:09.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.553+0000 7f1675900640 1 -- 172.21.15.154:0/554390518 wait complete. 2024-05-14T10:20:09.573 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":16127,"stamp":"2024-05-14T10:20:08.647221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":57544596,"kb_used_data":45499440,"kb_used_omap":5312,"kb_used_meta":11994687,"kb_avail":697430124,"statfs":{"total":773094113280,"available":714168446976,"internally_reserved":0,"allocated":46591426560,"data_stored":46581446160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5439617,"internal_metadata":12282560383},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,3,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-24994256957,"num_objects":-13859,"num_object_clones":0,"num_object_copies":-27718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13859,"num_whiteouts":0,"num_read":-1943171,"num_read_kb":-134102132,"num_write":-7546986,"num_write_kb":-203932194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-233,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.083781"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":465,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T10:20:03.423974+0000","last_change":"2024-05-14T01:23:25.487525+0000","last_active":"2024-05-14T10:20:03.423974+0000","last_peered":"2024-05-14T10:20:03.423974+0000","last_clean":"2024-05-14T10:20:03.423974+0000","last_became_active":"2024-05-14T01:23:25.485622+0000","last_became_peered":"2024-05-14T01:23:25.485622+0000","last_unstale":"2024-05-14T10:20:03.423974+0000","last_undegraded":"2024-05-14T10:20:03.423974+0000","last_fullsized":"2024-05-14T10:20:03.423974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_clean_scrub_stamp":"2024-05-14T01:23:24.138255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:26:23.884962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834581285,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8232408,"kb_used_data":6610508,"kb_used_omap":1194,"kb_used_meta":1620693,"kb_avail":86139432,"statfs":{"total":96636764160,"available":88206778368,"internally_reserved":0,"allocated":6769160192,"data_stored":6767644738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1223070,"internal_metadata":1659590242},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834581289,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6121736,"kb_used_data":4449980,"kb_used_omap":352,"kb_used_meta":1671391,"kb_avail":88250104,"statfs":{"total":96636764160,"available":90368106496,"internally_reserved":0,"allocated":4556779520,"data_stored":4555796822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":361293,"internal_metadata":1711504563},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834581290,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7463464,"kb_used_data":6030748,"kb_used_omap":181,"kb_used_meta":1432522,"kb_avail":86908376,"statfs":{"total":96636764160,"available":88994177024,"internally_reserved":0,"allocated":6175485952,"data_stored":6174120157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":185918,"internal_metadata":1466902978},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581292,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5567048,"kb_used_data":4128888,"kb_used_omap":656,"kb_used_meta":1437487,"kb_avail":88804792,"statfs":{"total":96636764160,"available":90936107008,"internally_reserved":0,"allocated":4227981312,"data_stored":4226956589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":672060,"internal_metadata":1471987396},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581291,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7749220,"kb_used_data":6087896,"kb_used_omap":593,"kb_used_meta":1660718,"kb_avail":86622620,"statfs":{"total":96636764160,"available":88701562880,"internally_reserved":0,"allocated":6234005504,"data_stored":6232825278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":608131,"internal_metadata":1700575357},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581292,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8059244,"kb_used_data":6732320,"kb_used_omap":821,"kb_used_meta":1326090,"kb_avail":86312596,"statfs":{"total":96636764160,"available":88384098304,"internally_reserved":0,"allocated":6893895680,"data_stored":6892393638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":841622,"internal_metadata":1357916266},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834581277,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8516024,"kb_used_data":6947052,"kb_used_omap":1168,"kb_used_meta":1567791,"kb_avail":85855816,"statfs":{"total":96636764160,"available":87916355584,"internally_reserved":0,"allocated":7113781248,"data_stored":7112405378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1196755,"internal_metadata":1605418285},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834581285,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5835452,"kb_used_data":4512048,"kb_used_omap":342,"kb_used_meta":1277993,"kb_avail":88536388,"statfs":{"total":96636764160,"available":90661261312,"internally_reserved":0,"allocated":4620337152,"data_stored":4619303560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":350768,"internal_metadata":1308665296},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T10:20:09.574 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T10:20:09.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.685+0000 7fa1d6660640 1 Processor -- start 2024-05-14T10:20:09.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.685+0000 7fa1d6660640 1 -- start start 2024-05-14T10:20:09.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.689+0000 7fa1d6660640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa1d013ede0 0x7fa1d01415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:09.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.689+0000 7fa1d6660640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa1d00cea50 0x7fa1d006d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:09.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.689+0000 7fa1d6660640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d00cf100 con 0x7fa1d0141b30 2024-05-14T10:20:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.689+0000 7fa1d6660640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa1d00ceee0 con 0x7fa1d013ede0 2024-05-14T10:20:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.689+0000 7fa1d6660640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa1d0141f90 con 0x7fa1d00cea50 2024-05-14T10:20:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.689+0000 7fa1cffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa1d013ede0 0x7fa1d01415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.689+0000 7fa1cffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa1d013ede0 0x7fa1d01415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55744/0 (socket says 172.21.15.154:55744) 2024-05-14T10:20:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.689+0000 7fa1cffff640 1 -- 172.21.15.154:0/1260804051 learned_addr learned my addr 172.21.15.154:0/1260804051 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.689+0000 7fa1d4bfd640 1 --2- 172.21.15.154:0/1260804051 >> v2:172.21.15.176:3300/0 conn(0x7fa1d00cea50 0x7fa1d006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.689+0000 7fa1cffff640 1 -- 172.21.15.154:0/1260804051 >> v2:172.21.15.176:3300/0 conn(0x7fa1d00cea50 msgr2=0x7fa1d006d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.689+0000 7fa1cffff640 1 --2- 172.21.15.154:0/1260804051 >> v2:172.21.15.176:3300/0 conn(0x7fa1d00cea50 0x7fa1d006d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.689+0000 7fa1cffff640 1 -- 172.21.15.154:0/1260804051 >> v1:172.21.15.154:6789/0 conn(0x7fa1d0141b30 legacy=0x7fa1d00ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.689+0000 7fa1cffff640 1 -- 172.21.15.154:0/1260804051 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d00cf3e0 con 0x7fa1d013ede0 2024-05-14T10:20:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.689+0000 7fa1ceffd640 1 -- 172.21.15.154:0/1260804051 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1450764506 0 0) 0x7fa1d00cf100 con 0x7fa1d0141b30 2024-05-14T10:20:09.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.689+0000 7fa1cffff640 1 --2- 172.21.15.154:0/1260804051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1d013ede0 0x7fa1d01415f0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009e80 tx=0x7fa1c801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b7030675737eff server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:09.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1ceffd640 1 -- 172.21.15.154:0/1260804051 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c80a5760 con 0x7fa1d013ede0 2024-05-14T10:20:09.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1ceffd640 1 -- 172.21.15.154:0/1260804051 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c80a5900 con 0x7fa1d013ede0 2024-05-14T10:20:09.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1ceffd640 1 -- 172.21.15.154:0/1260804051 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c80a5cd0 con 0x7fa1d013ede0 2024-05-14T10:20:09.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d6660640 1 -- 172.21.15.154:0/1260804051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1d013ede0 msgr2=0x7fa1d01415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:09.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d6660640 1 --2- 172.21.15.154:0/1260804051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1d013ede0 0x7fa1d01415f0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009e80 tx=0x7fa1c801c9d0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d6660640 1 -- 172.21.15.154:0/1260804051 shutdown_connections 2024-05-14T10:20:09.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d6660640 1 --2- 172.21.15.154:0/1260804051 >> v2:172.21.15.176:3300/0 conn(0x7fa1d00cea50 0x7fa1d006d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d6660640 1 --2- 172.21.15.154:0/1260804051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1d013ede0 0x7fa1d01415f0 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d6660640 1 -- 172.21.15.154:0/1260804051 >> 172.21.15.154:0/1260804051 conn(0x7fa1d00b1850 msgr2=0x7fa1d00b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:09.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d6660640 1 -- 172.21.15.154:0/1260804051 shutdown_connections 2024-05-14T10:20:09.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d6660640 1 -- 172.21.15.154:0/1260804051 wait complete. 2024-05-14T10:20:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d6660640 1 Processor -- start 2024-05-14T10:20:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d6660640 1 -- start start 2024-05-14T10:20:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d6660640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1d00cea50 0x7fa1d0131300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d6660640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1d013ede0 0x7fa1d012e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d6660640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1d0141b30 0x7fa1d0137ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d6660640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d006e350 con 0x7fa1d0141b30 2024-05-14T10:20:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d6660640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d006e1d0 con 0x7fa1d013ede0 2024-05-14T10:20:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d6660640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d006e4d0 con 0x7fa1d00cea50 2024-05-14T10:20:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d4bfd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1d0141b30 0x7fa1d0137ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d4bfd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1d0141b30 0x7fa1d0137ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55746/0 (socket says 172.21.15.154:55746) 2024-05-14T10:20:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d4bfd640 1 -- 172.21.15.154:0/90923960 learned_addr learned my addr 172.21.15.154:0/90923960 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1cf7fe640 1 --2- 172.21.15.154:0/90923960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1d013ede0 0x7fa1d012e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1cffff640 1 --2- 172.21.15.154:0/90923960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1d00cea50 0x7fa1d0131300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d4bfd640 1 -- 172.21.15.154:0/90923960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1d00cea50 msgr2=0x7fa1d0131300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d4bfd640 1 --2- 172.21.15.154:0/90923960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1d00cea50 0x7fa1d0131300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d4bfd640 1 -- 172.21.15.154:0/90923960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1d013ede0 msgr2=0x7fa1d012e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:09.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d4bfd640 1 --2- 172.21.15.154:0/90923960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1d013ede0 0x7fa1d012e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d4bfd640 1 -- 172.21.15.154:0/90923960 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d012ec00 con 0x7fa1d0141b30 2024-05-14T10:20:09.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1cf7fe640 1 --2- 172.21.15.154:0/90923960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1d013ede0 0x7fa1d012e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:20:09.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d4bfd640 1 --2- 172.21.15.154:0/90923960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1d0141b30 0x7fa1d0137ad0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000e960 tx=0x7fa1c000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:09.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1ccff9640 1 -- 172.21.15.154:0/90923960 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c0017070 con 0x7fa1d0141b30 2024-05-14T10:20:09.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1ccff9640 1 -- 172.21.15.154:0/90923960 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c000c9a0 con 0x7fa1d0141b30 2024-05-14T10:20:09.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d6660640 1 -- 172.21.15.154:0/90923960 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d015d360 con 0x7fa1d0141b30 2024-05-14T10:20:09.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1ccff9640 1 -- 172.21.15.154:0/90923960 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c000cd70 con 0x7fa1d0141b30 2024-05-14T10:20:09.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.693+0000 7fa1d6660640 1 -- 172.21.15.154:0/90923960 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d01382e0 con 0x7fa1d0141b30 2024-05-14T10:20:09.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.697+0000 7fa1d6660640 1 -- 172.21.15.154:0/90923960 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d0075470 con 0x7fa1d0141b30 2024-05-14T10:20:09.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.697+0000 7fa1ccff9640 1 -- 172.21.15.154:0/90923960 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa1c001a070 con 0x7fa1d0141b30 2024-05-14T10:20:09.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.697+0000 7fa1ccff9640 1 --2- 172.21.15.154:0/90923960 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa1bc0678f0 0x7fa1bc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:09.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.697+0000 7fa1cffff640 1 --2- 172.21.15.154:0/90923960 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa1bc0678f0 0x7fa1bc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:09.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.697+0000 7fa1ccff9640 1 -- 172.21.15.154:0/90923960 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fa1c00858e0 con 0x7fa1d0141b30 2024-05-14T10:20:09.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.697+0000 7fa1cffff640 1 --2- 172.21.15.154:0/90923960 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa1bc0678f0 0x7fa1bc069db0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fa1c80ae000 tx=0x7fa1c80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:09.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.701+0000 7fa1ccff9640 1 -- 172.21.15.154:0/90923960 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fa1c0056030 con 0x7fa1d0141b30 2024-05-14T10:20:09.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.861+0000 7fa1d6660640 1 -- 172.21.15.154:0/90923960 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1d006f180 con 0x7fa1d0141b30 2024-05-14T10:20:09.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.881+0000 7fa1ccff9640 1 -- 172.21.15.154:0/90923960 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13068 (secure 0 0 0) 0x7fa1c005a330 con 0x7fa1d0141b30 2024-05-14T10:20:09.888 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:20:09.888 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":37,"fsid":"ed6da4f4-feae-4641-a379-d93fb409ad95","created":"2024-05-14T01:23:10.517117+0000","modified":"2024-05-14T10:20:04.309775+0000","last_up_change":"2024-05-14T01:23:22.132374+0000","last_in_change":"2024-05-14T01:23:12.838865+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T01:23:23.183062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1bb2b6f1-d560-4244-88f8-d99ce0e30e7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6825","nonce":1610701849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6827","nonce":1610701849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6831","nonce":1610701849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1610701849},{"type":"v1","addr":"172.21.15.154:6829","nonce":1610701849}]},"public_addr":"172.21.15.154:6825/1610701849","cluster_addr":"172.21.15.154:6827/1610701849","heartbeat_back_addr":"172.21.15.154:6831/1610701849","heartbeat_front_addr":"172.21.15.154:6829/1610701849","state":["exists","up"]},{"osd":1,"uuid":"2af40f44-8490-45f0-9471-5d348625a2bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6812","nonce":4138707364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6815","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6817","nonce":4138707364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6823","nonce":4138707364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":4138707364},{"type":"v1","addr":"172.21.15.154:6821","nonce":4138707364}]},"public_addr":"172.21.15.154:6812/4138707364","cluster_addr":"172.21.15.154:6817/4138707364","heartbeat_back_addr":"172.21.15.154:6823/4138707364","heartbeat_front_addr":"172.21.15.154:6821/4138707364","state":["exists","up"]},{"osd":2,"uuid":"eed269d0-e759-492e-adb4-b1d0cc90550c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6801","nonce":1507596223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6803","nonce":1507596223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6807","nonce":1507596223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":1507596223},{"type":"v1","addr":"172.21.15.154:6805","nonce":1507596223}]},"public_addr":"172.21.15.154:6801/1507596223","cluster_addr":"172.21.15.154:6803/1507596223","heartbeat_back_addr":"172.21.15.154:6807/1507596223","heartbeat_front_addr":"172.21.15.154:6805/1507596223","state":["exists","up"]},{"osd":3,"uuid":"9dae72b4-5aba-4b16-b66a-fc6f8585ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6809","nonce":682645045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6811","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6813","nonce":682645045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6819","nonce":682645045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":682645045},{"type":"v1","addr":"172.21.15.154:6816","nonce":682645045}]},"public_addr":"172.21.15.154:6809/682645045","cluster_addr":"172.21.15.154:6813/682645045","heartbeat_back_addr":"172.21.15.154:6819/682645045","heartbeat_front_addr":"172.21.15.154:6816/682645045","state":["exists","up"]},{"osd":4,"uuid":"a39bb975-8482-4309-b709-9eae6f0e8eb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6817","nonce":2424559788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6819","nonce":2424559788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6823","nonce":2424559788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2424559788},{"type":"v1","addr":"172.21.15.176:6821","nonce":2424559788}]},"public_addr":"172.21.15.176:6817/2424559788","cluster_addr":"172.21.15.176:6819/2424559788","heartbeat_back_addr":"172.21.15.176:6823/2424559788","heartbeat_front_addr":"172.21.15.176:6821/2424559788","state":["exists","up"]},{"osd":5,"uuid":"d2078781-fe45-40b3-b4e4-3e692eb55436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6825","nonce":4163648494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6827","nonce":4163648494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6831","nonce":4163648494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":4163648494},{"type":"v1","addr":"172.21.15.176:6829","nonce":4163648494}]},"public_addr":"172.21.15.176:6825/4163648494","cluster_addr":"172.21.15.176:6827/4163648494","heartbeat_back_addr":"172.21.15.176:6831/4163648494","heartbeat_front_addr":"172.21.15.176:6829/4163648494","state":["exists","up"]},{"osd":6,"uuid":"1423b44b-3748-40df-a393-123342bf02eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6801","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6803","nonce":3092848670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6805","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6807","nonce":3092848670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6813","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6815","nonce":3092848670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6809","nonce":3092848670},{"type":"v1","addr":"172.21.15.176:6811","nonce":3092848670}]},"public_addr":"172.21.15.176:6803/3092848670","cluster_addr":"172.21.15.176:6807/3092848670","heartbeat_back_addr":"172.21.15.176:6815/3092848670","heartbeat_front_addr":"172.21.15.176:6811/3092848670","state":["exists","up"]},{"osd":7,"uuid":"a6d835cb-f3c9-4734-b70a-61be7a216526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6802","nonce":2969535252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6806","nonce":2969535252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6814","nonce":2969535252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2969535252},{"type":"v1","addr":"172.21.15.176:6810","nonce":2969535252}]},"public_addr":"172.21.15.176:6802/2969535252","cluster_addr":"172.21.15.176:6806/2969535252","heartbeat_back_addr":"172.21.15.176:6814/2969535252","heartbeat_front_addr":"172.21.15.176:6810/2969535252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.540852+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.470613+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.454706+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.549642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.347642+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.438792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.389399+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T01:23:18.284722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6836/848393842":"2024-05-15T10:20:01.075699+0000","172.21.15.154:6834/848393842":"2024-05-15T10:20:01.075699+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T10:20:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.885+0000 7fa1d6660640 1 -- 172.21.15.154:0/90923960 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa1bc0678f0 msgr2=0x7fa1bc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.885+0000 7fa1d6660640 1 --2- 172.21.15.154:0/90923960 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa1bc0678f0 0x7fa1bc069db0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fa1c80ae000 tx=0x7fa1c80a7070 comp rx=0 tx=0).stop 2024-05-14T10:20:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.885+0000 7fa1d6660640 1 -- 172.21.15.154:0/90923960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1d0141b30 msgr2=0x7fa1d0137ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.885+0000 7fa1d6660640 1 --2- 172.21.15.154:0/90923960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1d0141b30 0x7fa1d0137ad0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000e960 tx=0x7fa1c000ee20 comp rx=0 tx=0).stop 2024-05-14T10:20:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.885+0000 7fa1d6660640 1 -- 172.21.15.154:0/90923960 shutdown_connections 2024-05-14T10:20:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.885+0000 7fa1d6660640 1 --2- 172.21.15.154:0/90923960 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa1bc0678f0 0x7fa1bc069db0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.885+0000 7fa1d6660640 1 --2- 172.21.15.154:0/90923960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1d0141b30 0x7fa1d0137ad0 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.885+0000 7fa1d6660640 1 --2- 172.21.15.154:0/90923960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1d013ede0 0x7fa1d012e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.885+0000 7fa1d6660640 1 --2- 172.21.15.154:0/90923960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1d00cea50 0x7fa1d0131300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.885+0000 7fa1d6660640 1 -- 172.21.15.154:0/90923960 >> 172.21.15.154:0/90923960 conn(0x7fa1d00b1850 msgr2=0x7fa1d013d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.885+0000 7fa1d6660640 1 -- 172.21.15.154:0/90923960 shutdown_connections 2024-05-14T10:20:09.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:09.885+0000 7fa1d6660640 1 -- 172.21.15.154:0/90923960 wait complete. 2024-05-14T10:20:10.908 INFO:tasks.ceph:Scrubbing osd.0 2024-05-14T10:20:10.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-14T10:20:11.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.045+0000 7f8f250c2640 1 Processor -- start 2024-05-14T10:20:11.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.045+0000 7f8f250c2640 1 -- start start 2024-05-14T10:20:11.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.045+0000 7f8f250c2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8f200d0790 0x7f8f200d1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.045+0000 7f8f250c2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f200d2240 0x7f8f200b0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.045+0000 7f8f250c2640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f200cc770 con 0x7f8f2015bfe0 2024-05-14T10:20:11.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.045+0000 7f8f250c2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8f200d26b0 con 0x7f8f200d0790 2024-05-14T10:20:11.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.045+0000 7f8f250c2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8f200af1e0 con 0x7f8f200d2240 2024-05-14T10:20:11.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.045+0000 7f8f1e59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8f200d0790 0x7f8f200d1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.045+0000 7f8f1e59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8f200d0790 0x7f8f200d1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55758/0 (socket says 172.21.15.154:55758) 2024-05-14T10:20:11.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.045+0000 7f8f1e59c640 1 -- 172.21.15.154:0/905108312 learned_addr learned my addr 172.21.15.154:0/905108312 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:11.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.045+0000 7f8f1f59e640 1 --2- 172.21.15.154:0/905108312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f200d2240 0x7f8f200b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.045+0000 7f8f1e59c640 1 -- 172.21.15.154:0/905108312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f200d2240 msgr2=0x7f8f200b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:11.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.045+0000 7f8f1e59c640 1 --2- 172.21.15.154:0/905108312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f200d2240 0x7f8f200b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.045+0000 7f8f1e59c640 1 -- 172.21.15.154:0/905108312 >> v1:172.21.15.176:6789/0 conn(0x7f8f2015bfe0 legacy=0x7f8f200aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.045+0000 7f8f1e59c640 1 -- 172.21.15.154:0/905108312 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f200af4c0 con 0x7f8f200d0790 2024-05-14T10:20:11.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f1e59c640 1 --2- 172.21.15.154:0/905108312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f200d0790 0x7f8f200d1d00 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009870 tx=0x7f8f1401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81be30c4d3f0f6ed server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:11.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f1dd9b640 1 -- 172.21.15.154:0/905108312 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f140b0070 con 0x7f8f200d0790 2024-05-14T10:20:11.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f1dd9b640 1 -- 172.21.15.154:0/905108312 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f140ab600 con 0x7f8f200d0790 2024-05-14T10:20:11.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f1dd9b640 1 -- 172.21.15.154:0/905108312 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f140ab9d0 con 0x7f8f200d0790 2024-05-14T10:20:11.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f250c2640 1 -- 172.21.15.154:0/905108312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f200d0790 msgr2=0x7f8f200d1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f250c2640 1 --2- 172.21.15.154:0/905108312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f200d0790 0x7f8f200d1d00 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009870 tx=0x7f8f1401c4d0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f250c2640 1 -- 172.21.15.154:0/905108312 shutdown_connections 2024-05-14T10:20:11.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f250c2640 1 --2- 172.21.15.154:0/905108312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f200d2240 0x7f8f200b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f250c2640 1 --2- 172.21.15.154:0/905108312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f200d0790 0x7f8f200d1d00 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f250c2640 1 -- 172.21.15.154:0/905108312 >> 172.21.15.154:0/905108312 conn(0x7f8f2009aa10 msgr2=0x7f8f2009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:11.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f250c2640 1 -- 172.21.15.154:0/905108312 shutdown_connections 2024-05-14T10:20:11.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f250c2640 1 -- 172.21.15.154:0/905108312 wait complete. 2024-05-14T10:20:11.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f250c2640 1 Processor -- start 2024-05-14T10:20:11.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f250c2640 1 -- start start 2024-05-14T10:20:11.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f250c2640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f200d0790 0x7f8f20149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f250c2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f200d2240 0x7f8f2015ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f250c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f2015bfe0 0x7f8f20156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f250c2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8f200b1150 con 0x7f8f2015bfe0 2024-05-14T10:20:11.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f250c2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8f200b0fd0 con 0x7f8f200d2240 2024-05-14T10:20:11.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f250c2640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8f200b12d0 con 0x7f8f200d0790 2024-05-14T10:20:11.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f1f59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f2015bfe0 0x7f8f20156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f1f59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f2015bfe0 0x7f8f20156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55766/0 (socket says 172.21.15.154:55766) 2024-05-14T10:20:11.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f1f59e640 1 -- 172.21.15.154:0/1953597579 learned_addr learned my addr 172.21.15.154:0/1953597579 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:11.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f1e59c640 1 --2- 172.21.15.154:0/1953597579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f200d2240 0x7f8f2015ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.049+0000 7f8f1ed9d640 1 --2- 172.21.15.154:0/1953597579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f200d0790 0x7f8f20149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f1f59e640 1 -- 172.21.15.154:0/1953597579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f200d0790 msgr2=0x7f8f20149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f1f59e640 1 --2- 172.21.15.154:0/1953597579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f200d0790 0x7f8f20149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f1f59e640 1 -- 172.21.15.154:0/1953597579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f200d2240 msgr2=0x7f8f2015ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f1f59e640 1 --2- 172.21.15.154:0/1953597579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f200d2240 0x7f8f2015ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f1f59e640 1 -- 172.21.15.154:0/1953597579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2015d400 con 0x7f8f2015bfe0 2024-05-14T10:20:11.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f1f59e640 1 --2- 172.21.15.154:0/1953597579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f2015bfe0 0x7f8f20156cb0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f8f18007e90 tx=0x7f8f1800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:11.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f077fe640 1 -- 172.21.15.154:0/1953597579 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f18014420 con 0x7f8f2015bfe0 2024-05-14T10:20:11.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f077fe640 1 -- 172.21.15.154:0/1953597579 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f18019070 con 0x7f8f2015bfe0 2024-05-14T10:20:11.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f250c2640 1 -- 172.21.15.154:0/1953597579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f2015c780 con 0x7f8f2015bfe0 2024-05-14T10:20:11.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f077fe640 1 -- 172.21.15.154:0/1953597579 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f18014800 con 0x7f8f2015bfe0 2024-05-14T10:20:11.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f250c2640 1 -- 172.21.15.154:0/1953597579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f2015cd40 con 0x7f8f2015bfe0 2024-05-14T10:20:11.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f250c2640 1 -- 172.21.15.154:0/1953597579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8f20068360 con 0x7f8f2015bfe0 2024-05-14T10:20:11.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f077fe640 1 -- 172.21.15.154:0/1953597579 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f180149a0 con 0x7f8f2015bfe0 2024-05-14T10:20:11.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f077fe640 1 --2- 172.21.15.154:0/1953597579 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8f0c0678c0 0x7f8f0c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f077fe640 1 -- 172.21.15.154:0/1953597579 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f8f18087110 con 0x7f8f2015bfe0 2024-05-14T10:20:11.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f1ed9d640 1 --2- 172.21.15.154:0/1953597579 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8f0c0678c0 0x7f8f0c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f077fe640 1 --2- 172.21.15.154:0/1953597579 >> [v2:172.21.15.154:6824/1610701849,v1:172.21.15.154:6825/1610701849] conn(0x7f8f0c06d780 0x7f8f0c06fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f077fe640 1 -- 172.21.15.154:0/1953597579 --> [v2:172.21.15.154:6824/1610701849,v1:172.21.15.154:6825/1610701849] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f18016e70 con 0x7f8f0c06d780 2024-05-14T10:20:11.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f077fe640 1 -- 172.21.15.154:0/1953597579 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8f180874c0 con 0x7f8f2015bfe0 2024-05-14T10:20:11.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f1e59c640 1 --2- 172.21.15.154:0/1953597579 >> [v2:172.21.15.154:6824/1610701849,v1:172.21.15.154:6825/1610701849] conn(0x7f8f0c06d780 0x7f8f0c06fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f1ed9d640 1 --2- 172.21.15.154:0/1953597579 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8f0c0678c0 0x7f8f0c069d80 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8f10001650 tx=0x7f8f10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:11.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.053+0000 7f8f1e59c640 1 --2- 172.21.15.154:0/1953597579 >> [v2:172.21.15.154:6824/1610701849,v1:172.21.15.154:6825/1610701849] conn(0x7f8f0c06d780 0x7f8f0c06fba0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.229+0000 7f8f077fe640 1 -- 172.21.15.154:0/1953597579 <== osd.0 v2:172.21.15.154:6824/1610701849 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8f18016e70 con 0x7f8f0c06d780 2024-05-14T10:20:11.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.245+0000 7f8f250c2640 1 -- 172.21.15.154:0/1953597579 --> [v2:172.21.15.154:6824/1610701849,v1:172.21.15.154:6825/1610701849] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8f2009b530 con 0x7f8f0c06d780 2024-05-14T10:20:11.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.301+0000 7f8f077fe640 1 -- 172.21.15.154:0/1953597579 <== osd.0 v2:172.21.15.154:6824/1610701849 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8f2009b530 con 0x7f8f0c06d780 2024-05-14T10:20:11.309 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-14T10:20:11.310 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T10:20:11.310 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-14T10:20:11.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.305+0000 7f8f250c2640 1 -- 172.21.15.154:0/1953597579 >> [v2:172.21.15.154:6824/1610701849,v1:172.21.15.154:6825/1610701849] conn(0x7f8f0c06d780 msgr2=0x7f8f0c06fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.305+0000 7f8f250c2640 1 --2- 172.21.15.154:0/1953597579 >> [v2:172.21.15.154:6824/1610701849,v1:172.21.15.154:6825/1610701849] conn(0x7f8f0c06d780 0x7f8f0c06fba0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.305+0000 7f8f250c2640 1 -- 172.21.15.154:0/1953597579 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8f0c0678c0 msgr2=0x7f8f0c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.305+0000 7f8f250c2640 1 --2- 172.21.15.154:0/1953597579 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8f0c0678c0 0x7f8f0c069d80 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8f10001650 tx=0x7f8f10009040 comp rx=0 tx=0).stop 2024-05-14T10:20:11.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.305+0000 7f8f250c2640 1 -- 172.21.15.154:0/1953597579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f2015bfe0 msgr2=0x7f8f20156cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.305+0000 7f8f250c2640 1 --2- 172.21.15.154:0/1953597579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f2015bfe0 0x7f8f20156cb0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f8f18007e90 tx=0x7f8f1800e4b0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.305+0000 7f8f1f59e640 1 -- 172.21.15.154:0/1953597579 reap_dead start 2024-05-14T10:20:11.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.305+0000 7f8f250c2640 1 -- 172.21.15.154:0/1953597579 shutdown_connections 2024-05-14T10:20:11.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.305+0000 7f8f250c2640 1 -- 172.21.15.154:0/1953597579 >> 172.21.15.154:0/1953597579 conn(0x7f8f2009aa10 msgr2=0x7f8f200cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:11.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.305+0000 7f8f250c2640 1 -- 172.21.15.154:0/1953597579 shutdown_connections 2024-05-14T10:20:11.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.305+0000 7f8f250c2640 1 -- 172.21.15.154:0/1953597579 wait complete. 2024-05-14T10:20:11.334 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-14T10:20:11.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.457+0000 7feb06df1640 1 Processor -- start 2024-05-14T10:20:11.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.457+0000 7feb06df1640 1 -- start start 2024-05-14T10:20:11.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.457+0000 7feb06df1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb000cf520 0x7feb000d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.457+0000 7feb06df1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feb0015e4e0 0x7feb000b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.457+0000 7feb06df1640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb000d29f0 con 0x7feb0015e100 2024-05-14T10:20:11.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.457+0000 7feb06df1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7feb000d2cd0 con 0x7feb0015e4e0 2024-05-14T10:20:11.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.457+0000 7feb06df1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7feb000d2fb0 con 0x7feb000cf520 2024-05-14T10:20:11.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feb0538e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feb0015e4e0 0x7feb000b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feb0538e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feb0015e4e0 0x7feb000b9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55768/0 (socket says 172.21.15.154:55768) 2024-05-14T10:20:11.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feb0538e640 1 -- 172.21.15.154:0/925718051 learned_addr learned my addr 172.21.15.154:0/925718051 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:11.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feaf7fff640 1 --2- 172.21.15.154:0/925718051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb000cf520 0x7feb000d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feb0538e640 1 -- 172.21.15.154:0/925718051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb000cf520 msgr2=0x7feb000d22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:11.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feb0538e640 1 --2- 172.21.15.154:0/925718051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb000cf520 0x7feb000d22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feb0538e640 1 -- 172.21.15.154:0/925718051 >> v1:172.21.15.176:6789/0 conn(0x7feb0015e100 legacy=0x7feb000cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feb0538e640 1 -- 172.21.15.154:0/925718051 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb000d3290 con 0x7feb0015e4e0 2024-05-14T10:20:11.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feb0538e640 1 --2- 172.21.15.154:0/925718051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb0015e4e0 0x7feb000b9b20 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009e50 tx=0x7feaf801f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b8298f0c828925 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:11.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feaf77fe640 1 -- 172.21.15.154:0/925718051 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf80b4070 con 0x7feb0015e4e0 2024-05-14T10:20:11.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feaf77fe640 1 -- 172.21.15.154:0/925718051 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf80af400 con 0x7feb0015e4e0 2024-05-14T10:20:11.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feaf77fe640 1 -- 172.21.15.154:0/925718051 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf80af7d0 con 0x7feb0015e4e0 2024-05-14T10:20:11.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feb06df1640 1 -- 172.21.15.154:0/925718051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb0015e4e0 msgr2=0x7feb000b9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feb06df1640 1 --2- 172.21.15.154:0/925718051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb0015e4e0 0x7feb000b9b20 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009e50 tx=0x7feaf801f210 comp rx=0 tx=0).stop 2024-05-14T10:20:11.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feb06df1640 1 -- 172.21.15.154:0/925718051 shutdown_connections 2024-05-14T10:20:11.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feb06df1640 1 --2- 172.21.15.154:0/925718051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb0015e4e0 0x7feb000b9b20 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feb06df1640 1 --2- 172.21.15.154:0/925718051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb000cf520 0x7feb000d22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feb06df1640 1 -- 172.21.15.154:0/925718051 >> 172.21.15.154:0/925718051 conn(0x7feb000b5b50 msgr2=0x7feb000b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:11.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feb06df1640 1 -- 172.21.15.154:0/925718051 shutdown_connections 2024-05-14T10:20:11.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.461+0000 7feb06df1640 1 -- 172.21.15.154:0/925718051 wait complete. 2024-05-14T10:20:11.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb06df1640 1 Processor -- start 2024-05-14T10:20:11.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb06df1640 1 -- start start 2024-05-14T10:20:11.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb06df1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb000cf520 0x7feb0015f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb06df1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb0015e100 0x7feb0014dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb06df1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb0015e4e0 0x7feb001f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb06df1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feb000d3c10 con 0x7feb0015e4e0 2024-05-14T10:20:11.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb06df1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feb000d3a90 con 0x7feb000cf520 2024-05-14T10:20:11.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb06df1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7feb001617e0 con 0x7feb0015e100 2024-05-14T10:20:11.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb0538e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb0015e4e0 0x7feb001f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb0538e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb0015e4e0 0x7feb001f4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55778/0 (socket says 172.21.15.154:55778) 2024-05-14T10:20:11.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb0538e640 1 -- 172.21.15.154:0/3600047079 learned_addr learned my addr 172.21.15.154:0/3600047079 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:11.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb04b8d640 1 --2- 172.21.15.154:0/3600047079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb000cf520 0x7feb0015f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feaf7fff640 1 --2- 172.21.15.154:0/3600047079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb0015e100 0x7feb0014dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb0538e640 1 -- 172.21.15.154:0/3600047079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb0015e100 msgr2=0x7feb0014dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb0538e640 1 --2- 172.21.15.154:0/3600047079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb0015e100 0x7feb0014dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb0538e640 1 -- 172.21.15.154:0/3600047079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb000cf520 msgr2=0x7feb0015f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb0538e640 1 --2- 172.21.15.154:0/3600047079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb000cf520 0x7feb0015f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb0538e640 1 -- 172.21.15.154:0/3600047079 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0014e280 con 0x7feb0015e4e0 2024-05-14T10:20:11.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb04b8d640 1 --2- 172.21.15.154:0/3600047079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb000cf520 0x7feb0015f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:20:11.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb0538e640 1 --2- 172.21.15.154:0/3600047079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb0015e4e0 0x7feb001f4870 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7feaf801ce40 tx=0x7feaf801bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:11.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feaf57fa640 1 -- 172.21.15.154:0/3600047079 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf80b4040 con 0x7feb0015e4e0 2024-05-14T10:20:11.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feaf57fa640 1 -- 172.21.15.154:0/3600047079 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf80afdb0 con 0x7feb0015e4e0 2024-05-14T10:20:11.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feaf57fa640 1 -- 172.21.15.154:0/3600047079 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8009510 con 0x7feb0015e4e0 2024-05-14T10:20:11.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb06df1640 1 -- 172.21.15.154:0/3600047079 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb0015f890 con 0x7feb0015e4e0 2024-05-14T10:20:11.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb06df1640 1 -- 172.21.15.154:0/3600047079 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb0015fe50 con 0x7feb0015e4e0 2024-05-14T10:20:11.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.465+0000 7feb06df1640 1 -- 172.21.15.154:0/3600047079 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb00075470 con 0x7feb0015e4e0 2024-05-14T10:20:11.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.489+0000 7feaf57fa640 1 -- 172.21.15.154:0/3600047079 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feaf80c2020 con 0x7feb0015e4e0 2024-05-14T10:20:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.489+0000 7feaf57fa640 1 --2- 172.21.15.154:0/3600047079 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7feaec0678c0 0x7feaec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.489+0000 7feaf57fa640 1 -- 172.21.15.154:0/3600047079 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7feaf8123d60 con 0x7feb0015e4e0 2024-05-14T10:20:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.489+0000 7feb04b8d640 1 --2- 172.21.15.154:0/3600047079 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7feaec0678c0 0x7feaec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.489+0000 7feb04b8d640 1 --2- 172.21.15.154:0/3600047079 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7feaec0678c0 0x7feaec069d80 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7feafc001710 tx=0x7feafc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:11.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.493+0000 7feaf57fa640 1 -- 172.21.15.154:0/3600047079 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7feaf80c9020 con 0x7feb0015e4e0 2024-05-14T10:20:11.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.653+0000 7feb06df1640 1 -- 172.21.15.154:0/3600047079 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7feb00160090 con 0x7feaec0678c0 2024-05-14T10:20:11.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.701+0000 7feaf57fa640 1 -- 172.21.15.154:0/3600047079 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7feb00160090 con 0x7feaec0678c0 2024-05-14T10:20:11.708 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 0 to deep-scrub 2024-05-14T10:20:11.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.705+0000 7feb06df1640 1 -- 172.21.15.154:0/3600047079 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7feaec0678c0 msgr2=0x7feaec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.705+0000 7feb06df1640 1 --2- 172.21.15.154:0/3600047079 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7feaec0678c0 0x7feaec069d80 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7feafc001710 tx=0x7feafc009040 comp rx=0 tx=0).stop 2024-05-14T10:20:11.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.705+0000 7feb06df1640 1 -- 172.21.15.154:0/3600047079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb0015e4e0 msgr2=0x7feb001f4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.705+0000 7feb06df1640 1 --2- 172.21.15.154:0/3600047079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb0015e4e0 0x7feb001f4870 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7feaf801ce40 tx=0x7feaf801bfb0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.705+0000 7feb06df1640 1 -- 172.21.15.154:0/3600047079 shutdown_connections 2024-05-14T10:20:11.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.705+0000 7feb06df1640 1 --2- 172.21.15.154:0/3600047079 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7feaec0678c0 0x7feaec069d80 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.705+0000 7feb06df1640 1 --2- 172.21.15.154:0/3600047079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb0015e4e0 0x7feb001f4870 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.705+0000 7feb06df1640 1 --2- 172.21.15.154:0/3600047079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb0015e100 0x7feb0014dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.705+0000 7feb06df1640 1 --2- 172.21.15.154:0/3600047079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb000cf520 0x7feb0015f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.705+0000 7feb06df1640 1 -- 172.21.15.154:0/3600047079 >> 172.21.15.154:0/3600047079 conn(0x7feb000b5b50 msgr2=0x7feb000720a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:11.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.705+0000 7feb06df1640 1 -- 172.21.15.154:0/3600047079 shutdown_connections 2024-05-14T10:20:11.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.705+0000 7feb06df1640 1 -- 172.21.15.154:0/3600047079 wait complete. 2024-05-14T10:20:11.730 INFO:tasks.ceph:Scrubbing osd.1 2024-05-14T10:20:11.730 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-14T10:20:11.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3679fe7640 1 Processor -- start 2024-05-14T10:20:11.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3679fe7640 1 -- start start 2024-05-14T10:20:11.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3679fe7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f367415f150 0x7f367406e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3679fe7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3674144b00 con 0x7f36740b4570 2024-05-14T10:20:11.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3679fe7640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f367406ece0 con 0x7f3674144720 2024-05-14T10:20:11.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3679fe7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f367406ea80 con 0x7f367415f150 2024-05-14T10:20:11.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3673fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f36740b4570 0x7f3674071d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46752/0 (socket says 172.21.15.154:46752) 2024-05-14T10:20:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3673fff640 1 -- 172.21.15.154:0/914577315 learned_addr learned my addr 172.21.15.154:0/914577315 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:20:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f366affd640 1 --2- 172.21.15.154:0/914577315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f367415f150 0x7f367406e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3672ffd640 1 -- 172.21.15.154:0/914577315 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2817396685 0 0) 0x7f3674144b00 con 0x7f36740b4570 2024-05-14T10:20:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3672ffd640 1 -- 172.21.15.154:0/914577315 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3660003530 con 0x7f36740b4570 2024-05-14T10:20:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3672ffd640 1 -- 172.21.15.154:0/914577315 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2735148321 0 0) 0x7f3660003530 con 0x7f36740b4570 2024-05-14T10:20:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3672ffd640 1 -- 172.21.15.154:0/914577315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f367415f150 msgr2=0x7f367406e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3672ffd640 1 --2- 172.21.15.154:0/914577315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f367415f150 0x7f367406e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3672ffd640 1 -- 172.21.15.154:0/914577315 >> v1:172.21.15.176:6789/0 conn(0x7f3674144720 legacy=0x7f367415ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3672ffd640 1 -- 172.21.15.154:0/914577315 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3674070f50 con 0x7f36740b4570 2024-05-14T10:20:11.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3672ffd640 1 -- 172.21.15.154:0/914577315 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f366c001a00 con 0x7f36740b4570 2024-05-14T10:20:11.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3672ffd640 1 -- 172.21.15.154:0/914577315 >> v1:172.21.15.154:6789/0 conn(0x7f36740b4570 legacy=0x7f3674071d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3672ffd640 1 --2- 172.21.15.154:0/914577315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36600039f0 0x7f3660003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3672ffd640 1 --2- 172.21.15.154:0/914577315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f367415f150 0x7f3660004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3672ffd640 1 --2- 172.21.15.154:0/914577315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3660004d50 0x7f36600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3672ffd640 1 -- 172.21.15.154:0/914577315 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f367406ea80 con 0x7f36600039f0 2024-05-14T10:20:11.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3672ffd640 1 -- 172.21.15.154:0/914577315 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f366000bb00 con 0x7f3660004d50 2024-05-14T10:20:11.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3672ffd640 1 -- 172.21.15.154:0/914577315 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f366000bd00 con 0x7f367415f150 2024-05-14T10:20:11.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f36737fe640 1 --2- 172.21.15.154:0/914577315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36600039f0 0x7f3660003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3673fff640 1 --2- 172.21.15.154:0/914577315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3660004d50 0x7f36600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f366affd640 1 --2- 172.21.15.154:0/914577315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f367415f150 0x7f3660004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f36737fe640 1 -- 172.21.15.154:0/914577315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f367415f150 msgr2=0x7f3660004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:11.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f36737fe640 1 --2- 172.21.15.154:0/914577315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f367415f150 0x7f3660004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f36737fe640 1 -- 172.21.15.154:0/914577315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3660004d50 msgr2=0x7f36600051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:11.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f36737fe640 1 --2- 172.21.15.154:0/914577315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3660004d50 0x7f36600051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f36737fe640 1 -- 172.21.15.154:0/914577315 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3660003530 con 0x7f36600039f0 2024-05-14T10:20:11.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f366affd640 1 --2- 172.21.15.154:0/914577315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f367415f150 0x7f3660004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T10:20:11.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.853+0000 7f3673fff640 1 --2- 172.21.15.154:0/914577315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3660004d50 0x7f36600051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:20:11.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f36737fe640 1 --2- 172.21.15.154:0/914577315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36600039f0 0x7f3660003e10 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f3664001780 tx=0x7f366401e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e4489cc32bf80 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:11.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3672ffd640 1 -- 172.21.15.154:0/914577315 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36640b2070 con 0x7f36600039f0 2024-05-14T10:20:11.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3672ffd640 1 -- 172.21.15.154:0/914577315 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36640052f0 con 0x7f36600039f0 2024-05-14T10:20:11.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3672ffd640 1 -- 172.21.15.154:0/914577315 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36640013a0 con 0x7f36600039f0 2024-05-14T10:20:11.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3679fe7640 1 -- 172.21.15.154:0/914577315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36600039f0 msgr2=0x7f3660003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3679fe7640 1 --2- 172.21.15.154:0/914577315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36600039f0 0x7f3660003e10 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f3664001780 tx=0x7f366401e540 comp rx=0 tx=0).stop 2024-05-14T10:20:11.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3673fff640 1 -- 172.21.15.154:0/914577315 reap_dead start 2024-05-14T10:20:11.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3679fe7640 1 -- 172.21.15.154:0/914577315 shutdown_connections 2024-05-14T10:20:11.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3679fe7640 1 -- 172.21.15.154:0/914577315 >> 172.21.15.154:0/914577315 conn(0x7f36740b1850 msgr2=0x7f36740b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:11.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3679fe7640 1 -- 172.21.15.154:0/914577315 shutdown_connections 2024-05-14T10:20:11.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3679fe7640 1 -- 172.21.15.154:0/914577315 wait complete. 2024-05-14T10:20:11.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3679fe7640 1 Processor -- start 2024-05-14T10:20:11.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3679fe7640 1 -- start start 2024-05-14T10:20:11.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3679fe7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36600039f0 0x7f36740c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3679fe7640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36740cb3b0 0x7f367413cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3679fe7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3674159800 0x7f3674159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3679fe7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f367406d5b0 con 0x7f36600039f0 2024-05-14T10:20:11.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3679fe7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f367406d430 con 0x7f3674159800 2024-05-14T10:20:11.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3679fe7640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f367406d730 con 0x7f36740cb3b0 2024-05-14T10:20:11.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f36737fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36600039f0 0x7f36740c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f36737fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36600039f0 0x7f36740c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55794/0 (socket says 172.21.15.154:55794) 2024-05-14T10:20:11.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f36737fe640 1 -- 172.21.15.154:0/513702713 learned_addr learned my addr 172.21.15.154:0/513702713 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:11.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3673fff640 1 --2- 172.21.15.154:0/513702713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3674159800 0x7f3674159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f366affd640 1 --2- 172.21.15.154:0/513702713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36740cb3b0 0x7f367413cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f36737fe640 1 -- 172.21.15.154:0/513702713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36740cb3b0 msgr2=0x7f367413cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f36737fe640 1 --2- 172.21.15.154:0/513702713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36740cb3b0 0x7f367413cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f36737fe640 1 -- 172.21.15.154:0/513702713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3674159800 msgr2=0x7f3674159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f36737fe640 1 --2- 172.21.15.154:0/513702713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3674159800 0x7f3674159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f36737fe640 1 -- 172.21.15.154:0/513702713 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36740cab70 con 0x7f36600039f0 2024-05-14T10:20:11.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f3673fff640 1 --2- 172.21.15.154:0/513702713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3674159800 0x7f3674159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T10:20:11.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.857+0000 7f366affd640 1 --2- 172.21.15.154:0/513702713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36740cb3b0 0x7f367413cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T10:20:11.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.861+0000 7f36737fe640 1 --2- 172.21.15.154:0/513702713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36600039f0 0x7f36740c9920 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f3664001780 tx=0x7f3660005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:11.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.861+0000 7f3670ff9640 1 -- 172.21.15.154:0/513702713 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36640ba020 con 0x7f36600039f0 2024-05-14T10:20:11.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.861+0000 7f3670ff9640 1 -- 172.21.15.154:0/513702713 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36640054a0 con 0x7f36600039f0 2024-05-14T10:20:11.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.861+0000 7f3679fe7640 1 -- 172.21.15.154:0/513702713 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36740cae50 con 0x7f36600039f0 2024-05-14T10:20:11.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.861+0000 7f3670ff9640 1 -- 172.21.15.154:0/513702713 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36640b2040 con 0x7f36600039f0 2024-05-14T10:20:11.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.861+0000 7f3679fe7640 1 -- 172.21.15.154:0/513702713 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36741fa8f0 con 0x7f36600039f0 2024-05-14T10:20:11.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.861+0000 7f3679fe7640 1 -- 172.21.15.154:0/513702713 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f36740ca920 con 0x7f36600039f0 2024-05-14T10:20:11.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.861+0000 7f3670ff9640 1 -- 172.21.15.154:0/513702713 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f36640bd020 con 0x7f36600039f0 2024-05-14T10:20:11.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.861+0000 7f3670ff9640 1 --2- 172.21.15.154:0/513702713 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f36540678f0 0x7f3654069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.861+0000 7f3670ff9640 1 -- 172.21.15.154:0/513702713 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f366411fce0 con 0x7f36600039f0 2024-05-14T10:20:11.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.861+0000 7f366affd640 1 --2- 172.21.15.154:0/513702713 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f36540678f0 0x7f3654069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.861+0000 7f3670ff9640 1 --2- 172.21.15.154:0/513702713 >> [v2:172.21.15.154:6810/4138707364,v1:172.21.15.154:6812/4138707364] conn(0x7f365406d7b0 0x7f365406fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:11.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.861+0000 7f3670ff9640 1 -- 172.21.15.154:0/513702713 --> [v2:172.21.15.154:6810/4138707364,v1:172.21.15.154:6812/4138707364] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f366400bf30 con 0x7f365406d7b0 2024-05-14T10:20:11.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.861+0000 7f3670ff9640 1 -- 172.21.15.154:0/513702713 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3664120140 con 0x7f36600039f0 2024-05-14T10:20:11.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.861+0000 7f3673fff640 1 --2- 172.21.15.154:0/513702713 >> [v2:172.21.15.154:6810/4138707364,v1:172.21.15.154:6812/4138707364] conn(0x7f365406d7b0 0x7f365406fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:11.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.861+0000 7f366affd640 1 --2- 172.21.15.154:0/513702713 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f36540678f0 0x7f3654069db0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f36740cb7b0 tx=0x7f365c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:11.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.861+0000 7f3673fff640 1 --2- 172.21.15.154:0/513702713 >> [v2:172.21.15.154:6810/4138707364,v1:172.21.15.154:6812/4138707364] conn(0x7f365406d7b0 0x7f365406fbd0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:11.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.957+0000 7f3670ff9640 1 -- 172.21.15.154:0/513702713 <== osd.1 v2:172.21.15.154:6810/4138707364 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f366400bf30 con 0x7f365406d7b0 2024-05-14T10:20:11.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.973+0000 7f3679fe7640 1 -- 172.21.15.154:0/513702713 --> [v2:172.21.15.154:6810/4138707364,v1:172.21.15.154:6812/4138707364] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3674075470 con 0x7f365406d7b0 2024-05-14T10:20:11.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.993+0000 7f3670ff9640 1 -- 172.21.15.154:0/513702713 <== osd.1 v2:172.21.15.154:6810/4138707364 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3674075470 con 0x7f365406d7b0 2024-05-14T10:20:11.998 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-14T10:20:11.998 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T10:20:11.998 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-14T10:20:11.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.993+0000 7f3679fe7640 1 -- 172.21.15.154:0/513702713 >> [v2:172.21.15.154:6810/4138707364,v1:172.21.15.154:6812/4138707364] conn(0x7f365406d7b0 msgr2=0x7f365406fbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:11.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.993+0000 7f3679fe7640 1 --2- 172.21.15.154:0/513702713 >> [v2:172.21.15.154:6810/4138707364,v1:172.21.15.154:6812/4138707364] conn(0x7f365406d7b0 0x7f365406fbd0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:11.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.993+0000 7f3679fe7640 1 -- 172.21.15.154:0/513702713 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f36540678f0 msgr2=0x7f3654069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.993+0000 7f3679fe7640 1 --2- 172.21.15.154:0/513702713 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f36540678f0 0x7f3654069db0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f36740cb7b0 tx=0x7f365c008040 comp rx=0 tx=0).stop 2024-05-14T10:20:12.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.993+0000 7f3679fe7640 1 -- 172.21.15.154:0/513702713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36600039f0 msgr2=0x7f36740c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.993+0000 7f3679fe7640 1 --2- 172.21.15.154:0/513702713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36600039f0 0x7f36740c9920 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f3664001780 tx=0x7f3660005840 comp rx=0 tx=0).stop 2024-05-14T10:20:12.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.993+0000 7f3673fff640 1 -- 172.21.15.154:0/513702713 reap_dead start 2024-05-14T10:20:12.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.993+0000 7f3679fe7640 1 -- 172.21.15.154:0/513702713 shutdown_connections 2024-05-14T10:20:12.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.993+0000 7f3679fe7640 1 -- 172.21.15.154:0/513702713 >> 172.21.15.154:0/513702713 conn(0x7f36740b1850 msgr2=0x7f3674071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:12.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.993+0000 7f3679fe7640 1 -- 172.21.15.154:0/513702713 shutdown_connections 2024-05-14T10:20:12.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:11.993+0000 7f3679fe7640 1 -- 172.21.15.154:0/513702713 wait complete. 2024-05-14T10:20:12.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-14T10:20:12.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac762a5640 1 Processor -- start 2024-05-14T10:20:12.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac762a5640 1 -- start start 2024-05-14T10:20:12.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac762a5640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fac7015ae90 0x7fac700aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac762a5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac700aeff0 0x7fac700cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac762a5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac700cc420 con 0x7fac7015b270 2024-05-14T10:20:12.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac762a5640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fac7015ebc0 con 0x7fac7015ae90 2024-05-14T10:20:12.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac762a5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fac700cc700 con 0x7fac700aeff0 2024-05-14T10:20:12.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac74842640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fac7015b270 0x7fac7006c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46754/0 (socket says 172.21.15.154:46754) 2024-05-14T10:20:12.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac74842640 1 -- 172.21.15.154:0/3659826010 learned_addr learned my addr 172.21.15.154:0/3659826010 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:20:12.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6ffff640 1 --2- 172.21.15.154:0/3659826010 >> v2:172.21.15.176:3300/0 conn(0x7fac7015ae90 0x7fac700aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6f7fe640 1 --2- 172.21.15.154:0/3659826010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac700aeff0 0x7fac700cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6effd640 1 -- 172.21.15.154:0/3659826010 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4195952401 0 0) 0x7fac700cc420 con 0x7fac7015b270 2024-05-14T10:20:12.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6effd640 1 -- 172.21.15.154:0/3659826010 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac5c003530 con 0x7fac7015b270 2024-05-14T10:20:12.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6effd640 1 -- 172.21.15.154:0/3659826010 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1368498973 0 0) 0x7fac5c003530 con 0x7fac7015b270 2024-05-14T10:20:12.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6effd640 1 -- 172.21.15.154:0/3659826010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac700aeff0 msgr2=0x7fac700cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:12.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6effd640 1 --2- 172.21.15.154:0/3659826010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac700aeff0 0x7fac700cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6effd640 1 -- 172.21.15.154:0/3659826010 >> v2:172.21.15.176:3300/0 conn(0x7fac7015ae90 msgr2=0x7fac700aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:12.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6effd640 1 --2- 172.21.15.154:0/3659826010 >> v2:172.21.15.176:3300/0 conn(0x7fac7015ae90 0x7fac700aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6effd640 1 -- 172.21.15.154:0/3659826010 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac700cc9e0 con 0x7fac7015b270 2024-05-14T10:20:12.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6effd640 1 -- 172.21.15.154:0/3659826010 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7fac60001a00 con 0x7fac7015b270 2024-05-14T10:20:12.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6effd640 1 -- 172.21.15.154:0/3659826010 >> v1:172.21.15.154:6789/0 conn(0x7fac7015b270 legacy=0x7fac7006c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6effd640 1 --2- 172.21.15.154:0/3659826010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac5c0039c0 0x7fac5c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6effd640 1 --2- 172.21.15.154:0/3659826010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac5c004810 0x7fac5c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6effd640 1 --2- 172.21.15.154:0/3659826010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac700aeff0 0x7fac5c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6effd640 1 -- 172.21.15.154:0/3659826010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fac7015ebc0 con 0x7fac5c004810 2024-05-14T10:20:12.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6effd640 1 -- 172.21.15.154:0/3659826010 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fac700cc700 con 0x7fac5c0039c0 2024-05-14T10:20:12.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6effd640 1 -- 172.21.15.154:0/3659826010 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fac5c00b9d0 con 0x7fac700aeff0 2024-05-14T10:20:12.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6f7fe640 1 --2- 172.21.15.154:0/3659826010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac5c004810 0x7fac5c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6ffff640 1 --2- 172.21.15.154:0/3659826010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac5c0039c0 0x7fac5c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac74842640 1 --2- 172.21.15.154:0/3659826010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac700aeff0 0x7fac5c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6f7fe640 1 -- 172.21.15.154:0/3659826010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac700aeff0 msgr2=0x7fac5c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:12.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6f7fe640 1 --2- 172.21.15.154:0/3659826010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac700aeff0 0x7fac5c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6f7fe640 1 -- 172.21.15.154:0/3659826010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac5c0039c0 msgr2=0x7fac5c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:12.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6f7fe640 1 --2- 172.21.15.154:0/3659826010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac5c0039c0 0x7fac5c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.137+0000 7fac6f7fe640 1 -- 172.21.15.154:0/3659826010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c003530 con 0x7fac5c004810 2024-05-14T10:20:12.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.141+0000 7fac6f7fe640 1 --2- 172.21.15.154:0/3659826010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac5c004810 0x7fac5c004c90 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7fac700cb2a0 tx=0x7fac5801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e1c76bb051ac6f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:12.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.141+0000 7fac6effd640 1 -- 172.21.15.154:0/3659826010 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac580b2070 con 0x7fac5c004810 2024-05-14T10:20:12.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.141+0000 7fac6effd640 1 -- 172.21.15.154:0/3659826010 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac580a5520 con 0x7fac5c004810 2024-05-14T10:20:12.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.141+0000 7fac6effd640 1 -- 172.21.15.154:0/3659826010 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac580096b0 con 0x7fac5c004810 2024-05-14T10:20:12.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.141+0000 7fac762a5640 1 -- 172.21.15.154:0/3659826010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac5c004810 msgr2=0x7fac5c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.141+0000 7fac762a5640 1 --2- 172.21.15.154:0/3659826010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac5c004810 0x7fac5c004c90 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7fac700cb2a0 tx=0x7fac5801ca10 comp rx=0 tx=0).stop 2024-05-14T10:20:12.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.141+0000 7fac74842640 1 -- 172.21.15.154:0/3659826010 reap_dead start 2024-05-14T10:20:12.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.141+0000 7fac762a5640 1 -- 172.21.15.154:0/3659826010 shutdown_connections 2024-05-14T10:20:12.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.141+0000 7fac762a5640 1 -- 172.21.15.154:0/3659826010 >> 172.21.15.154:0/3659826010 conn(0x7fac70072050 msgr2=0x7fac70072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:12.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.141+0000 7fac762a5640 1 -- 172.21.15.154:0/3659826010 shutdown_connections 2024-05-14T10:20:12.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.141+0000 7fac762a5640 1 -- 172.21.15.154:0/3659826010 wait complete. 2024-05-14T10:20:12.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.141+0000 7fac762a5640 1 Processor -- start 2024-05-14T10:20:12.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.141+0000 7fac762a5640 1 -- start start 2024-05-14T10:20:12.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac762a5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac5c004810 0x7fac7014c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac762a5640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac700b6440 0x7fac7015b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac762a5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac700b68c0 0x7fac7015bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac762a5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fac7006c9a0 con 0x7fac700b68c0 2024-05-14T10:20:12.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac762a5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fac700cc0b0 con 0x7fac5c004810 2024-05-14T10:20:12.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac762a5640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fac7006cb20 con 0x7fac700b6440 2024-05-14T10:20:12.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac74842640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac700b68c0 0x7fac7015bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac74842640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac700b68c0 0x7fac7015bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55812/0 (socket says 172.21.15.154:55812) 2024-05-14T10:20:12.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac74842640 1 -- 172.21.15.154:0/2999066221 learned_addr learned my addr 172.21.15.154:0/2999066221 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:12.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac6f7fe640 1 --2- 172.21.15.154:0/2999066221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac700b6440 0x7fac7015b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac6ffff640 1 --2- 172.21.15.154:0/2999066221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac5c004810 0x7fac7014c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac74842640 1 -- 172.21.15.154:0/2999066221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac700b6440 msgr2=0x7fac7015b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac74842640 1 --2- 172.21.15.154:0/2999066221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac700b6440 0x7fac7015b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac74842640 1 -- 172.21.15.154:0/2999066221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac5c004810 msgr2=0x7fac7014c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac74842640 1 --2- 172.21.15.154:0/2999066221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac5c004810 0x7fac7014c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac74842640 1 -- 172.21.15.154:0/2999066221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac700b53a0 con 0x7fac700b68c0 2024-05-14T10:20:12.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac6ffff640 1 --2- 172.21.15.154:0/2999066221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac5c004810 0x7fac7014c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:20:12.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac74842640 1 --2- 172.21.15.154:0/2999066221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac700b68c0 0x7fac7015bc00 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7fac7015b690 tx=0x7fac60011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:12.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac6cff9640 1 -- 172.21.15.154:0/2999066221 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac60010040 con 0x7fac700b68c0 2024-05-14T10:20:12.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac6cff9640 1 -- 172.21.15.154:0/2999066221 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac60018020 con 0x7fac700b68c0 2024-05-14T10:20:12.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac762a5640 1 -- 172.21.15.154:0/2999066221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac700b5680 con 0x7fac700b68c0 2024-05-14T10:20:12.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac6cff9640 1 -- 172.21.15.154:0/2999066221 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac60011ea0 con 0x7fac700b68c0 2024-05-14T10:20:12.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac762a5640 1 -- 172.21.15.154:0/2999066221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac700b5c40 con 0x7fac700b68c0 2024-05-14T10:20:12.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac762a5640 1 -- 172.21.15.154:0/2999066221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac70068360 con 0x7fac700b68c0 2024-05-14T10:20:12.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac6cff9640 1 -- 172.21.15.154:0/2999066221 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fac6000f900 con 0x7fac700b68c0 2024-05-14T10:20:12.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac6cff9640 1 --2- 172.21.15.154:0/2999066221 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fac500678f0 0x7fac50069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac6cff9640 1 -- 172.21.15.154:0/2999066221 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fac6008a210 con 0x7fac700b68c0 2024-05-14T10:20:12.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.145+0000 7fac6ffff640 1 --2- 172.21.15.154:0/2999066221 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fac500678f0 0x7fac50069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.149+0000 7fac6ffff640 1 --2- 172.21.15.154:0/2999066221 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fac500678f0 0x7fac50069db0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fac68009c60 tx=0x7fac68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:12.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.149+0000 7fac6cff9640 1 -- 172.21.15.154:0/2999066221 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fac60022020 con 0x7fac700b68c0 2024-05-14T10:20:12.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.309+0000 7fac762a5640 1 -- 172.21.15.154:0/2999066221 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fac700730f0 con 0x7fac500678f0 2024-05-14T10:20:12.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.309+0000 7fac6cff9640 1 -- 172.21.15.154:0/2999066221 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fac700730f0 con 0x7fac500678f0 2024-05-14T10:20:12.316 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 1 to deep-scrub 2024-05-14T10:20:12.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.313+0000 7fac762a5640 1 -- 172.21.15.154:0/2999066221 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fac500678f0 msgr2=0x7fac50069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.313+0000 7fac762a5640 1 --2- 172.21.15.154:0/2999066221 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fac500678f0 0x7fac50069db0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fac68009c60 tx=0x7fac68008040 comp rx=0 tx=0).stop 2024-05-14T10:20:12.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.313+0000 7fac762a5640 1 -- 172.21.15.154:0/2999066221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac700b68c0 msgr2=0x7fac7015bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.313+0000 7fac762a5640 1 --2- 172.21.15.154:0/2999066221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac700b68c0 0x7fac7015bc00 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7fac7015b690 tx=0x7fac60011b60 comp rx=0 tx=0).stop 2024-05-14T10:20:12.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.313+0000 7fac762a5640 1 -- 172.21.15.154:0/2999066221 shutdown_connections 2024-05-14T10:20:12.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.313+0000 7fac762a5640 1 --2- 172.21.15.154:0/2999066221 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fac500678f0 0x7fac50069db0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.313+0000 7fac762a5640 1 --2- 172.21.15.154:0/2999066221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac700b68c0 0x7fac7015bc00 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.313+0000 7fac762a5640 1 --2- 172.21.15.154:0/2999066221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac700b6440 0x7fac7015b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.313+0000 7fac762a5640 1 --2- 172.21.15.154:0/2999066221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac5c004810 0x7fac7014c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.313+0000 7fac762a5640 1 -- 172.21.15.154:0/2999066221 >> 172.21.15.154:0/2999066221 conn(0x7fac70072050 msgr2=0x7fac700b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:12.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.313+0000 7fac762a5640 1 -- 172.21.15.154:0/2999066221 shutdown_connections 2024-05-14T10:20:12.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.313+0000 7fac762a5640 1 -- 172.21.15.154:0/2999066221 wait complete. 2024-05-14T10:20:12.335 INFO:tasks.ceph:Scrubbing osd.2 2024-05-14T10:20:12.335 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-14T10:20:12.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.457+0000 7f1662dd6640 1 Processor -- start 2024-05-14T10:20:12.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.457+0000 7f1662dd6640 1 -- start start 2024-05-14T10:20:12.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f1662dd6640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f165c144720 0x7f165c06e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f1662dd6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f165c15f150 0x7f165c071d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f1662dd6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f165c144b00 con 0x7f165c0b4570 2024-05-14T10:20:12.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f1662dd6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f165c06ea80 con 0x7f165c15f150 2024-05-14T10:20:12.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f1662dd6640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f165c06ece0 con 0x7f165c144720 2024-05-14T10:20:12.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f1661373640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f165c15f150 0x7f165c071d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f165bfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f165c0b4570 0x7f165c15ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46766/0 (socket says 172.21.15.154:46766) 2024-05-14T10:20:12.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f165bfff640 1 -- 172.21.15.154:0/1947836728 learned_addr learned my addr 172.21.15.154:0/1947836728 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:20:12.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f1660b72640 1 --2- 172.21.15.154:0/1947836728 >> v2:172.21.15.176:3300/0 conn(0x7f165c144720 0x7f165c06e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f1661373640 1 -- 172.21.15.154:0/1947836728 >> v2:172.21.15.176:3300/0 conn(0x7f165c144720 msgr2=0x7f165c06e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:12.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f1661373640 1 --2- 172.21.15.154:0/1947836728 >> v2:172.21.15.176:3300/0 conn(0x7f165c144720 0x7f165c06e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f1661373640 1 -- 172.21.15.154:0/1947836728 >> v1:172.21.15.154:6789/0 conn(0x7f165c0b4570 legacy=0x7f165c15ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f1661373640 1 -- 172.21.15.154:0/1947836728 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165c070f50 con 0x7f165c15f150 2024-05-14T10:20:12.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f165b7fe640 1 -- 172.21.15.154:0/1947836728 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3280058584 0 0) 0x7f165c144b00 con 0x7f165c0b4570 2024-05-14T10:20:12.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f1660b72640 1 --2- 172.21.15.154:0/1947836728 >> v2:172.21.15.176:3300/0 conn(0x7f165c144720 0x7f165c06e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:20:12.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f1661373640 1 --2- 172.21.15.154:0/1947836728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f165c15f150 0x7f165c071d10 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f165c0d0ce0 tx=0x7f165401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54a7c31a51895ab server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:12.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f165b7fe640 1 -- 172.21.15.154:0/1947836728 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540b2070 con 0x7f165c15f150 2024-05-14T10:20:12.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f165b7fe640 1 -- 172.21.15.154:0/1947836728 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16540a5930 con 0x7f165c15f150 2024-05-14T10:20:12.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.461+0000 7f165b7fe640 1 -- 172.21.15.154:0/1947836728 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540a5d00 con 0x7f165c15f150 2024-05-14T10:20:12.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 -- 172.21.15.154:0/1947836728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f165c15f150 msgr2=0x7f165c071d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 --2- 172.21.15.154:0/1947836728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f165c15f150 0x7f165c071d10 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f165c0d0ce0 tx=0x7f165401c870 comp rx=0 tx=0).stop 2024-05-14T10:20:12.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 -- 172.21.15.154:0/1947836728 shutdown_connections 2024-05-14T10:20:12.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 --2- 172.21.15.154:0/1947836728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f165c15f150 0x7f165c071d10 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 --2- 172.21.15.154:0/1947836728 >> v2:172.21.15.176:3300/0 conn(0x7f165c144720 0x7f165c06e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 -- 172.21.15.154:0/1947836728 >> 172.21.15.154:0/1947836728 conn(0x7f165c0b1850 msgr2=0x7f165c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:12.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 -- 172.21.15.154:0/1947836728 shutdown_connections 2024-05-14T10:20:12.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 -- 172.21.15.154:0/1947836728 wait complete. 2024-05-14T10:20:12.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 Processor -- start 2024-05-14T10:20:12.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 -- start start 2024-05-14T10:20:12.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f165c0b4570 0x7f165c143660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f165c144720 0x7f165c156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f165c15f150 0x7f165c139460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f165c167f40 con 0x7f165c15f150 2024-05-14T10:20:12.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f165c167dc0 con 0x7f165c0b4570 2024-05-14T10:20:12.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f165c1680c0 con 0x7f165c144720 2024-05-14T10:20:12.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1661373640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f165c15f150 0x7f165c139460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1661373640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f165c15f150 0x7f165c139460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55836/0 (socket says 172.21.15.154:55836) 2024-05-14T10:20:12.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1661373640 1 -- 172.21.15.154:0/1858184947 learned_addr learned my addr 172.21.15.154:0/1858184947 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:12.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1660b72640 1 --2- 172.21.15.154:0/1858184947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f165c0b4570 0x7f165c143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f165bfff640 1 --2- 172.21.15.154:0/1858184947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f165c144720 0x7f165c156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1661373640 1 -- 172.21.15.154:0/1858184947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f165c144720 msgr2=0x7f165c156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1661373640 1 --2- 172.21.15.154:0/1858184947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f165c144720 0x7f165c156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1661373640 1 -- 172.21.15.154:0/1858184947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f165c0b4570 msgr2=0x7f165c143660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1661373640 1 --2- 172.21.15.154:0/1858184947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f165c0b4570 0x7f165c143660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1661373640 1 -- 172.21.15.154:0/1858184947 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165c159310 con 0x7f165c15f150 2024-05-14T10:20:12.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1661373640 1 --2- 172.21.15.154:0/1858184947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f165c15f150 0x7f165c139460 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f165401a4a0 tx=0x7f1654019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:12.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f16597fa640 1 -- 172.21.15.154:0/1858184947 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540b2050 con 0x7f165c15f150 2024-05-14T10:20:12.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f16597fa640 1 -- 172.21.15.154:0/1858184947 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16540be070 con 0x7f165c15f150 2024-05-14T10:20:12.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 -- 172.21.15.154:0/1858184947 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f165c1595f0 con 0x7f165c15f150 2024-05-14T10:20:12.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f16597fa640 1 -- 172.21.15.154:0/1858184947 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540ada50 con 0x7f165c15f150 2024-05-14T10:20:12.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 -- 172.21.15.154:0/1858184947 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f165c159bb0 con 0x7f165c15f150 2024-05-14T10:20:12.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.465+0000 7f1662dd6640 1 -- 172.21.15.154:0/1858184947 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f165c075470 con 0x7f165c15f150 2024-05-14T10:20:12.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.469+0000 7f16597fa640 1 -- 172.21.15.154:0/1858184947 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f16540adbf0 con 0x7f165c15f150 2024-05-14T10:20:12.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.469+0000 7f16597fa640 1 --2- 172.21.15.154:0/1858184947 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16480678c0 0x7f1648069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.469+0000 7f16597fa640 1 -- 172.21.15.154:0/1858184947 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f1654121640 con 0x7f165c15f150 2024-05-14T10:20:12.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.469+0000 7f1660b72640 1 --2- 172.21.15.154:0/1858184947 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16480678c0 0x7f1648069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.469+0000 7f16597fa640 1 --2- 172.21.15.154:0/1858184947 >> [v2:172.21.15.154:6800/1507596223,v1:172.21.15.154:6801/1507596223] conn(0x7f164806d780 0x7f164806fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.469+0000 7f16597fa640 1 -- 172.21.15.154:0/1858184947 --> [v2:172.21.15.154:6800/1507596223,v1:172.21.15.154:6801/1507596223] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1648070250 con 0x7f164806d780 2024-05-14T10:20:12.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.469+0000 7f16597fa640 1 -- 172.21.15.154:0/1858184947 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f1654121ad0 con 0x7f165c15f150 2024-05-14T10:20:12.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.469+0000 7f165bfff640 1 --2- 172.21.15.154:0/1858184947 >> [v2:172.21.15.154:6800/1507596223,v1:172.21.15.154:6801/1507596223] conn(0x7f164806d780 0x7f164806fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.469+0000 7f1660b72640 1 --2- 172.21.15.154:0/1858184947 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16480678c0 0x7f1648069d80 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f165000c900 tx=0x7f1650008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:12.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.469+0000 7f165bfff640 1 --2- 172.21.15.154:0/1858184947 >> [v2:172.21.15.154:6800/1507596223,v1:172.21.15.154:6801/1507596223] conn(0x7f164806d780 0x7f164806fba0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:12.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.557+0000 7f16597fa640 1 -- 172.21.15.154:0/1858184947 <== osd.2 v2:172.21.15.154:6800/1507596223 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1648070250 con 0x7f164806d780 2024-05-14T10:20:12.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.573+0000 7f1662dd6640 1 -- 172.21.15.154:0/1858184947 --> [v2:172.21.15.154:6800/1507596223,v1:172.21.15.154:6801/1507596223] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f165c06d030 con 0x7f164806d780 2024-05-14T10:20:12.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.593+0000 7f16597fa640 1 -- 172.21.15.154:0/1858184947 <== osd.2 v2:172.21.15.154:6800/1507596223 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f165c06d030 con 0x7f164806d780 2024-05-14T10:20:12.600 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-14T10:20:12.600 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T10:20:12.600 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-14T10:20:12.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.593+0000 7f1662dd6640 1 -- 172.21.15.154:0/1858184947 >> [v2:172.21.15.154:6800/1507596223,v1:172.21.15.154:6801/1507596223] conn(0x7f164806d780 msgr2=0x7f164806fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.593+0000 7f1662dd6640 1 --2- 172.21.15.154:0/1858184947 >> [v2:172.21.15.154:6800/1507596223,v1:172.21.15.154:6801/1507596223] conn(0x7f164806d780 0x7f164806fba0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.593+0000 7f1662dd6640 1 -- 172.21.15.154:0/1858184947 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16480678c0 msgr2=0x7f1648069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.593+0000 7f1662dd6640 1 --2- 172.21.15.154:0/1858184947 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f16480678c0 0x7f1648069d80 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f165000c900 tx=0x7f1650008040 comp rx=0 tx=0).stop 2024-05-14T10:20:12.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.593+0000 7f1662dd6640 1 -- 172.21.15.154:0/1858184947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f165c15f150 msgr2=0x7f165c139460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.593+0000 7f1662dd6640 1 --2- 172.21.15.154:0/1858184947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f165c15f150 0x7f165c139460 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f165401a4a0 tx=0x7f1654019610 comp rx=0 tx=0).stop 2024-05-14T10:20:12.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.593+0000 7f1661373640 1 -- 172.21.15.154:0/1858184947 reap_dead start 2024-05-14T10:20:12.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.593+0000 7f1662dd6640 1 -- 172.21.15.154:0/1858184947 shutdown_connections 2024-05-14T10:20:12.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.593+0000 7f1662dd6640 1 -- 172.21.15.154:0/1858184947 >> 172.21.15.154:0/1858184947 conn(0x7f165c0b1850 msgr2=0x7f165c0b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:12.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.593+0000 7f1662dd6640 1 -- 172.21.15.154:0/1858184947 shutdown_connections 2024-05-14T10:20:12.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.593+0000 7f1662dd6640 1 -- 172.21.15.154:0/1858184947 wait complete. 2024-05-14T10:20:12.624 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-14T10:20:12.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.745+0000 7f564526e640 1 Processor -- start 2024-05-14T10:20:12.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.745+0000 7f564526e640 1 -- start start 2024-05-14T10:20:12.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.745+0000 7f564526e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5640070e60 0x7f56400b3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.745+0000 7f564526e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56400b4820 0x7f564006d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.745+0000 7f564526e640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5640071240 0x7f56400716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.745+0000 7f564526e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f56400b2d60 con 0x7f56400b4820 2024-05-14T10:20:12.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.745+0000 7f564526e640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f56400ae1b0 con 0x7f5640071240 2024-05-14T10:20:12.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.745+0000 7f564526e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f56400b3e40 con 0x7f5640070e60 2024-05-14T10:20:12.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.745+0000 7f563e7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56400b4820 0x7f564006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.745+0000 7f563e7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56400b4820 0x7f564006d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55838/0 (socket says 172.21.15.154:55838) 2024-05-14T10:20:12.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.745+0000 7f563e7fc640 1 -- 172.21.15.154:0/4169131382 learned_addr learned my addr 172.21.15.154:0/4169131382 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:12.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.745+0000 7f563effd640 1 --2- 172.21.15.154:0/4169131382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5640070e60 0x7f56400b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.745+0000 7f563f7fe640 1 --2- 172.21.15.154:0/4169131382 >> v2:172.21.15.176:3300/0 conn(0x7f5640071240 0x7f56400716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.745+0000 7f563e7fc640 1 -- 172.21.15.154:0/4169131382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5640070e60 msgr2=0x7f56400b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:12.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.745+0000 7f563e7fc640 1 --2- 172.21.15.154:0/4169131382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5640070e60 0x7f56400b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.745+0000 7f563e7fc640 1 -- 172.21.15.154:0/4169131382 >> v2:172.21.15.176:3300/0 conn(0x7f5640071240 msgr2=0x7f56400716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:12.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.745+0000 7f563e7fc640 1 --2- 172.21.15.154:0/4169131382 >> v2:172.21.15.176:3300/0 conn(0x7f5640071240 0x7f56400716d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.745+0000 7f563e7fc640 1 -- 172.21.15.154:0/4169131382 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56400b4110 con 0x7f56400b4820 2024-05-14T10:20:12.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f563e7fc640 1 --2- 172.21.15.154:0/4169131382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56400b4820 0x7f564006d170 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f56400b2be0 tx=0x7f563401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42e6fc718a28ea8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:12.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f563dffb640 1 -- 172.21.15.154:0/4169131382 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56340b5070 con 0x7f56400b4820 2024-05-14T10:20:12.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f563dffb640 1 -- 172.21.15.154:0/4169131382 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56340a89d0 con 0x7f56400b4820 2024-05-14T10:20:12.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f563dffb640 1 -- 172.21.15.154:0/4169131382 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56340a8da0 con 0x7f56400b4820 2024-05-14T10:20:12.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f564526e640 1 -- 172.21.15.154:0/4169131382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56400b4820 msgr2=0x7f564006d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f564526e640 1 --2- 172.21.15.154:0/4169131382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56400b4820 0x7f564006d170 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f56400b2be0 tx=0x7f563401ed10 comp rx=0 tx=0).stop 2024-05-14T10:20:12.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f564526e640 1 -- 172.21.15.154:0/4169131382 shutdown_connections 2024-05-14T10:20:12.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f564526e640 1 --2- 172.21.15.154:0/4169131382 >> v2:172.21.15.176:3300/0 conn(0x7f5640071240 0x7f56400716d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f564526e640 1 --2- 172.21.15.154:0/4169131382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56400b4820 0x7f564006d170 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f564526e640 1 --2- 172.21.15.154:0/4169131382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5640070e60 0x7f56400b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f564526e640 1 -- 172.21.15.154:0/4169131382 >> 172.21.15.154:0/4169131382 conn(0x7f56400b1850 msgr2=0x7f56400b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:12.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f564526e640 1 -- 172.21.15.154:0/4169131382 shutdown_connections 2024-05-14T10:20:12.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f564526e640 1 -- 172.21.15.154:0/4169131382 wait complete. 2024-05-14T10:20:12.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f564526e640 1 Processor -- start 2024-05-14T10:20:12.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f564526e640 1 -- start start 2024-05-14T10:20:12.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f564526e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5640070e60 0x7f564014b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f564526e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5640071240 0x7f5640145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f564526e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56400b4820 0x7f56400cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f564526e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56400ade40 con 0x7f5640070e60 2024-05-14T10:20:12.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f564526e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f56400adb60 con 0x7f56400b4820 2024-05-14T10:20:12.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.749+0000 7f564526e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f564006d6b0 con 0x7f5640071240 2024-05-14T10:20:12.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f563effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5640070e60 0x7f564014b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f563effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5640070e60 0x7f564014b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55848/0 (socket says 172.21.15.154:55848) 2024-05-14T10:20:12.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f563effd640 1 -- 172.21.15.154:0/3464923915 learned_addr learned my addr 172.21.15.154:0/3464923915 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:12.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f563e7fc640 1 --2- 172.21.15.154:0/3464923915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5640071240 0x7f5640145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f563f7fe640 1 --2- 172.21.15.154:0/3464923915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56400b4820 0x7f56400cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f563effd640 1 -- 172.21.15.154:0/3464923915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5640071240 msgr2=0x7f5640145d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f563effd640 1 --2- 172.21.15.154:0/3464923915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5640071240 0x7f5640145d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f563effd640 1 -- 172.21.15.154:0/3464923915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56400b4820 msgr2=0x7f56400cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f563effd640 1 --2- 172.21.15.154:0/3464923915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56400b4820 0x7f56400cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f563effd640 1 -- 172.21.15.154:0/3464923915 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564014c130 con 0x7f5640070e60 2024-05-14T10:20:12.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f563effd640 1 --2- 172.21.15.154:0/3464923915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5640070e60 0x7f564014b720 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7f5630007e40 tx=0x7f563000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:12.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f56277fe640 1 -- 172.21.15.154:0/3464923915 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630014620 con 0x7f5640070e60 2024-05-14T10:20:12.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f56277fe640 1 -- 172.21.15.154:0/3464923915 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5630019070 con 0x7f5640070e60 2024-05-14T10:20:12.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f564526e640 1 -- 172.21.15.154:0/3464923915 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f564015ba50 con 0x7f5640070e60 2024-05-14T10:20:12.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f56277fe640 1 -- 172.21.15.154:0/3464923915 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630014a00 con 0x7f5640070e60 2024-05-14T10:20:12.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f564526e640 1 -- 172.21.15.154:0/3464923915 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f564015c010 con 0x7f5640070e60 2024-05-14T10:20:12.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f564526e640 1 -- 172.21.15.154:0/3464923915 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5640075470 con 0x7f5640070e60 2024-05-14T10:20:12.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f56277fe640 1 -- 172.21.15.154:0/3464923915 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5630014ba0 con 0x7f5640070e60 2024-05-14T10:20:12.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f56277fe640 1 --2- 172.21.15.154:0/3464923915 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f562c0678c0 0x7f562c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:12.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f56277fe640 1 -- 172.21.15.154:0/3464923915 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f56300862b0 con 0x7f5640070e60 2024-05-14T10:20:12.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f563e7fc640 1 --2- 172.21.15.154:0/3464923915 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f562c0678c0 0x7f562c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:12.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.753+0000 7f563e7fc640 1 --2- 172.21.15.154:0/3464923915 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f562c0678c0 0x7f562c069d80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f56340b2000 tx=0x7f5634008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:12.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.793+0000 7f56277fe640 1 -- 172.21.15.154:0/3464923915 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f5630057090 con 0x7f5640070e60 2024-05-14T10:20:12.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.953+0000 7f564526e640 1 -- 172.21.15.154:0/3464923915 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f564006e8d0 con 0x7f562c0678c0 2024-05-14T10:20:12.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.953+0000 7f56277fe640 1 -- 172.21.15.154:0/3464923915 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f564006e8d0 con 0x7f562c0678c0 2024-05-14T10:20:12.959 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 2 to deep-scrub 2024-05-14T10:20:12.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.953+0000 7f564526e640 1 -- 172.21.15.154:0/3464923915 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f562c0678c0 msgr2=0x7f562c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.953+0000 7f564526e640 1 --2- 172.21.15.154:0/3464923915 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f562c0678c0 0x7f562c069d80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f56340b2000 tx=0x7f5634008040 comp rx=0 tx=0).stop 2024-05-14T10:20:12.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.953+0000 7f564526e640 1 -- 172.21.15.154:0/3464923915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5640070e60 msgr2=0x7f564014b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:12.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.957+0000 7f564526e640 1 --2- 172.21.15.154:0/3464923915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5640070e60 0x7f564014b720 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7f5630007e40 tx=0x7f563000e4b0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.957+0000 7f564526e640 1 -- 172.21.15.154:0/3464923915 shutdown_connections 2024-05-14T10:20:12.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.957+0000 7f564526e640 1 --2- 172.21.15.154:0/3464923915 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f562c0678c0 0x7f562c069d80 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.957+0000 7f564526e640 1 --2- 172.21.15.154:0/3464923915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56400b4820 0x7f56400cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.957+0000 7f564526e640 1 --2- 172.21.15.154:0/3464923915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5640071240 0x7f5640145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.957+0000 7f564526e640 1 --2- 172.21.15.154:0/3464923915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5640070e60 0x7f564014b720 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:12.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.957+0000 7f564526e640 1 -- 172.21.15.154:0/3464923915 >> 172.21.15.154:0/3464923915 conn(0x7f56400b1850 msgr2=0x7f564015e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:12.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.957+0000 7f564526e640 1 -- 172.21.15.154:0/3464923915 shutdown_connections 2024-05-14T10:20:12.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:12.957+0000 7f564526e640 1 -- 172.21.15.154:0/3464923915 wait complete. 2024-05-14T10:20:12.978 INFO:tasks.ceph:Scrubbing osd.3 2024-05-14T10:20:12.979 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-14T10:20:13.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.101+0000 7f0af8c36640 1 Processor -- start 2024-05-14T10:20:13.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.101+0000 7f0af8c36640 1 -- start start 2024-05-14T10:20:13.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.101+0000 7f0af8c36640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0af415e420 0x7f0af40d3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.101+0000 7f0af8c36640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0af4162760 0x7f0af40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.101+0000 7f0af8c36640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0af4162da0 con 0x7f0af40cf060 2024-05-14T10:20:13.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.101+0000 7f0af8c36640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0af40d23c0 con 0x7f0af415e420 2024-05-14T10:20:13.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.101+0000 7f0af8c36640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0af40d26a0 con 0x7f0af4162760 2024-05-14T10:20:13.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.101+0000 7f0af259c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0af415e420 0x7f0af40d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.101+0000 7f0af1d9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0af40cf060 0x7f0af4162050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46782/0 (socket says 172.21.15.154:46782) 2024-05-14T10:20:13.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.101+0000 7f0af1d9b640 1 -- 172.21.15.154:0/1135551047 learned_addr learned my addr 172.21.15.154:0/1135551047 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:20:13.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.101+0000 7f0af2d9d640 1 --2- 172.21.15.154:0/1135551047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0af4162760 0x7f0af40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.101+0000 7f0af259c640 1 -- 172.21.15.154:0/1135551047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0af4162760 msgr2=0x7f0af40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:13.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.101+0000 7f0af259c640 1 --2- 172.21.15.154:0/1135551047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0af4162760 0x7f0af40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.101+0000 7f0af259c640 1 -- 172.21.15.154:0/1135551047 >> v1:172.21.15.154:6789/0 conn(0x7f0af40cf060 legacy=0x7f0af4162050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.101+0000 7f0af159a640 1 -- 172.21.15.154:0/1135551047 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3506386166 0 0) 0x7f0af4162da0 con 0x7f0af40cf060 2024-05-14T10:20:13.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.101+0000 7f0af259c640 1 -- 172.21.15.154:0/1135551047 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af40d2980 con 0x7f0af415e420 2024-05-14T10:20:13.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af259c640 1 --2- 172.21.15.154:0/1135551047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0af415e420 0x7f0af40d3180 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0097c0 tx=0x7f0aec01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8c66ef1745d5f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:13.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af159a640 1 -- 172.21.15.154:0/1135551047 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0b0070 con 0x7f0af415e420 2024-05-14T10:20:13.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af159a640 1 -- 172.21.15.154:0/1135551047 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aec0ab600 con 0x7f0af415e420 2024-05-14T10:20:13.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af159a640 1 -- 172.21.15.154:0/1135551047 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0ab9d0 con 0x7f0af415e420 2024-05-14T10:20:13.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af8c36640 1 -- 172.21.15.154:0/1135551047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0af415e420 msgr2=0x7f0af40d3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af8c36640 1 --2- 172.21.15.154:0/1135551047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0af415e420 0x7f0af40d3180 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0097c0 tx=0x7f0aec01c4a0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af8c36640 1 -- 172.21.15.154:0/1135551047 shutdown_connections 2024-05-14T10:20:13.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af8c36640 1 --2- 172.21.15.154:0/1135551047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0af4162760 0x7f0af40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af8c36640 1 --2- 172.21.15.154:0/1135551047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0af415e420 0x7f0af40d3180 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af8c36640 1 -- 172.21.15.154:0/1135551047 >> 172.21.15.154:0/1135551047 conn(0x7f0af406b280 msgr2=0x7f0af406b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:13.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af8c36640 1 -- 172.21.15.154:0/1135551047 shutdown_connections 2024-05-14T10:20:13.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af8c36640 1 -- 172.21.15.154:0/1135551047 wait complete. 2024-05-14T10:20:13.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af8c36640 1 Processor -- start 2024-05-14T10:20:13.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af8c36640 1 -- start start 2024-05-14T10:20:13.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af8c36640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0af40cf060 0x7f0af40b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af8c36640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0af415e420 0x7f0af40ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af8c36640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0af4162760 0x7f0af40cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af8c36640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0af40b7e30 con 0x7f0af40cf060 2024-05-14T10:20:13.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af8c36640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0af40b7cb0 con 0x7f0af415e420 2024-05-14T10:20:13.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af8c36640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0af40b7fb0 con 0x7f0af4162760 2024-05-14T10:20:13.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0af40cf060 0x7f0af40b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0af40cf060 0x7f0af40b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55862/0 (socket says 172.21.15.154:55862) 2024-05-14T10:20:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.105+0000 7f0af259c640 1 -- 172.21.15.154:0/3013483249 learned_addr learned my addr 172.21.15.154:0/3013483249 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0af1d9b640 1 --2- 172.21.15.154:0/3013483249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0af415e420 0x7f0af40ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0af2d9d640 1 --2- 172.21.15.154:0/3013483249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0af4162760 0x7f0af40cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0af259c640 1 -- 172.21.15.154:0/3013483249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0af4162760 msgr2=0x7f0af40cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0af259c640 1 --2- 172.21.15.154:0/3013483249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0af4162760 0x7f0af40cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0af259c640 1 -- 172.21.15.154:0/3013483249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0af415e420 msgr2=0x7f0af40ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0af259c640 1 --2- 172.21.15.154:0/3013483249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0af415e420 0x7f0af40ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0af259c640 1 -- 172.21.15.154:0/3013483249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af40c9750 con 0x7f0af40cf060 2024-05-14T10:20:13.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0af259c640 1 --2- 172.21.15.154:0/3013483249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0af40cf060 0x7f0af40b5750 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0097c0 tx=0x7f0aec01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:13.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0ae2ffd640 1 -- 172.21.15.154:0/3013483249 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0b0040 con 0x7f0af40cf060 2024-05-14T10:20:13.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0ae2ffd640 1 -- 172.21.15.154:0/3013483249 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aec004030 con 0x7f0af40cf060 2024-05-14T10:20:13.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0af8c36640 1 -- 172.21.15.154:0/3013483249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af40c9a30 con 0x7f0af40cf060 2024-05-14T10:20:13.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0ae2ffd640 1 -- 172.21.15.154:0/3013483249 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec006e20 con 0x7f0af40cf060 2024-05-14T10:20:13.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0af8c36640 1 -- 172.21.15.154:0/3013483249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af40caa50 con 0x7f0af40cf060 2024-05-14T10:20:13.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0af8c36640 1 -- 172.21.15.154:0/3013483249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0af4068360 con 0x7f0af40cf060 2024-05-14T10:20:13.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0ae2ffd640 1 -- 172.21.15.154:0/3013483249 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0aec003620 con 0x7f0af40cf060 2024-05-14T10:20:13.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0ae2ffd640 1 --2- 172.21.15.154:0/3013483249 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f0ad40678c0 0x7f0ad4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0ae2ffd640 1 -- 172.21.15.154:0/3013483249 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f0aec120950 con 0x7f0af40cf060 2024-05-14T10:20:13.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0af1d9b640 1 --2- 172.21.15.154:0/3013483249 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f0ad40678c0 0x7f0ad4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0ae2ffd640 1 --2- 172.21.15.154:0/3013483249 >> [v2:172.21.15.154:6808/682645045,v1:172.21.15.154:6809/682645045] conn(0x7f0ad406d780 0x7f0ad406fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0ae2ffd640 1 -- 172.21.15.154:0/3013483249 --> [v2:172.21.15.154:6808/682645045,v1:172.21.15.154:6809/682645045] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0aec0ab600 con 0x7f0ad406d780 2024-05-14T10:20:13.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0ae2ffd640 1 -- 172.21.15.154:0/3013483249 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f0aec120de0 con 0x7f0af40cf060 2024-05-14T10:20:13.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0af2d9d640 1 --2- 172.21.15.154:0/3013483249 >> [v2:172.21.15.154:6808/682645045,v1:172.21.15.154:6809/682645045] conn(0x7f0ad406d780 0x7f0ad406fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0af1d9b640 1 --2- 172.21.15.154:0/3013483249 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f0ad40678c0 0x7f0ad4069d80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8007fd0 tx=0x7f0ae8007ee0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:13.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.109+0000 7f0af2d9d640 1 --2- 172.21.15.154:0/3013483249 >> [v2:172.21.15.154:6808/682645045,v1:172.21.15.154:6809/682645045] conn(0x7f0ad406d780 0x7f0ad406fba0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:13.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.177+0000 7f0ae2ffd640 1 -- 172.21.15.154:0/3013483249 <== osd.3 v2:172.21.15.154:6808/682645045 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0aec0ab600 con 0x7f0ad406d780 2024-05-14T10:20:13.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.189+0000 7f0af8c36640 1 -- 172.21.15.154:0/3013483249 --> [v2:172.21.15.154:6808/682645045,v1:172.21.15.154:6809/682645045] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0af40d1f70 con 0x7f0ad406d780 2024-05-14T10:20:13.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.213+0000 7f0ae2ffd640 1 -- 172.21.15.154:0/3013483249 <== osd.3 v2:172.21.15.154:6808/682645045 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0af40d1f70 con 0x7f0ad406d780 2024-05-14T10:20:13.221 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-14T10:20:13.222 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T10:20:13.222 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-14T10:20:13.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.213+0000 7f0af8c36640 1 -- 172.21.15.154:0/3013483249 >> [v2:172.21.15.154:6808/682645045,v1:172.21.15.154:6809/682645045] conn(0x7f0ad406d780 msgr2=0x7f0ad406fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.213+0000 7f0af8c36640 1 --2- 172.21.15.154:0/3013483249 >> [v2:172.21.15.154:6808/682645045,v1:172.21.15.154:6809/682645045] conn(0x7f0ad406d780 0x7f0ad406fba0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.213+0000 7f0af8c36640 1 -- 172.21.15.154:0/3013483249 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f0ad40678c0 msgr2=0x7f0ad4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.213+0000 7f0af8c36640 1 --2- 172.21.15.154:0/3013483249 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f0ad40678c0 0x7f0ad4069d80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8007fd0 tx=0x7f0ae8007ee0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.213+0000 7f0af8c36640 1 -- 172.21.15.154:0/3013483249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0af40cf060 msgr2=0x7f0af40b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.213+0000 7f0af8c36640 1 --2- 172.21.15.154:0/3013483249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0af40cf060 0x7f0af40b5750 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0097c0 tx=0x7f0aec01ace0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.213+0000 7f0af2d9d640 1 -- 172.21.15.154:0/3013483249 reap_dead start 2024-05-14T10:20:13.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.213+0000 7f0af8c36640 1 -- 172.21.15.154:0/3013483249 shutdown_connections 2024-05-14T10:20:13.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.213+0000 7f0af8c36640 1 -- 172.21.15.154:0/3013483249 >> 172.21.15.154:0/3013483249 conn(0x7f0af406b280 msgr2=0x7f0af40b8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:13.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.213+0000 7f0af8c36640 1 -- 172.21.15.154:0/3013483249 shutdown_connections 2024-05-14T10:20:13.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.213+0000 7f0af8c36640 1 -- 172.21.15.154:0/3013483249 wait complete. 2024-05-14T10:20:13.239 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-14T10:20:13.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.357+0000 7fee3722b640 1 Processor -- start 2024-05-14T10:20:13.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.357+0000 7fee3722b640 1 -- start start 2024-05-14T10:20:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.357+0000 7fee3722b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee30144760 0x7fee3006e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.357+0000 7fee3722b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee300b3530 0x7fee3015b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.357+0000 7fee3722b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee3015bda0 con 0x7fee3015b910 2024-05-14T10:20:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.357+0000 7fee3722b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fee300b4650 con 0x7fee30144760 2024-05-14T10:20:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.357+0000 7fee3722b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fee30144b40 con 0x7fee300b3530 2024-05-14T10:20:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.357+0000 7fee34fc7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee30144760 0x7fee3006e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.357+0000 7fee357c8640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fee3015b910 0x7fee3015e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46794/0 (socket says 172.21.15.154:46794) 2024-05-14T10:20:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.357+0000 7fee34fc7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee30144760 0x7fee3006e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55870/0 (socket says 172.21.15.154:55870) 2024-05-14T10:20:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.357+0000 7fee357c8640 1 -- 172.21.15.154:0/1070999514 learned_addr learned my addr 172.21.15.154:0/1070999514 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:20:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.357+0000 7fee2ffff640 1 --2- 172.21.15.154:0/1070999514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee300b3530 0x7fee3015b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.357+0000 7fee34fc7640 1 -- 172.21.15.154:0/1070999514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee300b3530 msgr2=0x7fee3015b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.357+0000 7fee34fc7640 1 --2- 172.21.15.154:0/1070999514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee300b3530 0x7fee3015b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.357+0000 7fee34fc7640 1 -- 172.21.15.154:0/1070999514 >> v1:172.21.15.154:6789/0 conn(0x7fee3015b910 legacy=0x7fee3015e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.357+0000 7fee34fc7640 1 -- 172.21.15.154:0/1070999514 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee300b3a40 con 0x7fee30144760 2024-05-14T10:20:13.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.361+0000 7fee34fc7640 1 --2- 172.21.15.154:0/1070999514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee30144760 0x7fee3006e680 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7fee280097c0 tx=0x7fee2801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd19c45618f1cd4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:13.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.361+0000 7fee2f7fe640 1 -- 172.21.15.154:0/1070999514 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee280a7070 con 0x7fee30144760 2024-05-14T10:20:13.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.361+0000 7fee2f7fe640 1 -- 172.21.15.154:0/1070999514 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee280b0070 con 0x7fee30144760 2024-05-14T10:20:13.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.361+0000 7fee2f7fe640 1 -- 172.21.15.154:0/1070999514 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee280ab890 con 0x7fee30144760 2024-05-14T10:20:13.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.361+0000 7fee3722b640 1 -- 172.21.15.154:0/1070999514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee30144760 msgr2=0x7fee3006e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.361+0000 7fee3722b640 1 --2- 172.21.15.154:0/1070999514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee30144760 0x7fee3006e680 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7fee280097c0 tx=0x7fee2801c470 comp rx=0 tx=0).stop 2024-05-14T10:20:13.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.361+0000 7fee3722b640 1 -- 172.21.15.154:0/1070999514 shutdown_connections 2024-05-14T10:20:13.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.361+0000 7fee3722b640 1 --2- 172.21.15.154:0/1070999514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee300b3530 0x7fee3015b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.361+0000 7fee3722b640 1 --2- 172.21.15.154:0/1070999514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee30144760 0x7fee3006e680 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.361+0000 7fee3722b640 1 -- 172.21.15.154:0/1070999514 >> 172.21.15.154:0/1070999514 conn(0x7fee300b1850 msgr2=0x7fee300b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.361+0000 7fee3722b640 1 -- 172.21.15.154:0/1070999514 shutdown_connections 2024-05-14T10:20:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.361+0000 7fee3722b640 1 -- 172.21.15.154:0/1070999514 wait complete. 2024-05-14T10:20:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.361+0000 7fee3722b640 1 Processor -- start 2024-05-14T10:20:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.361+0000 7fee3722b640 1 -- start start 2024-05-14T10:20:13.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee3722b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee300b3530 0x7fee301566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee3722b640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee30144760 0x7fee300729a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee3722b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee3015b910 0x7fee30070e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee3722b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee3006ed40 con 0x7fee300b3530 2024-05-14T10:20:13.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee3722b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fee3006ebc0 con 0x7fee3015b910 2024-05-14T10:20:13.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee3722b640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fee30165d10 con 0x7fee30144760 2024-05-14T10:20:13.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee34fc7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee300b3530 0x7fee301566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee34fc7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee300b3530 0x7fee301566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55876/0 (socket says 172.21.15.154:55876) 2024-05-14T10:20:13.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee34fc7640 1 -- 172.21.15.154:0/1760428633 learned_addr learned my addr 172.21.15.154:0/1760428633 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:13.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee2ffff640 1 --2- 172.21.15.154:0/1760428633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee30144760 0x7fee300729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee357c8640 1 --2- 172.21.15.154:0/1760428633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee3015b910 0x7fee30070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee34fc7640 1 -- 172.21.15.154:0/1760428633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee30144760 msgr2=0x7fee300729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee34fc7640 1 --2- 172.21.15.154:0/1760428633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee30144760 0x7fee300729a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee34fc7640 1 -- 172.21.15.154:0/1760428633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee3015b910 msgr2=0x7fee30070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee34fc7640 1 --2- 172.21.15.154:0/1760428633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee3015b910 0x7fee30070e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee34fc7640 1 -- 172.21.15.154:0/1760428633 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee30144f30 con 0x7fee300b3530 2024-05-14T10:20:13.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee2ffff640 1 --2- 172.21.15.154:0/1760428633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee30144760 0x7fee300729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:20:13.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee34fc7640 1 --2- 172.21.15.154:0/1760428633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee300b3530 0x7fee301566f0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7fee2801a0a0 tx=0x7fee2801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:13.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee2d7fa640 1 -- 172.21.15.154:0/1760428633 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee280bf610 con 0x7fee300b3530 2024-05-14T10:20:13.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee2d7fa640 1 -- 172.21.15.154:0/1760428633 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee280bf7d0 con 0x7fee300b3530 2024-05-14T10:20:13.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee3722b640 1 -- 172.21.15.154:0/1760428633 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee30145210 con 0x7fee300b3530 2024-05-14T10:20:13.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee2d7fa640 1 -- 172.21.15.154:0/1760428633 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee280bfbc0 con 0x7fee300b3530 2024-05-14T10:20:13.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee3722b640 1 -- 172.21.15.154:0/1760428633 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee30136f20 con 0x7fee300b3530 2024-05-14T10:20:13.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee3722b640 1 -- 172.21.15.154:0/1760428633 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee30075470 con 0x7fee300b3530 2024-05-14T10:20:13.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee2d7fa640 1 -- 172.21.15.154:0/1760428633 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fee280bd020 con 0x7fee300b3530 2024-05-14T10:20:13.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee2d7fa640 1 --2- 172.21.15.154:0/1760428633 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fee100678c0 0x7fee10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.365+0000 7fee2d7fa640 1 -- 172.21.15.154:0/1760428633 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fee28120580 con 0x7fee300b3530 2024-05-14T10:20:13.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.369+0000 7fee2ffff640 1 --2- 172.21.15.154:0/1760428633 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fee100678c0 0x7fee10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.369+0000 7fee2ffff640 1 --2- 172.21.15.154:0/1760428633 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fee100678c0 0x7fee10069d80 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fee30067510 tx=0x7fee18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:13.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.373+0000 7fee2d7fa640 1 -- 172.21.15.154:0/1760428633 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fee28016090 con 0x7fee300b3530 2024-05-14T10:20:13.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.533+0000 7fee3722b640 1 -- 172.21.15.154:0/1760428633 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fee30156fb0 con 0x7fee100678c0 2024-05-14T10:20:13.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.537+0000 7fee2d7fa640 1 -- 172.21.15.154:0/1760428633 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fee1800f8f0 con 0x7fee100678c0 2024-05-14T10:20:13.542 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 3 to deep-scrub 2024-05-14T10:20:13.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.537+0000 7fee3722b640 1 -- 172.21.15.154:0/1760428633 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fee100678c0 msgr2=0x7fee10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.537+0000 7fee3722b640 1 --2- 172.21.15.154:0/1760428633 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fee100678c0 0x7fee10069d80 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fee30067510 tx=0x7fee18008040 comp rx=0 tx=0).stop 2024-05-14T10:20:13.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.537+0000 7fee3722b640 1 -- 172.21.15.154:0/1760428633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee300b3530 msgr2=0x7fee301566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.537+0000 7fee3722b640 1 --2- 172.21.15.154:0/1760428633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee300b3530 0x7fee301566f0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7fee2801a0a0 tx=0x7fee2801acb0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.537+0000 7fee3722b640 1 -- 172.21.15.154:0/1760428633 shutdown_connections 2024-05-14T10:20:13.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.537+0000 7fee3722b640 1 --2- 172.21.15.154:0/1760428633 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fee100678c0 0x7fee10069d80 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.537+0000 7fee3722b640 1 --2- 172.21.15.154:0/1760428633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee3015b910 0x7fee30070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.537+0000 7fee3722b640 1 --2- 172.21.15.154:0/1760428633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee30144760 0x7fee300729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.537+0000 7fee3722b640 1 --2- 172.21.15.154:0/1760428633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee300b3530 0x7fee301566f0 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.537+0000 7fee3722b640 1 -- 172.21.15.154:0/1760428633 >> 172.21.15.154:0/1760428633 conn(0x7fee300b1850 msgr2=0x7fee30142070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:13.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.537+0000 7fee3722b640 1 -- 172.21.15.154:0/1760428633 shutdown_connections 2024-05-14T10:20:13.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.537+0000 7fee3722b640 1 -- 172.21.15.154:0/1760428633 wait complete. 2024-05-14T10:20:13.561 INFO:tasks.ceph:Scrubbing osd.4 2024-05-14T10:20:13.561 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-14T10:20:13.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.681+0000 7fb8f638e640 1 Processor -- start 2024-05-14T10:20:13.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.681+0000 7fb8f638e640 1 -- start start 2024-05-14T10:20:13.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8f638e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb8f015f150 0x7fb8f006e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8f638e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f0144b00 con 0x7fb8f0144720 2024-05-14T10:20:13.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8f638e640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f006ece0 con 0x7fb8f00b4570 2024-05-14T10:20:13.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8f638e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb8f006ea80 con 0x7fb8f015f150 2024-05-14T10:20:13.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8e77fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb8f015f150 0x7fb8f006e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8effff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb8f0144720 0x7fb8f015ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46808/0 (socket says 172.21.15.154:46808) 2024-05-14T10:20:13.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8effff640 1 -- 172.21.15.154:0/2416011342 learned_addr learned my addr 172.21.15.154:0/2416011342 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:20:13.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8e77fe640 1 -- 172.21.15.154:0/2416011342 >> v1:172.21.15.176:6789/0 conn(0x7fb8f00b4570 legacy=0x7fb8f0071d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8e77fe640 1 -- 172.21.15.154:0/2416011342 >> v1:172.21.15.154:6789/0 conn(0x7fb8f0144720 legacy=0x7fb8f015ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8e77fe640 1 -- 172.21.15.154:0/2416011342 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f0070f50 con 0x7fb8f015f150 2024-05-14T10:20:13.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8e77fe640 1 --2- 172.21.15.154:0/2416011342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f015f150 0x7fb8f006e540 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800ba60 tx=0x7fb8d801eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6776e74d40bcf5a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:13.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8ef7fe640 1 -- 172.21.15.154:0/2416011342 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d80b4070 con 0x7fb8f015f150 2024-05-14T10:20:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8ef7fe640 1 -- 172.21.15.154:0/2416011342 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d80a7b80 con 0x7fb8f015f150 2024-05-14T10:20:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8ef7fe640 1 -- 172.21.15.154:0/2416011342 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d80af440 con 0x7fb8f015f150 2024-05-14T10:20:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8f638e640 1 -- 172.21.15.154:0/2416011342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f015f150 msgr2=0x7fb8f006e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8f638e640 1 --2- 172.21.15.154:0/2416011342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f015f150 0x7fb8f006e540 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800ba60 tx=0x7fb8d801eab0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8f638e640 1 -- 172.21.15.154:0/2416011342 shutdown_connections 2024-05-14T10:20:13.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8f638e640 1 --2- 172.21.15.154:0/2416011342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f015f150 0x7fb8f006e540 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8f638e640 1 -- 172.21.15.154:0/2416011342 >> 172.21.15.154:0/2416011342 conn(0x7fb8f00b1850 msgr2=0x7fb8f00b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:13.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8f638e640 1 -- 172.21.15.154:0/2416011342 shutdown_connections 2024-05-14T10:20:13.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.685+0000 7fb8f638e640 1 -- 172.21.15.154:0/2416011342 wait complete. 2024-05-14T10:20:13.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f638e640 1 Processor -- start 2024-05-14T10:20:13.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f638e640 1 -- start start 2024-05-14T10:20:13.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f638e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8f00b4570 0x7fb8f0150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f638e640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8f0144720 0x7fb8f0137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f638e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f015f150 0x7fb8f01381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f638e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f006d5b0 con 0x7fb8f015f150 2024-05-14T10:20:13.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f638e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f006d430 con 0x7fb8f00b4570 2024-05-14T10:20:13.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f638e640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f006d730 con 0x7fb8f0144720 2024-05-14T10:20:13.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f492b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f015f150 0x7fb8f01381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f492b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f015f150 0x7fb8f01381e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55896/0 (socket says 172.21.15.154:55896) 2024-05-14T10:20:13.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f492b640 1 -- 172.21.15.154:0/2645589583 learned_addr learned my addr 172.21.15.154:0/2645589583 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:13.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8effff640 1 --2- 172.21.15.154:0/2645589583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8f00b4570 0x7fb8f0150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8e77fe640 1 --2- 172.21.15.154:0/2645589583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8f0144720 0x7fb8f0137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f492b640 1 -- 172.21.15.154:0/2645589583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8f0144720 msgr2=0x7fb8f0137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f492b640 1 --2- 172.21.15.154:0/2645589583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8f0144720 0x7fb8f0137ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f492b640 1 -- 172.21.15.154:0/2645589583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8f00b4570 msgr2=0x7fb8f0150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f492b640 1 --2- 172.21.15.154:0/2645589583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8f00b4570 0x7fb8f0150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f492b640 1 -- 172.21.15.154:0/2645589583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f01539c0 con 0x7fb8f015f150 2024-05-14T10:20:13.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f492b640 1 --2- 172.21.15.154:0/2645589583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f015f150 0x7fb8f01381e0 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7fb8e800c7a0 tx=0x7fb8e800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:13.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8ed7fa640 1 -- 172.21.15.154:0/2645589583 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8003b80 con 0x7fb8f015f150 2024-05-14T10:20:13.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8ed7fa640 1 -- 172.21.15.154:0/2645589583 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e8003d20 con 0x7fb8f015f150 2024-05-14T10:20:13.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f638e640 1 -- 172.21.15.154:0/2645589583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f0138970 con 0x7fb8f015f150 2024-05-14T10:20:13.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8ed7fa640 1 -- 172.21.15.154:0/2645589583 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e800aa90 con 0x7fb8f015f150 2024-05-14T10:20:13.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f638e640 1 -- 172.21.15.154:0/2645589583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f0138f30 con 0x7fb8f015f150 2024-05-14T10:20:13.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.689+0000 7fb8f638e640 1 -- 172.21.15.154:0/2645589583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb8f0075470 con 0x7fb8f015f150 2024-05-14T10:20:13.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.693+0000 7fb8ed7fa640 1 -- 172.21.15.154:0/2645589583 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb8e800ac30 con 0x7fb8f015f150 2024-05-14T10:20:13.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.693+0000 7fb8ed7fa640 1 --2- 172.21.15.154:0/2645589583 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb8d00678f0 0x7fb8d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.693+0000 7fb8ed7fa640 1 -- 172.21.15.154:0/2645589583 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fb8e8086400 con 0x7fb8f015f150 2024-05-14T10:20:13.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.693+0000 7fb8effff640 1 --2- 172.21.15.154:0/2645589583 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb8d00678f0 0x7fb8d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.693+0000 7fb8ed7fa640 1 --2- 172.21.15.154:0/2645589583 >> [v2:172.21.15.176:6816/2424559788,v1:172.21.15.176:6817/2424559788] conn(0x7fb8d006d7b0 0x7fb8d006fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:13.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.693+0000 7fb8ed7fa640 1 -- 172.21.15.154:0/2645589583 --> [v2:172.21.15.176:6816/2424559788,v1:172.21.15.176:6817/2424559788] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8e800bf30 con 0x7fb8d006d7b0 2024-05-14T10:20:13.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.693+0000 7fb8ed7fa640 1 -- 172.21.15.154:0/2645589583 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb8e8086890 con 0x7fb8f015f150 2024-05-14T10:20:13.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.693+0000 7fb8effff640 1 --2- 172.21.15.154:0/2645589583 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb8d00678f0 0x7fb8d0069db0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0005890 tx=0x7fb8e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:13.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.693+0000 7fb8e77fe640 1 --2- 172.21.15.154:0/2645589583 >> [v2:172.21.15.176:6816/2424559788,v1:172.21.15.176:6817/2424559788] conn(0x7fb8d006d7b0 0x7fb8d006fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:13.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.693+0000 7fb8e77fe640 1 --2- 172.21.15.154:0/2645589583 >> [v2:172.21.15.176:6816/2424559788,v1:172.21.15.176:6817/2424559788] conn(0x7fb8d006d7b0 0x7fb8d006fbd0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:13.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.813+0000 7fb8ed7fa640 1 -- 172.21.15.154:0/2645589583 <== osd.4 v2:172.21.15.176:6816/2424559788 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb8e800bf30 con 0x7fb8d006d7b0 2024-05-14T10:20:13.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.829+0000 7fb8f638e640 1 -- 172.21.15.154:0/2645589583 --> [v2:172.21.15.176:6816/2424559788,v1:172.21.15.176:6817/2424559788] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb8f006d030 con 0x7fb8d006d7b0 2024-05-14T10:20:13.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.869+0000 7fb8ed7fa640 1 -- 172.21.15.154:0/2645589583 <== osd.4 v2:172.21.15.176:6816/2424559788 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb8f006d030 con 0x7fb8d006d7b0 2024-05-14T10:20:13.877 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-14T10:20:13.877 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T10:20:13.878 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-14T10:20:13.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.869+0000 7fb8f638e640 1 -- 172.21.15.154:0/2645589583 >> [v2:172.21.15.176:6816/2424559788,v1:172.21.15.176:6817/2424559788] conn(0x7fb8d006d7b0 msgr2=0x7fb8d006fbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.869+0000 7fb8f638e640 1 --2- 172.21.15.154:0/2645589583 >> [v2:172.21.15.176:6816/2424559788,v1:172.21.15.176:6817/2424559788] conn(0x7fb8d006d7b0 0x7fb8d006fbd0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:13.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.873+0000 7fb8f638e640 1 -- 172.21.15.154:0/2645589583 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb8d00678f0 msgr2=0x7fb8d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.873+0000 7fb8f638e640 1 --2- 172.21.15.154:0/2645589583 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fb8d00678f0 0x7fb8d0069db0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0005890 tx=0x7fb8e0009040 comp rx=0 tx=0).stop 2024-05-14T10:20:13.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.873+0000 7fb8f638e640 1 -- 172.21.15.154:0/2645589583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f015f150 msgr2=0x7fb8f01381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:13.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.873+0000 7fb8f638e640 1 --2- 172.21.15.154:0/2645589583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f015f150 0x7fb8f01381e0 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7fb8e800c7a0 tx=0x7fb8e800cc60 comp rx=0 tx=0).stop 2024-05-14T10:20:13.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.873+0000 7fb8f492b640 1 -- 172.21.15.154:0/2645589583 reap_dead start 2024-05-14T10:20:13.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.873+0000 7fb8f638e640 1 -- 172.21.15.154:0/2645589583 shutdown_connections 2024-05-14T10:20:13.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.873+0000 7fb8f638e640 1 -- 172.21.15.154:0/2645589583 >> 172.21.15.154:0/2645589583 conn(0x7fb8f00b1850 msgr2=0x7fb8f0156d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:13.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.873+0000 7fb8f638e640 1 -- 172.21.15.154:0/2645589583 shutdown_connections 2024-05-14T10:20:13.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:13.873+0000 7fb8f638e640 1 -- 172.21.15.154:0/2645589583 wait complete. 2024-05-14T10:20:13.900 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-14T10:20:14.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.021+0000 7fe8a499f640 1 Processor -- start 2024-05-14T10:20:14.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.021+0000 7fe8a499f640 1 -- start start 2024-05-14T10:20:14.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.025+0000 7fe8a499f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe8a015e100 0x7fe8a00d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.025+0000 7fe8a499f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8a00cf520 0x7fe8a00b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.025+0000 7fe8a499f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a00d29f0 con 0x7fe8a015e4e0 2024-05-14T10:20:14.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.025+0000 7fe8a499f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe8a00d2cd0 con 0x7fe8a015e100 2024-05-14T10:20:14.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.025+0000 7fe8a499f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a00d2fb0 con 0x7fe8a00cf520 2024-05-14T10:20:14.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.025+0000 7fe89e59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe8a015e100 0x7fe8a00d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.025+0000 7fe89dd9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe8a015e4e0 0x7fe8a00cee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46810/0 (socket says 172.21.15.154:46810) 2024-05-14T10:20:14.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.025+0000 7fe89e59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe8a015e100 0x7fe8a00d22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55908/0 (socket says 172.21.15.154:55908) 2024-05-14T10:20:14.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.025+0000 7fe89dd9b640 1 -- 172.21.15.154:0/2749336038 learned_addr learned my addr 172.21.15.154:0/2749336038 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:20:14.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.025+0000 7fe89ed9d640 1 --2- 172.21.15.154:0/2749336038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8a00cf520 0x7fe8a00b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.025+0000 7fe89e59c640 1 -- 172.21.15.154:0/2749336038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8a00cf520 msgr2=0x7fe8a00b9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:14.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.025+0000 7fe89e59c640 1 --2- 172.21.15.154:0/2749336038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8a00cf520 0x7fe8a00b9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.025+0000 7fe89e59c640 1 -- 172.21.15.154:0/2749336038 >> v1:172.21.15.154:6789/0 conn(0x7fe8a015e4e0 legacy=0x7fe8a00cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.025+0000 7fe89e59c640 1 -- 172.21.15.154:0/2749336038 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a00d3290 con 0x7fe8a015e100 2024-05-14T10:20:14.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.025+0000 7fe89e59c640 1 --2- 172.21.15.154:0/2749336038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8a015e100 0x7fe8a00d22f0 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7fe8900097c0 tx=0x7fe89001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3062525c500756 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:14.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.025+0000 7fe89d59a640 1 -- 172.21.15.154:0/2749336038 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900b0070 con 0x7fe8a015e100 2024-05-14T10:20:14.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.025+0000 7fe89d59a640 1 -- 172.21.15.154:0/2749336038 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8900ab600 con 0x7fe8a015e100 2024-05-14T10:20:14.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.025+0000 7fe89d59a640 1 -- 172.21.15.154:0/2749336038 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900ab9d0 con 0x7fe8a015e100 2024-05-14T10:20:14.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe8a499f640 1 -- 172.21.15.154:0/2749336038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8a015e100 msgr2=0x7fe8a00d22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe8a499f640 1 --2- 172.21.15.154:0/2749336038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8a015e100 0x7fe8a00d22f0 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7fe8900097c0 tx=0x7fe89001c3c0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe8a499f640 1 -- 172.21.15.154:0/2749336038 shutdown_connections 2024-05-14T10:20:14.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe8a499f640 1 --2- 172.21.15.154:0/2749336038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8a00cf520 0x7fe8a00b9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe8a499f640 1 --2- 172.21.15.154:0/2749336038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8a015e100 0x7fe8a00d22f0 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe8a499f640 1 -- 172.21.15.154:0/2749336038 >> 172.21.15.154:0/2749336038 conn(0x7fe8a00b5b50 msgr2=0x7fe8a00b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:14.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe8a499f640 1 -- 172.21.15.154:0/2749336038 shutdown_connections 2024-05-14T10:20:14.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe8a499f640 1 -- 172.21.15.154:0/2749336038 wait complete. 2024-05-14T10:20:14.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe8a499f640 1 Processor -- start 2024-05-14T10:20:14.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe8a499f640 1 -- start start 2024-05-14T10:20:14.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe8a499f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8a00cf520 0x7fe8a01606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe8a499f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8a015e100 0x7fe8a0150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe8a499f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8a015e4e0 0x7fe8a0161420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe8a499f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a00d3c10 con 0x7fe8a015e4e0 2024-05-14T10:20:14.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe8a499f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a00d3a90 con 0x7fe8a015e100 2024-05-14T10:20:14.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe8a499f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a015f600 con 0x7fe8a00cf520 2024-05-14T10:20:14.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe89ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8a015e4e0 0x7fe8a0161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe89ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8a015e4e0 0x7fe8a0161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55922/0 (socket says 172.21.15.154:55922) 2024-05-14T10:20:14.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe89ed9d640 1 -- 172.21.15.154:0/3705957559 learned_addr learned my addr 172.21.15.154:0/3705957559 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:14.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe89dd9b640 1 --2- 172.21.15.154:0/3705957559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8a015e100 0x7fe8a0150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe89e59c640 1 --2- 172.21.15.154:0/3705957559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8a00cf520 0x7fe8a01606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe89ed9d640 1 -- 172.21.15.154:0/3705957559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8a00cf520 msgr2=0x7fe8a01606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe89ed9d640 1 --2- 172.21.15.154:0/3705957559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8a00cf520 0x7fe8a01606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe89ed9d640 1 -- 172.21.15.154:0/3705957559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8a015e100 msgr2=0x7fe8a0150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe89ed9d640 1 --2- 172.21.15.154:0/3705957559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8a015e100 0x7fe8a0150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe89ed9d640 1 -- 172.21.15.154:0/3705957559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a015f8e0 con 0x7fe8a015e4e0 2024-05-14T10:20:14.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe89dd9b640 1 --2- 172.21.15.154:0/3705957559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8a015e100 0x7fe8a0150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:20:14.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe89ed9d640 1 --2- 172.21.15.154:0/3705957559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8a015e4e0 0x7fe8a0161420 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7fe898007e60 tx=0x7fe89800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:14.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe88effd640 1 -- 172.21.15.154:0/3705957559 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe898014620 con 0x7fe8a015e4e0 2024-05-14T10:20:14.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe88effd640 1 -- 172.21.15.154:0/3705957559 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe898019070 con 0x7fe8a015e4e0 2024-05-14T10:20:14.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe8a499f640 1 -- 172.21.15.154:0/3705957559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a015fbc0 con 0x7fe8a015e4e0 2024-05-14T10:20:14.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe88effd640 1 -- 172.21.15.154:0/3705957559 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe898014a00 con 0x7fe8a015e4e0 2024-05-14T10:20:14.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.029+0000 7fe8a499f640 1 -- 172.21.15.154:0/3705957559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a0160be0 con 0x7fe8a015e4e0 2024-05-14T10:20:14.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.033+0000 7fe8a499f640 1 -- 172.21.15.154:0/3705957559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8a0075470 con 0x7fe8a015e4e0 2024-05-14T10:20:14.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.033+0000 7fe88effd640 1 -- 172.21.15.154:0/3705957559 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe898014ba0 con 0x7fe8a015e4e0 2024-05-14T10:20:14.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.033+0000 7fe88effd640 1 --2- 172.21.15.154:0/3705957559 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe8800678c0 0x7fe880069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.033+0000 7fe88effd640 1 -- 172.21.15.154:0/3705957559 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fe898086180 con 0x7fe8a015e4e0 2024-05-14T10:20:14.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.033+0000 7fe89e59c640 1 --2- 172.21.15.154:0/3705957559 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe8800678c0 0x7fe880069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.033+0000 7fe89e59c640 1 --2- 172.21.15.154:0/3705957559 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe8800678c0 0x7fe880069d80 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fe8900ad000 tx=0x7fe890008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:14.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.037+0000 7fe88effd640 1 -- 172.21.15.154:0/3705957559 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fe898057050 con 0x7fe8a015e4e0 2024-05-14T10:20:14.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.197+0000 7fe8a499f640 1 -- 172.21.15.154:0/3705957559 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fe8a015d460 con 0x7fe8800678c0 2024-05-14T10:20:14.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.205+0000 7fe88effd640 1 -- 172.21.15.154:0/3705957559 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe8a015d460 con 0x7fe8800678c0 2024-05-14T10:20:14.210 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 4 to deep-scrub 2024-05-14T10:20:14.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.205+0000 7fe8a499f640 1 -- 172.21.15.154:0/3705957559 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe8800678c0 msgr2=0x7fe880069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.205+0000 7fe8a499f640 1 --2- 172.21.15.154:0/3705957559 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe8800678c0 0x7fe880069d80 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fe8900ad000 tx=0x7fe890008040 comp rx=0 tx=0).stop 2024-05-14T10:20:14.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.205+0000 7fe8a499f640 1 -- 172.21.15.154:0/3705957559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8a015e4e0 msgr2=0x7fe8a0161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.205+0000 7fe8a499f640 1 --2- 172.21.15.154:0/3705957559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8a015e4e0 0x7fe8a0161420 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7fe898007e60 tx=0x7fe89800e4b0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.205+0000 7fe8a499f640 1 -- 172.21.15.154:0/3705957559 shutdown_connections 2024-05-14T10:20:14.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.205+0000 7fe8a499f640 1 --2- 172.21.15.154:0/3705957559 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fe8800678c0 0x7fe880069d80 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.205+0000 7fe8a499f640 1 --2- 172.21.15.154:0/3705957559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8a015e4e0 0x7fe8a0161420 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.205+0000 7fe8a499f640 1 --2- 172.21.15.154:0/3705957559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8a015e100 0x7fe8a0150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.205+0000 7fe8a499f640 1 --2- 172.21.15.154:0/3705957559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8a00cf520 0x7fe8a01606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.205+0000 7fe8a499f640 1 -- 172.21.15.154:0/3705957559 >> 172.21.15.154:0/3705957559 conn(0x7fe8a00b5b50 msgr2=0x7fe8a00b8670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:14.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.205+0000 7fe8a499f640 1 -- 172.21.15.154:0/3705957559 shutdown_connections 2024-05-14T10:20:14.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.205+0000 7fe8a499f640 1 -- 172.21.15.154:0/3705957559 wait complete. 2024-05-14T10:20:14.229 INFO:tasks.ceph:Scrubbing osd.5 2024-05-14T10:20:14.230 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-14T10:20:14.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.345+0000 7fc7bfe96640 1 Processor -- start 2024-05-14T10:20:14.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.345+0000 7fc7bfe96640 1 -- start start 2024-05-14T10:20:14.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.345+0000 7fc7bfe96640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7b81457c0 0x7fc7b80b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.345+0000 7fc7bfe96640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc7b815fa20 0x7fc7b815fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.345+0000 7fc7bfe96640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc7b80b3120 0x7fc7b80b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.345+0000 7fc7bfe96640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc7b8145ba0 con 0x7fc7b815fa20 2024-05-14T10:20:14.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.345+0000 7fc7bfe96640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc7b806cdb0 con 0x7fc7b80b3120 2024-05-14T10:20:14.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.345+0000 7fc7bfe96640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc7b80b5070 con 0x7fc7b81457c0 2024-05-14T10:20:14.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.345+0000 7fc7bd431640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc7b815fa20 0x7fc7b815fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.345+0000 7fc7bd431640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc7b815fa20 0x7fc7b815fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55930/0 (socket says 172.21.15.154:55930) 2024-05-14T10:20:14.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.345+0000 7fc7bd431640 1 -- 172.21.15.154:0/91478306 learned_addr learned my addr 172.21.15.154:0/91478306 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.345+0000 7fc7be433640 1 --2- 172.21.15.154:0/91478306 >> v2:172.21.15.176:3300/0 conn(0x7fc7b80b3120 0x7fc7b80b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.345+0000 7fc7bdc32640 1 --2- 172.21.15.154:0/91478306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7b81457c0 0x7fc7b80b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.345+0000 7fc7bd431640 1 -- 172.21.15.154:0/91478306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7b81457c0 msgr2=0x7fc7b80b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.345+0000 7fc7bd431640 1 --2- 172.21.15.154:0/91478306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7b81457c0 0x7fc7b80b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.345+0000 7fc7bd431640 1 -- 172.21.15.154:0/91478306 >> v2:172.21.15.176:3300/0 conn(0x7fc7b80b3120 msgr2=0x7fc7b80b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.345+0000 7fc7bd431640 1 --2- 172.21.15.154:0/91478306 >> v2:172.21.15.176:3300/0 conn(0x7fc7b80b3120 0x7fc7b80b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.345+0000 7fc7bd431640 1 -- 172.21.15.154:0/91478306 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b80b2df0 con 0x7fc7b815fa20 2024-05-14T10:20:14.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bd431640 1 --2- 172.21.15.154:0/91478306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b815fa20 0x7fc7b815fea0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80af750 tx=0x7fc7a801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c897cc732983507d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:14.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bcc30640 1 -- 172.21.15.154:0/91478306 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a80b0070 con 0x7fc7b815fa20 2024-05-14T10:20:14.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bcc30640 1 -- 172.21.15.154:0/91478306 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a80ab600 con 0x7fc7b815fa20 2024-05-14T10:20:14.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bcc30640 1 -- 172.21.15.154:0/91478306 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a80ab9d0 con 0x7fc7b815fa20 2024-05-14T10:20:14.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bfe96640 1 -- 172.21.15.154:0/91478306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b815fa20 msgr2=0x7fc7b815fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bfe96640 1 --2- 172.21.15.154:0/91478306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b815fa20 0x7fc7b815fea0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80af750 tx=0x7fc7a801c490 comp rx=0 tx=0).stop 2024-05-14T10:20:14.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bfe96640 1 -- 172.21.15.154:0/91478306 shutdown_connections 2024-05-14T10:20:14.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bfe96640 1 --2- 172.21.15.154:0/91478306 >> v2:172.21.15.176:3300/0 conn(0x7fc7b80b3120 0x7fc7b80b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bfe96640 1 --2- 172.21.15.154:0/91478306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b815fa20 0x7fc7b815fea0 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bfe96640 1 --2- 172.21.15.154:0/91478306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7b81457c0 0x7fc7b80b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bfe96640 1 -- 172.21.15.154:0/91478306 >> 172.21.15.154:0/91478306 conn(0x7fc7b80b1850 msgr2=0x7fc7b80b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:14.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bfe96640 1 -- 172.21.15.154:0/91478306 shutdown_connections 2024-05-14T10:20:14.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bfe96640 1 -- 172.21.15.154:0/91478306 wait complete. 2024-05-14T10:20:14.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bfe96640 1 Processor -- start 2024-05-14T10:20:14.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bfe96640 1 -- start start 2024-05-14T10:20:14.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bfe96640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7b80b3120 0x7fc7b815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bfe96640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7b81457c0 0x7fc7b8157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bfe96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b815fa20 0x7fc7b815c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bfe96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b80cedc0 con 0x7fc7b815fa20 2024-05-14T10:20:14.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bfe96640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b80b3ee0 con 0x7fc7b80b3120 2024-05-14T10:20:14.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7bfe96640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc7b80cef40 con 0x7fc7b81457c0 2024-05-14T10:20:14.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7be433640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b815fa20 0x7fc7b815c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7be433640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b815fa20 0x7fc7b815c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55944/0 (socket says 172.21.15.154:55944) 2024-05-14T10:20:14.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.349+0000 7fc7be433640 1 -- 172.21.15.154:0/2316142594 learned_addr learned my addr 172.21.15.154:0/2316142594 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:14.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7bdc32640 1 --2- 172.21.15.154:0/2316142594 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7b80b3120 0x7fc7b815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7bd431640 1 --2- 172.21.15.154:0/2316142594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7b81457c0 0x7fc7b8157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7be433640 1 -- 172.21.15.154:0/2316142594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7b81457c0 msgr2=0x7fc7b8157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7be433640 1 --2- 172.21.15.154:0/2316142594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7b81457c0 0x7fc7b8157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7be433640 1 -- 172.21.15.154:0/2316142594 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7b80b3120 msgr2=0x7fc7b815dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7be433640 1 --2- 172.21.15.154:0/2316142594 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7b80b3120 0x7fc7b815dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7be433640 1 -- 172.21.15.154:0/2316142594 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b815cf50 con 0x7fc7b815fa20 2024-05-14T10:20:14.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7be433640 1 --2- 172.21.15.154:0/2316142594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b815fa20 0x7fc7b815c4b0 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0007e90 tx=0x7fc7b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:14.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7ae7fc640 1 -- 172.21.15.154:0/2316142594 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0014420 con 0x7fc7b815fa20 2024-05-14T10:20:14.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7ae7fc640 1 -- 172.21.15.154:0/2316142594 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b0019070 con 0x7fc7b815fa20 2024-05-14T10:20:14.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7bfe96640 1 -- 172.21.15.154:0/2316142594 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b815d230 con 0x7fc7b815fa20 2024-05-14T10:20:14.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7ae7fc640 1 -- 172.21.15.154:0/2316142594 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0014800 con 0x7fc7b815fa20 2024-05-14T10:20:14.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7bfe96640 1 -- 172.21.15.154:0/2316142594 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b815d7f0 con 0x7fc7b815fa20 2024-05-14T10:20:14.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7bfe96640 1 -- 172.21.15.154:0/2316142594 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc7b815dbd0 con 0x7fc7b815fa20 2024-05-14T10:20:14.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7ae7fc640 1 -- 172.21.15.154:0/2316142594 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc7b00149a0 con 0x7fc7b815fa20 2024-05-14T10:20:14.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7ae7fc640 1 --2- 172.21.15.154:0/2316142594 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc79c0678c0 0x7fc79c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7ae7fc640 1 -- 172.21.15.154:0/2316142594 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fc7b0087030 con 0x7fc7b815fa20 2024-05-14T10:20:14.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7bdc32640 1 --2- 172.21.15.154:0/2316142594 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc79c0678c0 0x7fc79c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7ae7fc640 1 --2- 172.21.15.154:0/2316142594 >> [v2:172.21.15.176:6824/4163648494,v1:172.21.15.176:6825/4163648494] conn(0x7fc79c06d780 0x7fc79c06fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7ae7fc640 1 -- 172.21.15.154:0/2316142594 --> [v2:172.21.15.176:6824/4163648494,v1:172.21.15.176:6825/4163648494] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc7b0016e70 con 0x7fc79c06d780 2024-05-14T10:20:14.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7ae7fc640 1 -- 172.21.15.154:0/2316142594 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc7b00874c0 con 0x7fc7b815fa20 2024-05-14T10:20:14.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7bdc32640 1 --2- 172.21.15.154:0/2316142594 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc79c0678c0 0x7fc79c069d80 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400d8d0 tx=0x7fc7b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:14.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7bd431640 1 --2- 172.21.15.154:0/2316142594 >> [v2:172.21.15.176:6824/4163648494,v1:172.21.15.176:6825/4163648494] conn(0x7fc79c06d780 0x7fc79c06fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.353+0000 7fc7bd431640 1 --2- 172.21.15.154:0/2316142594 >> [v2:172.21.15.176:6824/4163648494,v1:172.21.15.176:6825/4163648494] conn(0x7fc79c06d780 0x7fc79c06fba0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:14.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.357+0000 7fc7ae7fc640 1 -- 172.21.15.154:0/2316142594 <== osd.5 v2:172.21.15.176:6824/4163648494 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc7b0016e70 con 0x7fc79c06d780 2024-05-14T10:20:14.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.369+0000 7fc7bfe96640 1 -- 172.21.15.154:0/2316142594 --> [v2:172.21.15.176:6824/4163648494,v1:172.21.15.176:6825/4163648494] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc7b8075470 con 0x7fc79c06d780 2024-05-14T10:20:14.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.369+0000 7fc7ae7fc640 1 -- 172.21.15.154:0/2316142594 <== osd.5 v2:172.21.15.176:6824/4163648494 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc7b8075470 con 0x7fc79c06d780 2024-05-14T10:20:14.377 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-14T10:20:14.377 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T10:20:14.377 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-14T10:20:14.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.369+0000 7fc7bfe96640 1 -- 172.21.15.154:0/2316142594 >> [v2:172.21.15.176:6824/4163648494,v1:172.21.15.176:6825/4163648494] conn(0x7fc79c06d780 msgr2=0x7fc79c06fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.369+0000 7fc7bfe96640 1 --2- 172.21.15.154:0/2316142594 >> [v2:172.21.15.176:6824/4163648494,v1:172.21.15.176:6825/4163648494] conn(0x7fc79c06d780 0x7fc79c06fba0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.373+0000 7fc7bfe96640 1 -- 172.21.15.154:0/2316142594 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc79c0678c0 msgr2=0x7fc79c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.373+0000 7fc7bfe96640 1 --2- 172.21.15.154:0/2316142594 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fc79c0678c0 0x7fc79c069d80 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400d8d0 tx=0x7fc7b4008040 comp rx=0 tx=0).stop 2024-05-14T10:20:14.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.373+0000 7fc7bfe96640 1 -- 172.21.15.154:0/2316142594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b815fa20 msgr2=0x7fc7b815c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.373+0000 7fc7bfe96640 1 --2- 172.21.15.154:0/2316142594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b815fa20 0x7fc7b815c4b0 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0007e90 tx=0x7fc7b000e4b0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.373+0000 7fc7be433640 1 -- 172.21.15.154:0/2316142594 reap_dead start 2024-05-14T10:20:14.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.373+0000 7fc7bfe96640 1 -- 172.21.15.154:0/2316142594 shutdown_connections 2024-05-14T10:20:14.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.373+0000 7fc7bfe96640 1 -- 172.21.15.154:0/2316142594 >> 172.21.15.154:0/2316142594 conn(0x7fc7b80b1850 msgr2=0x7fc7b815b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:14.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.373+0000 7fc7bfe96640 1 -- 172.21.15.154:0/2316142594 shutdown_connections 2024-05-14T10:20:14.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.373+0000 7fc7bfe96640 1 -- 172.21.15.154:0/2316142594 wait complete. 2024-05-14T10:20:14.395 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-14T10:20:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eb5d42640 1 Processor -- start 2024-05-14T10:20:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eb5d42640 1 -- start start 2024-05-14T10:20:14.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eb5d42640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb00cc750 0x7f9eb006d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eb5d42640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9eb00ccbb0 con 0x7f9eb015c040 2024-05-14T10:20:14.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eb5d42640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9eb00afd60 con 0x7f9eb006dcc0 2024-05-14T10:20:14.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eb5d42640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb00cb460 con 0x7f9eb00cc750 2024-05-14T10:20:14.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eaf7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9eb015c040 0x7f9eb006f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46824/0 (socket says 172.21.15.154:46824) 2024-05-14T10:20:14.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eaf7fe640 1 -- 172.21.15.154:0/818843029 learned_addr learned my addr 172.21.15.154:0/818843029 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:20:14.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eaeffd640 1 --2- 172.21.15.154:0/818843029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb00cc750 0x7f9eb006d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eae7fc640 1 -- 172.21.15.154:0/818843029 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4034471820 0 0) 0x7f9ea0001120 con 0x7f9eb015c040 2024-05-14T10:20:14.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eae7fc640 1 -- 172.21.15.154:0/818843029 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e98003530 con 0x7f9eb015c040 2024-05-14T10:20:14.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eae7fc640 1 -- 172.21.15.154:0/818843029 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1558700885 0 0) 0x7f9e98003530 con 0x7f9eb015c040 2024-05-14T10:20:14.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eae7fc640 1 -- 172.21.15.154:0/818843029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb00cc750 msgr2=0x7f9eb006d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eae7fc640 1 --2- 172.21.15.154:0/818843029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb00cc750 0x7f9eb006d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eae7fc640 1 -- 172.21.15.154:0/818843029 >> v1:172.21.15.176:6789/0 conn(0x7f9eb006dcc0 legacy=0x7f9eb00b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eae7fc640 1 -- 172.21.15.154:0/818843029 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb00cb6b0 con 0x7f9eb015c040 2024-05-14T10:20:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eae7fc640 1 -- 172.21.15.154:0/818843029 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f9ea0001850 con 0x7f9eb015c040 2024-05-14T10:20:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eae7fc640 1 -- 172.21.15.154:0/818843029 >> v1:172.21.15.154:6789/0 conn(0x7f9eb015c040 legacy=0x7f9eb006f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eae7fc640 1 --2- 172.21.15.154:0/818843029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e980039f0 0x7f9e98003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eae7fc640 1 --2- 172.21.15.154:0/818843029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e98004810 0x7f9e98004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eae7fc640 1 --2- 172.21.15.154:0/818843029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb00cc750 0x7f9e98005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eae7fc640 1 -- 172.21.15.154:0/818843029 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb00cb460 con 0x7f9e98004810 2024-05-14T10:20:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eae7fc640 1 -- 172.21.15.154:0/818843029 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9800bb00 con 0x7f9e980039f0 2024-05-14T10:20:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eae7fc640 1 -- 172.21.15.154:0/818843029 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9e9800bd00 con 0x7f9eb00cc750 2024-05-14T10:20:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eaeffd640 1 --2- 172.21.15.154:0/818843029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e98004810 0x7f9e98004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eaffff640 1 --2- 172.21.15.154:0/818843029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb00cc750 0x7f9e98005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eaf7fe640 1 --2- 172.21.15.154:0/818843029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e980039f0 0x7f9e98003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eaeffd640 1 -- 172.21.15.154:0/818843029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb00cc750 msgr2=0x7f9e98005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eaeffd640 1 --2- 172.21.15.154:0/818843029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb00cc750 0x7f9e98005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eaeffd640 1 -- 172.21.15.154:0/818843029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e980039f0 msgr2=0x7f9e98003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eaeffd640 1 --2- 172.21.15.154:0/818843029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e980039f0 0x7f9e98003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eaeffd640 1 -- 172.21.15.154:0/818843029 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e98003530 con 0x7f9e98004810 2024-05-14T10:20:14.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.509+0000 7f9eaffff640 1 --2- 172.21.15.154:0/818843029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb00cc750 0x7f9e98005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:20:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.513+0000 7f9eaeffd640 1 --2- 172.21.15.154:0/818843029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e98004810 0x7f9e98004c90 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4009ac0 tx=0x7f9ea401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86780d7dcd9d7440 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.513+0000 7f9eae7fc640 1 -- 172.21.15.154:0/818843029 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4009690 con 0x7f9e98004810 2024-05-14T10:20:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.513+0000 7f9eae7fc640 1 -- 172.21.15.154:0/818843029 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea40a6430 con 0x7f9e98004810 2024-05-14T10:20:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.513+0000 7f9eae7fc640 1 -- 172.21.15.154:0/818843029 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea40a6800 con 0x7f9e98004810 2024-05-14T10:20:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.513+0000 7f9eb5d42640 1 -- 172.21.15.154:0/818843029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e98004810 msgr2=0x7f9e98004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.513+0000 7f9eb5d42640 1 --2- 172.21.15.154:0/818843029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e98004810 0x7f9e98004c90 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4009ac0 tx=0x7f9ea401ca50 comp rx=0 tx=0).stop 2024-05-14T10:20:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.513+0000 7f9eaffff640 1 -- 172.21.15.154:0/818843029 reap_dead start 2024-05-14T10:20:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.513+0000 7f9eb5d42640 1 -- 172.21.15.154:0/818843029 shutdown_connections 2024-05-14T10:20:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.513+0000 7f9eb5d42640 1 -- 172.21.15.154:0/818843029 >> 172.21.15.154:0/818843029 conn(0x7f9eb00cce80 msgr2=0x7f9eb00cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.513+0000 7f9eb5d42640 1 -- 172.21.15.154:0/818843029 shutdown_connections 2024-05-14T10:20:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.513+0000 7f9eb5d42640 1 -- 172.21.15.154:0/818843029 wait complete. 2024-05-14T10:20:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.513+0000 7f9eb5d42640 1 Processor -- start 2024-05-14T10:20:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.513+0000 7f9eb5d42640 1 -- start start 2024-05-14T10:20:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eb5d42640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e98004810 0x7f9eb0149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eb5d42640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9eb014ce20 0x7f9eb014d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eb5d42640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb0166760 0x7f9eb0166be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eb5d42640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb00cc230 con 0x7f9e98004810 2024-05-14T10:20:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eb5d42640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb006e0d0 con 0x7f9eb014ce20 2024-05-14T10:20:14.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eb5d42640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb006ff60 con 0x7f9eb0166760 2024-05-14T10:20:14.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eaf7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e98004810 0x7f9eb0149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eaf7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e98004810 0x7f9eb0149a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55962/0 (socket says 172.21.15.154:55962) 2024-05-14T10:20:14.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eaf7fe640 1 -- 172.21.15.154:0/426594881 learned_addr learned my addr 172.21.15.154:0/426594881 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:14.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eaeffd640 1 --2- 172.21.15.154:0/426594881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9eb014ce20 0x7f9eb014d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eaffff640 1 --2- 172.21.15.154:0/426594881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb0166760 0x7f9eb0166be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eaf7fe640 1 -- 172.21.15.154:0/426594881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb0166760 msgr2=0x7f9eb0166be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eaf7fe640 1 --2- 172.21.15.154:0/426594881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb0166760 0x7f9eb0166be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eaf7fe640 1 -- 172.21.15.154:0/426594881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9eb014ce20 msgr2=0x7f9eb014d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eaf7fe640 1 --2- 172.21.15.154:0/426594881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9eb014ce20 0x7f9eb014d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eaf7fe640 1 -- 172.21.15.154:0/426594881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb0149f80 con 0x7f9e98004810 2024-05-14T10:20:14.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eaeffd640 1 --2- 172.21.15.154:0/426594881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9eb014ce20 0x7f9eb014d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:20:14.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eaf7fe640 1 --2- 172.21.15.154:0/426594881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e98004810 0x7f9eb0149a40 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0007300 tx=0x7f9ea00077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:14.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9e97fff640 1 -- 172.21.15.154:0/426594881 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000e8f0 con 0x7f9e98004810 2024-05-14T10:20:14.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9e97fff640 1 -- 172.21.15.154:0/426594881 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea0018070 con 0x7f9e98004810 2024-05-14T10:20:14.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9e97fff640 1 -- 172.21.15.154:0/426594881 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000ec90 con 0x7f9e98004810 2024-05-14T10:20:14.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eb5d42640 1 -- 172.21.15.154:0/426594881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb0159400 con 0x7f9e98004810 2024-05-14T10:20:14.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eb5d42640 1 -- 172.21.15.154:0/426594881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb01599c0 con 0x7f9e98004810 2024-05-14T10:20:14.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eb5d42640 1 -- 172.21.15.154:0/426594881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eb0068360 con 0x7f9e98004810 2024-05-14T10:20:14.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9e97fff640 1 -- 172.21.15.154:0/426594881 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9ea001d460 con 0x7f9e98004810 2024-05-14T10:20:14.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9e97fff640 1 --2- 172.21.15.154:0/426594881 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9e9c0678c0 0x7f9e9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9e97fff640 1 -- 172.21.15.154:0/426594881 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f9ea0085920 con 0x7f9e98004810 2024-05-14T10:20:14.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eaeffd640 1 --2- 172.21.15.154:0/426594881 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9e9c0678c0 0x7f9e9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.517+0000 7f9eaeffd640 1 --2- 172.21.15.154:0/426594881 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9e9c0678c0 0x7f9e9c069d80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f9ea40ad000 tx=0x7f9ea40b2040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:14.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.521+0000 7f9e97fff640 1 -- 172.21.15.154:0/426594881 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f9eb00ccbb0 con 0x7f9e98004810 2024-05-14T10:20:14.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.685+0000 7f9eb5d42640 1 -- 172.21.15.154:0/426594881 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f9eb0068a70 con 0x7f9e9c0678c0 2024-05-14T10:20:14.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.753+0000 7f9e97fff640 1 -- 172.21.15.154:0/426594881 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9eb0068a70 con 0x7f9e9c0678c0 2024-05-14T10:20:14.761 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 5 to deep-scrub 2024-05-14T10:20:14.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.757+0000 7f9eb5d42640 1 -- 172.21.15.154:0/426594881 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9e9c0678c0 msgr2=0x7f9e9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.757+0000 7f9eb5d42640 1 --2- 172.21.15.154:0/426594881 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9e9c0678c0 0x7f9e9c069d80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f9ea40ad000 tx=0x7f9ea40b2040 comp rx=0 tx=0).stop 2024-05-14T10:20:14.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.757+0000 7f9eb5d42640 1 -- 172.21.15.154:0/426594881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e98004810 msgr2=0x7f9eb0149a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.757+0000 7f9eb5d42640 1 --2- 172.21.15.154:0/426594881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e98004810 0x7f9eb0149a40 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0007300 tx=0x7f9ea00077c0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.757+0000 7f9eb5d42640 1 -- 172.21.15.154:0/426594881 shutdown_connections 2024-05-14T10:20:14.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.757+0000 7f9eb5d42640 1 --2- 172.21.15.154:0/426594881 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9e9c0678c0 0x7f9e9c069d80 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.757+0000 7f9eb5d42640 1 --2- 172.21.15.154:0/426594881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb0166760 0x7f9eb0166be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.757+0000 7f9eb5d42640 1 --2- 172.21.15.154:0/426594881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9eb014ce20 0x7f9eb014d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.757+0000 7f9eb5d42640 1 --2- 172.21.15.154:0/426594881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e98004810 0x7f9eb0149a40 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.757+0000 7f9eb5d42640 1 -- 172.21.15.154:0/426594881 >> 172.21.15.154:0/426594881 conn(0x7f9eb00cce80 msgr2=0x7f9eb0071620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:14.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.757+0000 7f9eb5d42640 1 -- 172.21.15.154:0/426594881 shutdown_connections 2024-05-14T10:20:14.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.757+0000 7f9eb5d42640 1 -- 172.21.15.154:0/426594881 wait complete. 2024-05-14T10:20:14.785 INFO:tasks.ceph:Scrubbing osd.6 2024-05-14T10:20:14.785 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-14T10:20:14.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.909+0000 7f9c44e90640 1 Processor -- start 2024-05-14T10:20:14.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.909+0000 7f9c44e90640 1 -- start start 2024-05-14T10:20:14.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.909+0000 7f9c44e90640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400d0350 0x7f9c400d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.909+0000 7f9c44e90640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9c400720c0 0x7f9c4006de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.909+0000 7f9c44e90640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c4015d420 con 0x7f9c4006f370 2024-05-14T10:20:14.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.909+0000 7f9c44e90640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9c400725a0 con 0x7f9c400720c0 2024-05-14T10:20:14.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.909+0000 7f9c44e90640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9c400d0c70 con 0x7f9c400d0350 2024-05-14T10:20:14.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.909+0000 7f9c3dd9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9c4006f370 0x7f9c4006d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46840/0 (socket says 172.21.15.154:46840) 2024-05-14T10:20:14.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.909+0000 7f9c3dd9b640 1 -- 172.21.15.154:0/2390108465 learned_addr learned my addr 172.21.15.154:0/2390108465 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:20:14.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.909+0000 7f9c3e59c640 1 --2- 172.21.15.154:0/2390108465 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400d0350 0x7f9c400d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.909+0000 7f9c3ed9d640 1 --2- 172.21.15.154:0/2390108465 >> v2:172.21.15.176:3300/0 conn(0x7f9c400720c0 0x7f9c4006de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.909+0000 7f9c3d59a640 1 -- 172.21.15.154:0/2390108465 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 340543103 0 0) 0x7f9c4015d420 con 0x7f9c4006f370 2024-05-14T10:20:14.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.909+0000 7f9c3d59a640 1 -- 172.21.15.154:0/2390108465 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c28003530 con 0x7f9c4006f370 2024-05-14T10:20:14.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3d59a640 1 -- 172.21.15.154:0/2390108465 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3637568361 0 0) 0x7f9c28003530 con 0x7f9c4006f370 2024-05-14T10:20:14.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3d59a640 1 -- 172.21.15.154:0/2390108465 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400d0350 msgr2=0x7f9c400d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:14.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3d59a640 1 --2- 172.21.15.154:0/2390108465 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400d0350 0x7f9c400d0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3d59a640 1 -- 172.21.15.154:0/2390108465 >> v2:172.21.15.176:3300/0 conn(0x7f9c400720c0 msgr2=0x7f9c4006de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:14.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3d59a640 1 --2- 172.21.15.154:0/2390108465 >> v2:172.21.15.176:3300/0 conn(0x7f9c400720c0 0x7f9c4006de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3d59a640 1 -- 172.21.15.154:0/2390108465 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4015c660 con 0x7f9c4006f370 2024-05-14T10:20:14.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3d59a640 1 -- 172.21.15.154:0/2390108465 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f9c34001680 con 0x7f9c4006f370 2024-05-14T10:20:14.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3d59a640 1 -- 172.21.15.154:0/2390108465 >> v1:172.21.15.154:6789/0 conn(0x7f9c4006f370 legacy=0x7f9c4006d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3d59a640 1 --2- 172.21.15.154:0/2390108465 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c280039c0 0x7f9c28003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3d59a640 1 --2- 172.21.15.154:0/2390108465 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400d0350 0x7f9c28004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3d59a640 1 --2- 172.21.15.154:0/2390108465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c28004d50 0x7f9c280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3d59a640 1 -- 172.21.15.154:0/2390108465 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9c400725a0 con 0x7f9c28004d50 2024-05-14T10:20:14.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3d59a640 1 -- 172.21.15.154:0/2390108465 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9c400d0c70 con 0x7f9c280039c0 2024-05-14T10:20:14.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3d59a640 1 -- 172.21.15.154:0/2390108465 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9c2800b9d0 con 0x7f9c400d0350 2024-05-14T10:20:14.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3ed9d640 1 --2- 172.21.15.154:0/2390108465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c28004d50 0x7f9c280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3dd9b640 1 --2- 172.21.15.154:0/2390108465 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400d0350 0x7f9c28004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3e59c640 1 --2- 172.21.15.154:0/2390108465 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c280039c0 0x7f9c28003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3ed9d640 1 -- 172.21.15.154:0/2390108465 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400d0350 msgr2=0x7f9c28004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:14.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3ed9d640 1 --2- 172.21.15.154:0/2390108465 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400d0350 0x7f9c28004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3ed9d640 1 -- 172.21.15.154:0/2390108465 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c280039c0 msgr2=0x7f9c28003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:14.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3ed9d640 1 --2- 172.21.15.154:0/2390108465 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c280039c0 0x7f9c28003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3ed9d640 1 -- 172.21.15.154:0/2390108465 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c28003530 con 0x7f9c28004d50 2024-05-14T10:20:14.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3ed9d640 1 --2- 172.21.15.154:0/2390108465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c28004d50 0x7f9c280051d0 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7f9c400724d0 tx=0x7f9c3801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff61cac0dd1a656 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:14.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3d59a640 1 -- 172.21.15.154:0/2390108465 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c380b2070 con 0x7f9c28004d50 2024-05-14T10:20:14.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3d59a640 1 -- 172.21.15.154:0/2390108465 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c380a5c70 con 0x7f9c28004d50 2024-05-14T10:20:14.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3d59a640 1 -- 172.21.15.154:0/2390108465 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c38009c10 con 0x7f9c28004d50 2024-05-14T10:20:14.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c44e90640 1 -- 172.21.15.154:0/2390108465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c28004d50 msgr2=0x7f9c280051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c44e90640 1 --2- 172.21.15.154:0/2390108465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c28004d50 0x7f9c280051d0 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7f9c400724d0 tx=0x7f9c3801cc60 comp rx=0 tx=0).stop 2024-05-14T10:20:14.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.913+0000 7f9c3ed9d640 1 -- 172.21.15.154:0/2390108465 reap_dead start 2024-05-14T10:20:14.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c44e90640 1 -- 172.21.15.154:0/2390108465 shutdown_connections 2024-05-14T10:20:14.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c44e90640 1 -- 172.21.15.154:0/2390108465 >> 172.21.15.154:0/2390108465 conn(0x7f9c400b21b0 msgr2=0x7f9c400b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:14.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c44e90640 1 -- 172.21.15.154:0/2390108465 shutdown_connections 2024-05-14T10:20:14.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c44e90640 1 -- 172.21.15.154:0/2390108465 wait complete. 2024-05-14T10:20:14.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c44e90640 1 Processor -- start 2024-05-14T10:20:14.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c44e90640 1 -- start start 2024-05-14T10:20:14.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c44e90640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c28004d50 0x7f9c4014e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c44e90640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c40151d50 0x7f9c401f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c44e90640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c40154750 0x7f9c40154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c44e90640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4015cf00 con 0x7f9c28004d50 2024-05-14T10:20:14.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c44e90640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4015cc20 con 0x7f9c40151d50 2024-05-14T10:20:14.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c44e90640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9c40159e90 con 0x7f9c40154750 2024-05-14T10:20:14.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c3e59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c28004d50 0x7f9c4014e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c3e59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c28004d50 0x7f9c4014e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55984/0 (socket says 172.21.15.154:55984) 2024-05-14T10:20:14.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c3e59c640 1 -- 172.21.15.154:0/2574675670 learned_addr learned my addr 172.21.15.154:0/2574675670 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:14.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c3dd9b640 1 --2- 172.21.15.154:0/2574675670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c40151d50 0x7f9c401f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c3ed9d640 1 --2- 172.21.15.154:0/2574675670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c40154750 0x7f9c40154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c3e59c640 1 -- 172.21.15.154:0/2574675670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c40154750 msgr2=0x7f9c40154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c3e59c640 1 --2- 172.21.15.154:0/2574675670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c40154750 0x7f9c40154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c3e59c640 1 -- 172.21.15.154:0/2574675670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c40151d50 msgr2=0x7f9c401f2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:14.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c3e59c640 1 --2- 172.21.15.154:0/2574675670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c40151d50 0x7f9c401f2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:14.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c3e59c640 1 -- 172.21.15.154:0/2574675670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c401f2e90 con 0x7f9c28004d50 2024-05-14T10:20:14.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c3ed9d640 1 --2- 172.21.15.154:0/2574675670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c40154750 0x7f9c40154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:20:14.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c3e59c640 1 --2- 172.21.15.154:0/2574675670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c28004d50 0x7f9c4014e4c0 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f9c30011560 tx=0x7f9c30011960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:14.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c2effd640 1 -- 172.21.15.154:0/2574675670 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c30015930 con 0x7f9c28004d50 2024-05-14T10:20:14.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c2effd640 1 -- 172.21.15.154:0/2574675670 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c30015ad0 con 0x7f9c28004d50 2024-05-14T10:20:14.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c44e90640 1 -- 172.21.15.154:0/2574675670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c40152920 con 0x7f9c28004d50 2024-05-14T10:20:14.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c2effd640 1 -- 172.21.15.154:0/2574675670 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3001d400 con 0x7f9c28004d50 2024-05-14T10:20:14.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c44e90640 1 -- 172.21.15.154:0/2574675670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c40152ee0 con 0x7f9c28004d50 2024-05-14T10:20:14.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.917+0000 7f9c44e90640 1 -- 172.21.15.154:0/2574675670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9c40068360 con 0x7f9c28004d50 2024-05-14T10:20:14.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.921+0000 7f9c2effd640 1 -- 172.21.15.154:0/2574675670 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9c3001d5a0 con 0x7f9c28004d50 2024-05-14T10:20:14.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.921+0000 7f9c2effd640 1 --2- 172.21.15.154:0/2574675670 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9c200678c0 0x7f9c20069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.921+0000 7f9c2effd640 1 -- 172.21.15.154:0/2574675670 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f9c300867e0 con 0x7f9c28004d50 2024-05-14T10:20:14.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.921+0000 7f9c3dd9b640 1 --2- 172.21.15.154:0/2574675670 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9c200678c0 0x7f9c20069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.921+0000 7f9c2effd640 1 --2- 172.21.15.154:0/2574675670 >> [v2:172.21.15.176:6801/3092848670,v1:172.21.15.176:6803/3092848670] conn(0x7f9c2006d780 0x7f9c2006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:14.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.921+0000 7f9c2effd640 1 -- 172.21.15.154:0/2574675670 --> [v2:172.21.15.176:6801/3092848670,v1:172.21.15.176:6803/3092848670] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c20070250 con 0x7f9c2006d780 2024-05-14T10:20:14.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.921+0000 7f9c2effd640 1 -- 172.21.15.154:0/2574675670 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f9c30086b90 con 0x7f9c28004d50 2024-05-14T10:20:14.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.921+0000 7f9c3ed9d640 1 --2- 172.21.15.154:0/2574675670 >> [v2:172.21.15.176:6801/3092848670,v1:172.21.15.176:6803/3092848670] conn(0x7f9c2006d780 0x7f9c2006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:14.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.921+0000 7f9c3dd9b640 1 --2- 172.21.15.154:0/2574675670 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9c200678c0 0x7f9c20069d80 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f9c34000c10 tx=0x7f9c34007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:14.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:14.921+0000 7f9c3ed9d640 1 --2- 172.21.15.154:0/2574675670 >> [v2:172.21.15.176:6801/3092848670,v1:172.21.15.176:6803/3092848670] conn(0x7f9c2006d780 0x7f9c2006fba0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:15.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.269+0000 7f9c2effd640 1 -- 172.21.15.154:0/2574675670 <== osd.6 v2:172.21.15.176:6801/3092848670 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9c20070250 con 0x7f9c2006d780 2024-05-14T10:20:15.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.285+0000 7f9c44e90640 1 -- 172.21.15.154:0/2574675670 --> [v2:172.21.15.176:6801/3092848670,v1:172.21.15.176:6803/3092848670] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9c40153300 con 0x7f9c2006d780 2024-05-14T10:20:15.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.485+0000 7f9c2effd640 1 -- 172.21.15.154:0/2574675670 <== osd.6 v2:172.21.15.176:6801/3092848670 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9c40153300 con 0x7f9c2006d780 2024-05-14T10:20:15.491 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-14T10:20:15.491 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T10:20:15.491 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-14T10:20:15.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.485+0000 7f9c44e90640 1 -- 172.21.15.154:0/2574675670 >> [v2:172.21.15.176:6801/3092848670,v1:172.21.15.176:6803/3092848670] conn(0x7f9c2006d780 msgr2=0x7f9c2006fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:15.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.485+0000 7f9c44e90640 1 --2- 172.21.15.154:0/2574675670 >> [v2:172.21.15.176:6801/3092848670,v1:172.21.15.176:6803/3092848670] conn(0x7f9c2006d780 0x7f9c2006fba0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:15.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.485+0000 7f9c44e90640 1 -- 172.21.15.154:0/2574675670 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9c200678c0 msgr2=0x7f9c20069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:15.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.485+0000 7f9c44e90640 1 --2- 172.21.15.154:0/2574675670 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f9c200678c0 0x7f9c20069d80 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f9c34000c10 tx=0x7f9c34007040 comp rx=0 tx=0).stop 2024-05-14T10:20:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.485+0000 7f9c44e90640 1 -- 172.21.15.154:0/2574675670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c28004d50 msgr2=0x7f9c4014e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.485+0000 7f9c44e90640 1 --2- 172.21.15.154:0/2574675670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c28004d50 0x7f9c4014e4c0 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f9c30011560 tx=0x7f9c30011960 comp rx=0 tx=0).stop 2024-05-14T10:20:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.485+0000 7f9c3ed9d640 1 -- 172.21.15.154:0/2574675670 reap_dead start 2024-05-14T10:20:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.485+0000 7f9c44e90640 1 -- 172.21.15.154:0/2574675670 shutdown_connections 2024-05-14T10:20:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.485+0000 7f9c44e90640 1 -- 172.21.15.154:0/2574675670 >> 172.21.15.154:0/2574675670 conn(0x7f9c400b21b0 msgr2=0x7f9c4015ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.485+0000 7f9c44e90640 1 -- 172.21.15.154:0/2574675670 shutdown_connections 2024-05-14T10:20:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.485+0000 7f9c44e90640 1 -- 172.21.15.154:0/2574675670 wait complete. 2024-05-14T10:20:15.520 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-14T10:20:15.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.645+0000 7f60f7d9d640 1 Processor -- start 2024-05-14T10:20:15.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.645+0000 7f60f7d9d640 1 -- start start 2024-05-14T10:20:15.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f7d9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f006de40 0x7f60f015d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:15.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f7d9d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60f006fd40 con 0x7f60f006f8a0 2024-05-14T10:20:15.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f7d9d640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60f0070020 con 0x7f60f015bd80 2024-05-14T10:20:15.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f7d9d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f60f015c5d0 con 0x7f60f006de40 2024-05-14T10:20:15.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f5338640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f60f006f8a0 0x7f60f006d730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46846/0 (socket says 172.21.15.154:46846) 2024-05-14T10:20:15.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f5338640 1 -- 172.21.15.154:0/3468504364 learned_addr learned my addr 172.21.15.154:0/3468504364 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:20:15.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f633a640 1 --2- 172.21.15.154:0/3468504364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f006de40 0x7f60f015d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:15.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f4b37640 1 -- 172.21.15.154:0/3468504364 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3816038997 0 0) 0x7f60f006fd40 con 0x7f60f006f8a0 2024-05-14T10:20:15.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f4b37640 1 -- 172.21.15.154:0/3468504364 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60dc003530 con 0x7f60f006f8a0 2024-05-14T10:20:15.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f4b37640 1 -- 172.21.15.154:0/3468504364 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3292655159 0 0) 0x7f60dc003530 con 0x7f60f006f8a0 2024-05-14T10:20:15.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f4b37640 1 -- 172.21.15.154:0/3468504364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f006de40 msgr2=0x7f60f015d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:15.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f4b37640 1 --2- 172.21.15.154:0/3468504364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f006de40 0x7f60f015d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:15.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f4b37640 1 -- 172.21.15.154:0/3468504364 >> v1:172.21.15.176:6789/0 conn(0x7f60f015bd80 legacy=0x7f60f01604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:15.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f4b37640 1 -- 172.21.15.154:0/3468504364 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f015c8b0 con 0x7f60f006f8a0 2024-05-14T10:20:15.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f4b37640 1 -- 172.21.15.154:0/3468504364 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f60e0001680 con 0x7f60f006f8a0 2024-05-14T10:20:15.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f4b37640 1 -- 172.21.15.154:0/3468504364 >> v1:172.21.15.154:6789/0 conn(0x7f60f006f8a0 legacy=0x7f60f006d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:15.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f4b37640 1 --2- 172.21.15.154:0/3468504364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60dc0039f0 0x7f60dc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:15.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f4b37640 1 --2- 172.21.15.154:0/3468504364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f006de40 0x7f60dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:15.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f4b37640 1 --2- 172.21.15.154:0/3468504364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60dc004d50 0x7f60dc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:15.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f4b37640 1 -- 172.21.15.154:0/3468504364 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60f015c5d0 con 0x7f60dc004d50 2024-05-14T10:20:15.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f4b37640 1 -- 172.21.15.154:0/3468504364 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f60dc00bb60 con 0x7f60dc0039f0 2024-05-14T10:20:15.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f4b37640 1 -- 172.21.15.154:0/3468504364 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f60dc00bd60 con 0x7f60f006de40 2024-05-14T10:20:15.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f633a640 1 --2- 172.21.15.154:0/3468504364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60dc004d50 0x7f60dc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:15.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f5b39640 1 --2- 172.21.15.154:0/3468504364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60dc0039f0 0x7f60dc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:15.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f5338640 1 --2- 172.21.15.154:0/3468504364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f006de40 0x7f60dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:15.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f633a640 1 -- 172.21.15.154:0/3468504364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f006de40 msgr2=0x7f60dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:15.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f633a640 1 --2- 172.21.15.154:0/3468504364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f006de40 0x7f60dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:15.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f633a640 1 -- 172.21.15.154:0/3468504364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60dc0039f0 msgr2=0x7f60dc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:15.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f633a640 1 --2- 172.21.15.154:0/3468504364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60dc0039f0 0x7f60dc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:15.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f633a640 1 -- 172.21.15.154:0/3468504364 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60dc003530 con 0x7f60dc004d50 2024-05-14T10:20:15.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f5338640 1 --2- 172.21.15.154:0/3468504364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f006de40 0x7f60dc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T10:20:15.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.649+0000 7f60f633a640 1 --2- 172.21.15.154:0/3468504364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60dc004d50 0x7f60dc0051d0 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f60e8009fc0 tx=0x7f60e801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76491976992ac154 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:15.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f4b37640 1 -- 172.21.15.154:0/3468504364 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e80b2070 con 0x7f60dc004d50 2024-05-14T10:20:15.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f4b37640 1 -- 172.21.15.154:0/3468504364 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60e80a5c90 con 0x7f60dc004d50 2024-05-14T10:20:15.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f4b37640 1 -- 172.21.15.154:0/3468504364 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e8009c10 con 0x7f60dc004d50 2024-05-14T10:20:15.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f7d9d640 1 -- 172.21.15.154:0/3468504364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60dc004d50 msgr2=0x7f60dc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:15.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f7d9d640 1 --2- 172.21.15.154:0/3468504364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60dc004d50 0x7f60dc0051d0 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f60e8009fc0 tx=0x7f60e801cc80 comp rx=0 tx=0).stop 2024-05-14T10:20:15.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f633a640 1 -- 172.21.15.154:0/3468504364 reap_dead start 2024-05-14T10:20:15.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f7d9d640 1 -- 172.21.15.154:0/3468504364 shutdown_connections 2024-05-14T10:20:15.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f7d9d640 1 -- 172.21.15.154:0/3468504364 >> 172.21.15.154:0/3468504364 conn(0x7f60f00ccef0 msgr2=0x7f60f00cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:15.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f7d9d640 1 -- 172.21.15.154:0/3468504364 shutdown_connections 2024-05-14T10:20:15.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f7d9d640 1 -- 172.21.15.154:0/3468504364 wait complete. 2024-05-14T10:20:15.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f7d9d640 1 Processor -- start 2024-05-14T10:20:15.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f7d9d640 1 -- start start 2024-05-14T10:20:15.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f7d9d640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f014fb30 0x7f60f015af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:15.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f7d9d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60f015a190 0x7f60f00c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:15.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f7d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60f00c8e70 0x7f60f0157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:15.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f7d9d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60f015c160 con 0x7f60f00c8e70 2024-05-14T10:20:15.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f7d9d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f60f00afd50 con 0x7f60f015a190 2024-05-14T10:20:15.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f7d9d640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f60f015c2e0 con 0x7f60f014fb30 2024-05-14T10:20:15.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f633a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60f00c8e70 0x7f60f0157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:15.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f633a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60f00c8e70 0x7f60f0157f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55996/0 (socket says 172.21.15.154:55996) 2024-05-14T10:20:15.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f633a640 1 -- 172.21.15.154:0/4115919343 learned_addr learned my addr 172.21.15.154:0/4115919343 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:15.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f5338640 1 --2- 172.21.15.154:0/4115919343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60f015a190 0x7f60f00c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:15.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f5b39640 1 --2- 172.21.15.154:0/4115919343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f014fb30 0x7f60f015af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:15.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f633a640 1 -- 172.21.15.154:0/4115919343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f014fb30 msgr2=0x7f60f015af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:15.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f633a640 1 --2- 172.21.15.154:0/4115919343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f014fb30 0x7f60f015af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:15.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f633a640 1 -- 172.21.15.154:0/4115919343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60f015a190 msgr2=0x7f60f00c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:15.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f633a640 1 --2- 172.21.15.154:0/4115919343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60f015a190 0x7f60f00c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:15.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f633a640 1 -- 172.21.15.154:0/4115919343 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f014ff10 con 0x7f60f00c8e70 2024-05-14T10:20:15.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f633a640 1 --2- 172.21.15.154:0/4115919343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60f00c8e70 0x7f60f0157f40 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f60e80b0040 tx=0x7f60dc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:15.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60e67fc640 1 -- 172.21.15.154:0/4115919343 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e80be070 con 0x7f60f00c8e70 2024-05-14T10:20:15.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60e67fc640 1 -- 172.21.15.154:0/4115919343 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60e80b3040 con 0x7f60f00c8e70 2024-05-14T10:20:15.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60e67fc640 1 -- 172.21.15.154:0/4115919343 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e80b2050 con 0x7f60f00c8e70 2024-05-14T10:20:15.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f7d9d640 1 -- 172.21.15.154:0/4115919343 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f015a670 con 0x7f60f00c8e70 2024-05-14T10:20:15.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.653+0000 7f60f7d9d640 1 -- 172.21.15.154:0/4115919343 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f0159480 con 0x7f60f00c8e70 2024-05-14T10:20:15.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.657+0000 7f60f7d9d640 1 -- 172.21.15.154:0/4115919343 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f0068360 con 0x7f60f00c8e70 2024-05-14T10:20:15.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.657+0000 7f60e67fc640 1 -- 172.21.15.154:0/4115919343 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f60e80c1070 con 0x7f60f00c8e70 2024-05-14T10:20:15.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.657+0000 7f60e67fc640 1 --2- 172.21.15.154:0/4115919343 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f60d40678f0 0x7f60d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:15.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.657+0000 7f60f5b39640 1 --2- 172.21.15.154:0/4115919343 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f60d40678f0 0x7f60d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:15.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.657+0000 7f60e67fc640 1 -- 172.21.15.154:0/4115919343 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f60e811fc50 con 0x7f60f00c8e70 2024-05-14T10:20:15.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.657+0000 7f60f5b39640 1 --2- 172.21.15.154:0/4115919343 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f60d40678f0 0x7f60d4069db0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f60ec005490 tx=0x7f60ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:15.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.685+0000 7f60e67fc640 1 -- 172.21.15.154:0/4115919343 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f60e8125020 con 0x7f60f00c8e70 2024-05-14T10:20:15.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.845+0000 7f60f7d9d640 1 -- 172.21.15.154:0/4115919343 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f60f006d980 con 0x7f60d40678f0 2024-05-14T10:20:15.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.845+0000 7f60e67fc640 1 -- 172.21.15.154:0/4115919343 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f60f006d980 con 0x7f60d40678f0 2024-05-14T10:20:15.853 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 6 to deep-scrub 2024-05-14T10:20:15.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.849+0000 7f60f7d9d640 1 -- 172.21.15.154:0/4115919343 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f60d40678f0 msgr2=0x7f60d4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:15.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.849+0000 7f60f7d9d640 1 --2- 172.21.15.154:0/4115919343 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f60d40678f0 0x7f60d4069db0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f60ec005490 tx=0x7f60ec009040 comp rx=0 tx=0).stop 2024-05-14T10:20:15.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.849+0000 7f60f7d9d640 1 -- 172.21.15.154:0/4115919343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60f00c8e70 msgr2=0x7f60f0157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:15.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.849+0000 7f60f7d9d640 1 --2- 172.21.15.154:0/4115919343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60f00c8e70 0x7f60f0157f40 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f60e80b0040 tx=0x7f60dc005840 comp rx=0 tx=0).stop 2024-05-14T10:20:15.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.849+0000 7f60f7d9d640 1 -- 172.21.15.154:0/4115919343 shutdown_connections 2024-05-14T10:20:15.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.849+0000 7f60f7d9d640 1 --2- 172.21.15.154:0/4115919343 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f60d40678f0 0x7f60d4069db0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:15.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.849+0000 7f60f7d9d640 1 --2- 172.21.15.154:0/4115919343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60f00c8e70 0x7f60f0157f40 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:15.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.849+0000 7f60f7d9d640 1 --2- 172.21.15.154:0/4115919343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60f015a190 0x7f60f00c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:15.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.849+0000 7f60f7d9d640 1 --2- 172.21.15.154:0/4115919343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f014fb30 0x7f60f015af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:15.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.849+0000 7f60f7d9d640 1 -- 172.21.15.154:0/4115919343 >> 172.21.15.154:0/4115919343 conn(0x7f60f00ccef0 msgr2=0x7f60f00b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:15.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.849+0000 7f60f7d9d640 1 -- 172.21.15.154:0/4115919343 shutdown_connections 2024-05-14T10:20:15.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.849+0000 7f60f7d9d640 1 -- 172.21.15.154:0/4115919343 wait complete. 2024-05-14T10:20:15.873 INFO:tasks.ceph:Scrubbing osd.7 2024-05-14T10:20:15.873 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-14T10:20:16.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.997+0000 7fee2c3f1640 1 Processor -- start 2024-05-14T10:20:16.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.997+0000 7fee2c3f1640 1 -- start start 2024-05-14T10:20:16.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.997+0000 7fee2c3f1640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fee24144720 0x7fee2406e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:16.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.997+0000 7fee2c3f1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee2415f150 0x7fee24071d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:16.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.997+0000 7fee2c3f1640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee24144b00 con 0x7fee240b4570 2024-05-14T10:20:16.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.997+0000 7fee2c3f1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fee2406ea80 con 0x7fee2415f150 2024-05-14T10:20:16.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.997+0000 7fee2c3f1640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fee2406ece0 con 0x7fee24144720 2024-05-14T10:20:16.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.997+0000 7fee2a98e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee2415f150 0x7fee24071d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:16.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.997+0000 7fee2a98e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee2415f150 0x7fee24071d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56012/0 (socket says 172.21.15.154:56012) 2024-05-14T10:20:16.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.997+0000 7fee2a98e640 1 -- 172.21.15.154:0/2691526202 learned_addr learned my addr 172.21.15.154:0/2691526202 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:16.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.997+0000 7fee2a18d640 1 --2- 172.21.15.154:0/2691526202 >> v2:172.21.15.176:3300/0 conn(0x7fee24144720 0x7fee2406e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:16.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.997+0000 7fee2a98e640 1 -- 172.21.15.154:0/2691526202 >> v2:172.21.15.176:3300/0 conn(0x7fee24144720 msgr2=0x7fee2406e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:16.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.997+0000 7fee2a98e640 1 --2- 172.21.15.154:0/2691526202 >> v2:172.21.15.176:3300/0 conn(0x7fee24144720 0x7fee2406e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.997+0000 7fee2a98e640 1 -- 172.21.15.154:0/2691526202 >> v1:172.21.15.176:6789/0 conn(0x7fee240b4570 legacy=0x7fee2415ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:16.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:15.997+0000 7fee2a98e640 1 -- 172.21.15.154:0/2691526202 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee24070f50 con 0x7fee2415f150 2024-05-14T10:20:16.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.001+0000 7fee2a98e640 1 --2- 172.21.15.154:0/2691526202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee2415f150 0x7fee24071d10 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7fee240d0ce0 tx=0x7fee1c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b49f4449b8296 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:16.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.001+0000 7fee2918b640 1 -- 172.21.15.154:0/2691526202 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0a57b0 con 0x7fee2415f150 2024-05-14T10:20:16.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.001+0000 7fee2918b640 1 -- 172.21.15.154:0/2691526202 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1c0a5950 con 0x7fee2415f150 2024-05-14T10:20:16.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.001+0000 7fee2918b640 1 -- 172.21.15.154:0/2691526202 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0a5d20 con 0x7fee2415f150 2024-05-14T10:20:16.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.001+0000 7fee2c3f1640 1 -- 172.21.15.154:0/2691526202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee2415f150 msgr2=0x7fee24071d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:16.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.001+0000 7fee2c3f1640 1 --2- 172.21.15.154:0/2691526202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee2415f150 0x7fee24071d10 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7fee240d0ce0 tx=0x7fee1c01c8f0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.001+0000 7fee2c3f1640 1 -- 172.21.15.154:0/2691526202 shutdown_connections 2024-05-14T10:20:16.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.001+0000 7fee2c3f1640 1 --2- 172.21.15.154:0/2691526202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee2415f150 0x7fee24071d10 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.001+0000 7fee2c3f1640 1 --2- 172.21.15.154:0/2691526202 >> v2:172.21.15.176:3300/0 conn(0x7fee24144720 0x7fee2406e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.001+0000 7fee2c3f1640 1 -- 172.21.15.154:0/2691526202 >> 172.21.15.154:0/2691526202 conn(0x7fee240b1850 msgr2=0x7fee240b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:16.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.001+0000 7fee2c3f1640 1 -- 172.21.15.154:0/2691526202 shutdown_connections 2024-05-14T10:20:16.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.001+0000 7fee2c3f1640 1 -- 172.21.15.154:0/2691526202 wait complete. 2024-05-14T10:20:16.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.001+0000 7fee2c3f1640 1 Processor -- start 2024-05-14T10:20:16.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.001+0000 7fee2c3f1640 1 -- start start 2024-05-14T10:20:16.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2c3f1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee240b4570 0x7fee24137120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:16.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2c3f1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee24144720 0x7fee2406d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:16.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2c3f1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee2415f150 0x7fee2406d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:16.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2c3f1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee24167f40 con 0x7fee24144720 2024-05-14T10:20:16.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2c3f1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fee24167dc0 con 0x7fee240b4570 2024-05-14T10:20:16.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2c3f1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fee241680c0 con 0x7fee2415f150 2024-05-14T10:20:16.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2998c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee24144720 0x7fee2406d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:16.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2998c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee24144720 0x7fee2406d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56028/0 (socket says 172.21.15.154:56028) 2024-05-14T10:20:16.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2998c640 1 -- 172.21.15.154:0/1175475523 learned_addr learned my addr 172.21.15.154:0/1175475523 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:16.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2a18d640 1 --2- 172.21.15.154:0/1175475523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee240b4570 0x7fee24137120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:16.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2a98e640 1 --2- 172.21.15.154:0/1175475523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee2415f150 0x7fee2406d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:16.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2998c640 1 -- 172.21.15.154:0/1175475523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee2415f150 msgr2=0x7fee2406d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:16.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2998c640 1 --2- 172.21.15.154:0/1175475523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee2415f150 0x7fee2406d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2998c640 1 -- 172.21.15.154:0/1175475523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee240b4570 msgr2=0x7fee24137120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:16.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2998c640 1 --2- 172.21.15.154:0/1175475523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee240b4570 0x7fee24137120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2998c640 1 -- 172.21.15.154:0/1175475523 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2413f700 con 0x7fee24144720 2024-05-14T10:20:16.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2998c640 1 --2- 172.21.15.154:0/1175475523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee24144720 0x7fee2406d430 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7fee1400b410 tx=0x7fee1400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:16.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee1affd640 1 -- 172.21.15.154:0/1175475523 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14015030 con 0x7fee24144720 2024-05-14T10:20:16.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee1affd640 1 -- 172.21.15.154:0/1175475523 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee14004020 con 0x7fee24144720 2024-05-14T10:20:16.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2c3f1640 1 -- 172.21.15.154:0/1175475523 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee24137660 con 0x7fee24144720 2024-05-14T10:20:16.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee1affd640 1 -- 172.21.15.154:0/1175475523 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14004410 con 0x7fee24144720 2024-05-14T10:20:16.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2c3f1640 1 -- 172.21.15.154:0/1175475523 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee2413ec20 con 0x7fee24144720 2024-05-14T10:20:16.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2c3f1640 1 -- 172.21.15.154:0/1175475523 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fee24075470 con 0x7fee24144720 2024-05-14T10:20:16.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee1affd640 1 -- 172.21.15.154:0/1175475523 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fee14018070 con 0x7fee24144720 2024-05-14T10:20:16.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee1affd640 1 --2- 172.21.15.154:0/1175475523 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fee080678c0 0x7fee08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:16.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2a18d640 1 --2- 172.21.15.154:0/1175475523 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fee080678c0 0x7fee08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:16.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee1affd640 1 -- 172.21.15.154:0/1175475523 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fee14085540 con 0x7fee24144720 2024-05-14T10:20:16.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee1affd640 1 --2- 172.21.15.154:0/1175475523 >> [v2:172.21.15.176:6800/2969535252,v1:172.21.15.176:6802/2969535252] conn(0x7fee0806d780 0x7fee0806fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:16.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee1affd640 1 -- 172.21.15.154:0/1175475523 --> [v2:172.21.15.176:6800/2969535252,v1:172.21.15.176:6802/2969535252] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee14006780 con 0x7fee0806d780 2024-05-14T10:20:16.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee1affd640 1 -- 172.21.15.154:0/1175475523 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fee1408c050 con 0x7fee24144720 2024-05-14T10:20:16.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2a98e640 1 --2- 172.21.15.154:0/1175475523 >> [v2:172.21.15.176:6800/2969535252,v1:172.21.15.176:6802/2969535252] conn(0x7fee0806d780 0x7fee0806fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:16.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.005+0000 7fee2a18d640 1 --2- 172.21.15.154:0/1175475523 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fee080678c0 0x7fee08069d80 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fee2000b9d0 tx=0x7fee20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:16.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.009+0000 7fee2a98e640 1 --2- 172.21.15.154:0/1175475523 >> [v2:172.21.15.176:6800/2969535252,v1:172.21.15.176:6802/2969535252] conn(0x7fee0806d780 0x7fee0806fba0 crc :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:16.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.129+0000 7fee1affd640 1 -- 172.21.15.154:0/1175475523 <== osd.7 v2:172.21.15.176:6800/2969535252 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fee14006780 con 0x7fee0806d780 2024-05-14T10:20:16.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.145+0000 7fee2c3f1640 1 -- 172.21.15.154:0/1175475523 --> [v2:172.21.15.176:6800/2969535252,v1:172.21.15.176:6802/2969535252] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fee2413f0b0 con 0x7fee0806d780 2024-05-14T10:20:16.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.173+0000 7fee1affd640 1 -- 172.21.15.154:0/1175475523 <== osd.7 v2:172.21.15.176:6800/2969535252 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fee2413f0b0 con 0x7fee0806d780 2024-05-14T10:20:16.178 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-14T10:20:16.178 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T10:20:16.178 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-14T10:20:16.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.173+0000 7fee2c3f1640 1 -- 172.21.15.154:0/1175475523 >> [v2:172.21.15.176:6800/2969535252,v1:172.21.15.176:6802/2969535252] conn(0x7fee0806d780 msgr2=0x7fee0806fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:16.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.173+0000 7fee2c3f1640 1 --2- 172.21.15.154:0/1175475523 >> [v2:172.21.15.176:6800/2969535252,v1:172.21.15.176:6802/2969535252] conn(0x7fee0806d780 0x7fee0806fba0 crc :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.173+0000 7fee2c3f1640 1 -- 172.21.15.154:0/1175475523 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fee080678c0 msgr2=0x7fee08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:16.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.173+0000 7fee2c3f1640 1 --2- 172.21.15.154:0/1175475523 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fee080678c0 0x7fee08069d80 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fee2000b9d0 tx=0x7fee20008040 comp rx=0 tx=0).stop 2024-05-14T10:20:16.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.173+0000 7fee2c3f1640 1 -- 172.21.15.154:0/1175475523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee24144720 msgr2=0x7fee2406d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:16.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.173+0000 7fee2c3f1640 1 --2- 172.21.15.154:0/1175475523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee24144720 0x7fee2406d430 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7fee1400b410 tx=0x7fee1400b8d0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.173+0000 7fee2a98e640 1 -- 172.21.15.154:0/1175475523 reap_dead start 2024-05-14T10:20:16.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.173+0000 7fee2c3f1640 1 -- 172.21.15.154:0/1175475523 shutdown_connections 2024-05-14T10:20:16.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.173+0000 7fee2c3f1640 1 -- 172.21.15.154:0/1175475523 >> 172.21.15.154:0/1175475523 conn(0x7fee240b1850 msgr2=0x7fee2415ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:16.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.173+0000 7fee2c3f1640 1 -- 172.21.15.154:0/1175475523 shutdown_connections 2024-05-14T10:20:16.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.173+0000 7fee2c3f1640 1 -- 172.21.15.154:0/1175475523 wait complete. 2024-05-14T10:20:16.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-14T10:20:16.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.325+0000 7f32e0e6f640 1 Processor -- start 2024-05-14T10:20:16.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.325+0000 7f32e0e6f640 1 -- start start 2024-05-14T10:20:16.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.325+0000 7f32e0e6f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32dc15bae0 0x7f32dc165d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:16.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.325+0000 7f32e0e6f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32dc144b40 con 0x7f32dc0b3530 2024-05-14T10:20:16.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.325+0000 7f32e0e6f640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32dc0b3a40 con 0x7f32dc144760 2024-05-14T10:20:16.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.325+0000 7f32e0e6f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f32dc06ed90 con 0x7f32dc15bae0 2024-05-14T10:20:16.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.325+0000 7f32dad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32dc15bae0 0x7f32dc165d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:16.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.325+0000 7f32dad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32dc15bae0 0x7f32dc165d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56042/0 (socket says 172.21.15.154:56042) 2024-05-14T10:20:16.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.325+0000 7f32dad9d640 1 -- 172.21.15.154:0/130299700 learned_addr learned my addr 172.21.15.154:0/130299700 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:16.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.325+0000 7f32d3fff640 1 --1- 172.21.15.154:0/130299700 >> v1:172.21.15.154:6789/0 conn(0x7f32dc0b3530 0x7f32dc15b3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46862/0 (socket says 172.21.15.154:46862) 2024-05-14T10:20:16.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.325+0000 7f32dad9d640 1 -- 172.21.15.154:0/130299700 >> v1:172.21.15.176:6789/0 conn(0x7f32dc144760 legacy=0x7f32dc06e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:16.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.325+0000 7f32dad9d640 1 -- 172.21.15.154:0/130299700 >> v1:172.21.15.154:6789/0 conn(0x7f32dc0b3530 legacy=0x7f32dc15b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:16.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.325+0000 7f32dad9d640 1 -- 172.21.15.154:0/130299700 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32dc0b3d20 con 0x7f32dc15bae0 2024-05-14T10:20:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32dad9d640 1 --2- 172.21.15.154:0/130299700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32dc15bae0 0x7f32dc165d10 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009e50 tx=0x7f32d401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758a81595a3bf12f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:16.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32d9d9b640 1 -- 172.21.15.154:0/130299700 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d40a57a0 con 0x7f32dc15bae0 2024-05-14T10:20:16.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32d9d9b640 1 -- 172.21.15.154:0/130299700 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d40a5940 con 0x7f32dc15bae0 2024-05-14T10:20:16.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32d9d9b640 1 -- 172.21.15.154:0/130299700 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d40a5d10 con 0x7f32dc15bae0 2024-05-14T10:20:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32e0e6f640 1 -- 172.21.15.154:0/130299700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32dc15bae0 msgr2=0x7f32dc165d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32e0e6f640 1 --2- 172.21.15.154:0/130299700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32dc15bae0 0x7f32dc165d10 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009e50 tx=0x7f32d401c9f0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32e0e6f640 1 -- 172.21.15.154:0/130299700 shutdown_connections 2024-05-14T10:20:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32e0e6f640 1 --2- 172.21.15.154:0/130299700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32dc15bae0 0x7f32dc165d10 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32e0e6f640 1 -- 172.21.15.154:0/130299700 >> 172.21.15.154:0/130299700 conn(0x7f32dc0b1850 msgr2=0x7f32dc0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32e0e6f640 1 -- 172.21.15.154:0/130299700 shutdown_connections 2024-05-14T10:20:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32e0e6f640 1 -- 172.21.15.154:0/130299700 wait complete. 2024-05-14T10:20:16.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32e0e6f640 1 Processor -- start 2024-05-14T10:20:16.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32e0e6f640 1 -- start start 2024-05-14T10:20:16.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32e0e6f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32dc0b3530 0x7f32dc13b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:16.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32e0e6f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32dc144760 0x7f32dc13bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:16.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32e0e6f640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32dc15bae0 0x7f32dc13e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:16.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32e0e6f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc168e00 con 0x7f32dc144760 2024-05-14T10:20:16.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32e0e6f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc168c80 con 0x7f32dc0b3530 2024-05-14T10:20:16.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32e0e6f640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f32dc168f80 con 0x7f32dc15bae0 2024-05-14T10:20:16.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32dc144760 0x7f32dc13bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:16.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.329+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32dc144760 0x7f32dc13bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56052/0 (socket says 172.21.15.154:56052) 2024-05-14T10:20:16.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32d3fff640 1 -- 172.21.15.154:0/2624099744 learned_addr learned my addr 172.21.15.154:0/2624099744 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:16.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32da59c640 1 --2- 172.21.15.154:0/2624099744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32dc0b3530 0x7f32dc13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:16.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32dad9d640 1 --2- 172.21.15.154:0/2624099744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32dc15bae0 0x7f32dc13e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:16.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32d3fff640 1 -- 172.21.15.154:0/2624099744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32dc15bae0 msgr2=0x7f32dc13e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:16.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32d3fff640 1 --2- 172.21.15.154:0/2624099744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32dc15bae0 0x7f32dc13e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32d3fff640 1 -- 172.21.15.154:0/2624099744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32dc0b3530 msgr2=0x7f32dc13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:16.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32d3fff640 1 --2- 172.21.15.154:0/2624099744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32dc0b3530 0x7f32dc13b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32d3fff640 1 -- 172.21.15.154:0/2624099744 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32dc13c500 con 0x7f32dc144760 2024-05-14T10:20:16.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32dad9d640 1 --2- 172.21.15.154:0/2624099744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32dc15bae0 0x7f32dc13e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:20:16.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32d3fff640 1 --2- 172.21.15.154:0/2624099744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32dc144760 0x7f32dc13bed0 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f32c400c370 tx=0x7f32c400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:16.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32d2ffd640 1 -- 172.21.15.154:0/2624099744 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c40074e0 con 0x7f32dc144760 2024-05-14T10:20:16.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32d2ffd640 1 -- 172.21.15.154:0/2624099744 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c40076a0 con 0x7f32dc144760 2024-05-14T10:20:16.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32e0e6f640 1 -- 172.21.15.154:0/2624099744 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32dc13c7e0 con 0x7f32dc144760 2024-05-14T10:20:16.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32d2ffd640 1 -- 172.21.15.154:0/2624099744 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4004a10 con 0x7f32dc144760 2024-05-14T10:20:16.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32e0e6f640 1 -- 172.21.15.154:0/2624099744 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32dc0710d0 con 0x7f32dc144760 2024-05-14T10:20:16.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32e0e6f640 1 -- 172.21.15.154:0/2624099744 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32dc075470 con 0x7f32dc144760 2024-05-14T10:20:16.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32d2ffd640 1 -- 172.21.15.154:0/2624099744 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f32c401a020 con 0x7f32dc144760 2024-05-14T10:20:16.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32d2ffd640 1 --2- 172.21.15.154:0/2624099744 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f32bc0678c0 0x7f32bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:16.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32d2ffd640 1 -- 172.21.15.154:0/2624099744 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f32c40857a0 con 0x7f32dc144760 2024-05-14T10:20:16.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32da59c640 1 --2- 172.21.15.154:0/2624099744 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f32bc0678c0 0x7f32bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:16.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.333+0000 7f32da59c640 1 --2- 172.21.15.154:0/2624099744 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f32bc0678c0 0x7f32bc069d80 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f32cc007fd0 tx=0x7f32cc007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:16.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.337+0000 7f32d2ffd640 1 -- 172.21.15.154:0/2624099744 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f32c4021070 con 0x7f32dc144760 2024-05-14T10:20:16.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.501+0000 7f32e0e6f640 1 -- 172.21.15.154:0/2624099744 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f32dc06deb0 con 0x7f32bc0678c0 2024-05-14T10:20:16.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.501+0000 7f32d2ffd640 1 -- 172.21.15.154:0/2624099744 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f32dc06deb0 con 0x7f32bc0678c0 2024-05-14T10:20:16.507 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 7 to deep-scrub 2024-05-14T10:20:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.501+0000 7f32e0e6f640 1 -- 172.21.15.154:0/2624099744 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f32bc0678c0 msgr2=0x7f32bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.501+0000 7f32e0e6f640 1 --2- 172.21.15.154:0/2624099744 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f32bc0678c0 0x7f32bc069d80 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f32cc007fd0 tx=0x7f32cc007e40 comp rx=0 tx=0).stop 2024-05-14T10:20:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.501+0000 7f32e0e6f640 1 -- 172.21.15.154:0/2624099744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32dc144760 msgr2=0x7f32dc13bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.501+0000 7f32e0e6f640 1 --2- 172.21.15.154:0/2624099744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32dc144760 0x7f32dc13bed0 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f32c400c370 tx=0x7f32c400c830 comp rx=0 tx=0).stop 2024-05-14T10:20:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.501+0000 7f32e0e6f640 1 -- 172.21.15.154:0/2624099744 shutdown_connections 2024-05-14T10:20:16.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.501+0000 7f32e0e6f640 1 --2- 172.21.15.154:0/2624099744 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f32bc0678c0 0x7f32bc069d80 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.501+0000 7f32e0e6f640 1 --2- 172.21.15.154:0/2624099744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32dc15bae0 0x7f32dc13e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.501+0000 7f32e0e6f640 1 --2- 172.21.15.154:0/2624099744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32dc144760 0x7f32dc13bed0 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.501+0000 7f32e0e6f640 1 --2- 172.21.15.154:0/2624099744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32dc0b3530 0x7f32dc13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.501+0000 7f32e0e6f640 1 -- 172.21.15.154:0/2624099744 >> 172.21.15.154:0/2624099744 conn(0x7f32dc0b1850 msgr2=0x7f32dc15ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:16.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.501+0000 7f32e0e6f640 1 -- 172.21.15.154:0/2624099744 shutdown_connections 2024-05-14T10:20:16.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.501+0000 7f32e0e6f640 1 -- 172.21.15.154:0/2624099744 wait complete. 2024-05-14T10:20:16.526 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T10:20:16.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.637+0000 7fd298d34640 1 Processor -- start 2024-05-14T10:20:16.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.637+0000 7fd298d34640 1 -- start start 2024-05-14T10:20:16.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd298d34640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2940cf520 0x7fd2940d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:16.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd298d34640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd29415e4e0 0x7fd2940b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:16.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd298d34640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2940d29f0 con 0x7fd29415e100 2024-05-14T10:20:16.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd298d34640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd2940d2cd0 con 0x7fd29415e4e0 2024-05-14T10:20:16.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd298d34640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd2940d2fb0 con 0x7fd2940cf520 2024-05-14T10:20:16.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd292d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd29415e4e0 0x7fd2940b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:16.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd29259c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd29415e100 0x7fd2940cee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46864/0 (socket says 172.21.15.154:46864) 2024-05-14T10:20:16.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd29259c640 1 -- 172.21.15.154:0/1923603915 learned_addr learned my addr 172.21.15.154:0/1923603915 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:20:16.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd291d9b640 1 --2- 172.21.15.154:0/1923603915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2940cf520 0x7fd2940d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:16.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd292d9d640 1 -- 172.21.15.154:0/1923603915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2940cf520 msgr2=0x7fd2940d22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:16.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd292d9d640 1 --2- 172.21.15.154:0/1923603915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2940cf520 0x7fd2940d22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd292d9d640 1 -- 172.21.15.154:0/1923603915 >> v1:172.21.15.154:6789/0 conn(0x7fd29415e100 legacy=0x7fd2940cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:16.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd29159a640 1 -- 172.21.15.154:0/1923603915 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3592575427 0 0) 0x7fd2940d29f0 con 0x7fd29415e100 2024-05-14T10:20:16.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd292d9d640 1 -- 172.21.15.154:0/1923603915 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2940d3290 con 0x7fd29415e4e0 2024-05-14T10:20:16.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd291d9b640 1 --2- 172.21.15.154:0/1923603915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2940cf520 0x7fd2940d22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T10:20:16.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd292d9d640 1 --2- 172.21.15.154:0/1923603915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29415e4e0 0x7fd2940b9b20 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009d90 tx=0x7fd28c01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe0635361b3e2aa server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:16.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd29159a640 1 -- 172.21.15.154:0/1923603915 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0b4070 con 0x7fd29415e4e0 2024-05-14T10:20:16.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd29159a640 1 -- 172.21.15.154:0/1923603915 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd28c0af600 con 0x7fd29415e4e0 2024-05-14T10:20:16.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.641+0000 7fd29159a640 1 -- 172.21.15.154:0/1923603915 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0af9d0 con 0x7fd29415e4e0 2024-05-14T10:20:16.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd298d34640 1 -- 172.21.15.154:0/1923603915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29415e4e0 msgr2=0x7fd2940b9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:16.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd298d34640 1 --2- 172.21.15.154:0/1923603915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29415e4e0 0x7fd2940b9b20 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009d90 tx=0x7fd28c01f150 comp rx=0 tx=0).stop 2024-05-14T10:20:16.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd298d34640 1 -- 172.21.15.154:0/1923603915 shutdown_connections 2024-05-14T10:20:16.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd298d34640 1 --2- 172.21.15.154:0/1923603915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29415e4e0 0x7fd2940b9b20 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd298d34640 1 --2- 172.21.15.154:0/1923603915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2940cf520 0x7fd2940d22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd298d34640 1 -- 172.21.15.154:0/1923603915 >> 172.21.15.154:0/1923603915 conn(0x7fd2940b5b50 msgr2=0x7fd2940b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:16.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd298d34640 1 -- 172.21.15.154:0/1923603915 shutdown_connections 2024-05-14T10:20:16.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd298d34640 1 -- 172.21.15.154:0/1923603915 wait complete. 2024-05-14T10:20:16.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd298d34640 1 Processor -- start 2024-05-14T10:20:16.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd298d34640 1 -- start start 2024-05-14T10:20:16.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd298d34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2940cf520 0x7fd2940c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:16.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd298d34640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd29415e100 0x7fd29415f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:16.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd298d34640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd29415e4e0 0x7fd294160e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:16.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd298d34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd2940d3c10 con 0x7fd2940cf520 2024-05-14T10:20:16.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd298d34640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd2940d3a90 con 0x7fd29415e100 2024-05-14T10:20:16.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd298d34640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd2940c80b0 con 0x7fd29415e4e0 2024-05-14T10:20:16.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd29259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2940cf520 0x7fd2940c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:16.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd29259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2940cf520 0x7fd2940c7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56064/0 (socket says 172.21.15.154:56064) 2024-05-14T10:20:16.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd29259c640 1 -- 172.21.15.154:0/1363915134 learned_addr learned my addr 172.21.15.154:0/1363915134 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:16.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd292d9d640 1 --2- 172.21.15.154:0/1363915134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd29415e4e0 0x7fd294160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:16.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd291d9b640 1 --2- 172.21.15.154:0/1363915134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd29415e100 0x7fd29415f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:16.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd29259c640 1 -- 172.21.15.154:0/1363915134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd29415e4e0 msgr2=0x7fd294160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:16.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd29259c640 1 --2- 172.21.15.154:0/1363915134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd29415e4e0 0x7fd294160e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd29259c640 1 -- 172.21.15.154:0/1363915134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd29415e100 msgr2=0x7fd29415f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:16.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd29259c640 1 --2- 172.21.15.154:0/1363915134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd29415e100 0x7fd29415f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd29259c640 1 -- 172.21.15.154:0/1363915134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd294154040 con 0x7fd2940cf520 2024-05-14T10:20:16.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd291d9b640 1 --2- 172.21.15.154:0/1363915134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd29415e100 0x7fd29415f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:20:16.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd29259c640 1 --2- 172.21.15.154:0/1363915134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2940cf520 0x7fd2940c7b70 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7fd2840011f0 tx=0x7fd28400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:16.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd282ffd640 1 -- 172.21.15.154:0/1363915134 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284018070 con 0x7fd2940cf520 2024-05-14T10:20:16.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd282ffd640 1 -- 172.21.15.154:0/1363915134 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2840074e0 con 0x7fd2940cf520 2024-05-14T10:20:16.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.645+0000 7fd282ffd640 1 -- 172.21.15.154:0/1363915134 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284004a10 con 0x7fd2940cf520 2024-05-14T10:20:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.649+0000 7fd298d34640 1 -- 172.21.15.154:0/1363915134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd294154320 con 0x7fd2940cf520 2024-05-14T10:20:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.649+0000 7fd298d34640 1 -- 172.21.15.154:0/1363915134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd294154bc0 con 0x7fd2940cf520 2024-05-14T10:20:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.649+0000 7fd298d34640 1 -- 172.21.15.154:0/1363915134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2941544f0 con 0x7fd2940cf520 2024-05-14T10:20:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.649+0000 7fd282ffd640 1 -- 172.21.15.154:0/1363915134 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd284004bb0 con 0x7fd2940cf520 2024-05-14T10:20:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.649+0000 7fd282ffd640 1 --2- 172.21.15.154:0/1363915134 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd2740678f0 0x7fd274069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.649+0000 7fd282ffd640 1 -- 172.21.15.154:0/1363915134 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fd284084bf0 con 0x7fd2940cf520 2024-05-14T10:20:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.649+0000 7fd291d9b640 1 --2- 172.21.15.154:0/1363915134 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd2740678f0 0x7fd274069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.649+0000 7fd291d9b640 1 --2- 172.21.15.154:0/1363915134 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd2740678f0 0x7fd274069db0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd288006fd0 tx=0x7fd288008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:16.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.653+0000 7fd282ffd640 1 -- 172.21.15.154:0/1363915134 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fd284055340 con 0x7fd2940cf520 2024-05-14T10:20:16.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.813+0000 7fd298d34640 1 -- 172.21.15.154:0/1363915134 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd294075470 con 0x7fd2740678f0 2024-05-14T10:20:16.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.813+0000 7fd282ffd640 1 -- 172.21.15.154:0/1363915134 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13449 (secure 0 0 0) 0x7fd294075470 con 0x7fd2740678f0 2024-05-14T10:20:16.820 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:20:16.820 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-05-14T10:20:16.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.817+0000 7fd298d34640 1 -- 172.21.15.154:0/1363915134 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd2740678f0 msgr2=0x7fd274069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:16.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.817+0000 7fd298d34640 1 --2- 172.21.15.154:0/1363915134 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd2740678f0 0x7fd274069db0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd288006fd0 tx=0x7fd288008040 comp rx=0 tx=0).stop 2024-05-14T10:20:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.817+0000 7fd298d34640 1 -- 172.21.15.154:0/1363915134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2940cf520 msgr2=0x7fd2940c7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.817+0000 7fd298d34640 1 --2- 172.21.15.154:0/1363915134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2940cf520 0x7fd2940c7b70 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7fd2840011f0 tx=0x7fd28400c9b0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.817+0000 7fd298d34640 1 -- 172.21.15.154:0/1363915134 shutdown_connections 2024-05-14T10:20:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.817+0000 7fd298d34640 1 --2- 172.21.15.154:0/1363915134 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fd2740678f0 0x7fd274069db0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.817+0000 7fd298d34640 1 --2- 172.21.15.154:0/1363915134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd29415e4e0 0x7fd294160e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.817+0000 7fd298d34640 1 --2- 172.21.15.154:0/1363915134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd29415e100 0x7fd29415f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.817+0000 7fd298d34640 1 --2- 172.21.15.154:0/1363915134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2940cf520 0x7fd2940c7b70 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.817+0000 7fd298d34640 1 -- 172.21.15.154:0/1363915134 >> 172.21.15.154:0/1363915134 conn(0x7fd2940b5b50 msgr2=0x7fd294159430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.817+0000 7fd298d34640 1 -- 172.21.15.154:0/1363915134 shutdown_connections 2024-05-14T10:20:16.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:16.817+0000 7fd298d34640 1 -- 172.21.15.154:0/1363915134 wait complete. 2024-05-14T10:20:16.838 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":16131,"stamp":"2024-05-14T10:20:16.649143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12095404,"kb_used_data":4520,"kb_used_omap":5312,"kb_used_meta":12085503,"kb_avail":742879316,"statfs":{"total":773094113280,"available":760708419584,"internally_reserved":0,"allocated":4628480,"data_stored":2533584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5439617,"internal_metadata":12375555967},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002617"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":468,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-14T10:20:04.604133+0000","last_change":"2024-05-14T01:23:25.487525+0000","last_active":"2024-05-14T10:20:04.604133+0000","last_peered":"2024-05-14T10:20:04.604133+0000","last_clean":"2024-05-14T10:20:04.604133+0000","last_became_active":"2024-05-14T01:23:25.485622+0000","last_became_peered":"2024-05-14T01:23:25.485622+0000","last_unstale":"2024-05-14T10:20:04.604133+0000","last_undegraded":"2024-05-14T10:20:04.604133+0000","last_fullsized":"2024-05-14T10:20:04.604133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T01:23:24.138255+0000","last_clean_scrub_stamp":"2024-05-14T01:23:24.138255+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T04:26:23.884962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834581287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1676460,"kb_used_data":420,"kb_used_omap":1194,"kb_used_meta":1674837,"kb_avail":92695380,"statfs":{"total":96636764160,"available":94920069120,"internally_reserved":0,"allocated":430080,"data_stored":169106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1223070,"internal_metadata":1715033698},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834581291,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1690800,"kb_used_data":1000,"kb_used_omap":352,"kb_used_meta":1689439,"kb_avail":92681040,"statfs":{"total":96636764160,"available":94905384960,"internally_reserved":0,"allocated":1024000,"data_stored":759474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":361293,"internal_metadata":1729985715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834581292,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1451760,"kb_used_data":1000,"kb_used_omap":181,"kb_used_meta":1450570,"kb_avail":92920080,"statfs":{"total":96636764160,"available":95150161920,"internally_reserved":0,"allocated":1024000,"data_stored":759474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":185918,"internal_metadata":1485384130},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1456620,"kb_used_data":420,"kb_used_omap":656,"kb_used_meta":1455535,"kb_avail":92915220,"statfs":{"total":96636764160,"available":95145185280,"internally_reserved":0,"allocated":430080,"data_stored":169106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":672060,"internal_metadata":1490468548},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581293,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1590124,"kb_used_data":420,"kb_used_omap":593,"kb_used_meta":1589102,"kb_avail":92781716,"statfs":{"total":96636764160,"available":95008477184,"internally_reserved":0,"allocated":430080,"data_stored":169106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":608131,"internal_metadata":1627240573},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1363436,"kb_used_data":420,"kb_used_omap":821,"kb_used_meta":1362186,"kb_avail":93008404,"statfs":{"total":96636764160,"available":95240605696,"internally_reserved":0,"allocated":430080,"data_stored":169106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":841622,"internal_metadata":1394878570},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834581279,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1587436,"kb_used_data":420,"kb_used_omap":1168,"kb_used_meta":1585839,"kb_avail":92784404,"statfs":{"total":96636764160,"available":95011229696,"internally_reserved":0,"allocated":430080,"data_stored":169106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1196755,"internal_metadata":1623899437},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834581287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1278768,"kb_used_data":420,"kb_used_omap":342,"kb_used_meta":1277993,"kb_avail":93093072,"statfs":{"total":96636764160,"available":95327305728,"internally_reserved":0,"allocated":430080,"data_stored":169106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":350768,"internal_metadata":1308665296},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T10:20:16.841 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-14T01:23:24.138255+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=1, tm_min=23, tm_sec=24, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=20, tm_sec=9, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:20:16.841 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-14T10:20:36.842 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T10:20:36.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f2721982640 1 Processor -- start 2024-05-14T10:20:36.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f2721982640 1 -- start start 2024-05-14T10:20:36.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f2721982640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f271c15e5b0 0x7f271c0b3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:36.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f2721982640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f271c162080 con 0x7f271c0b60e0 2024-05-14T10:20:36.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f2721982640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f271c162360 con 0x7f271c0b5d00 2024-05-14T10:20:36.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f2721982640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f271c162640 con 0x7f271c15e5b0 2024-05-14T10:20:36.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f2713fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f271c0b60e0 0x7f271c0d24c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53210/0 (socket says 172.21.15.154:53210) 2024-05-14T10:20:36.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f2713fff640 1 -- 172.21.15.154:0/1342569284 learned_addr learned my addr 172.21.15.154:0/1342569284 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:20:36.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271b7fe640 1 --2- 172.21.15.154:0/1342569284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f271c15e5b0 0x7f271c0b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:36.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271a7fc640 1 -- 172.21.15.154:0/1342569284 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1056140348 0 0) 0x7f271c162080 con 0x7f271c0b60e0 2024-05-14T10:20:36.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271a7fc640 1 -- 172.21.15.154:0/1342569284 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2708003530 con 0x7f271c0b60e0 2024-05-14T10:20:36.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271a7fc640 1 -- 172.21.15.154:0/1342569284 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1939791689 0 0) 0x7f2708003530 con 0x7f271c0b60e0 2024-05-14T10:20:36.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271a7fc640 1 -- 172.21.15.154:0/1342569284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f271c15e5b0 msgr2=0x7f271c0b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:36.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271a7fc640 1 --2- 172.21.15.154:0/1342569284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f271c15e5b0 0x7f271c0b3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:36.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271a7fc640 1 -- 172.21.15.154:0/1342569284 >> v1:172.21.15.176:6789/0 conn(0x7f271c0b5d00 legacy=0x7f271c15dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:36.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271a7fc640 1 -- 172.21.15.154:0/1342569284 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271c162920 con 0x7f271c0b60e0 2024-05-14T10:20:36.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271a7fc640 1 -- 172.21.15.154:0/1342569284 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4215574705 0 0) 0x7f27040016a0 con 0x7f271c0b60e0 2024-05-14T10:20:36.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271a7fc640 1 -- 172.21.15.154:0/1342569284 >> v1:172.21.15.154:6789/0 conn(0x7f271c0b60e0 legacy=0x7f271c0d24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:36.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271a7fc640 1 --2- 172.21.15.154:0/1342569284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f271c15e5b0 0x7f27080039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:36.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271a7fc640 1 --2- 172.21.15.154:0/1342569284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2708003f70 0x7f2708004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:36.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271a7fc640 1 --2- 172.21.15.154:0/1342569284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2708004d50 0x7f27080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:36.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271a7fc640 1 -- 172.21.15.154:0/1342569284 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f271c162640 con 0x7f2708004d50 2024-05-14T10:20:36.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271a7fc640 1 -- 172.21.15.154:0/1342569284 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f270800bab0 con 0x7f2708003f70 2024-05-14T10:20:36.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271a7fc640 1 -- 172.21.15.154:0/1342569284 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f270800bcb0 con 0x7f271c15e5b0 2024-05-14T10:20:36.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271b7fe640 1 --2- 172.21.15.154:0/1342569284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2708004d50 0x7f27080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:36.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271affd640 1 --2- 172.21.15.154:0/1342569284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f271c15e5b0 0x7f27080039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:36.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f2713fff640 1 --2- 172.21.15.154:0/1342569284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2708003f70 0x7f2708004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:36.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271b7fe640 1 -- 172.21.15.154:0/1342569284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f271c15e5b0 msgr2=0x7f27080039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:36.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271b7fe640 1 --2- 172.21.15.154:0/1342569284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f271c15e5b0 0x7f27080039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:36.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271b7fe640 1 -- 172.21.15.154:0/1342569284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2708003f70 msgr2=0x7f2708004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:36.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271b7fe640 1 --2- 172.21.15.154:0/1342569284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2708003f70 0x7f2708004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:36.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271b7fe640 1 -- 172.21.15.154:0/1342569284 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2708003530 con 0x7f2708004d50 2024-05-14T10:20:36.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.968+0000 7f271affd640 1 --2- 172.21.15.154:0/1342569284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f271c15e5b0 0x7f27080039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:20:36.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.972+0000 7f271b7fe640 1 --2- 172.21.15.154:0/1342569284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2708004d50 0x7f27080051d0 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7f2714009fa0 tx=0x7f271401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4860b8406d2e2e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:36.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.972+0000 7f271a7fc640 1 -- 172.21.15.154:0/1342569284 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27140b2070 con 0x7f2708004d50 2024-05-14T10:20:36.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.972+0000 7f271a7fc640 1 -- 172.21.15.154:0/1342569284 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27140a5d10 con 0x7f2708004d50 2024-05-14T10:20:36.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.972+0000 7f271a7fc640 1 -- 172.21.15.154:0/1342569284 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2714009bf0 con 0x7f2708004d50 2024-05-14T10:20:36.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.972+0000 7f2721982640 1 -- 172.21.15.154:0/1342569284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2708004d50 msgr2=0x7f27080051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:36.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.972+0000 7f2721982640 1 --2- 172.21.15.154:0/1342569284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2708004d50 0x7f27080051d0 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7f2714009fa0 tx=0x7f271401cc40 comp rx=0 tx=0).stop 2024-05-14T10:20:36.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.972+0000 7f271b7fe640 1 -- 172.21.15.154:0/1342569284 reap_dead start 2024-05-14T10:20:36.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.972+0000 7f2721982640 1 -- 172.21.15.154:0/1342569284 shutdown_connections 2024-05-14T10:20:36.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.972+0000 7f2721982640 1 -- 172.21.15.154:0/1342569284 >> 172.21.15.154:0/1342569284 conn(0x7f271c0718a0 msgr2=0x7f271c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:36.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.972+0000 7f2721982640 1 -- 172.21.15.154:0/1342569284 shutdown_connections 2024-05-14T10:20:36.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.972+0000 7f2721982640 1 -- 172.21.15.154:0/1342569284 wait complete. 2024-05-14T10:20:36.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.972+0000 7f2721982640 1 Processor -- start 2024-05-14T10:20:36.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.972+0000 7f2721982640 1 -- start start 2024-05-14T10:20:36.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f2721982640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f271c153a50 0x7f271c1614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:36.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f2721982640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f271c153e30 0x7f271c0cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:36.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f2721982640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f271c0cc680 0x7f271c0ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:36.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f2721982640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f271c0b3680 con 0x7f271c0cc680 2024-05-14T10:20:36.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f2721982640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f271c0b3500 con 0x7f271c153a50 2024-05-14T10:20:36.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f2721982640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f271c0b3800 con 0x7f271c153e30 2024-05-14T10:20:36.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f271b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f271c0cc680 0x7f271c0ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:36.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f271b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f271c0cc680 0x7f271c0ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53930/0 (socket says 172.21.15.154:53930) 2024-05-14T10:20:36.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f271b7fe640 1 -- 172.21.15.154:0/1029944932 learned_addr learned my addr 172.21.15.154:0/1029944932 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:36.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f271affd640 1 --2- 172.21.15.154:0/1029944932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f271c153a50 0x7f271c1614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:36.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f2713fff640 1 --2- 172.21.15.154:0/1029944932 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f271c153e30 0x7f271c0cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:36.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f271b7fe640 1 -- 172.21.15.154:0/1029944932 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f271c153e30 msgr2=0x7f271c0cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:36.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f271b7fe640 1 --2- 172.21.15.154:0/1029944932 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f271c153e30 0x7f271c0cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:36.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f271b7fe640 1 -- 172.21.15.154:0/1029944932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f271c153a50 msgr2=0x7f271c1614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:36.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f271b7fe640 1 --2- 172.21.15.154:0/1029944932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f271c153a50 0x7f271c1614c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:36.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f271b7fe640 1 -- 172.21.15.154:0/1029944932 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271c0ca310 con 0x7f271c0cc680 2024-05-14T10:20:36.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f2713fff640 1 --2- 172.21.15.154:0/1029944932 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f271c153e30 0x7f271c0cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:20:36.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f271b7fe640 1 --2- 172.21.15.154:0/1029944932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f271c0cc680 0x7f271c0ccb10 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7f27140b0040 tx=0x7f2714009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:36.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f2718ff9640 1 -- 172.21.15.154:0/1029944932 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27140b2040 con 0x7f271c0cc680 2024-05-14T10:20:36.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f2718ff9640 1 -- 172.21.15.154:0/1029944932 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27140a5b10 con 0x7f271c0cc680 2024-05-14T10:20:36.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f2718ff9640 1 -- 172.21.15.154:0/1029944932 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2714009bf0 con 0x7f271c0cc680 2024-05-14T10:20:36.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f2721982640 1 -- 172.21.15.154:0/1029944932 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271c0ca5f0 con 0x7f271c0cc680 2024-05-14T10:20:36.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f2721982640 1 -- 172.21.15.154:0/1029944932 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f271c161a00 con 0x7f271c0cc680 2024-05-14T10:20:36.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f2721982640 1 -- 172.21.15.154:0/1029944932 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f271c075470 con 0x7f271c0cc680 2024-05-14T10:20:36.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f2718ff9640 1 -- 172.21.15.154:0/1029944932 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f27140c0020 con 0x7f271c0cc680 2024-05-14T10:20:36.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f2718ff9640 1 --2- 172.21.15.154:0/1029944932 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f26fc0678c0 0x7f26fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:36.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f2718ff9640 1 -- 172.21.15.154:0/1029944932 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f271411ffe0 con 0x7f271c0cc680 2024-05-14T10:20:36.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.976+0000 7f271affd640 1 --2- 172.21.15.154:0/1029944932 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f26fc0678c0 0x7f26fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:36.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.980+0000 7f271affd640 1 --2- 172.21.15.154:0/1029944932 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f26fc0678c0 0x7f26fc069d80 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f270c000c10 tx=0x7f270c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:36.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:36.984+0000 7f2718ff9640 1 -- 172.21.15.154:0/1029944932 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f2714016950 con 0x7f271c0cc680 2024-05-14T10:20:37.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.140+0000 7f2721982640 1 -- 172.21.15.154:0/1029944932 --> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f271c0c7700 con 0x7f26fc0678c0 2024-05-14T10:20:37.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.140+0000 7f2718ff9640 1 -- 172.21.15.154:0/1029944932 <== mgr.4104 v2:172.21.15.154:6832/2359224792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13457 (secure 0 0 0) 0x7f271c0c7700 con 0x7f26fc0678c0 2024-05-14T10:20:37.148 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:20:37.148 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-05-14T10:20:37.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.144+0000 7f2721982640 1 -- 172.21.15.154:0/1029944932 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f26fc0678c0 msgr2=0x7f26fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:37.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.144+0000 7f2721982640 1 --2- 172.21.15.154:0/1029944932 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f26fc0678c0 0x7f26fc069d80 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f270c000c10 tx=0x7f270c009040 comp rx=0 tx=0).stop 2024-05-14T10:20:37.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.144+0000 7f2721982640 1 -- 172.21.15.154:0/1029944932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f271c0cc680 msgr2=0x7f271c0ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.144+0000 7f2721982640 1 --2- 172.21.15.154:0/1029944932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f271c0cc680 0x7f271c0ccb10 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7f27140b0040 tx=0x7f2714009750 comp rx=0 tx=0).stop 2024-05-14T10:20:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.144+0000 7f2721982640 1 -- 172.21.15.154:0/1029944932 shutdown_connections 2024-05-14T10:20:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.144+0000 7f2721982640 1 --2- 172.21.15.154:0/1029944932 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f26fc0678c0 0x7f26fc069d80 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.144+0000 7f2721982640 1 --2- 172.21.15.154:0/1029944932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f271c0cc680 0x7f271c0ccb10 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.144+0000 7f2721982640 1 --2- 172.21.15.154:0/1029944932 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f271c153e30 0x7f271c0cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.144+0000 7f2721982640 1 --2- 172.21.15.154:0/1029944932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f271c153a50 0x7f271c1614c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.144+0000 7f2721982640 1 -- 172.21.15.154:0/1029944932 >> 172.21.15.154:0/1029944932 conn(0x7f271c0718a0 msgr2=0x7f271c0b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.144+0000 7f2721982640 1 -- 172.21.15.154:0/1029944932 shutdown_connections 2024-05-14T10:20:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.144+0000 7f2721982640 1 -- 172.21.15.154:0/1029944932 wait complete. 2024-05-14T10:20:37.168 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":16141,"stamp":"2024-05-14T10:20:36.654232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12095404,"kb_used_data":4520,"kb_used_omap":5312,"kb_used_meta":12085503,"kb_avail":742879316,"statfs":{"total":773094113280,"available":760708419584,"internally_reserved":0,"allocated":4628480,"data_stored":2533584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5439617,"internal_metadata":12375555967},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003115"},"pg_stats":[{"pgid":"1.0","version":"37'119","reported_seq":479,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-14T10:20:16.984374+0000","last_change":"2024-05-14T10:20:16.984461+0000","last_active":"2024-05-14T10:20:16.984374+0000","last_peered":"2024-05-14T10:20:16.984374+0000","last_clean":"2024-05-14T10:20:16.984374+0000","last_became_active":"2024-05-14T01:23:25.485622+0000","last_became_peered":"2024-05-14T01:23:25.485622+0000","last_unstale":"2024-05-14T10:20:16.984374+0000","last_undegraded":"2024-05-14T10:20:16.984374+0000","last_fullsized":"2024-05-14T10:20:16.984374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'119","last_scrub_stamp":"2024-05-14T10:20:16.984160+0000","last_deep_scrub":"37'119","last_deep_scrub_stamp":"2024-05-14T10:20:16.984160+0000","last_clean_scrub_stamp":"2024-05-14T10:20:16.984160+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:17:26.986603+0000","scrub_duration":463,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834581291,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1676460,"kb_used_data":420,"kb_used_omap":1194,"kb_used_meta":1674837,"kb_avail":92695380,"statfs":{"total":96636764160,"available":94920069120,"internally_reserved":0,"allocated":430080,"data_stored":169106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1223070,"internal_metadata":1715033698},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834581295,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1690800,"kb_used_data":1000,"kb_used_omap":352,"kb_used_meta":1689439,"kb_avail":92681040,"statfs":{"total":96636764160,"available":94905384960,"internally_reserved":0,"allocated":1024000,"data_stored":759474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":361293,"internal_metadata":1729985715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834581296,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1451760,"kb_used_data":1000,"kb_used_omap":181,"kb_used_meta":1450570,"kb_avail":92920080,"statfs":{"total":96636764160,"available":95150161920,"internally_reserved":0,"allocated":1024000,"data_stored":759474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":185918,"internal_metadata":1485384130},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581298,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1456620,"kb_used_data":420,"kb_used_omap":656,"kb_used_meta":1455535,"kb_avail":92915220,"statfs":{"total":96636764160,"available":95145185280,"internally_reserved":0,"allocated":430080,"data_stored":169106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":672060,"internal_metadata":1490468548},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581297,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1590124,"kb_used_data":420,"kb_used_omap":593,"kb_used_meta":1589102,"kb_avail":92781716,"statfs":{"total":96636764160,"available":95008477184,"internally_reserved":0,"allocated":430080,"data_stored":169106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":608131,"internal_metadata":1627240573},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581298,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1363436,"kb_used_data":420,"kb_used_omap":821,"kb_used_meta":1362186,"kb_avail":93008404,"statfs":{"total":96636764160,"available":95240605696,"internally_reserved":0,"allocated":430080,"data_stored":169106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":841622,"internal_metadata":1394878570},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834581283,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1587436,"kb_used_data":420,"kb_used_omap":1168,"kb_used_meta":1585839,"kb_avail":92784404,"statfs":{"total":96636764160,"available":95011229696,"internally_reserved":0,"allocated":430080,"data_stored":169106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1196755,"internal_metadata":1623899437},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834581291,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1278768,"kb_used_data":420,"kb_used_omap":342,"kb_used_meta":1277993,"kb_avail":93093072,"statfs":{"total":96636764160,"available":95327305728,"internally_reserved":0,"allocated":430080,"data_stored":169106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":350768,"internal_metadata":1308665296},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T10:20:37.169 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-14T10:20:37.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.284+0000 7fa67a1f1640 1 Processor -- start 2024-05-14T10:20:37.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.284+0000 7fa67a1f1640 1 -- start start 2024-05-14T10:20:37.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.284+0000 7fa67a1f1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa67415a670 0x7fa674071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:37.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.284+0000 7fa67a1f1640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa674071060 0x7fa67406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:37.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.284+0000 7fa67a1f1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa674071ea0 con 0x7fa67406d380 2024-05-14T10:20:37.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.284+0000 7fa67a1f1640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa6740b32d0 con 0x7fa674071060 2024-05-14T10:20:37.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.284+0000 7fa67a1f1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa6740b2c80 con 0x7fa67415a670 2024-05-14T10:20:37.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.284+0000 7fa673fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa67406d380 0x7fa67406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36026/0 (socket says 172.21.15.154:36026) 2024-05-14T10:20:37.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.284+0000 7fa673fff640 1 -- 172.21.15.154:0/2977841297 learned_addr learned my addr 172.21.15.154:0/2977841297 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-05-14T10:20:37.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.284+0000 7fa6737fe640 1 --2- 172.21.15.154:0/2977841297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa67415a670 0x7fa674071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:37.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.284+0000 7fa672ffd640 1 --2- 172.21.15.154:0/2977841297 >> v2:172.21.15.176:3300/0 conn(0x7fa674071060 0x7fa67406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:37.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.284+0000 7fa6727fc640 1 -- 172.21.15.154:0/2977841297 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1587738571 0 0) 0x7fa674071ea0 con 0x7fa67406d380 2024-05-14T10:20:37.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.284+0000 7fa6727fc640 1 -- 172.21.15.154:0/2977841297 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa660003530 con 0x7fa67406d380 2024-05-14T10:20:37.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.284+0000 7fa6737fe640 1 -- 172.21.15.154:0/2977841297 >> v2:172.21.15.176:3300/0 conn(0x7fa674071060 msgr2=0x7fa67406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:37.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.284+0000 7fa6737fe640 1 --2- 172.21.15.154:0/2977841297 >> v2:172.21.15.176:3300/0 conn(0x7fa674071060 0x7fa67406ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.284+0000 7fa6727fc640 1 -- 172.21.15.154:0/2977841297 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3253687576 0 0) 0x7fa660003530 con 0x7fa67406d380 2024-05-14T10:20:37.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.284+0000 7fa6737fe640 1 -- 172.21.15.154:0/2977841297 >> v1:172.21.15.154:6789/0 conn(0x7fa67406d380 legacy=0x7fa67406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:37.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.284+0000 7fa6737fe640 1 -- 172.21.15.154:0/2977841297 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6740b2f60 con 0x7fa67415a670 2024-05-14T10:20:37.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.288+0000 7fa6737fe640 1 --2- 172.21.15.154:0/2977841297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa67415a670 0x7fa674071850 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0097c0 tx=0x7fa65c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e272335be54e655c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:37.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.288+0000 7fa6727fc640 1 -- 172.21.15.154:0/2977841297 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c0b0070 con 0x7fa67415a670 2024-05-14T10:20:37.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.288+0000 7fa6727fc640 1 -- 172.21.15.154:0/2977841297 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa65c0ab400 con 0x7fa67415a670 2024-05-14T10:20:37.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.288+0000 7fa6727fc640 1 -- 172.21.15.154:0/2977841297 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c001680 con 0x7fa67415a670 2024-05-14T10:20:37.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.288+0000 7fa67a1f1640 1 -- 172.21.15.154:0/2977841297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa67415a670 msgr2=0x7fa674071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:37.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.288+0000 7fa67a1f1640 1 --2- 172.21.15.154:0/2977841297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa67415a670 0x7fa674071850 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0097c0 tx=0x7fa65c01c3c0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.288+0000 7fa67a1f1640 1 -- 172.21.15.154:0/2977841297 shutdown_connections 2024-05-14T10:20:37.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.288+0000 7fa67a1f1640 1 --2- 172.21.15.154:0/2977841297 >> v2:172.21.15.176:3300/0 conn(0x7fa674071060 0x7fa67406ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.288+0000 7fa67a1f1640 1 --2- 172.21.15.154:0/2977841297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa67415a670 0x7fa674071850 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.288+0000 7fa67a1f1640 1 -- 172.21.15.154:0/2977841297 >> 172.21.15.154:0/2977841297 conn(0x7fa6740b1770 msgr2=0x7fa6740b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:37.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.288+0000 7fa67a1f1640 1 -- 172.21.15.154:0/2977841297 shutdown_connections 2024-05-14T10:20:37.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.288+0000 7fa67a1f1640 1 -- 172.21.15.154:0/2977841297 wait complete. 2024-05-14T10:20:37.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.288+0000 7fa67a1f1640 1 Processor -- start 2024-05-14T10:20:37.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.288+0000 7fa67a1f1640 1 -- start start 2024-05-14T10:20:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa67a1f1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa67406d380 0x7fa674141840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa67a1f1640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa674071060 0x7fa6741560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa67a1f1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67415a670 0x7fa67414e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa67a1f1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa674167990 con 0x7fa67415a670 2024-05-14T10:20:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa67a1f1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa674071650 con 0x7fa67406d380 2024-05-14T10:20:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa67a1f1640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa674167b10 con 0x7fa674071060 2024-05-14T10:20:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa673fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67415a670 0x7fa67414e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa673fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67415a670 0x7fa67414e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40058/0 (socket says 172.21.15.154:40058) 2024-05-14T10:20:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa673fff640 1 -- 172.21.15.154:0/1236253688 learned_addr learned my addr 172.21.15.154:0/1236253688 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa6737fe640 1 --2- 172.21.15.154:0/1236253688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa67406d380 0x7fa674141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa672ffd640 1 --2- 172.21.15.154:0/1236253688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa674071060 0x7fa6741560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa673fff640 1 -- 172.21.15.154:0/1236253688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa674071060 msgr2=0x7fa6741560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa673fff640 1 --2- 172.21.15.154:0/1236253688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa674071060 0x7fa6741560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa673fff640 1 -- 172.21.15.154:0/1236253688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa67406d380 msgr2=0x7fa674141840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa673fff640 1 --2- 172.21.15.154:0/1236253688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa67406d380 0x7fa674141840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa673fff640 1 -- 172.21.15.154:0/1236253688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67414a7c0 con 0x7fa67415a670 2024-05-14T10:20:37.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa6737fe640 1 --2- 172.21.15.154:0/1236253688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa67406d380 0x7fa674141840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:20:37.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa673fff640 1 --2- 172.21.15.154:0/1236253688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67415a670 0x7fa67414e9b0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00c600 tx=0x7fa66c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:37.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa66bfff640 1 -- 172.21.15.154:0/1236253688 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c005cf0 con 0x7fa67415a670 2024-05-14T10:20:37.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa66bfff640 1 -- 172.21.15.154:0/1236253688 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa66c007070 con 0x7fa67415a670 2024-05-14T10:20:37.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa67a1f1640 1 -- 172.21.15.154:0/1236253688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa67414aaa0 con 0x7fa67415a670 2024-05-14T10:20:37.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa66bfff640 1 -- 172.21.15.154:0/1236253688 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c007460 con 0x7fa67415a670 2024-05-14T10:20:37.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa67a1f1640 1 -- 172.21.15.154:0/1236253688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa67414b060 con 0x7fa67415a670 2024-05-14T10:20:37.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa67a1f1640 1 -- 172.21.15.154:0/1236253688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa674075470 con 0x7fa67415a670 2024-05-14T10:20:37.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa66bfff640 1 -- 172.21.15.154:0/1236253688 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa66c007600 con 0x7fa67415a670 2024-05-14T10:20:37.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa66bfff640 1 --2- 172.21.15.154:0/1236253688 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa6540678f0 0x7fa654069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa6737fe640 1 --2- 172.21.15.154:0/1236253688 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa6540678f0 0x7fa654069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.292+0000 7fa66bfff640 1 -- 172.21.15.154:0/1236253688 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fa66c0856b0 con 0x7fa67415a670 2024-05-14T10:20:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.296+0000 7fa6737fe640 1 --2- 172.21.15.154:0/1236253688 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa6540678f0 0x7fa654069db0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0ad000 tx=0x7fa65c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.296+0000 7fa66bfff640 1 -- 172.21.15.154:0/1236253688 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fa66c056580 con 0x7fa67415a670 2024-05-14T10:20:37.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.452+0000 7fa67a1f1640 1 -- 172.21.15.154:0/1236253688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fa6740670d0 con 0x7fa67415a670 2024-05-14T10:20:37.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.460+0000 7fa66bfff640 1 -- 172.21.15.154:0/1236253688 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7fa66c055e80 con 0x7fa67415a670 2024-05-14T10:20:37.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.460+0000 7fa66bfff640 1 -- 172.21.15.154:0/1236253688 <== mon.0 v2:172.21.15.154:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa66c05a230 con 0x7fa67415a670 2024-05-14T10:20:37.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.464+0000 7fa67a1f1640 1 -- 172.21.15.154:0/1236253688 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa6540678f0 msgr2=0x7fa654069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:37.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.464+0000 7fa67a1f1640 1 --2- 172.21.15.154:0/1236253688 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa6540678f0 0x7fa654069db0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0ad000 tx=0x7fa65c0a6000 comp rx=0 tx=0).stop 2024-05-14T10:20:37.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.464+0000 7fa67a1f1640 1 -- 172.21.15.154:0/1236253688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67415a670 msgr2=0x7fa67414e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:37.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.464+0000 7fa67a1f1640 1 --2- 172.21.15.154:0/1236253688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67415a670 0x7fa67414e9b0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00c600 tx=0x7fa66c00cac0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.464+0000 7fa67a1f1640 1 -- 172.21.15.154:0/1236253688 shutdown_connections 2024-05-14T10:20:37.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.464+0000 7fa67a1f1640 1 --2- 172.21.15.154:0/1236253688 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7fa6540678f0 0x7fa654069db0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.464+0000 7fa67a1f1640 1 --2- 172.21.15.154:0/1236253688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67415a670 0x7fa67414e9b0 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.464+0000 7fa67a1f1640 1 --2- 172.21.15.154:0/1236253688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa674071060 0x7fa6741560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.464+0000 7fa67a1f1640 1 --2- 172.21.15.154:0/1236253688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa67406d380 0x7fa674141840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.464+0000 7fa67a1f1640 1 -- 172.21.15.154:0/1236253688 >> 172.21.15.154:0/1236253688 conn(0x7fa6740b1770 msgr2=0x7fa6741594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:37.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.464+0000 7fa67a1f1640 1 -- 172.21.15.154:0/1236253688 shutdown_connections 2024-05-14T10:20:37.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.464+0000 7fa67a1f1640 1 -- 172.21.15.154:0/1236253688 wait complete. 2024-05-14T10:20:37.486 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-14T10:20:37.486 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T10:20:37.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.592+0000 7f8f4c644640 1 Processor -- start 2024-05-14T10:20:37.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.592+0000 7f8f4c644640 1 -- start start 2024-05-14T10:20:37.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.596+0000 7f8f4c644640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8f4415bf50 0x7f8f4406b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:37.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.596+0000 7f8f4c644640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8f4406f2d0 0x7f8f4406b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:37.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.596+0000 7f8f4c644640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f440717a0 con 0x7f8f4415fb20 2024-05-14T10:20:37.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.596+0000 7f8f4c644640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8f44072370 con 0x7f8f4415bf50 2024-05-14T10:20:37.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.596+0000 7f8f4c644640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8f44071a40 con 0x7f8f4406f2d0 2024-05-14T10:20:37.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.596+0000 7f8f4a3e0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8f4415bf50 0x7f8f4406b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:37.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.596+0000 7f8f4a3e0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8f4415bf50 0x7f8f4406b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40062/0 (socket says 172.21.15.154:40062) 2024-05-14T10:20:37.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.596+0000 7f8f4a3e0640 1 -- 172.21.15.154:0/1506523645 learned_addr learned my addr 172.21.15.154:0/1506523645 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:37.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.596+0000 7f8f49bdf640 1 --2- 172.21.15.154:0/1506523645 >> v2:172.21.15.176:3300/0 conn(0x7f8f4406f2d0 0x7f8f4406b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:37.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.596+0000 7f8f4a3e0640 1 -- 172.21.15.154:0/1506523645 >> v2:172.21.15.176:3300/0 conn(0x7f8f4406f2d0 msgr2=0x7f8f4406b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:37.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.596+0000 7f8f4a3e0640 1 --2- 172.21.15.154:0/1506523645 >> v2:172.21.15.176:3300/0 conn(0x7f8f4406f2d0 0x7f8f4406b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.596+0000 7f8f4a3e0640 1 -- 172.21.15.154:0/1506523645 >> v1:172.21.15.176:6789/0 conn(0x7f8f4415fb20 legacy=0x7f8f4406d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:20:37.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.596+0000 7f8f4a3e0640 1 -- 172.21.15.154:0/1506523645 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f44071d20 con 0x7f8f4415bf50 2024-05-14T10:20:37.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.596+0000 7f8f49bdf640 1 --2- 172.21.15.154:0/1506523645 >> v2:172.21.15.176:3300/0 conn(0x7f8f4406f2d0 0x7f8f4406b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T10:20:37.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.596+0000 7f8f4a3e0640 1 --2- 172.21.15.154:0/1506523645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f4415bf50 0x7f8f4406b280 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7f8f440b3160 tx=0x7f8f4001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ef706f13c441f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:37.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.596+0000 7f8f493de640 1 -- 172.21.15.154:0/1506523645 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f400b1070 con 0x7f8f4415bf50 2024-05-14T10:20:37.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.596+0000 7f8f493de640 1 -- 172.21.15.154:0/1506523645 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8f400ac620 con 0x7f8f4415bf50 2024-05-14T10:20:37.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.596+0000 7f8f493de640 1 -- 172.21.15.154:0/1506523645 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f400aca10 con 0x7f8f4415bf50 2024-05-14T10:20:37.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4c644640 1 -- 172.21.15.154:0/1506523645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f4415bf50 msgr2=0x7f8f4406b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:37.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4c644640 1 --2- 172.21.15.154:0/1506523645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f4415bf50 0x7f8f4406b280 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7f8f440b3160 tx=0x7f8f4001c4b0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4c644640 1 -- 172.21.15.154:0/1506523645 shutdown_connections 2024-05-14T10:20:37.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4c644640 1 --2- 172.21.15.154:0/1506523645 >> v2:172.21.15.176:3300/0 conn(0x7f8f4406f2d0 0x7f8f4406b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4c644640 1 --2- 172.21.15.154:0/1506523645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f4415bf50 0x7f8f4406b280 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4c644640 1 -- 172.21.15.154:0/1506523645 >> 172.21.15.154:0/1506523645 conn(0x7f8f440b2140 msgr2=0x7f8f440b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:37.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4c644640 1 -- 172.21.15.154:0/1506523645 shutdown_connections 2024-05-14T10:20:37.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4c644640 1 -- 172.21.15.154:0/1506523645 wait complete. 2024-05-14T10:20:37.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4c644640 1 Processor -- start 2024-05-14T10:20:37.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4c644640 1 -- start start 2024-05-14T10:20:37.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4c644640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f4406f2d0 0x7f8f44149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:37.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4c644640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f4415bf50 0x7f8f4414dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:37.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4c644640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f4415fb20 0x7f8f440b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:37.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4c644640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8f44168ec0 con 0x7f8f4406f2d0 2024-05-14T10:20:37.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4c644640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4406f0a0 con 0x7f8f4415bf50 2024-05-14T10:20:37.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4c644640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8f44169040 con 0x7f8f4415fb20 2024-05-14T10:20:37.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4a3e0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f4406f2d0 0x7f8f44149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:37.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4a3e0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f4406f2d0 0x7f8f44149170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40066/0 (socket says 172.21.15.154:40066) 2024-05-14T10:20:37.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4a3e0640 1 -- 172.21.15.154:0/1805134008 learned_addr learned my addr 172.21.15.154:0/1805134008 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-14T10:20:37.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f49bdf640 1 --2- 172.21.15.154:0/1805134008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f4415bf50 0x7f8f4414dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:37.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4abe1640 1 --2- 172.21.15.154:0/1805134008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f4415fb20 0x7f8f440b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:37.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4a3e0640 1 -- 172.21.15.154:0/1805134008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f4415fb20 msgr2=0x7f8f440b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:37.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4a3e0640 1 --2- 172.21.15.154:0/1805134008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f4415fb20 0x7f8f440b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4a3e0640 1 -- 172.21.15.154:0/1805134008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f4415bf50 msgr2=0x7f8f4414dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:37.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4a3e0640 1 --2- 172.21.15.154:0/1805134008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f4415bf50 0x7f8f4414dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4a3e0640 1 -- 172.21.15.154:0/1805134008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f44152ca0 con 0x7f8f4406f2d0 2024-05-14T10:20:37.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f49bdf640 1 --2- 172.21.15.154:0/1805134008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f4415bf50 0x7f8f4414dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:20:37.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4a3e0640 1 --2- 172.21.15.154:0/1805134008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f4406f2d0 0x7f8f44149170 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f8f4001a0e0 tx=0x7f8f40019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:37.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f3affd640 1 -- 172.21.15.154:0/1805134008 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f400bc070 con 0x7f8f4406f2d0 2024-05-14T10:20:37.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f3affd640 1 -- 172.21.15.154:0/1805134008 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8f400b7630 con 0x7f8f4406f2d0 2024-05-14T10:20:37.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f3affd640 1 -- 172.21.15.154:0/1805134008 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f400b1040 con 0x7f8f4406f2d0 2024-05-14T10:20:37.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.600+0000 7f8f4c644640 1 -- 172.21.15.154:0/1805134008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f44152f80 con 0x7f8f4406f2d0 2024-05-14T10:20:37.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.604+0000 7f8f4c644640 1 -- 172.21.15.154:0/1805134008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f44153540 con 0x7f8f4406f2d0 2024-05-14T10:20:37.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.604+0000 7f8f4c644640 1 -- 172.21.15.154:0/1805134008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f44068360 con 0x7f8f4406f2d0 2024-05-14T10:20:37.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.604+0000 7f8f3affd640 1 -- 172.21.15.154:0/1805134008 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f400b63d0 con 0x7f8f4406f2d0 2024-05-14T10:20:37.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.604+0000 7f8f3affd640 1 --2- 172.21.15.154:0/1805134008 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8f280678f0 0x7f8f28069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:20:37.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.604+0000 7f8f49bdf640 1 --2- 172.21.15.154:0/1805134008 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8f280678f0 0x7f8f28069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:20:37.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.604+0000 7f8f3affd640 1 -- 172.21.15.154:0/1805134008 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f8f4011f550 con 0x7f8f4406f2d0 2024-05-14T10:20:37.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.604+0000 7f8f49bdf640 1 --2- 172.21.15.154:0/1805134008 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8f280678f0 0x7f8f28069db0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f8f34006fd0 tx=0x7f8f34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:20:37.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.608+0000 7f8f3affd640 1 -- 172.21.15.154:0/1805134008 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f8f400160d0 con 0x7f8f4406f2d0 2024-05-14T10:20:37.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.804+0000 7f8f4c644640 1 -- 172.21.15.154:0/1805134008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f4406c080 con 0x7f8f4406f2d0 2024-05-14T10:20:37.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.816+0000 7f8f3affd640 1 -- 172.21.15.154:0/1805134008 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3882 (secure 0 0 0) 0x7f8f400f0300 con 0x7f8f4406f2d0 2024-05-14T10:20:37.822 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-14T10:20:37.822 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3153095738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3153095738},{"type":"v1","addr":"172.21.15.176:6835","nonce":3153095738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1660216913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":1660216913},{"type":"v1","addr":"172.21.15.176:6834","nonce":1660216913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1431439777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1431439777},{"type":"v1","addr":"172.21.15.154:6837","nonce":1431439777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":10215,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2992645305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2992645305},{"type":"v1","addr":"172.21.15.154:6836","nonce":2992645305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-05-14T10:20:37.823 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 19 2024-05-14T10:20:37.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.816+0000 7f8f4c644640 1 -- 172.21.15.154:0/1805134008 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8f280678f0 msgr2=0x7f8f28069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:37.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.816+0000 7f8f4c644640 1 --2- 172.21.15.154:0/1805134008 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8f280678f0 0x7f8f28069db0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f8f34006fd0 tx=0x7f8f34008040 comp rx=0 tx=0).stop 2024-05-14T10:20:37.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.816+0000 7f8f4c644640 1 -- 172.21.15.154:0/1805134008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f4406f2d0 msgr2=0x7f8f44149170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:20:37.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.816+0000 7f8f4c644640 1 --2- 172.21.15.154:0/1805134008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f4406f2d0 0x7f8f44149170 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f8f4001a0e0 tx=0x7f8f40019250 comp rx=0 tx=0).stop 2024-05-14T10:20:37.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.816+0000 7f8f4c644640 1 -- 172.21.15.154:0/1805134008 shutdown_connections 2024-05-14T10:20:37.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.816+0000 7f8f4c644640 1 --2- 172.21.15.154:0/1805134008 >> [v2:172.21.15.154:6832/2359224792,v1:172.21.15.154:6833/2359224792] conn(0x7f8f280678f0 0x7f8f28069db0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.816+0000 7f8f4c644640 1 --2- 172.21.15.154:0/1805134008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f4415fb20 0x7f8f440b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.816+0000 7f8f4c644640 1 --2- 172.21.15.154:0/1805134008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f4415bf50 0x7f8f4414dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.816+0000 7f8f4c644640 1 --2- 172.21.15.154:0/1805134008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f4406f2d0 0x7f8f44149170 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:20:37.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.816+0000 7f8f4c644640 1 -- 172.21.15.154:0/1805134008 >> 172.21.15.154:0/1805134008 conn(0x7f8f440b2140 msgr2=0x7f8f4415c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:20:37.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.816+0000 7f8f4c644640 1 -- 172.21.15.154:0/1805134008 shutdown_connections 2024-05-14T10:20:37.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-14T10:20:37.816+0000 7f8f4c644640 1 -- 172.21.15.154:0/1805134008 wait complete. 2024-05-14T10:20:37.841 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-14T10:20:37.841 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-14T10:20:37.842 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-14T10:20:37.842 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:20:43.944 INFO:tasks.ceph.mds.a:Stopped 2024-05-14T10:20:43.944 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-14T10:20:43.944 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:20:50.046 INFO:tasks.ceph.mds.c:Stopped 2024-05-14T10:20:50.047 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-14T10:20:50.047 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:20:50.081 INFO:tasks.ceph.mds.b:Stopped 2024-05-14T10:20:50.081 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-14T10:20:50.081 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:20:50.149 INFO:tasks.ceph.mds.d:Stopped 2024-05-14T10:20:50.149 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-14T10:20:50.149 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-14T10:20:50.149 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:20:56.252 INFO:tasks.ceph.osd.0:Stopped 2024-05-14T10:20:56.252 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-14T10:20:56.253 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:20:57.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-05-14T10:21:02.355 INFO:tasks.ceph.osd.1:Stopped 2024-05-14T10:21:02.355 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-14T10:21:02.355 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:21:03.402 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-05-14T10:21:03.403 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-05-14T10:21:08.458 INFO:tasks.ceph.osd.2:Stopped 2024-05-14T10:21:08.458 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-14T10:21:08.458 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:21:09.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-05-14T10:21:09.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-05-14T10:21:14.560 INFO:tasks.ceph.osd.3:Stopped 2024-05-14T10:21:14.560 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-14T10:21:14.561 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:21:15.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-05-14T10:21:15.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-05-14T10:21:20.662 INFO:tasks.ceph.osd.4:Stopped 2024-05-14T10:21:20.663 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-14T10:21:20.663 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:21:21.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-05-14T10:21:21.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-05-14T10:21:26.764 INFO:tasks.ceph.osd.5:Stopped 2024-05-14T10:21:26.765 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-14T10:21:26.765 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:21:26.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-14T10:21:26.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-05-14T10:21:32.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-14T10:21:32.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-14T10:21:32.867 INFO:tasks.ceph.osd.6:Stopped 2024-05-14T10:21:32.867 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-14T10:21:32.868 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:21:37.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-05-14T10:21:37.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-14T10:21:38.969 INFO:tasks.ceph.osd.7:Stopped 2024-05-14T10:21:38.970 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-14T10:21:38.970 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-14T10:21:38.970 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:21:43.349 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-05-14T10:21:43.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-05-14T10:21:45.072 INFO:tasks.ceph.mgr.y:Stopped 2024-05-14T10:21:45.072 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-14T10:21:45.073 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:21:48.652 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-05-14T10:21:48.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-05-14T10:21:51.175 INFO:tasks.ceph.mgr.x:Stopped 2024-05-14T10:21:51.175 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-14T10:21:51.176 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-14T10:21:51.176 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:21:51.486 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:21:51.489 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:21:53.856 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-05-14T10:21:53.857 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-05-14T10:21:57.277 INFO:tasks.ceph.mon.a:Stopped 2024-05-14T10:21:57.278 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-14T10:21:57.278 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:21:58.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-05-14T10:21:58.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-05-14T10:22:03.380 INFO:tasks.ceph.mon.b:Stopped 2024-05-14T10:22:03.381 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-14T10:22:03.381 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:22:03.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-05-14T10:22:03.961 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-05-14T10:22:08.962 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~5s 2024-05-14T10:22:09.482 INFO:tasks.ceph.mon.c:Stopped 2024-05-14T10:22:09.483 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-14T10:22:09.483 DEBUG:teuthology.orchestra.run.smithi154:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-05-14T10:22:09.606 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi154.front.sepia.ceph.com 2024-05-14T10:22:09.607 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-14T10:22:09.813 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi154.front.sepia.ceph.com 2024-05-14T10:22:09.813 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-14T10:22:10.047 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi154.front.sepia.ceph.com 2024-05-14T10:22:10.047 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-14T10:22:10.309 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi154.front.sepia.ceph.com 2024-05-14T10:22:10.310 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-14T10:22:10.580 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi176.front.sepia.ceph.com 2024-05-14T10:22:10.580 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-14T10:22:10.799 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi176.front.sepia.ceph.com 2024-05-14T10:22:10.800 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-14T10:22:11.047 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi176.front.sepia.ceph.com 2024-05-14T10:22:11.048 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-14T10:22:11.261 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi176.front.sepia.ceph.com 2024-05-14T10:22:11.261 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-14T10:22:11.494 INFO:tasks.ceph:Archiving mon data... 2024-05-14T10:22:11.496 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi/7705395/data/mon.a.tgz 2024-05-14T10:22:11.496 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-05-14T10:22:11.503 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.s91pGHeFfU 2024-05-14T10:22:11.503 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.s91pGHeFfU 2024-05-14T10:22:11.688 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.s91pGHeFfU 2024-05-14T10:22:11.828 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.s91pGHeFfU is 602KB 2024-05-14T10:22:11.892 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.s91pGHeFfU 2024-05-14T10:22:11.898 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi/7705395/data/mon.b.tgz 2024-05-14T10:22:11.898 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-05-14T10:22:11.904 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.9m1AljzNMc 2024-05-14T10:22:11.905 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.9m1AljzNMc 2024-05-14T10:22:12.069 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.9m1AljzNMc 2024-05-14T10:22:12.174 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.9m1AljzNMc is 617KB 2024-05-14T10:22:12.195 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.9m1AljzNMc 2024-05-14T10:22:12.200 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi/7705395/data/mon.c.tgz 2024-05-14T10:22:12.201 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-05-14T10:22:12.247 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.5QhzMUJOvK 2024-05-14T10:22:12.248 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.5QhzMUJOvK 2024-05-14T10:22:12.412 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.5QhzMUJOvK 2024-05-14T10:22:12.477 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.5QhzMUJOvK is 617KB 2024-05-14T10:22:12.538 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.5QhzMUJOvK 2024-05-14T10:22:12.543 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-14T10:22:12.544 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-14T10:22:12.546 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-14T10:22:12.645 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-14T10:22:12.656 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-14T10:22:12.656 INFO:tasks.ceph:Archiving crash dumps... 2024-05-14T10:22:12.658 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi/7705395/remote/smithi154/crash 2024-05-14T10:22:12.659 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-14T10:22:12.703 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi/7705395/remote/smithi176/crash 2024-05-14T10:22:12.704 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-14T10:22:12.717 INFO:tasks.ceph:Shutting down logrotate 2024-05-14T10:22:12.717 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:22:12.751 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:22:12.797 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-14T10:22:12.851 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-14T10:22:12.874 INFO:tasks.ceph:Compressing logs... 2024-05-14T10:22:12.875 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-14T10:22:12.895 DEBUG:teuthology.orchestra.run.smithi176:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-14T10:22:12.908 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36023.log 2024-05-14T10:22:12.909 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189952.log 2024-05-14T10:22:12.909 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419151.log 2024-05-14T10:22:12.910 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317062.log 2024-05-14T10:22:12.910 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201492.log 2024-05-14T10:22:12.911 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163284.log 2024-05-14T10:22:12.911 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87166.log 2024-05-14T10:22:12.911 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27826.log 2024-05-14T10:22:12.912 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200632.log 2024-05-14T10:22:12.912 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187047.log 2024-05-14T10:22:12.913 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431924.log 2024-05-14T10:22:12.914 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34128.log 2024-05-14T10:22:12.914 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429731.log 2024-05-14T10:22:12.914 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150903.log 2024-05-14T10:22:12.915 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190369.log 2024-05-14T10:22:12.915 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285754.log 2024-05-14T10:22:12.915 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323459.log 2024-05-14T10:22:12.916 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189952.log: /var/log/ceph/ceph-client.admin.419151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369938.log 2024-05-14T10:22:12.921 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454219.log 2024-05-14T10:22:12.922 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495667.log 2024-05-14T10:22:12.922 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299533.log 2024-05-14T10:22:12.922 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441326.log 2024-05-14T10:22:12.922 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.431924.log: /var/log/ceph/ceph-client.admin.429731.log: /var/log/ceph/ceph-client.admin.317062.log: /var/log/ceph/ceph-client.admin.87166.log: /var/log/ceph/ceph-client.admin.190369.log: /var/log/ceph/ceph-client.admin.187047.log: /var/log/ceph/ceph-client.admin.323459.log: /var/log/ceph/ceph-client.admin.285754.log: gzip/var/log/ceph/ceph-client.admin.299533.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.201501.log 2024-05-14T10:22:12.922 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163284.log: /var/log/ceph/ceph-client.admin.34128.log: /var/log/ceph/ceph-client.admin.150903.log: /var/log/ceph/ceph-client.admin.27826.log: /var/log/ceph/ceph-client.admin.201492.log: /var/log/ceph/ceph-client.admin.200632.log: /var/log/ceph/ceph-client.admin.369938.log: /var/log/ceph/ceph-client.admin.441326.log: /var/log/ceph/ceph-client.admin.454219.log: /var/log/ceph/ceph-client.admin.495667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169374.log 2024-05-14T10:22:12.922 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.201501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35202.log 2024-05-14T10:22:12.922 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.495667.log.gz 2024-05-14T10:22:12.923 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410744.log 2024-05-14T10:22:12.923 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83634.log 2024-05-14T10:22:12.923 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.410744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177700.log 2024-05-14T10:22:12.923 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.83634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427133.log 2024-05-14T10:22:12.923 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404815.log 2024-05-14T10:22:12.923 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.427133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299092.log 2024-05-14T10:22:12.923 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.404815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308984.log 2024-05-14T10:22:12.923 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.299092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361885.log 2024-05-14T10:22:12.924 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.308984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333745.log 2024-05-14T10:22:12.924 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.361885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422781.log 2024-05-14T10:22:12.924 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.333745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148308.log 2024-05-14T10:22:12.924 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185652.log 2024-05-14T10:22:12.949 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.422781.log: /var/log/ceph/ceph-client.admin.148308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165439.log 2024-05-14T10:22:12.949 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121733.log 2024-05-14T10:22:12.949 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146675.log 2024-05-14T10:22:12.949 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.87166.log.gz 2024-05-14T10:22:12.949 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420467.log 2024-05-14T10:22:12.949 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304823.log 2024-05-14T10:22:12.950 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.420467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364504.log 2024-05-14T10:22:12.950 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.304823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387231.log 2024-05-14T10:22:12.950 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.364504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196525.log 2024-05-14T10:22:12.950 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.387231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329509.log 2024-05-14T10:22:12.950 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.196525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214021.log 2024-05-14T10:22:12.950 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.329509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93610.log 2024-05-14T10:22:12.950 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.214021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470430.log 2024-05-14T10:22:12.950 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.93610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34323.log 2024-05-14T10:22:12.951 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.470430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397557.log 2024-05-14T10:22:12.951 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454848.log 2024-05-14T10:22:12.951 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.285754.log.gz 2024-05-14T10:22:12.951 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.397557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345580.log 2024-05-14T10:22:12.951 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.454848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198182.log 2024-05-14T10:22:12.951 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.345580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167618.log 2024-05-14T10:22:12.951 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.198182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230040.log 2024-05-14T10:22:12.951 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33595.log 2024-05-14T10:22:12.952 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108637.log 2024-05-14T10:22:12.952 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.230040.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.441326.log.gz 2024-05-14T10:22:12.952 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494874.log 2024-05-14T10:22:12.952 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461381.log 2024-05-14T10:22:12.952 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.494874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93200.log 2024-05-14T10:22:12.952 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.461381.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.494874.log.gz 2024-05-14T10:22:12.952 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291491.log 2024-05-14T10:22:12.952 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.93200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230457.log 2024-05-14T10:22:12.953 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.291491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130723.log 2024-05-14T10:22:12.953 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.230457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221710.log 2024-05-14T10:22:12.953 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130723.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-14T10:22:12.953 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.221710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410735.log 2024-05-14T10:22:12.953 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110731.log 2024-05-14T10:22:12.953 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.410735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298675.log 2024-05-14T10:22:12.953 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130480.log 2024-05-14T10:22:12.953 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.427133.log.gz 2024-05-14T10:22:12.953 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.298675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302785.log 2024-05-14T10:22:12.954 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461798.log 2024-05-14T10:22:12.954 INFO:teuthology.orchestra.run.smithi154.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.93610.log.gz 2024-05-14T10:22:12.954 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.429731.log.gz 2024-05-14T10:22:12.954 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.302785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181927.log 2024-05-14T10:22:12.954 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.461798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214446.log 2024-05-14T10:22:12.954 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361072.log 2024-05-14T10:22:12.954 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.214446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34139.log 2024-05-14T10:22:12.954 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.361072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335640.log 2024-05-14T10:22:12.955 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.404815.log.gz 2024-05-14T10:22:12.955 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183190.log 2024-05-14T10:22:12.955 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.335640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151712.log 2024-05-14T10:22:12.955 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184005.log 2024-05-14T10:22:12.955 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119214.log 2024-05-14T10:22:12.955 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243045.log 2024-05-14T10:22:12.955 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.119214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33565.log 2024-05-14T10:22:12.955 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.243045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285336.log 2024-05-14T10:22:12.956 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35202.log.gz 2024-05-14T10:22:12.956 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327743.log 2024-05-14T10:22:12.956 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.285336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476817.log 2024-05-14T10:22:12.956 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.327743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229641.log 2024-05-14T10:22:12.956 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.476817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197741.log 2024-05-14T10:22:12.956 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.229641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161524.log 2024-05-14T10:22:12.956 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.197741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299083.log 2024-05-14T10:22:12.956 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.317062.log.gz 2024-05-14T10:22:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37123.log 2024-05-14T10:22:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.299083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495305.log 2024-05-14T10:22:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166741.log 2024-05-14T10:22:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406875.log 2024-05-14T10:22:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166741.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.495305.log.gz 2024-05-14T10:22:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347731.log 2024-05-14T10:22:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.406875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407697.log 2024-05-14T10:22:12.957 INFO:teuthology.orchestra.run.smithi154.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.333745.log.gz 2024-05-14T10:22:12.957 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.347731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456490.log 2024-05-14T10:22:12.958 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.407697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206964.log 2024-05-14T10:22:12.958 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.456490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413697.log 2024-05-14T10:22:12.958 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321354.log 2024-05-14T10:22:12.958 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.206964.log: /var/log/ceph/ceph-client.admin.413697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153427.log 2024-05-14T10:22:12.958 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.321354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293547.log 2024-05-14T10:22:12.958 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469537.log 2024-05-14T10:22:12.958 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.293547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414117.log 2024-05-14T10:22:12.958 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.469537.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.168492.log 2024-05-14T10:22:12.959 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.189952.log.gz 2024-05-14T10:22:12.959 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.414117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476006.log 2024-05-14T10:22:12.959 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436507.log 2024-05-14T10:22:12.959 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.476006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372402.log 2024-05-14T10:22:12.959 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.436507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230856.log 2024-05-14T10:22:12.959 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.372402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468206.log 2024-05-14T10:22:12.959 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.230856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234601.log 2024-05-14T10:22:12.959 INFO:teuthology.orchestra.run.smithi154.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.422781.log.gz 2024-05-14T10:22:12.960 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.468206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215061.log 2024-05-14T10:22:12.960 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.234601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371571.log 2024-05-14T10:22:12.960 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.215061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398364.log 2024-05-14T10:22:12.960 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.371571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445077.log 2024-05-14T10:22:12.960 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.398364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436923.log 2024-05-14T10:22:12.960 INFO:teuthology.orchestra.run.smithi154.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.470430.log.gz 2024-05-14T10:22:12.960 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.445077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307348.log 2024-05-14T10:22:12.960 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.436923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185643.log 2024-05-14T10:22:12.960 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.307348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434456.log 2024-05-14T10:22:12.961 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193399.log 2024-05-14T10:22:12.961 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.434456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113707.log 2024-05-14T10:22:12.961 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388076.log 2024-05-14T10:22:12.976 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-14T10:22:12.976 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33363.log 2024-05-14T10:22:12.976 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-14T10:22:12.977 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27822.log 2024-05-14T10:22:12.977 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.33363.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27918.log 2024-05-14T10:22:12.977 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.27822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27846.log 2024-05-14T10:22:12.977 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-14T10:22:12.977 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.27918.log: /var/log/ceph/ceph-client.admin.27846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27943.log 2024-05-14T10:22:12.977 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-14T10:22:12.977 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.27943.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-14T10:22:12.977 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-14T10:22:12.977 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27894.log 2024-05-14T10:22:12.978 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-14T10:22:12.978 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.27894.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-14T10:22:12.978 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33482.log 2024-05-14T10:22:12.978 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27870.log 2024-05-14T10:22:12.978 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.3.33482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27774.log 2024-05-14T10:22:12.978 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.27870.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-14T10:22:12.978 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.27774.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-14T10:22:12.978 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-14T10:22:12.979 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27798.log 2024-05-14T10:22:12.980 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.27798.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-14T10:22:12.993 INFO:teuthology.orchestra.run.smithi176.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27822.log.gz 2024-05-14T10:22:12.993 INFO:teuthology.orchestra.run.smithi176.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27870.log.gz 2024-05-14T10:22:12.993 INFO:teuthology.orchestra.run.smithi176.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27894.log.gz 2024-05-14T10:22:12.998 INFO:teuthology.orchestra.run.smithi176.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27846.log.gz 2024-05-14T10:22:13.005 INFO:teuthology.orchestra.run.smithi176.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.1.33363.log.gz 2024-05-14T10:22:13.006 INFO:teuthology.orchestra.run.smithi176.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.3.33482.log.gz 2024-05-14T10:22:13.006 INFO:teuthology.orchestra.run.smithi176.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.27918.log.gz 2024-05-14T10:22:13.006 INFO:teuthology.orchestra.run.smithi176.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.27943.log.gz 2024-05-14T10:22:13.118 INFO:teuthology.orchestra.run.smithi176.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27774.log.gz 2024-05-14T10:22:13.118 INFO:teuthology.orchestra.run.smithi176.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.27798.log.gz 2024-05-14T10:22:13.317 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35731.log 2024-05-14T10:22:13.318 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.388076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361894.log 2024-05-14T10:22:13.318 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367028.log 2024-05-14T10:22:13.318 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.361894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369539.log 2024-05-14T10:22:13.318 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.367028.log: 88.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.34128.log.gz --verbose 2024-05-14T10:22:13.318 INFO:teuthology.orchestra.run.smithi154.stderr: -- /var/log/ceph/ceph-client.admin.37683.log 2024-05-14T10:22:13.318 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.369539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36153.log 2024-05-14T10:22:13.319 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37300.log 2024-05-14T10:22:13.319 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456073.log 2024-05-14T10:22:13.319 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37300.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.323459.log.gz 2024-05-14T10:22:13.319 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98236.log 2024-05-14T10:22:13.319 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.456073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297868.log 2024-05-14T10:22:13.319 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366585.log 2024-05-14T10:22:13.319 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.297868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358084.log 2024-05-14T10:22:13.319 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.366585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318414.log 2024-05-14T10:22:13.320 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.358084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36863.log 2024-05-14T10:22:13.320 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.318414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156472.log 2024-05-14T10:22:13.320 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193846.log 2024-05-14T10:22:13.320 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158084.log 2024-05-14T10:22:13.320 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37787.log 2024-05-14T10:22:13.320 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477655.log 2024-05-14T10:22:13.320 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.308984.log.gz 2024-05-14T10:22:13.320 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436914.log 2024-05-14T10:22:13.320 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.477655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347740.log 2024-05-14T10:22:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.436914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436516.log 2024-05-14T10:22:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.347740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399180.log 2024-05-14T10:22:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.436516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33511.log 2024-05-14T10:22:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131131.log 2024-05-14T10:22:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.399180.log: /var/log/ceph/ceph-client.admin.33511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83166.log 2024-05-14T10:22:13.321 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.299533.log.gz 2024-05-14T10:22:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362203.log 2024-05-14T10:22:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.83166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346887.log 2024-05-14T10:22:13.322 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.362203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413298.log 2024-05-14T10:22:13.322 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.346887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205232.log 2024-05-14T10:22:13.322 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.187047.log.gz 2024-05-14T10:22:13.322 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.413298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158891.log 2024-05-14T10:22:13.322 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.205232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472086.log 2024-05-14T10:22:13.322 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318423.log 2024-05-14T10:22:13.322 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.472086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233322.log 2024-05-14T10:22:13.322 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.318423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495591.log 2024-05-14T10:22:13.323 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.233322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112458.log 2024-05-14T10:22:13.323 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36941.log 2024-05-14T10:22:13.323 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.361885.log.gz 2024-05-14T10:22:13.323 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.495591.log.gz 2024-05-14T10:22:13.323 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398781.log 2024-05-14T10:22:13.323 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369947.log 2024-05-14T10:22:13.323 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.398781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495227.log 2024-05-14T10:22:13.323 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.369947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245207.log 2024-05-14T10:22:13.324 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224588.log 2024-05-14T10:22:13.324 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.245207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245216.log 2024-05-14T10:22:13.324 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.495227.log.gz 2024-05-14T10:22:13.324 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.224588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198590.log 2024-05-14T10:22:13.324 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.245216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349449.log 2024-05-14T10:22:13.324 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.198590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174430.log 2024-05-14T10:22:13.324 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.349449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352297.log 2024-05-14T10:22:13.324 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174430.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-14T10:22:13.324 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.352297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244802.log 2024-05-14T10:22:13.325 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196117.log 2024-05-14T10:22:13.325 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.244802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473466.log 2024-05-14T10:22:13.325 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.196117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34687.log 2024-05-14T10:22:13.325 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.473466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383916.log 2024-05-14T10:22:13.325 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328211.log 2024-05-14T10:22:13.325 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.383916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425898.log 2024-05-14T10:22:13.325 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.328211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212743.log 2024-05-14T10:22:13.325 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.425898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474302.log 2024-05-14T10:22:13.326 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.212743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36915.log 2024-05-14T10:22:13.326 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.474302.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.369938.log.gz 2024-05-14T10:22:13.326 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478501.log 2024-05-14T10:22:13.326 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434447.log 2024-05-14T10:22:13.326 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.478501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36707.log 2024-05-14T10:22:13.326 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.434447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491437.log 2024-05-14T10:22:13.326 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351880.log 2024-05-14T10:22:13.326 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.491437.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.93191.log 2024-05-14T10:22:13.327 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.351880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383925.log 2024-05-14T10:22:13.327 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.93191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485398.log 2024-05-14T10:22:13.327 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.383925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79231.log 2024-05-14T10:22:13.327 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378194.log 2024-05-14T10:22:13.327 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.485398.log: /var/log/ceph/ceph-client.admin.79231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79639.log 2024-05-14T10:22:13.327 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.230040.log.gz 2024-05-14T10:22:13.327 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196108.log 2024-05-14T10:22:13.327 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.378194.log: /var/log/ceph/ceph-client.admin.79639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403557.log 2024-05-14T10:22:13.328 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.229641.log.gz 2024-05-14T10:22:13.328 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.196108.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.230856.log.gz 2024-05-14T10:22:13.328 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176062.log 2024-05-14T10:22:13.328 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.403557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416440.log 2024-05-14T10:22:13.328 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.230457.log.gz 2024-05-14T10:22:13.328 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293967.log 2024-05-14T10:22:13.328 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.416440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177691.log 2024-05-14T10:22:13.328 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.293967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35783.log 2024-05-14T10:22:13.328 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201901.log 2024-05-14T10:22:13.329 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285745.log 2024-05-14T10:22:13.329 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330831.log 2024-05-14T10:22:13.329 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.201901.log: /var/log/ceph/ceph-client.admin.285745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184413.log 2024-05-14T10:22:13.329 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.330831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413289.log 2024-05-14T10:22:13.329 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225010.log 2024-05-14T10:22:13.329 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.413289.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.177700.log.gz 2024-05-14T10:22:13.329 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402698.log 2024-05-14T10:22:13.329 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.225010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220066.log 2024-05-14T10:22:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.402698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179777.log 2024-05-14T10:22:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.220066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83625.log 2024-05-14T10:22:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404415.log 2024-05-14T10:22:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.83625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301157.log 2024-05-14T10:22:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.404415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37709.log 2024-05-14T10:22:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.301157.log: gzip 80.8% -- replaced with /var/log/ceph/ceph-client.admin.167618.log.gz -5 2024-05-14T10:22:13.330 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.310635.log 2024-05-14T10:22:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303192.log 2024-05-14T10:22:13.331 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.190369.log.gz 2024-05-14T10:22:13.331 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.310635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33725.log 2024-05-14T10:22:13.331 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.303192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161965.log 2024-05-14T10:22:13.331 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37510.log 2024-05-14T10:22:13.331 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321363.log 2024-05-14T10:22:13.331 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161965.log: /var/log/ceph/ceph-client.admin.37510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214455.log 2024-05-14T10:22:13.331 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.196525.log.gz 2024-05-14T10:22:13.331 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.321363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400018.log 2024-05-14T10:22:13.331 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.214455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353132.log 2024-05-14T10:22:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.400018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34768.log 2024-05-14T10:22:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.353132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406466.log 2024-05-14T10:22:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161974.log 2024-05-14T10:22:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.406466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124324.log 2024-05-14T10:22:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210633.log 2024-05-14T10:22:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99475.log 2024-05-14T10:22:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.210633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156058.log 2024-05-14T10:22:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388085.log 2024-05-14T10:22:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171978.log 2024-05-14T10:22:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.388085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374900.log 2024-05-14T10:22:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225414.log 2024-05-14T10:22:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.374900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436093.log 2024-05-14T10:22:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.225414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415492.log 2024-05-14T10:22:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.436093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173206.log 2024-05-14T10:22:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.415492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288213.log 2024-05-14T10:22:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377382.log 2024-05-14T10:22:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.288213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434039.log 2024-05-14T10:22:13.334 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.377382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385153.log 2024-05-14T10:22:13.334 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.434039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351473.log 2024-05-14T10:22:13.334 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.385153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174838.log 2024-05-14T10:22:13.334 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.351473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407274.log 2024-05-14T10:22:13.334 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222128.log 2024-05-14T10:22:13.334 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.407274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311456.log 2024-05-14T10:22:13.334 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.222128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305651.log 2024-05-14T10:22:13.334 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.311456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96530.log 2024-05-14T10:22:13.334 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.305651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157478.log 2024-05-14T10:22:13.335 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.96530.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.415008.log 2024-05-14T10:22:13.335 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.157478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482392.log 2024-05-14T10:22:13.335 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.415008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481528.log 2024-05-14T10:22:13.335 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.482392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36337.log 2024-05-14T10:22:13.335 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.481528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484957.log 2024-05-14T10:22:13.335 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295305.log 2024-05-14T10:22:13.335 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.484957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206564.log 2024-05-14T10:22:13.335 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.295305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487162.log 2024-05-14T10:22:13.336 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.108637.log.gz 2024-05-14T10:22:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.206564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311035.log 2024-05-14T10:22:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.487162.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.308166.log 2024-05-14T10:22:13.336 INFO:teuthology.orchestra.run.smithi154.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.110731.log.gz 2024-05-14T10:22:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.311035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95706.log 2024-05-14T10:22:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325926.log 2024-05-14T10:22:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.308166.log: /var/log/ceph/ceph-client.admin.95706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442151.log 2024-05-14T10:22:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.325926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120039.log 2024-05-14T10:22:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.442151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428397.log 2024-05-14T10:22:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386408.log 2024-05-14T10:22:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308584.log 2024-05-14T10:22:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.428397.log: /var/log/ceph/ceph-client.admin.386408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321803.log 2024-05-14T10:22:13.337 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.121733.log.gz 2024-05-14T10:22:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.308584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425088.log 2024-05-14T10:22:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.321803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438243.log 2024-05-14T10:22:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.425088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329918.log 2024-05-14T10:22:13.338 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.438243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102740.log 2024-05-14T10:22:13.338 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.329918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34138.log 2024-05-14T10:22:13.338 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492328.log 2024-05-14T10:22:13.338 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478931.log 2024-05-14T10:22:13.338 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.492328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225001.log 2024-05-14T10:22:13.338 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.478931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204824.log 2024-05-14T10:22:13.338 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120893.log 2024-05-14T10:22:13.338 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.225001.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.346887.log.gz 2024-05-14T10:22:13.339 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.204824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147487.log 2024-05-14T10:22:13.339 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162401.log 2024-05-14T10:22:13.339 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308575.log 2024-05-14T10:22:13.339 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376969.log 2024-05-14T10:22:13.339 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.308575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423388.log 2024-05-14T10:22:13.339 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.376969.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.364504.log.gz 2024-05-14T10:22:13.339 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304007.log 2024-05-14T10:22:13.339 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.423388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234169.log 2024-05-14T10:22:13.339 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.304007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127499.log 2024-05-14T10:22:13.340 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.234169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82306.log 2024-05-14T10:22:13.340 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205653.log 2024-05-14T10:22:13.340 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.82306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447097.log 2024-05-14T10:22:13.340 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.205653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86358.log 2024-05-14T10:22:13.340 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.447097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215498.log 2024-05-14T10:22:13.340 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.86358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397092.log 2024-05-14T10:22:13.340 INFO:teuthology.orchestra.run.smithi154.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.298675.log.gz 2024-05-14T10:22:13.340 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.215498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491848.log 2024-05-14T10:22:13.340 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.397092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327337.log 2024-05-14T10:22:13.340 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.491848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370763.log 2024-05-14T10:22:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.327337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358075.log 2024-05-14T10:22:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.370763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431515.log 2024-05-14T10:22:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.358075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494822.log 2024-05-14T10:22:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.431515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35672.log 2024-05-14T10:22:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.494822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389529.log 2024-05-14T10:22:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361063.log 2024-05-14T10:22:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.389529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104374.log 2024-05-14T10:22:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.361063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296560.log 2024-05-14T10:22:13.341 INFO:teuthology.orchestra.run.smithi154.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.299092.log.gz 2024-05-14T10:22:13.342 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427998.log 2024-05-14T10:22:13.342 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.494822.log.gz 2024-05-14T10:22:13.342 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.296560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489713.log 2024-05-14T10:22:13.342 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.427998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175246.log 2024-05-14T10:22:13.342 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.489713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351064.log 2024-05-14T10:22:13.342 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188737.log 2024-05-14T10:22:13.342 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.351064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328202.log 2024-05-14T10:22:13.342 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.397557.log.gz 2024-05-14T10:22:13.343 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203128.log 2024-05-14T10:22:13.343 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.398364.log.gz 2024-05-14T10:22:13.343 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.328202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188329.log 2024-05-14T10:22:13.343 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.203128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174022.log 2024-05-14T10:22:13.343 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156938.log 2024-05-14T10:22:13.343 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309400.log 2024-05-14T10:22:13.343 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.345580.log.gz 2024-05-14T10:22:13.343 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113285.log 2024-05-14T10:22:13.344 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.309400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186648.log 2024-05-14T10:22:13.344 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444224.log 2024-05-14T10:22:13.344 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109494.log 2024-05-14T10:22:13.344 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.444224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181078.log 2024-05-14T10:22:13.344 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81018.log 2024-05-14T10:22:13.344 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459339.log 2024-05-14T10:22:13.344 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.81018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411593.log 2024-05-14T10:22:13.344 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.431924.log.gz 2024-05-14T10:22:13.344 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.459339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466470.log 2024-05-14T10:22:13.344 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.411593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374047.log 2024-05-14T10:22:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.466470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218841.log 2024-05-14T10:22:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.374047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351482.log 2024-05-14T10:22:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.218841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425499.log 2024-05-14T10:22:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.351482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459348.log 2024-05-14T10:22:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.425499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161121.log 2024-05-14T10:22:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.459348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443786.log 2024-05-14T10:22:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97789.log 2024-05-14T10:22:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380277.log 2024-05-14T10:22:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.443786.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.302785.log.gz 2024-05-14T10:22:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33922.log 2024-05-14T10:22:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.380277.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.494692.log 2024-05-14T10:22:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226691.log 2024-05-14T10:22:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.494692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294801.log 2024-05-14T10:22:13.346 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.494692.log.gz 2024-05-14T10:22:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.226691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306073.log 2024-05-14T10:22:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.294801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35516.log 2024-05-14T10:22:13.346 INFO:teuthology.orchestra.run.smithi154.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.304823.log.gz 2024-05-14T10:22:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.306073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183996.log 2024-05-14T10:22:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35436.log 2024-05-14T10:22:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407283.log 2024-05-14T10:22:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80068.log 2024-05-14T10:22:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.407283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34479.log 2024-05-14T10:22:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.80068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495641.log 2024-05-14T10:22:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155140.log 2024-05-14T10:22:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372800.log 2024-05-14T10:22:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155140.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.495641.log.gz 2024-05-14T10:22:13.348 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93619.log 2024-05-14T10:22:13.348 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.372800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228408.log 2024-05-14T10:22:13.348 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.93619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290671.log 2024-05-14T10:22:13.348 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.228408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440694.log 2024-05-14T10:22:13.348 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.290671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101516.log 2024-05-14T10:22:13.348 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.440694.log: gzip -5 81.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.291491.log.gz 2024-05-14T10:22:13.348 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.432341.log 2024-05-14T10:22:13.348 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371989.log 2024-05-14T10:22:13.348 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.432341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314791.log 2024-05-14T10:22:13.349 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.371989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35488.log 2024-05-14T10:22:13.349 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.314791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34946.log 2024-05-14T10:22:13.349 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409448.log 2024-05-14T10:22:13.349 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227601.log 2024-05-14T10:22:13.349 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.409448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219254.log 2024-05-14T10:22:13.349 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.227601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111572.log 2024-05-14T10:22:13.349 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2%/var/log/ceph/ceph-client.admin.219254.log: -- replaced with /var/log/ceph/ceph-client.admin.407274.log.gz 2024-05-14T10:22:13.349 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419560.log 2024-05-14T10:22:13.349 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111572.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.406875.log.gz 2024-05-14T10:22:13.350 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354386.log 2024-05-14T10:22:13.350 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.419560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490584.log 2024-05-14T10:22:13.350 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.354386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478094.log 2024-05-14T10:22:13.350 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.490584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332805.log 2024-05-14T10:22:13.350 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.478094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374471.log 2024-05-14T10:22:13.350 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.410735.log.gz 2024-05-14T10:22:13.350 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.332805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200623.log 2024-05-14T10:22:13.350 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.374471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196516.log 2024-05-14T10:22:13.350 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.200623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211498.log 2024-05-14T10:22:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.196516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477247.log 2024-05-14T10:22:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.211498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246439.log 2024-05-14T10:22:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.477247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417894.log 2024-05-14T10:22:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.246439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477238.log 2024-05-14T10:22:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.417894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214012.log 2024-05-14T10:22:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.477238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33315.log 2024-05-14T10:22:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.214012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435273.log 2024-05-14T10:22:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81886.log 2024-05-14T10:22:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.435273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87583.log 2024-05-14T10:22:13.352 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.81886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466479.log 2024-05-14T10:22:13.352 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.87583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211507.log 2024-05-14T10:22:13.352 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.466479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35306.log 2024-05-14T10:22:13.352 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.211507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284927.log 2024-05-14T10:22:13.352 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.329509.log.gz 2024-05-14T10:22:13.352 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33214.log 2024-05-14T10:22:13.352 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.284927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106856.log 2024-05-14T10:22:13.352 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362523.log 2024-05-14T10:22:13.352 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.106856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318822.log 2024-05-14T10:22:13.353 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.362523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458940.log 2024-05-14T10:22:13.353 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.318822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91576.log 2024-05-14T10:22:13.353 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.458940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441734.log 2024-05-14T10:22:13.353 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91576.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-14T10:22:13.353 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.441734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145853.log 2024-05-14T10:22:13.353 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380685.log 2024-05-14T10:22:13.353 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465215.log 2024-05-14T10:22:13.353 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.380685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315640.log 2024-05-14T10:22:13.354 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.465215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456481.log 2024-05-14T10:22:13.354 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.315640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148317.log 2024-05-14T10:22:13.354 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.456481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232914.log 2024-05-14T10:22:13.354 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495435.log 2024-05-14T10:22:13.354 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.232914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298684.log 2024-05-14T10:22:13.354 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.484957.log.gz 2024-05-14T10:22:13.354 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367866.log 2024-05-14T10:22:13.354 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.298684.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.495435.log.gz 2024-05-14T10:22:13.354 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463854.log 2024-05-14T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.367866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349440.log 2024-05-14T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.463854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490152.log 2024-05-14T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.349440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460573.log 2024-05-14T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.490152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103973.log 2024-05-14T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.460573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305231.log 2024-05-14T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160684.log 2024-05-14T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.305231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381506.log 2024-05-14T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479795.log 2024-05-14T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.381506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103556.log 2024-05-14T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.479795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193837.log 2024-05-14T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35997.log 2024-05-14T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35835.log 2024-05-14T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.221710.log.gz 2024-05-14T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128948.log 2024-05-14T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.35835.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35862.log 2024-05-14T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184404.log 2024-05-14T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296551.log 2024-05-14T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478492.log 2024-05-14T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.296551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33855.log 2024-05-14T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.478492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488469.log 2024-05-14T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33855.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.86358.log.gz 2024-05-14T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78643.log 2024-05-14T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.488469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494848.log 2024-05-14T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.414117.log.gz 2024-05-14T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37538.log 2024-05-14T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.494848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111563.log 2024-05-14T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37538.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.494848.log.gz 2024-05-14T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200215.log 2024-05-14T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489295.log 2024-05-14T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.200215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369118.log 2024-05-14T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.489295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112449.log 2024-05-14T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.369118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405650.log 2024-05-14T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284524.log 2024-05-14T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.148308.log.gz 2024-05-14T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.405650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286154.log 2024-05-14T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.284524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129347.log 2024-05-14T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292317.log 2024-05-14T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.286154.log: /var/log/ceph/ceph-client.admin.129347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368265.log 2024-05-14T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.292317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331330.log 2024-05-14T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.368265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104794.log 2024-05-14T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.331330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442550.log 2024-05-14T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160154.log 2024-05-14T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.442550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329046.log 2024-05-14T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35384.log 2024-05-14T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.329046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455673.log 2024-05-14T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442142.log 2024-05-14T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.455673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372809.log 2024-05-14T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.442142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97351.log 2024-05-14T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.372809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86349.log 2024-05-14T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36442.log 2024-05-14T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.86349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246448.log 2024-05-14T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386417.log 2024-05-14T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.246448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219658.log 2024-05-14T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.386417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477646.log 2024-05-14T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.219658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94464.log 2024-05-14T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.477646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302378.log 2024-05-14T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.166741.log.gz 2024-05-14T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433640.log 2024-05-14T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.302378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84835.log 2024-05-14T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.433640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466062.log 2024-05-14T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.84835.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-14T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.466062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284515.log 2024-05-14T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235837.log 2024-05-14T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.284515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292326.log 2024-05-14T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.235837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381093.log 2024-05-14T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.292326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438234.log 2024-05-14T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.381093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479363.log 2024-05-14T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.438234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84845.log 2024-05-14T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.479363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428815.log 2024-05-14T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.84845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303599.log 2024-05-14T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.428815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218011.log 2024-05-14T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.303599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174013.log 2024-05-14T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.218011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362305.log 2024-05-14T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434855.log 2024-05-14T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.362305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292733.log 2024-05-14T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.434855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128439.log 2024-05-14T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.292733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80059.log 2024-05-14T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34531.log 2024-05-14T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.80059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158483.log 2024-05-14T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161112.log 2024-05-14T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371162.log 2024-05-14T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226244.log 2024-05-14T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.371162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311044.log 2024-05-14T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.226244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469097.log 2024-05-14T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.311044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92031.log 2024-05-14T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.469097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182366.log 2024-05-14T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199806.log 2024-05-14T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34139.log.gz 2024-05-14T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325507.log 2024-05-14T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34323.log.gz 2024-05-14T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.199806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106027.log 2024-05-14T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.325507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200224.log 2024-05-14T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.106027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189136.log 2024-05-14T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.200224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110317.log 2024-05-14T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296967.log 2024-05-14T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110740.log 2024-05-14T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.296967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220888.log 2024-05-14T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426308.log 2024-05-14T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.220888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231682.log 2024-05-14T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.426308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383507.log 2024-05-14T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.231682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353572.log 2024-05-14T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.383507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149555.log 2024-05-14T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.353572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346052.log 2024-05-14T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36785.log 2024-05-14T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.346052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119205.log 2024-05-14T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35150.log 2024-05-14T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.119205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488888.log 2024-05-14T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36967.log 2024-05-14T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.488888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421357.log 2024-05-14T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319240.log 2024-05-14T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.421357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422790.log 2024-05-14T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.319240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121308.log 2024-05-14T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.422790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205241.log 2024-05-14T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244384.log 2024-05-14T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.205241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304016.log 2024-05-14T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.244384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462609.log 2024-05-14T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.304016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166750.log 2024-05-14T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.462609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92040.log 2024-05-14T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164129.log 2024-05-14T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413706.log 2024-05-14T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433631.log 2024-05-14T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.413706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405228.log 2024-05-14T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.433631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159746.log 2024-05-14T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.405228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120451.log 2024-05-14T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.159746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27945.log 2024-05-14T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365339.log 2024-05-14T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.27945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107716.log 2024-05-14T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.365339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172789.log 2024-05-14T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219667.log 2024-05-14T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.172789.log: /var/log/ceph/ceph-client.admin.219667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414527.log 2024-05-14T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213559.log 2024-05-14T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.414527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82297.log 2024-05-14T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.213559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495513.log 2024-05-14T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.82297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319231.log 2024-05-14T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420476.log 2024-05-14T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.319231.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.495513.log.gz 2024-05-14T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480226.log 2024-05-14T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.420476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222527.log 2024-05-14T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.480226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367453.log 2024-05-14T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.222527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301166.log 2024-05-14T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.367453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122142.log 2024-05-14T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.301166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122969.log 2024-05-14T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296958.log 2024-05-14T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490143.log 2024-05-14T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.296958.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.473466.log.gz 2024-05-14T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.490143.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.474302.log.gz 2024-05-14T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287805.log 2024-05-14T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437332.log 2024-05-14T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.287805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34557.log 2024-05-14T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345174.log 2024-05-14T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.437332.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.477238.log.gz 2024-05-14T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.476817.log.gz 2024-05-14T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403566.log 2024-05-14T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.478094.log.gz 2024-05-14T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.345174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242141.log 2024-05-14T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.403566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235019.log 2024-05-14T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.242141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109903.log 2024-05-14T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.235019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34896.log 2024-05-14T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236264.log 2024-05-14T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109903.log: /var/log/ceph/ceph-client.0.34896.log: /var/log/ceph/ceph-client.admin.236264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352719.log 2024-05-14T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171114.log 2024-05-14T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.352719.log: /var/log/ceph/ceph-client.admin.171114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36311.log 2024-05-14T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437783.log 2024-05-14T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.440694.log.gz 2024-05-14T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494945.log 2024-05-14T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.437783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155581.log 2024-05-14T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.494945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361486.log 2024-05-14T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155581.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.494945.log.gz 2024-05-14T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495123.log 2024-05-14T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.361486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424196.log 2024-05-14T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440446.log 2024-05-14T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.495123.log.gz 2024-05-14T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.424196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147074.log 2024-05-14T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222119.log 2024-05-14T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.440446.log: /var/log/ceph/ceph-client.admin.147074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206555.log 2024-05-14T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.222119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430139.log 2024-05-14T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.206555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159755.log 2024-05-14T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.430139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441743.log 2024-05-14T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.159755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192968.log 2024-05-14T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.351064.log.gz 2024-05-14T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.441743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366172.log 2024-05-14T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494997.log 2024-05-14T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.351473.log.gz 2024-05-14T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.366172.log: /var/log/ceph/ceph-client.admin.192968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150427.log 2024-05-14T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.494997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242584.log 2024-05-14T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.351482.log.gz 2024-05-14T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.494997.log.gz 2024-05-14T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36390.log 2024-05-14T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.242584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397965.log 2024-05-14T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289450.log 2024-05-14T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.397965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458523.log 2024-05-14T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.289450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315208.log 2024-05-14T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.458523.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.436516.log.gz 2024-05-14T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417331.log 2024-05-14T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228816.log 2024-05-14T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.315208.log: /var/log/ceph/ceph-client.admin.417331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480666.log 2024-05-14T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.228816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367444.log 2024-05-14T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.480666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105196.log 2024-05-14T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.367444.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.469537.log.gz 2024-05-14T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96114.log 2024-05-14T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.105196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223771.log 2024-05-14T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38049.log 2024-05-14T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.223771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179768.log 2024-05-14T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.38049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335631.log 2024-05-14T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220075.log 2024-05-14T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.335631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178101.log 2024-05-14T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.220075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316593.log 2024-05-14T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182774.log 2024-05-14T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.316593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478940.log 2024-05-14T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433220.log 2024-05-14T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.478940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148721.log 2024-05-14T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.433220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213142.log 2024-05-14T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124333.log 2024-05-14T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.213142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150894.log 2024-05-14T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208661.log 2024-05-14T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.243045.log.gz 2024-05-14T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440001.log 2024-05-14T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.208661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488042.log 2024-05-14T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.440001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129356.log 2024-05-14T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.488042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153009.log 2024-05-14T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478085.log 2024-05-14T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488051.log 2024-05-14T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.478085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304832.log 2024-05-14T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.488051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35542.log 2024-05-14T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.201492.log.gz 2024-05-14T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.304832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181087.log 2024-05-14T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349002.log 2024-05-14T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454857.log 2024-05-14T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.201501.log.gz 2024-05-14T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.349002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443370.log 2024-05-14T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.454857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399597.log 2024-05-14T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.443370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330359.log 2024-05-14T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.399597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211057.log 2024-05-14T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.330359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37404.log 2024-05-14T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.211057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91113.log 2024-05-14T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152581.log 2024-05-14T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130471.log 2024-05-14T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171969.log 2024-05-14T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358492.log 2024-05-14T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333754.log 2024-05-14T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.358492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315649.log 2024-05-14T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.333754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356471.log 2024-05-14T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.315649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34119.log 2024-05-14T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.356471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33459.log 2024-05-14T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229224.log 2024-05-14T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.156058.log.gz 2024-05-14T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.488469.log.gz 2024-05-14T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242150.log 2024-05-14T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.196108.log.gz 2024-05-14T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.229224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362514.log 2024-05-14T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.242150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168938.log 2024-05-14T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.362514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34609.log 2024-05-14T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289026.log 2024-05-14T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353141.log 2024-05-14T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.289026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287796.log 2024-05-14T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.353141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463863.log 2024-05-14T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.287796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472560.log 2024-05-14T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.463863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461789.log 2024-05-14T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.472560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287397.log 2024-05-14T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.461789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346474.log 2024-05-14T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.287397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33433.log 2024-05-14T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.346474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389131.log 2024-05-14T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350330.log 2024-05-14T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.389131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35698.log 2024-05-14T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.350330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176053.log 2024-05-14T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494306.log 2024-05-14T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483254.log 2024-05-14T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.494306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457299.log 2024-05-14T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.494306.log.gz 2024-05-14T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.483254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355203.log 2024-05-14T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.457299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366594.log 2024-05-14T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.355203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431524.log 2024-05-14T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.366594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381497.log 2024-05-14T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.431524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412418.log 2024-05-14T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.381497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165867.log 2024-05-14T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.412418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438641.log 2024-05-14T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206085.log 2024-05-14T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.438641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317543.log 2024-05-14T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.206085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131140.log 2024-05-14T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.317543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476826.log 2024-05-14T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94899.log 2024-05-14T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.476826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179332.log 2024-05-14T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469106.log 2024-05-14T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368679.log 2024-05-14T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.469106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92773.log 2024-05-14T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.368679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165003.log 2024-05-14T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154291.log 2024-05-14T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35280.log 2024-05-14T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431933.log 2024-05-14T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.420467.log.gz 2024-05-14T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299935.log 2024-05-14T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.419151.log.gz 2024-05-14T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.431933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495253.log 2024-05-14T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.299935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37045.log 2024-05-14T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412817.log 2024-05-14T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424205.log 2024-05-14T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.495253.log.gz 2024-05-14T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.412817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106431.log 2024-05-14T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.424205.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.454848.log.gz 2024-05-14T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215906.log 2024-05-14T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.106431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34713.log 2024-05-14T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.215906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493875.log 2024-05-14T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100708.log 2024-05-14T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.493875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184812.log 2024-05-14T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.493875.log.gz 2024-05-14T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397548.log 2024-05-14T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.456481.log.gz 2024-05-14T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145844.log 2024-05-14T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.456490.log.gz 2024-05-14T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.397548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291904.log 2024-05-14T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292724.log 2024-05-14T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145844.log: /var/log/ceph/ceph-client.admin.291904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398772.log 2024-05-14T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.292724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106018.log 2024-05-14T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.398772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385557.log 2024-05-14T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.106018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232497.log 2024-05-14T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.385557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403965.log 2024-05-14T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.232497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100300.log 2024-05-14T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.403965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463425.log 2024-05-14T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418313.log 2024-05-14T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.463425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192509.log 2024-05-14T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.418313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326407.log 2024-05-14T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122541.log 2024-05-14T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.326407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325516.log 2024-05-14T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236706.log 2024-05-14T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.325516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85055.log 2024-05-14T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.236706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45242.log 2024-05-14T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.85055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288621.log 2024-05-14T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.120039.log.gz 2024-05-14T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493884.log 2024-05-14T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.288621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290263.log 2024-05-14T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.493884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113698.log 2024-05-14T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.290263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416914.log 2024-05-14T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176461.log 2024-05-14T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.493884.log.gz 2024-05-14T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.416914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429722.log 2024-05-14T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287388.log 2024-05-14T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.429722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430130.log 2024-05-14T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.287388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487602.log 2024-05-14T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.430130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102749.log 2024-05-14T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.487602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385566.log 2024-05-14T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211066.log 2024-05-14T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.385566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182375.log 2024-05-14T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.211066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408226.log 2024-05-14T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402689.log 2024-05-14T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.408226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414536.log 2024-05-14T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34138.log.gz 2024-05-14T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.232914.log.gz 2024-05-14T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.402689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217603.log 2024-05-14T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.414536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420002.log 2024-05-14T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.217603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294380.log 2024-05-14T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.420002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80562.log 2024-05-14T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.294380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295735.log 2024-05-14T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.80562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168929.log 2024-05-14T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.295735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452628.log 2024-05-14T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329037.log 2024-05-14T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.452628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146258.log 2024-05-14T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.329037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401807.log 2024-05-14T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192959.log 2024-05-14T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.401807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36837.log 2024-05-14T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167189.log 2024-05-14T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476405.log 2024-05-14T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.112449.log.gz 2024-05-14T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185229.log 2024-05-14T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.476405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192054.log 2024-05-14T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168055.log 2024-05-14T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91567.log 2024-05-14T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434048.log 2024-05-14T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111160.log 2024-05-14T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.434048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33829.log 2024-05-14T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78634.log 2024-05-14T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359359.log 2024-05-14T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491039.log 2024-05-14T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.359359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440437.log 2024-05-14T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.491039.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-14T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405641.log 2024-05-14T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.440437.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372393.log 2024-05-14T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.405641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458124.log 2024-05-14T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.372393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358483.log 2024-05-14T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.458124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453389.log 2024-05-14T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.358483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123891.log 2024-05-14T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35672.log.gz 2024-05-14T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35698.log.gz 2024-05-14T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.453389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163275.log 2024-05-14T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485389.log 2024-05-14T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285345.log 2024-05-14T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.485389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320511.log 2024-05-14T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33725.log.gz 2024-05-14T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.285345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376556.log 2024-05-14T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.320511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439465.log 2024-05-14T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.376556.log: /var/log/ceph/ceph-client.admin.364513.log 2024-05-14T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.439465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180213.log 2024-05-14T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.364513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149139.log 2024-05-14T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447106.log 2024-05-14T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34119.log.gz 2024-05-14T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180213.log: /var/log/ceph/ceph-client.admin.149139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108181.log 2024-05-14T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.447106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179341.log 2024-05-14T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384323.log 2024-05-14T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36494.log 2024-05-14T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.384323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417322.log 2024-05-14T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495064.log 2024-05-14T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.417322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464284.log 2024-05-14T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37865.log 2024-05-14T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.464284.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.495064.log.gz 2024-05-14T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387964.log 2024-05-14T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310218.log 2024-05-14T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.387964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491446.log 2024-05-14T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.310218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210624.log 2024-05-14T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.491446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35462.log 2024-05-14T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.210624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122550.log 2024-05-14T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495539.log 2024-05-14T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.372393.log.gz 2024-05-14T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198581.log 2024-05-14T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495539.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.372402.log.gz 2024-05-14T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427541.log 2024-05-14T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.495539.log.gz 2024-05-14T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.198581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470857.log 2024-05-14T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.427541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424605.log 2024-05-14T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.470857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484116.log 2024-05-14T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.424605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379011.log 2024-05-14T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.484116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419993.log 2024-05-14T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.379011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408632.log 2024-05-14T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.419993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235428.log 2024-05-14T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.408632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389937.log 2024-05-14T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.235428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427124.log 2024-05-14T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.389937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442559.log 2024-05-14T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.427124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494770.log 2024-05-14T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.442559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36363.log 2024-05-14T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.494770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296152.log 2024-05-14T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.494770.log.gz 2024-05-14T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397956.log 2024-05-14T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.296152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187464.log 2024-05-14T10:22:13.408 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.397956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332312.log 2024-05-14T10:22:13.408 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.404415.log.gz 2024-05-14T10:22:13.408 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479804.log 2024-05-14T10:22:13.408 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.332312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405237.log 2024-05-14T10:22:13.408 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152572.log 2024-05-14T10:22:13.408 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.479804.log: /var/log/ceph/ceph-client.admin.405237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207782.log 2024-05-14T10:22:13.408 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164566.log 2024-05-14T10:22:13.408 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.207782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201084.log 2024-05-14T10:22:13.409 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384740.log 2024-05-14T10:22:13.409 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204387.log 2024-05-14T10:22:13.409 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.201084.log: /var/log/ceph/ceph-client.admin.384740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401816.log 2024-05-14T10:22:13.409 INFO:teuthology.orchestra.run.smithi154.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.296551.log.gz 2024-05-14T10:22:13.409 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.204387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365768.log 2024-05-14T10:22:13.409 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.296958.log.gz 2024-05-14T10:22:13.409 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.401816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33621.log 2024-05-14T10:22:13.409 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.365768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409910.log 2024-05-14T10:22:13.409 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371980.log 2024-05-14T10:22:13.410 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.409910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492337.log 2024-05-14T10:22:13.410 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.371980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380268.log 2024-05-14T10:22:13.410 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.492337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345165.log 2024-05-14T10:22:13.410 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.380268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195709.log 2024-05-14T10:22:13.410 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.345165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232905.log 2024-05-14T10:22:13.410 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.367444.log.gz 2024-05-14T10:22:13.410 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.195709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426716.log 2024-05-14T10:22:13.410 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.232905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495097.log 2024-05-14T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.426716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461390.log 2024-05-14T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215489.log 2024-05-14T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.495097.log.gz 2024-05-14T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.461390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33282.log 2024-05-14T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.215489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297460.log 2024-05-14T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35966.log 2024-05-14T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.369539.log.gz 2024-05-14T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.297460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397101.log 2024-05-14T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.408632.log.gz 2024-05-14T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181519.log 2024-05-14T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.408226.log.gz 2024-05-14T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.397101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203946.log 2024-05-14T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378203.log 2024-05-14T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.203946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356063.log 2024-05-14T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.378203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495383.log 2024-05-14T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.356063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429259.log 2024-05-14T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218002.log 2024-05-14T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.304832.log.gz 2024-05-14T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.495383.log.gz 2024-05-14T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.429259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155590.log 2024-05-14T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.218002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34453.log 2024-05-14T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480235.log 2024-05-14T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429250.log 2024-05-14T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.480235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33932.log 2024-05-14T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.429250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469978.log 2024-05-14T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.485389.log.gz 2024-05-14T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183181.log 2024-05-14T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33932.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.389131.log.gz 2024-05-14T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.469978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290680.log 2024-05-14T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494744.log 2024-05-14T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.290680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474711.log 2024-05-14T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.494744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408641.log 2024-05-14T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.474711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146267.log 2024-05-14T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.494744.log.gz 2024-05-14T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.408641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195261.log 2024-05-14T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153864.log 2024-05-14T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.195261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470439.log 2024-05-14T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400009.log 2024-05-14T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.470439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403102.log 2024-05-14T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172798.log 2024-05-14T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.400009.log: /var/log/ceph/ceph-client.admin.403102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175654.log 2024-05-14T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.172798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176880.log 2024-05-14T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435264.log 2024-05-14T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465620.log 2024-05-14T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.435264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226682.log 2024-05-14T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.465620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244793.log 2024-05-14T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.226682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87175.log 2024-05-14T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.244793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359368.log 2024-05-14T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.87175.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.211507.log.gz 2024-05-14T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109503.log 2024-05-14T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.359368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232091.log 2024-05-14T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368274.log 2024-05-14T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.232091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495201.log 2024-05-14T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.214012.log.gz 2024-05-14T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.368274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490593.log 2024-05-14T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305660.log 2024-05-14T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.490593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447881.log 2024-05-14T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.495201.log.gz 2024-05-14T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.305660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245615.log 2024-05-14T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.447881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245624.log 2024-05-14T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.245615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475114.log 2024-05-14T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.245624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480657.log 2024-05-14T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.219254.log.gz 2024-05-14T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.92031.log.gz 2024-05-14T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.475114.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-14T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.480657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462197.log 2024-05-14T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169365.log 2024-05-14T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.462197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308993.log 2024-05-14T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199398.log 2024-05-14T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.308993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33406.log 2024-05-14T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.199398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489304.log 2024-05-14T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404824.log 2024-05-14T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.489304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494613.log 2024-05-14T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.404824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316112.log 2024-05-14T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.494613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131577.log 2024-05-14T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.316112.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.494613.log.gz 2024-05-14T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320090.log 2024-05-14T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131577.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.100708.log.gz 2024-05-14T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216714.log 2024-05-14T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.320090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37599.log 2024-05-14T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.216714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147496.log 2024-05-14T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194750.log 2024-05-14T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323885.log 2024-05-14T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294371.log 2024-05-14T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.323885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218424.log 2024-05-14T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.294371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235828.log 2024-05-14T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.218424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458115.log 2024-05-14T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.235828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34583.log 2024-05-14T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.477646.log.gz 2024-05-14T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.458115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473872.log 2024-05-14T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36231.log 2024-05-14T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.473872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386824.log 2024-05-14T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366181.log 2024-05-14T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.386824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107311.log 2024-05-14T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.366181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481960.log 2024-05-14T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35888.log 2024-05-14T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.481960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176871.log 2024-05-14T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35888.log: gzip 79.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.85055.log.gz -- 2024-05-14T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.368688.log 2024-05-14T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494900.log 2024-05-14T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.368688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485829.log 2024-05-14T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.494900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323876.log 2024-05-14T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.494900.log.gz 2024-05-14T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.485829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225827.log 2024-05-14T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.323876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317071.log 2024-05-14T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.225827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409049.log 2024-05-14T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.317071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406457.log 2024-05-14T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.409049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108172.log 2024-05-14T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.226682.log.gz 2024-05-14T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.406457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288204.log 2024-05-14T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367037.log 2024-05-14T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.288204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440703.log 2024-05-14T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.367037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216306.log 2024-05-14T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.440703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180641.log 2024-05-14T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.216306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149546.log 2024-05-14T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346878.log 2024-05-14T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122133.log 2024-05-14T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.346878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409901.log 2024-05-14T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464711.log 2024-05-14T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.409901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329927.log 2024-05-14T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.464711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37071.log 2024-05-14T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.329927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155149.log 2024-05-14T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.168492.log.gz 2024-05-14T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457308.log 2024-05-14T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.159755.log.gz 2024-05-14T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175237.log 2024-05-14T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.172789.log.gz 2024-05-14T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.457308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221310.log 2024-05-14T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171556.log 2024-05-14T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.221310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85886.log 2024-05-14T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331821.log 2024-05-14T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.174013.log.gz 2024-05-14T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.85886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151721.log 2024-05-14T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197333.log 2024-05-14T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.331821.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.174022.log.gz 2024-05-14T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323051.log 2024-05-14T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.197333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450927.log 2024-05-14T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.419993.log.gz 2024-05-14T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.323051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333273.log 2024-05-14T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.450927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494796.log 2024-05-14T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.333273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369127.log 2024-05-14T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.494796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495331.log 2024-05-14T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.494796.log.gz 2024-05-14T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.369127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242575.log 2024-05-14T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320502.log 2024-05-14T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.495331.log.gz 2024-05-14T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.242575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186240.log 2024-05-14T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.320502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227592.log 2024-05-14T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470848.log 2024-05-14T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.227592.log: gzip -5 --verbose 90.3% -- -- replaced with /var/log/ceph/ceph-client.admin.488051.log.gz /var/log/ceph/ceph-client.admin.415501.log 2024-05-14T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-05-14T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.470848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219245.log 2024-05-14T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.415501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224184.log 2024-05-14T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.219245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449382.log 2024-05-14T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.224184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379859.log 2024-05-14T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.449382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37247.log 2024-05-14T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.379859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34375.log 2024-05-14T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37735.log 2024-05-14T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432747.log 2024-05-14T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37735.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.147074.log.gz 2024-05-14T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482814.log 2024-05-14T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.432747.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.146675.log.gz 2024-05-14T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319639.log 2024-05-14T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.482814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302387.log 2024-05-14T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.319639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100291.log 2024-05-14T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.302387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163712.log 2024-05-14T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193408.log 2024-05-14T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231264.log 2024-05-14T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362146.log 2024-05-14T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.231264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196933.log 2024-05-14T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.362146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439057.log 2024-05-14T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.181927.log.gz 2024-05-14T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.196933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33930.log 2024-05-14T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.439057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362194.log 2024-05-14T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45216.log 2024-05-14T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.362194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158492.log 2024-05-14T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170686.log 2024-05-14T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37430.log 2024-05-14T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412409.log 2024-05-14T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86766.log 2024-05-14T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.412409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194276.log 2024-05-14T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.86766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299944.log 2024-05-14T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231273.log 2024-05-14T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.299944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411185.log 2024-05-14T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.231273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321812.log 2024-05-14T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.411185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350339.log 2024-05-14T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.321812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489704.log 2024-05-14T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.350339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108628.log 2024-05-14T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.489704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37352.log 2024-05-14T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.108628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165876.log 2024-05-14T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36993.log 2024-05-14T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371171.log 2024-05-14T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35176.log 2024-05-14T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.371171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176470.log 2024-05-14T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206973.log 2024-05-14T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362242.log 2024-05-14T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.206973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421348.log 2024-05-14T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.362242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33931.log 2024-05-14T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.421348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379020.log 2024-05-14T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326856.log 2024-05-14T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.379020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294810.log 2024-05-14T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.326856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178919.log 2024-05-14T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.294810.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.424605.log.gz 2024-05-14T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34661.log 2024-05-14T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300342.log 2024-05-14T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.424205.log.gz 2024-05-14T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204833.log 2024-05-14T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.300342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216315.log 2024-05-14T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.426308.log.gz 2024-05-14T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.204833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414126.log 2024-05-14T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.216315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85064.log 2024-05-14T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.414126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491030.log 2024-05-14T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.85064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389538.log 2024-05-14T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.491030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79648.log 2024-05-14T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.389538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460981.log 2024-05-14T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.79648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322635.log 2024-05-14T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.460981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228009.log 2024-05-14T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.322635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36577.log 2024-05-14T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.228009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487611.log 2024-05-14T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158900.log 2024-05-14T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.487611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351073.log 2024-05-14T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286567.log 2024-05-14T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.351073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213550.log 2024-05-14T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.286567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34427.log 2024-05-14T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203537.log 2024-05-14T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.213550.log: /var/log/ceph/ceph-client.admin.34427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150418.log 2024-05-14T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.203537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487153.log 2024-05-14T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217594.log 2024-05-14T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.487153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246036.log 2024-05-14T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.217594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174829.log 2024-05-14T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.356063.log.gz 2024-05-14T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.246036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431045.log 2024-05-14T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36889.log 2024-05-14T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.431045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297451.log 2024-05-14T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364926.log 2024-05-14T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36889.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.358483.log.gz 2024-05-14T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.297451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97798.log 2024-05-14T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36629.log 2024-05-14T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.364926.log: /var/log/ceph/ceph-client.admin.97798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484107.log 2024-05-14T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431054.log 2024-05-14T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36629.log: /var/log/ceph/ceph-client.admin.484107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426317.log 2024-05-14T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.431054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194741.log 2024-05-14T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.426317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288612.log 2024-05-14T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291087.log 2024-05-14T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.288612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35332.log 2024-05-14T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.291087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375726.log 2024-05-14T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376960.log 2024-05-14T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.375726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403974.log 2024-05-14T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.376960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450060.log 2024-05-14T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.403974.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.198581.log.gz 2024-05-14T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.450060.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.198182.log.gz 2024-05-14T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228825.log 2024-05-14T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.198590.log.gz 2024-05-14T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181936.log 2024-05-14T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376144.log 2024-05-14T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.228825.log: /var/log/ceph/ceph-client.admin.181936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80553.log 2024-05-14T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119620.log 2024-05-14T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.376144.log: /var/log/ceph/ceph-client.admin.80553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495023.log 2024-05-14T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.119620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241717.log 2024-05-14T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173197.log 2024-05-14T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.241717.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.495023.log.gz 2024-05-14T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306936.log 2024-05-14T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205662.log 2024-05-14T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173197.log: /var/log/ceph/ceph-client.admin.306936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178110.log 2024-05-14T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454440.log 2024-05-14T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.205662.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.206973.log.gz 2024-05-14T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34349.log 2024-05-14T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.454440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168064.log 2024-05-14T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325935.log 2024-05-14T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109912.log 2024-05-14T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.325935.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-14T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202728.log 2024-05-14T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191196.log 2024-05-14T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.202728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203137.log 2024-05-14T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223358.log 2024-05-14T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.203137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234610.log 2024-05-14T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.223358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445068.log 2024-05-14T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.151712.log.gz 2024-05-14T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.234610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175645.log 2024-05-14T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.445068.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.422232.log 2024-05-14T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416923.log 2024-05-14T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.422232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420939.log 2024-05-14T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.416923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374909.log 2024-05-14T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.420939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479372.log 2024-05-14T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.374909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415975.log 2024-05-14T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.479372.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.245615.log.gz 2024-05-14T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.245216.log.gz 2024-05-14T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.204387.log.gz 2024-05-14T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.245624.log.gz 2024-05-14T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484526.log 2024-05-14T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.196933.log.gz 2024-05-14T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.415975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36733.log 2024-05-14T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.484526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95298.log 2024-05-14T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.232091.log.gz 2024-05-14T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349858.log 2024-05-14T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389122.log 2024-05-14T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.349858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302794.log 2024-05-14T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.389122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476414.log 2024-05-14T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.302794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170677.log 2024-05-14T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.476414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121724.log 2024-05-14T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377373.log 2024-05-14T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128007.log 2024-05-14T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121724.log: /var/log/ceph/ceph-client.admin.377373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418322.log 2024-05-14T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304415.log 2024-05-14T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.418322.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33932.log.gz 2024-05-14T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318006.log 2024-05-14T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408217.log 2024-05-14T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.304415.log: /var/log/ceph/ceph-client.admin.318006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316121.log 2024-05-14T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.408217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178510.log 2024-05-14T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.316121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81009.log 2024-05-14T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401342.log 2024-05-14T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.81009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453398.log 2024-05-14T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.401342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435688.log 2024-05-14T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.453398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419142.log 2024-05-14T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.435688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227193.log 2024-05-14T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.419142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34131.log 2024-05-14T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.227193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207381.log 2024-05-14T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301573.log 2024-05-14T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.207381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202719.log 2024-05-14T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37735.log.gz 2024-05-14T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.301573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482823.log 2024-05-14T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.202719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387666.log 2024-05-14T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.482823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306482.log 2024-05-14T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.387666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198989.log 2024-05-14T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.306482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333282.log 2024-05-14T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.198989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484966.log 2024-05-14T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.333282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212734.log 2024-05-14T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.484966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35117.log 2024-05-14T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.212734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486251.log 2024-05-14T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380676.log 2024-05-14T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.486251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316584.log 2024-05-14T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.380676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324293.log 2024-05-14T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.316584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347319.log 2024-05-14T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153855.log 2024-05-14T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.324293.log: /var/log/ceph/ceph-client.admin.347319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488879.log 2024-05-14T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118336.log 2024-05-14T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.488879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215897.log 2024-05-14T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457716.log 2024-05-14T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.215897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352288.log 2024-05-14T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.457716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36416.log 2024-05-14T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.352288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465206.log 2024-05-14T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120902.log 2024-05-14T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.465206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293958.log 2024-05-14T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322228.log 2024-05-14T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.293958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328637.log 2024-05-14T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.322228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37456.log 2024-05-14T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.328637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471680.log 2024-05-14T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37456.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.154291.log.gz 2024-05-14T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167627.log 2024-05-14T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.471680.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.316112.log.gz 2024-05-14T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.316584.log.gz 2024-05-14T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167627.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.316121.log.gz 2024-05-14T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331812.log 2024-05-14T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382523.log 2024-05-14T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.331812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154300.log 2024-05-14T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.382523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98245.log 2024-05-14T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82715.log 2024-05-14T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118805.log 2024-05-14T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.82715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36811.log 2024-05-14T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422241.log 2024-05-14T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301980.log 2024-05-14T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.422241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27710.log 2024-05-14T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.301980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224175.log 2024-05-14T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.27710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388718.log 2024-05-14T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.224175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86757.log 2024-05-14T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.388718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85487.log 2024-05-14T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.86757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348194.log 2024-05-14T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.85487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400439.log 2024-05-14T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.348194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494639.log 2024-05-14T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.400439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33803.log 2024-05-14T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.494639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177281.log 2024-05-14T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33803.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.494639.log.gz 2024-05-14T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.320502.log.gz 2024-05-14T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123882.log 2024-05-14T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36075.log 2024-05-14T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35410.log 2024-05-14T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183597.log 2024-05-14T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35410.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.323051.log.gz 2024-05-14T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311465.log 2024-05-14T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191595.log 2024-05-14T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.311465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82706.log 2024-05-14T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387222.log 2024-05-14T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.82706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361477.log 2024-05-14T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.387222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189145.log 2024-05-14T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.361477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331321.log 2024-05-14T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322219.log 2024-05-14T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.331321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154708.log 2024-05-14T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.322219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300749.log 2024-05-14T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451751.log 2024-05-14T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.300749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103157.log 2024-05-14T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.451751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488460.log 2024-05-14T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370754.log 2024-05-14T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.488460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289441.log 2024-05-14T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.370754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412826.log 2024-05-14T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.289441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349849.log 2024-05-14T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.412826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187872.log 2024-05-14T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.349849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416449.log 2024-05-14T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243533.log 2024-05-14T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.416449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432332.log 2024-05-14T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428406.log 2024-05-14T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.243533.log: 90.3%/var/log/ceph/ceph-client.admin.432332.log: -- replaced with /var/log/ceph/ceph-client.admin.384740.log.gz 2024-05-14T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207372.log 2024-05-14T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.428406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436102.log 2024-05-14T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.207372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178928.log 2024-05-14T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.436102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112866.log 2024-05-14T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35914.log 2024-05-14T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130732.log 2024-05-14T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246027.log 2024-05-14T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34145.log 2024-05-14T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.246027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35041.log 2024-05-14T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306473.log 2024-05-14T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.2.35041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37273.log 2024-05-14T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.306473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190779.log 2024-05-14T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412001.log 2024-05-14T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398373.log 2024-05-14T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.412001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467761.log 2024-05-14T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.378194.log.gz 2024-05-14T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.398373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447872.log 2024-05-14T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.467761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101933.log 2024-05-14T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.447872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468657.log 2024-05-14T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169811.log 2024-05-14T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.468657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164557.log 2024-05-14T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402281.log 2024-05-14T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358947.log 2024-05-14T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.402281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35358.log 2024-05-14T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.358947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230448.log 2024-05-14T10:22:13.462 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.380685.log.gz 2024-05-14T10:22:13.462 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375317.log 2024-05-14T10:22:13.462 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.230448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162838.log 2024-05-14T10:22:13.462 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.296152.log.gz 2024-05-14T10:22:13.462 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.375317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362292.log 2024-05-14T10:22:13.462 INFO:teuthology.orchestra.run.smithi154.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.297451.log.gz 2024-05-14T10:22:13.462 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127490.log 2024-05-14T10:22:13.462 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.362292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432756.log 2024-05-14T10:22:13.463 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.297460.log.gz 2024-05-14T10:22:13.463 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127077.log 2024-05-14T10:22:13.463 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.432756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81877.log 2024-05-14T10:22:13.463 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353971.log 2024-05-14T10:22:13.463 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.81877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229233.log 2024-05-14T10:22:13.463 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.353971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170248.log 2024-05-14T10:22:13.463 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.229233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467361.log 2024-05-14T10:22:13.463 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307357.log 2024-05-14T10:22:13.463 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.467361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99466.log 2024-05-14T10:22:13.464 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.307357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471270.log 2024-05-14T10:22:13.464 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186231.log 2024-05-14T10:22:13.464 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.471270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355627.log 2024-05-14T10:22:13.464 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217131.log 2024-05-14T10:22:13.464 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.355627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235010.log 2024-05-14T10:22:13.464 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.217131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348602.log 2024-05-14T10:22:13.464 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.235010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323060.log 2024-05-14T10:22:13.464 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.348602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33751.log 2024-05-14T10:22:13.465 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.323060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286163.log 2024-05-14T10:22:13.465 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.27826.log.gz 2024-05-14T10:22:13.465 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94455.log 2024-05-14T10:22:13.465 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.286163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334199.log 2024-05-14T10:22:13.465 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495357.log 2024-05-14T10:22:13.465 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.334199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37993.log 2024-05-14T10:22:13.465 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36551.log 2024-05-14T10:22:13.465 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.495357.log.gz 2024-05-14T10:22:13.465 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164994.log 2024-05-14T10:22:13.466 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156947.log 2024-05-14T10:22:13.466 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95715.log 2024-05-14T10:22:13.466 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492751.log 2024-05-14T10:22:13.466 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208670.log 2024-05-14T10:22:13.466 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.492751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109047.log 2024-05-14T10:22:13.466 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.208670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373230.log 2024-05-14T10:22:13.466 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222949.log 2024-05-14T10:22:13.467 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.373230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129755.log 2024-05-14T10:22:13.467 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36023.log.gz 2024-05-14T10:22:13.467 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-14T10:22:13.467 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.222949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103148.log 2024-05-14T10:22:13.467 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462206.log 2024-05-14T10:22:13.467 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444215.log 2024-05-14T10:22:13.467 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.462206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440913.log 2024-05-14T10:22:13.467 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.444215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330350.log 2024-05-14T10:22:13.467 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.440913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103565.log 2024-05-14T10:22:13.468 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.330350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370355.log 2024-05-14T10:22:13.468 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156067.log 2024-05-14T10:22:13.468 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.370355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92782.log 2024-05-14T10:22:13.468 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187863.log 2024-05-14T10:22:13.468 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.92782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388305.log 2024-05-14T10:22:13.468 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119629.log 2024-05-14T10:22:13.468 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187863.log: /var/log/ceph/ceph-client.admin.388305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35594.log 2024-05-14T10:22:13.468 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.119629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202319.log 2024-05-14T10:22:13.469 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495487.log 2024-05-14T10:22:13.469 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.202319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33934.log 2024-05-14T10:22:13.469 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293538.log 2024-05-14T10:22:13.469 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33934.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.495487.log.gz 2024-05-14T10:22:13.469 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189544.log 2024-05-14T10:22:13.469 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.293538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33935.log 2024-05-14T10:22:13.469 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33433.log.gz 88.4% 2024-05-14T10:22:13.469 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33459.log.gz 2024-05-14T10:22:13.469 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189544.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33565.log.gz 2024-05-14T10:22:13.470 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494718.log 2024-05-14T10:22:13.470 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33595.log.gz 2024-05-14T10:22:13.470 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370346.log 2024-05-14T10:22:13.470 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.494718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386815.log 2024-05-14T10:22:13.470 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.494718.log.gz 2024-05-14T10:22:13.470 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.370346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360664.log 2024-05-14T10:22:13.470 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.386815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230049.log 2024-05-14T10:22:13.470 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36390.log.gz 2024-05-14T10:22:13.471 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.319648.log 2024-05-14T10:22:13.471 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.230049.log: /var/log/ceph/ceph-client.admin.360664.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36363.log.gz 2024-05-14T10:22:13.471 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36442.log.gz 2024-05-14T10:22:13.471 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94047.log 2024-05-14T10:22:13.471 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.319648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233313.log 2024-05-14T10:22:13.471 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212321.log 2024-05-14T10:22:13.471 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.233313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34127.log 2024-05-14T10:22:13.471 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.212321.log: gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36837.log.gz 2024-05-14T10:22:13.472 INFO:teuthology.orchestra.run.smithi154.stderr: -- /var/log/ceph/ceph-client.admin.457707.log 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36863.log.gz 2024-05-14T10:22:13.472 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-05-14T10:22:13.472 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96521.log 2024-05-14T10:22:13.472 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36941.log.gz 2024-05-14T10:22:13.472 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.457707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473044.log 2024-05-14T10:22:13.472 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37071.log.gz 2024-05-14T10:22:13.472 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96521.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37123.log.gz 2024-05-14T10:22:13.472 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99887.log 2024-05-14T10:22:13.472 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.473044.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37300.log.gz 2024-05-14T10:22:13.473 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186639.log 2024-05-14T10:22:13.473 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358956.log 2024-05-14T10:22:13.473 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284116.log 2024-05-14T10:22:13.473 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.358956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359801.log 2024-05-14T10:22:13.473 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.284116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37657.log 2024-05-14T10:22:13.473 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.359801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495279.log 2024-05-14T10:22:13.473 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.409049.log.gz 2024-05-14T10:22:13.473 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463026.log 2024-05-14T10:22:13.474 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111151.log 2024-05-14T10:22:13.474 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.495279.log.gz 2024-05-14T10:22:13.474 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.463026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454449.log 2024-05-14T10:22:13.474 INFO:teuthology.orchestra.run.smithi154.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.429250.log.gz 2024-05-14T10:22:13.474 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107725.log 2024-05-14T10:22:13.474 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.454449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494315.log 2024-05-14T10:22:13.474 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425907.log 2024-05-14T10:22:13.474 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.494315.log: 81.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.83625.log.gz -5 2024-05-14T10:22:13.475 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.486711.log 2024-05-14T10:22:13.475 INFO:teuthology.orchestra.run.smithi154.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.212321.log.gz 2024-05-14T10:22:13.475 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.425907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217122.log 2024-05-14T10:22:13.475 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.494315.log.gz 2024-05-14T10:22:13.475 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.486711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373643.log 2024-05-14T10:22:13.475 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.217122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425490.log 2024-05-14T10:22:13.475 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.373643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207791.log 2024-05-14T10:22:13.475 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.235828.log.gz 2024-05-14T10:22:13.476 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.425490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484535.log 2024-05-14T10:22:13.476 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.207791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346465.log 2024-05-14T10:22:13.476 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.484535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376135.log 2024-05-14T10:22:13.476 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.346465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469987.log 2024-05-14T10:22:13.476 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.376135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195700.log 2024-05-14T10:22:13.476 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.469987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159308.log 2024-05-14T10:22:13.476 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.195700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303608.log 2024-05-14T10:22:13.476 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.159308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91104.log 2024-05-14T10:22:13.477 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.303608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387955.log 2024-05-14T10:22:13.477 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.91104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475534.log 2024-05-14T10:22:13.477 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.387955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109038.log 2024-05-14T10:22:13.477 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.475534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223349.log 2024-05-14T10:22:13.477 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.109038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307757.log 2024-05-14T10:22:13.477 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.223349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345589.log 2024-05-14T10:22:13.477 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.307757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464702.log 2024-05-14T10:22:13.477 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.345589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407688.log 2024-05-14T10:22:13.477 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.464702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424614.log 2024-05-14T10:22:13.477 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.407688.log: 80.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.366172.log.gz 2024-05-14T10:22:13.478 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.439456.log 2024-05-14T10:22:13.478 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.424614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94890.log 2024-05-14T10:22:13.478 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.439456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225836.log 2024-05-14T10:22:13.478 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227184.log 2024-05-14T10:22:13.478 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.225836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426725.log 2024-05-14T10:22:13.478 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.227184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299524.log 2024-05-14T10:22:13.478 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.426725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486260.log 2024-05-14T10:22:13.478 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.299524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332321.log 2024-05-14T10:22:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.486260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215052.log 2024-05-14T10:22:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.332321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466953.log 2024-05-14T10:22:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.215052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379428.log 2024-05-14T10:22:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.466953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472835.log 2024-05-14T10:22:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.379428.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.402281.log.gz 2024-05-14T10:22:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181528.log 2024-05-14T10:22:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.472835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467770.log 2024-05-14T10:22:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481097.log 2024-05-14T10:22:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.467770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149148.log 2024-05-14T10:22:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.481097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486702.log 2024-05-14T10:22:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37156.log 2024-05-14T10:22:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.486702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190360.log 2024-05-14T10:22:13.480 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.414126.log.gz 2024-05-14T10:22:13.480 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.413298.log.gz 2024-05-14T10:22:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402290.log 2024-05-14T10:22:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147895.log 2024-05-14T10:22:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.402290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34401.log 2024-05-14T10:22:13.480 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.415975.log.gz 2024-05-14T10:22:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224597.log 2024-05-14T10:22:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221301.log 2024-05-14T10:22:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.224597.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.416449.log.gz 2024-05-14T10:22:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386004.log 2024-05-14T10:22:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.221301.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.488879.log.gz 2024-05-14T10:22:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460165.log 2024-05-14T10:22:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.386004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153418.log 2024-05-14T10:22:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.460165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35757.log 2024-05-14T10:22:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352728.log 2024-05-14T10:22:13.482 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168501.log 2024-05-14T10:22:13.482 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.352728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180204.log 2024-05-14T10:22:13.482 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233721.log 2024-05-14T10:22:13.482 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443777.log 2024-05-14T10:22:13.482 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.233721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440922.log 2024-05-14T10:22:13.482 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.443777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221719.log 2024-05-14T10:22:13.482 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.440922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35091.log 2024-05-14T10:22:13.482 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.221719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295744.log 2024-05-14T10:22:13.482 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184821.log 2024-05-14T10:22:13.483 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.295744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357170.log 2024-05-14T10:22:13.483 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406049.log 2024-05-14T10:22:13.483 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.357170.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-14T10:22:13.483 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.406049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131568.log 2024-05-14T10:22:13.483 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96123.log 2024-05-14T10:22:13.483 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.131568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34505.log 2024-05-14T10:22:13.483 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194285.log 2024-05-14T10:22:13.483 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36179.log 2024-05-14T10:22:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85895.log 2024-05-14T10:22:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36179.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-14T10:22:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.85895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208235.log 2024-05-14T10:22:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223762.log 2024-05-14T10:22:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.208235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410335.log 2024-05-14T10:22:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.223762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348185.log 2024-05-14T10:22:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.410335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473053.log 2024-05-14T10:22:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.348185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284107.log 2024-05-14T10:22:13.484 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35462.log.gz 2024-05-14T10:22:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.473053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459756.log 2024-05-14T10:22:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.284107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293131.log 2024-05-14T10:22:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.459756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98654.log 2024-05-14T10:22:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.293131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127086.log 2024-05-14T10:22:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346061.log 2024-05-14T10:22:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127086.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35888.log.gz 2024-05-14T10:22:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225423.log 2024-05-14T10:22:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.346061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235419.log 2024-05-14T10:22:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.225423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201093.log 2024-05-14T10:22:13.485 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36889.log.gz 2024-05-14T10:22:13.486 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36915.log.gz 2024-05-14T10:22:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.235419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36205.log 2024-05-14T10:22:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.201093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113294.log 2024-05-14T10:22:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385995.log 2024-05-14T10:22:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.113294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37221.log 2024-05-14T10:22:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.385995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441335.log 2024-05-14T10:22:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454210.log 2024-05-14T10:22:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.441335.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-14T10:22:13.487 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.454210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482383.log 2024-05-14T10:22:13.487 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379419.log 2024-05-14T10:22:13.487 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.482383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423796.log 2024-05-14T10:22:13.487 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.379419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403111.log 2024-05-14T10:22:13.487 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.423796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463017.log 2024-05-14T10:22:13.487 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.403111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467352.log 2024-05-14T10:22:13.487 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.463017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495617.log 2024-05-14T10:22:13.487 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.467352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475123.log 2024-05-14T10:22:13.487 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33380.log 2024-05-14T10:22:13.488 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.475123.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.495617.log.gz 2024-05-14T10:22:13.488 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353563.log 2024-05-14T10:22:13.488 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187056.log 2024-05-14T10:22:13.488 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.353563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241305.log 2024-05-14T10:22:13.488 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203955.log 2024-05-14T10:22:13.488 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.241305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118327.log 2024-05-14T10:22:13.488 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.203955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418735.log 2024-05-14T10:22:13.488 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197750.log 2024-05-14T10:22:13.489 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.418735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37019.log 2024-05-14T10:22:13.489 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.197750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153018.log 2024-05-14T10:22:13.489 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481951.log 2024-05-14T10:22:13.489 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97342.log 2024-05-14T10:22:13.489 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.481951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37839.log 2024-05-14T10:22:13.489 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449391.log 2024-05-14T10:22:13.489 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173614.log 2024-05-14T10:22:13.489 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.223358.log.gz 2024-05-14T10:22:13.489 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.449391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495149.log 2024-05-14T10:22:13.489 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37456.log.gz 2024-05-14T10:22:13.490 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474702.log 2024-05-14T10:22:13.490 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357578.log 2024-05-14T10:22:13.490 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.495149.log.gz 2024-05-14T10:22:13.490 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.474702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471671.log 2024-05-14T10:22:13.490 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.357578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357587.log 2024-05-14T10:22:13.490 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.471671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384332.log 2024-05-14T10:22:13.490 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.325935.log.gz 2024-05-14T10:22:13.490 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.357587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298276.log 2024-05-14T10:22:13.491 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.326856.log.gz 2024-05-14T10:22:13.491 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.384332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444638.log 2024-05-14T10:22:13.491 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.298276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183588.log 2024-05-14T10:22:13.491 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.444638.log: gzip 84.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.345165.log.gz -- 2024-05-14T10:22:13.491 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.360655.log 2024-05-14T10:22:13.491 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481519.log 2024-05-14T10:22:13.491 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.360655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415966.log 2024-05-14T10:22:13.491 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.481519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211912.log 2024-05-14T10:22:13.492 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.415966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468215.log 2024-05-14T10:22:13.492 INFO:teuthology.orchestra.run.smithi154.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.347731.log.gz 2024-05-14T10:22:13.492 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.211912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328628.log 2024-05-14T10:22:13.492 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.468215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388296.log 2024-05-14T10:22:13.492 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.207372.log.gz 2024-05-14T10:22:13.492 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.328628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102332.log 2024-05-14T10:22:13.492 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.388296.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.207381.log.gz 2024-05-14T10:22:13.492 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374462.log 2024-05-14T10:22:13.492 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169802.log 2024-05-14T10:22:13.493 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.374462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373634.log 2024-05-14T10:22:13.493 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466071.log 2024-05-14T10:22:13.493 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.373634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129764.log 2024-05-14T10:22:13.493 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.466071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378612.log 2024-05-14T10:22:13.493 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129764.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.221301.log.gz 2024-05-14T10:22:13.493 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173605.log 2024-05-14T10:22:13.493 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.378612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411602.log 2024-05-14T10:22:13.493 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373221.log 2024-05-14T10:22:13.494 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.411602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472095.log 2024-05-14T10:22:13.494 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.230049.log.gz 2024-05-14T10:22:13.494 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.373221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35568.log 2024-05-14T10:22:13.494 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33803.log.gz 2024-05-14T10:22:13.494 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.472095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37891.log 2024-05-14T10:22:13.601 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379868.log 2024-05-14T10:22:13.601 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189961.log 2024-05-14T10:22:13.601 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.379868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495461.log 2024-05-14T10:22:13.601 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220484.log 2024-05-14T10:22:13.601 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81465.log 2024-05-14T10:22:13.602 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.220484.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33935.log.gz 2024-05-14T10:22:13.602 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.495461.log.gz 2024-05-14T10:22:13.602 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149991.log 2024-05-14T10:22:13.602 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.81465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37761.log 2024-05-14T10:22:13.602 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421830.log 2024-05-14T10:22:13.602 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149982.log 2024-05-14T10:22:13.602 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.487153.log.gz 2024-05-14T10:22:13.602 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.421830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495175.log 2024-05-14T10:22:13.603 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34127.log.gz 2024-05-14T10:22:13.603 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349011.log 2024-05-14T10:22:13.603 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399588.log 2024-05-14T10:22:13.603 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.349011.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.495175.log.gz 2024-05-14T10:22:13.603 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100699.log 2024-05-14T10:22:13.603 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.399588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437774.log 2024-05-14T10:22:13.603 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427532.log 2024-05-14T10:22:13.603 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.437774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174421.log 2024-05-14T10:22:13.604 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.427532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297859.log 2024-05-14T10:22:13.604 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34126.log 2024-05-14T10:22:13.604 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.297859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37917.log 2024-05-14T10:22:13.604 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34126.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22857.log 2024-05-14T10:22:13.604 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220897.log 2024-05-14T10:22:13.604 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.tmp-client.admin.22857.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph.tmp-client.admin.22857.log.gz 2024-05-14T10:22:13.604 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33928.log 2024-05-14T10:22:13.604 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.220897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228417.log 2024-05-14T10:22:13.604 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110326.log 2024-05-14T10:22:13.605 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.228417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357179.log 2024-05-14T10:22:13.605 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.110326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425079.log 2024-05-14T10:22:13.605 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.357179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290272.log 2024-05-14T10:22:13.605 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.425079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35940.log 2024-05-14T10:22:13.605 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.290272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483676.log 2024-05-14T10:22:13.605 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36049.log 2024-05-14T10:22:13.605 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.483676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152134.log 2024-05-14T10:22:13.605 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96929.log 2024-05-14T10:22:13.606 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330822.log 2024-05-14T10:22:13.606 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96929.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.189544.log.gz 2024-05-14T10:22:13.606 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322644.log 2024-05-14T10:22:13.606 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.330822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448633.log 2024-05-14T10:22:13.606 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.322644.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.190360.log.gz 2024-05-14T10:22:13.606 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243975.log 2024-05-14T10:22:13.606 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.448633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147083.log 2024-05-14T10:22:13.606 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.189961.log.gz 2024-05-14T10:22:13.607 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.243975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243984.log 2024-05-14T10:22:13.607 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87574.log 2024-05-14T10:22:13.607 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.243984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96938.log 2024-05-14T10:22:13.607 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.87574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448642.log 2024-05-14T10:22:13.607 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147904.log 2024-05-14T10:22:13.607 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.448642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311868.log 2024-05-14T10:22:13.607 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36655.log 2024-05-14T10:22:13.607 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.311868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166313.log 2024-05-14T10:22:13.607 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36655.log: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.193399.log.gz 2024-05-14T10:22:13.608 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166313.log: 81.3% 83.5% -- replaced with /var/log/ceph/ceph-client.admin.193837.log.gz -- replaced with /var/log/ceph/ceph-client.admin.194276.log.gz 2024-05-14T10:22:13.608 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-05-14T10:22:13.608 INFO:teuthology.orchestra.run.smithi154.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.192959.log.gz 2024-05-14T10:22:13.608 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472826.log 2024-05-14T10:22:13.608 INFO:teuthology.orchestra.run.smithi154.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.197741.log.gz 2024-05-14T10:22:13.608 INFO:teuthology.orchestra.run.smithi154.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.194741.log.gz 2024-05-14T10:22:13.608 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233730.log 2024-05-14T10:22:13.608 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.472826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37573.log 2024-05-14T10:22:13.609 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.233730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111971.log 2024-05-14T10:22:13.609 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406058.log 2024-05-14T10:22:13.609 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.322219.log.gz 2024-05-14T10:22:13.609 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34635.log 2024-05-14T10:22:13.609 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.406058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309819.log 2024-05-14T10:22:13.609 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332796.log 2024-05-14T10:22:13.609 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.309819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166304.log 2024-05-14T10:22:13.609 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.332796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364100.log 2024-05-14T10:22:13.610 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399189.log 2024-05-14T10:22:13.610 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.364100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348593.log 2024-05-14T10:22:13.610 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.399189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103964.log 2024-05-14T10:22:13.610 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.348593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377789.log 2024-05-14T10:22:13.610 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460156.log 2024-05-14T10:22:13.610 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.377789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36603.log 2024-05-14T10:22:13.610 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.460156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414999.log 2024-05-14T10:22:13.610 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198998.log 2024-05-14T10:22:13.610 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36603.log: /var/log/ceph/ceph-client.admin.414999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458532.log 2024-05-14T10:22:13.611 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.198998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410326.log 2024-05-14T10:22:13.611 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.458532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222536.log 2024-05-14T10:22:13.611 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.410326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99053.log 2024-05-14T10:22:13.611 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.222536.log: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.373221.log.gz 2024-05-14T10:22:13.611 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475997.log 2024-05-14T10:22:13.611 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473457.log 2024-05-14T10:22:13.611 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99053.log: /var/log/ceph/ceph-client.admin.475997.log: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.373634.log.gz 2024-05-14T10:22:13.611 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185220.log 2024-05-14T10:22:13.612 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.473457.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.373643.log.gz 2024-05-14T10:22:13.612 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218415.log 2024-05-14T10:22:13.612 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364091.log 2024-05-14T10:22:13.612 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.218415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35809.log 2024-05-14T10:22:13.612 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.364091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121317.log 2024-05-14T10:22:13.612 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35809.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.293538.log.gz 2024-05-14T10:22:13.612 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37482.log 2024-05-14T10:22:13.612 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.121317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163721.log 2024-05-14T10:22:13.612 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371580.log 2024-05-14T10:22:13.613 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354803.log 2024-05-14T10:22:13.613 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.371580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232506.log 2024-05-14T10:22:13.613 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.354803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356072.log 2024-05-14T10:22:13.613 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.232506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384731.log 2024-05-14T10:22:13.613 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.356072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303201.log 2024-05-14T10:22:13.613 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440010.log 2024-05-14T10:22:13.613 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.384731.log: /var/log/ceph/ceph-client.admin.303201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437323.log 2024-05-14T10:22:13.613 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.440010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347310.log 2024-05-14T10:22:13.614 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.437323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33673.log 2024-05-14T10:22:13.614 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.347310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378603.log 2024-05-14T10:22:13.614 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469546.log 2024-05-14T10:22:13.614 INFO:teuthology.orchestra.run.smithi154.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.306473.log.gz 2024-05-14T10:22:13.614 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.306936.log.gz 2024-05-14T10:22:13.614 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.378603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286975.log 2024-05-14T10:22:13.614 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.469546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36468.log 2024-05-14T10:22:13.614 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.286975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206076.log 2024-05-14T10:22:13.614 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430547.log 2024-05-14T10:22:13.615 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.206076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362155.log 2024-05-14T10:22:13.615 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.430547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468666.log 2024-05-14T10:22:13.615 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.362155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296143.log 2024-05-14T10:22:13.615 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.468666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438650.log 2024-05-14T10:22:13.615 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.296143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189553.log 2024-05-14T10:22:13.615 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.438650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360219.log 2024-05-14T10:22:13.615 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37813.log 2024-05-14T10:22:13.615 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.360219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123425.log 2024-05-14T10:22:13.616 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104383.log 2024-05-14T10:22:13.616 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462618.log 2024-05-14T10:22:13.616 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177290.log 2024-05-14T10:22:13.616 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4%/var/log/ceph/ceph-client.admin.462618.log: -- replaced with /var/log/ceph/ceph-client.admin.222128.log.gz 2024-05-14T10:22:13.616 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231673.log 2024-05-14T10:22:13.616 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.223349.log.gz 2024-05-14T10:22:13.616 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.222536.log.gz 2024-05-14T10:22:13.616 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310227.log 2024-05-14T10:22:13.616 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.231673.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.222949.log.gz 2024-05-14T10:22:13.617 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435679.log 2024-05-14T10:22:13.617 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.310227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419551.log 2024-05-14T10:22:13.617 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.435679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104785.log 2024-05-14T10:22:13.617 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.419551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222940.log 2024-05-14T10:22:13.617 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.104785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229632.log 2024-05-14T10:22:13.617 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.225414.log.gz 2024-05-14T10:22:13.617 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.222940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35254.log 2024-05-14T10:22:13.617 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.229632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464275.log 2024-05-14T10:22:13.617 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165430.log 2024-05-14T10:22:13.618 INFO:teuthology.orchestra.run.smithi154.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.225423.log.gz 2024-05-14T10:22:13.618 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.464275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400859.log 2024-05-14T10:22:13.618 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165430.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.303192.log.gz 2024-05-14T10:22:13.618 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120048.log 2024-05-14T10:22:13.618 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35228.log 2024-05-14T10:22:13.618 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.400859.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.303201.log.gz 2024-05-14T10:22:13.618 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495565.log 2024-05-14T10:22:13.618 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187455.log 2024-05-14T10:22:13.619 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460972.log 2024-05-14T10:22:13.619 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.466071.log.gz 2024-05-14T10:22:13.619 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.495565.log.gz 2024-05-14T10:22:13.619 INFO:teuthology.orchestra.run.smithi154.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.407688.log.gz 2024-05-14T10:22:13.619 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406866.log 2024-05-14T10:22:13.619 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.460972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388709.log 2024-05-14T10:22:13.619 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.406866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118796.log 2024-05-14T10:22:13.619 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.388709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216723.log 2024-05-14T10:22:13.619 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307766.log 2024-05-14T10:22:13.620 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.299524.log.gz 2024-05-14T10:22:13.620 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.216723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381084.log 2024-05-14T10:22:13.620 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.307766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286576.log 2024-05-14T10:22:13.620 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.381084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465629.log 2024-05-14T10:22:13.620 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.286576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171123.log 2024-05-14T10:22:13.620 INFO:teuthology.orchestra.run.smithi154.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.301157.log.gz 2024-05-14T10:22:13.620 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.465629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450069.log 2024-05-14T10:22:13.620 INFO:teuthology.orchestra.run.smithi154.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.472826.log.gz 2024-05-14T10:22:13.621 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158075.log 2024-05-14T10:22:13.621 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.450069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123416.log 2024-05-14T10:22:13.621 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33777.log 2024-05-14T10:22:13.621 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320910.log 2024-05-14T10:22:13.621 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161533.log 2024-05-14T10:22:13.621 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.320910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473881.log 2024-05-14T10:22:13.621 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.96521.log.gz 2024-05-14T10:22:13.621 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161533.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.415966.log.gz 2024-05-14T10:22:13.622 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36101.log 2024-05-14T10:22:13.622 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.473881.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.96123.log.gz 2024-05-14T10:22:13.622 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459747.log 2024-05-14T10:22:13.622 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306945.log 2024-05-14T10:22:13.622 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.459747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112857.log 2024-05-14T10:22:13.622 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.306945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79240.log 2024-05-14T10:22:13.622 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.112857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360210.log 2024-05-14T10:22:13.622 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.79240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354794.log 2024-05-14T10:22:13.623 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.360210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99062.log 2024-05-14T10:22:13.623 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.354794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98645.log 2024-05-14T10:22:13.623 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494665.log 2024-05-14T10:22:13.623 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127998.log 2024-05-14T10:22:13.623 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.494665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122960.log 2024-05-14T10:22:13.623 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.494665.log.gz 2024-05-14T10:22:13.623 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33699.log 2024-05-14T10:22:13.623 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95307.log 2024-05-14T10:22:13.623 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236273.log 2024-05-14T10:22:13.624 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483245.log 2024-05-14T10:22:13.624 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.236273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128448.log 2024-05-14T10:22:13.624 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.483245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36285.log 2024-05-14T10:22:13.624 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293140.log 2024-05-14T10:22:13.624 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375308.log 2024-05-14T10:22:13.624 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.293140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325099.log 2024-05-14T10:22:13.624 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.375308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314800.log 2024-05-14T10:22:13.624 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.325099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188728.log 2024-05-14T10:22:13.625 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.314800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191187.log 2024-05-14T10:22:13.625 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400448.log 2024-05-14T10:22:13.625 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443379.log 2024-05-14T10:22:13.625 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.400448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300758.log 2024-05-14T10:22:13.625 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37993.log.gz 2024-05-14T10:22:13.625 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.443379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208226.log 2024-05-14T10:22:13.625 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.300758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33647.log 2024-05-14T10:22:13.625 INFO:teuthology.orchestra.run.smithi154.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.99053.log.gz 2024-05-14T10:22:13.626 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.425907.log.gz 2024-05-14T10:22:13.626 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.208226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458931.log 2024-05-14T10:22:13.626 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33647.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.99887.log.gz 2024-05-14T10:22:13.626 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.357578.log.gz -5 2024-05-14T10:22:13.626 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.444629.log 2024-05-14T10:22:13.626 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.458931.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.357179.log.gz 2024-05-14T10:22:13.626 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369530.log 2024-05-14T10:22:13.626 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.444629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382532.log 2024-05-14T10:22:13.626 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.369530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324284.log 2024-05-14T10:22:13.627 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.382532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320081.log 2024-05-14T10:22:13.627 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.324284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243542.log 2024-05-14T10:22:13.627 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.320081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318831.log 2024-05-14T10:22:13.627 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.243542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289859.log 2024-05-14T10:22:13.627 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.318831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37097.log 2024-05-14T10:22:13.627 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.289859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375717.log 2024-05-14T10:22:13.627 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354395.log 2024-05-14T10:22:13.628 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.375717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318015.log 2024-05-14T10:22:13.628 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.354395.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.311456.log.gz 2024-05-14T10:22:13.628 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199815.log 2024-05-14T10:22:13.628 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.318015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196924.log 2024-05-14T10:22:13.628 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.199815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101924.log 2024-05-14T10:22:13.628 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.196924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172381.log 2024-05-14T10:22:13.628 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37627.log 2024-05-14T10:22:13.628 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.172381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212330.log 2024-05-14T10:22:13.628 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172390.log 2024-05-14T10:22:13.629 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.212330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494971.log 2024-05-14T10:22:13.629 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.475997.log.gz 2024-05-14T10:22:13.629 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.172390.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.471671.log.gz 2024-05-14T10:22:13.629 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36127.log 2024-05-14T10:22:13.629 INFO:teuthology.orchestra.run.smithi154.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.473044.log.gz 2024-05-14T10:22:13.629 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.473053.log.gz 2024-05-14T10:22:13.629 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.494971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289035.log 2024-05-14T10:22:13.629 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.494971.log.gz 2024-05-14T10:22:13.629 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491857.log 2024-05-14T10:22:13.630 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.289035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385144.log 2024-05-14T10:22:13.630 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.491857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105607.log 2024-05-14T10:22:13.630 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.385144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102341.log 2024-05-14T10:22:13.630 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.105607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101107.log 2024-05-14T10:22:13.630 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202310.log 2024-05-14T10:22:13.630 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475525.log 2024-05-14T10:22:13.630 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.202310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228000.log 2024-05-14T10:22:13.630 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.475525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423787.log 2024-05-14T10:22:13.630 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.228000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376547.log 2024-05-14T10:22:13.631 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.423787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309810.log 2024-05-14T10:22:13.631 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.376547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451761.log 2024-05-14T10:22:13.631 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.309810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389946.log 2024-05-14T10:22:13.631 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.451761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481088.log 2024-05-14T10:22:13.631 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.389946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401333.log 2024-05-14T10:22:13.631 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.481088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326865.log 2024-05-14T10:22:13.631 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.401333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241314.log 2024-05-14T10:22:13.631 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.326865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192045.log 2024-05-14T10:22:13.632 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.241314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324691.log 2024-05-14T10:22:13.632 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305240.log 2024-05-14T10:22:13.632 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.324691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37378.log 2024-05-14T10:22:13.632 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.305240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284936.log 2024-05-14T10:22:13.632 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417885.log 2024-05-14T10:22:13.632 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.284936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197342.log 2024-05-14T10:22:13.632 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.417885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314392.log 2024-05-14T10:22:13.632 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.197342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234160.log 2024-05-14T10:22:13.633 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.314392.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.104785.log.gz 2024-05-14T10:22:13.633 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356480.log 2024-05-14T10:22:13.633 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.234160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334208.log 2024-05-14T10:22:13.633 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.104383.log.gz 2024-05-14T10:22:13.633 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.356480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433229.log 2024-05-14T10:22:13.633 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.334208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106847.log 2024-05-14T10:22:13.633 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.379868.log.gz 2024-05-14T10:22:13.633 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.433229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452619.log 2024-05-14T10:22:13.633 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.106847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164120.log 2024-05-14T10:22:13.634 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.452619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412010.log 2024-05-14T10:22:13.634 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308175.log 2024-05-14T10:22:13.634 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.412010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456900.log 2024-05-14T10:22:13.634 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.308175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298267.log 2024-05-14T10:22:13.634 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.456900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154699.log 2024-05-14T10:22:13.634 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.298267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301971.log 2024-05-14T10:22:13.634 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460564.log 2024-05-14T10:22:13.634 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.301971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327328.log 2024-05-14T10:22:13.635 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.460564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471261.log 2024-05-14T10:22:13.635 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.327328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291078.log 2024-05-14T10:22:13.635 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.471261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195252.log 2024-05-14T10:22:13.635 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.291078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317534.log 2024-05-14T10:22:13.635 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.195252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171565.log 2024-05-14T10:22:13.635 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.317534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309409.log 2024-05-14T10:22:13.635 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36759.log 2024-05-14T10:22:13.635 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.309409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326398.log 2024-05-14T10:22:13.635 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329518.log 2024-05-14T10:22:13.636 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.326398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320919.log 2024-05-14T10:22:13.636 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.329518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387675.log 2024-05-14T10:22:13.636 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.320919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485820.log 2024-05-14T10:22:13.636 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.387675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156481.log 2024-05-14T10:22:13.636 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.485820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374056.log 2024-05-14T10:22:13.636 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201910.log 2024-05-14T10:22:13.636 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.374056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36681.log 2024-05-14T10:22:13.636 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.201910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180650.log 2024-05-14T10:22:13.636 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105205.log 2024-05-14T10:22:13.637 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152143.log 2024-05-14T10:22:13.637 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.105205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353980.log 2024-05-14T10:22:13.637 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230865.log 2024-05-14T10:22:13.637 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.353980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37943.log 2024-05-14T10:22:13.637 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.230865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325108.log 2024-05-14T10:22:13.637 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36049.log.gz 2024-05-14T10:22:13.637 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.127086.log.gz 2024-05-14T10:22:13.637 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120460.log 2024-05-14T10:22:13.637 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.325108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94056.log 2024-05-14T10:22:13.637 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.120460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199407.log 2024-05-14T10:22:13.638 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33927.log 2024-05-14T10:22:13.638 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.199407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367857.log 2024-05-14T10:22:13.638 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218832.log 2024-05-14T10:22:13.638 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.367857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160675.log 2024-05-14T10:22:13.638 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.218832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427989.log 2024-05-14T10:22:13.638 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.418322.log.gz 2024-05-14T10:22:13.638 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146666.log 2024-05-14T10:22:13.638 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.427989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327752.log 2024-05-14T10:22:13.639 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300351.log 2024-05-14T10:22:13.639 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.327752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204396.log 2024-05-14T10:22:13.639 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.348185.log.gz 2024-05-14T10:22:13.639 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.300351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286984.log 2024-05-14T10:22:13.639 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.204396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190788.log 2024-05-14T10:22:13.639 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.286984.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.348602.log.gz 2024-05-14T10:22:13.639 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203546.log 2024-05-14T10:22:13.639 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311877.log 2024-05-14T10:22:13.639 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.203546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455664.log 2024-05-14T10:22:13.640 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.311877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324700.log 2024-05-14T10:22:13.640 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.455664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315199.log 2024-05-14T10:22:13.640 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.324700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162847.log 2024-05-14T10:22:13.640 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.315199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483685.log 2024-05-14T10:22:13.640 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442960.log 2024-05-14T10:22:13.640 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.483685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355618.log 2024-05-14T10:22:13.640 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.442960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455256.log 2024-05-14T10:22:13.640 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.355618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466944.log 2024-05-14T10:22:13.640 INFO:teuthology.orchestra.run.smithi154.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.381084.log.gz 2024-05-14T10:22:13.641 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.455256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101116.log 2024-05-14T10:22:13.641 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.466944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236715.log 2024-05-14T10:22:13.641 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439048.log 2024-05-14T10:22:13.641 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.236715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159299.log 2024-05-14T10:22:13.641 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.439048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418726.log 2024-05-14T10:22:13.641 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.159299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130172.log 2024-05-14T10:22:13.641 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.418726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241726.log 2024-05-14T10:22:13.641 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85478.log 2024-05-14T10:22:13.641 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.241726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105616.log 2024-05-14T10:22:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.85478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301564.log 2024-05-14T10:22:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.105616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226235.log 2024-05-14T10:22:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.301564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33881.log 2024-05-14T10:22:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.226235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162410.log 2024-05-14T10:22:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33537.log 2024-05-14T10:22:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162410.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.124324.log.gz 2024-05-14T10:22:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377780.log 2024-05-14T10:22:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291500.log 2024-05-14T10:22:13.643 INFO:teuthology.orchestra.run.smithi154.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.195252.log.gz 2024-05-14T10:22:13.643 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.377780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362251.log 2024-05-14T10:22:13.643 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.291500.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.208226.log.gz 2024-05-14T10:22:13.643 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409457.log 2024-05-14T10:22:13.643 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.201910.log.gz 2024-05-14T10:22:13.643 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.362251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160163.log 2024-05-14T10:22:13.643 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.409457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107302.log 2024-05-14T10:22:13.643 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83175.log 2024-05-14T10:22:13.643 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.107302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130163.log 2024-05-14T10:22:13.644 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.83175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244393.log 2024-05-14T10:22:13.644 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128939.log 2024-05-14T10:22:13.644 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.244393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409040.log 2024-05-14T10:22:13.644 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400868.log 2024-05-14T10:22:13.644 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.409040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170239.log 2024-05-14T10:22:13.644 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.400868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220475.log 2024-05-14T10:22:13.644 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492760.log 2024-05-14T10:22:13.644 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.220475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182783.log 2024-05-14T10:22:13.645 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.492760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167180.log 2024-05-14T10:22:13.645 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182783.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.118796.log.gz 2024-05-14T10:22:13.645 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178519.log 2024-05-14T10:22:13.645 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243054.log 2024-05-14T10:22:13.645 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192518.log 2024-05-14T10:22:13.645 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.243054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35646.log 2024-05-14T10:22:13.645 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213151.log 2024-05-14T10:22:13.645 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211921.log 2024-05-14T10:22:13.646 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.213151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359810.log 2024-05-14T10:22:13.646 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.211921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188320.log 2024-05-14T10:22:13.646 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.359810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474293.log 2024-05-14T10:22:13.646 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434864.log 2024-05-14T10:22:13.646 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.474293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455265.log 2024-05-14T10:22:13.646 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.434864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428806.log 2024-05-14T10:22:13.646 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.455265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463434.log 2024-05-14T10:22:13.646 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.428806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323468.log 2024-05-14T10:22:13.647 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.463434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421821.log 2024-05-14T10:22:13.647 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.323468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430538.log 2024-05-14T10:22:13.647 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.421821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306064.log 2024-05-14T10:22:13.647 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.430538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36525.log 2024-05-14T10:22:13.647 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.306064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450936.log 2024-05-14T10:22:13.647 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304424.log 2024-05-14T10:22:13.647 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.450936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411194.log 2024-05-14T10:22:13.647 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.304424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36259.log 2024-05-14T10:22:13.647 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.411194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148730.log 2024-05-14T10:22:13.648 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81456.log 2024-05-14T10:22:13.648 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157469.log 2024-05-14T10:22:13.648 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.81456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423379.log 2024-05-14T10:22:13.648 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.187455.log.gz 2024-05-14T10:22:13.648 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.157469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232082.log 2024-05-14T10:22:13.648 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.423379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37326.log 2024-05-14T10:22:13.648 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.232082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383516.log 2024-05-14T10:22:13.648 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37326.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.234160.log.gz 2024-05-14T10:22:13.649 INFO:teuthology.orchestra.run.smithi154.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.234601.log.gz 2024-05-14T10:22:13.649 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365330.log 2024-05-14T10:22:13.649 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.383516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101525.log 2024-05-14T10:22:13.649 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.365330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33485.log 2024-05-14T10:22:13.649 INFO:teuthology.orchestra.run.smithi154.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.412001.log.gz 2024-05-14T10:22:13.649 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456891.log 2024-05-14T10:22:13.649 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.33485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106440.log 2024-05-14T10:22:13.650 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.456891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310626.log 2024-05-14T10:22:13.650 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.106440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351889.log 2024-05-14T10:22:13.650 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.310626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191604.log 2024-05-14T10:22:13.650 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.457707.log.gz 2024-05-14T10:22:13.650 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.351889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198173.log 2024-05-14T10:22:13.650 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442969.log 2024-05-14T10:22:13.650 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.198173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404406.log 2024-05-14T10:22:13.650 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.442969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314383.log 2024-05-14T10:22:13.651 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.404406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495409.log 2024-05-14T10:22:13.651 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.314383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99878.log 2024-05-14T10:22:13.651 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.495409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111980.log 2024-05-14T10:22:13.651 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.495409.log.gz 2024-05-14T10:22:13.651 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472569.log 2024-05-14T10:22:13.651 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.111980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291913.log 2024-05-14T10:22:13.651 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.472569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364917.log 2024-05-14T10:22:13.651 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.291913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365759.log 2024-05-14T10:22:13.652 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.364917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420948.log 2024-05-14T10:22:13.652 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.365759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456082.log 2024-05-14T10:22:13.652 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.420948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289850.log 2024-05-14T10:22:13.652 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.456082.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.130723.log.gz 2024-05-14T10:22:13.652 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295296.log 2024-05-14T10:22:13.652 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.130732.log.gz 2024-05-14T10:22:13.652 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.289850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355212.log 2024-05-14T10:22:13.652 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.295296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35620.log 2024-05-14T10:22:13.652 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.355212.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.158483.log.gz 2024-05-14T10:22:13.653 INFO:teuthology.orchestra.run.smithi154.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.161112.log.gz 2024-05-14T10:22:13.653 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.158084.log.gz 2024-05-14T10:22:13.653 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.158492.log.gz 2024-05-14T10:22:13.653 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.162838.log.gz 2024-05-14T10:22:13.653 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35620.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35809.log.gz 2024-05-14T10:22:13.653 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.149982.log.gz 2024-05-14T10:22:13.653 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.188320.log.gz 2024-05-14T10:22:13.653 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.320910.log.gz 2024-05-14T10:22:13.654 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.322644.log.gz 2024-05-14T10:22:13.654 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37573.log.gz 2024-05-14T10:22:13.654 INFO:teuthology.orchestra.run.smithi154.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.222940.log.gz 2024-05-14T10:22:13.654 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.300758.log.gz 2024-05-14T10:22:13.654 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.308575.log.gz 2024-05-14T10:22:13.654 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34768.log.gz 2024-05-14T10:22:13.654 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35410.log.gz 2024-05-14T10:22:13.654 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.327743.log.gz 2024-05-14T10:22:13.654 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.310626.log.gz 2024-05-14T10:22:13.655 INFO:teuthology.orchestra.run.smithi154.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.401333.log.gz 2024-05-14T10:22:13.655 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.165430.log.gz 2024-05-14T10:22:13.655 INFO:teuthology.orchestra.run.smithi154.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.458931.log.gz 2024-05-14T10:22:13.655 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.459339.log.gz 2024-05-14T10:22:13.655 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.111572.log.gz 2024-05-14T10:22:13.655 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.400448.log.gz 2024-05-14T10:22:13.655 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.400868.log.gz 2024-05-14T10:22:13.655 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.101516.log.gz 2024-05-14T10:22:13.655 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.447097.log.gz 2024-05-14T10:22:13.656 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.211498.log.gz 2024-05-14T10:22:13.656 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.229632.log.gz 2024-05-14T10:22:13.656 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.230865.log.gz 2024-05-14T10:22:13.656 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.212330.log.gz 2024-05-14T10:22:13.656 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.218832.log.gz 2024-05-14T10:22:13.656 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.353980.log.gz 2024-05-14T10:22:13.656 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.354395.log.gz 2024-05-14T10:22:13.656 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33647.log.gz 2024-05-14T10:22:13.657 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33699.log.gz 2024-05-14T10:22:13.657 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33673.log.gz 2024-05-14T10:22:13.657 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.355618.log.gz 2024-05-14T10:22:13.657 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.355212.log.gz 2024-05-14T10:22:13.657 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.289850.log.gz 2024-05-14T10:22:13.657 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.361063.log.gz 2024-05-14T10:22:13.657 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.380277.log.gz 2024-05-14T10:22:13.657 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.456073.log.gz 2024-05-14T10:22:13.657 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.456082.log.gz 2024-05-14T10:22:13.658 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33537.log.gz 2024-05-14T10:22:13.658 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.97789.log.gz 2024-05-14T10:22:13.658 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37326.log.gz 2024-05-14T10:22:13.658 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.101525.log.gz 2024-05-14T10:22:13.658 INFO:teuthology.orchestra.run.smithi154.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.147895.log.gz 2024-05-14T10:22:13.658 INFO:teuthology.orchestra.run.smithi154.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.174421.log.gz 2024-05-14T10:22:13.658 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.188329.log.gz 2024-05-14T10:22:13.659 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.371989.log.gz 2024-05-14T10:22:13.659 INFO:teuthology.orchestra.run.smithi154.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.163284.log.gz 2024-05-14T10:22:13.659 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.291500.log.gz 2024-05-14T10:22:13.659 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.376969.log.gz 2024-05-14T10:22:13.659 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.367866.log.gz 2024-05-14T10:22:13.659 INFO:teuthology.orchestra.run.smithi154.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.436507.log.gz 2024-05-14T10:22:13.659 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.432341.log.gz 2024-05-14T10:22:13.659 INFO:teuthology.orchestra.run.smithi154.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.490584.log.gz 2024-05-14T10:22:13.659 INFO:teuthology.orchestra.run.smithi154.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.411593.log.gz 2024-05-14T10:22:13.660 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.407283.log.gz 2024-05-14T10:22:13.660 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.479795.log.gz 2024-05-14T10:22:13.660 INFO:teuthology.orchestra.run.smithi154.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.103556.log.gz 2024-05-14T10:22:13.660 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.477247.log.gz 2024-05-14T10:22:13.660 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.354386.log.gz 2024-05-14T10:22:13.660 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.161533.log.gz 2024-05-14T10:22:13.660 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.129764.log.gz 2024-05-14T10:22:13.660 INFO:teuthology.orchestra.run.smithi154.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.441734.log.gz 2024-05-14T10:22:13.661 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.349440.log.gz 2024-05-14T10:22:13.661 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.465215.log.gz 2024-05-14T10:22:13.661 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.284927.log.gz 2024-05-14T10:22:13.661 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35997.log.gz 2024-05-14T10:22:13.661 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.314791.log.gz 2024-05-14T10:22:13.661 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.82306.log.gz 2024-05-14T10:22:13.661 INFO:teuthology.orchestra.run.smithi154.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.315640.log.gz 2024-05-14T10:22:13.661 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.166313.log.gz 2024-05-14T10:22:13.661 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.371571.log.gz 2024-05-14T10:22:13.662 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.162410.log.gz 2024-05-14T10:22:13.662 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.215498.log.gz 2024-05-14T10:22:13.662 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.458940.log.gz 2024-05-14T10:22:13.662 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.460573.log.gz 2024-05-14T10:22:13.662 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.435273.log.gz 2024-05-14T10:22:13.662 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.103973.log.gz 2024-05-14T10:22:13.662 INFO:teuthology.orchestra.run.smithi154.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.305231.log.gz 2024-05-14T10:22:13.662 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.290671.log.gz 2024-05-14T10:22:13.663 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.227601.log.gz 2024-05-14T10:22:13.663 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.417894.log.gz 2024-05-14T10:22:13.663 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.156938.log.gz 2024-05-14T10:22:13.663 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.200623.log.gz 2024-05-14T10:22:13.663 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.206964.log.gz 2024-05-14T10:22:13.663 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.182783.log.gz 2024-05-14T10:22:13.663 INFO:teuthology.orchestra.run.smithi154.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.183996.log.gz 2024-05-14T10:22:13.663 INFO:teuthology.orchestra.run.smithi154.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.184404.log.gz 2024-05-14T10:22:13.663 INFO:teuthology.orchestra.run.smithi154.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.246439.log.gz 2024-05-14T10:22:13.667 INFO:teuthology.orchestra.run.smithi154.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.196516.log.gz 2024-05-14T10:22:13.667 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.155140.log.gz 2024-05-14T10:22:13.668 INFO:teuthology.orchestra.run.smithi154.stderr: 94.7% -- replaced with /var/log/ceph/ceph-client.admin.130480.log.gz 2024-05-14T10:22:13.668 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.160154.log.gz 2024-05-14T10:22:13.668 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37787.log.gz 2024-05-14T10:22:13.668 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33315.log.gz 2024-05-14T10:22:13.668 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33855.log.gz 2024-05-14T10:22:13.668 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.145853.log.gz 2024-05-14T10:22:13.668 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34479.log.gz 2024-05-14T10:22:13.668 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34531.log.gz 2024-05-14T10:22:13.669 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34946.log.gz 2024-05-14T10:22:13.669 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35306.log.gz 2024-05-14T10:22:13.669 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35384.log.gz 2024-05-14T10:22:13.669 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35488.log.gz 2024-05-14T10:22:13.669 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35516.log.gz 2024-05-14T10:22:13.669 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.228408.log.gz 2024-05-14T10:22:13.669 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37538.log.gz 2024-05-14T10:22:13.669 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.371162.log.gz 2024-05-14T10:22:13.670 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33214.log.gz 2024-05-14T10:22:13.670 INFO:teuthology.orchestra.run.smithi154.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.369118.log.gz 2024-05-14T10:22:13.670 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.303599.log.gz 2024-05-14T10:22:13.670 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.298684.log.gz 2024-05-14T10:22:13.670 INFO:teuthology.orchestra.run.smithi154.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.93619.log.gz 2024-05-14T10:22:13.670 INFO:teuthology.orchestra.run.smithi154.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.466062.log.gz 2024-05-14T10:22:13.670 INFO:teuthology.orchestra.run.smithi154.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.111563.log.gz 2024-05-14T10:22:13.670 INFO:teuthology.orchestra.run.smithi154.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.84835.log.gz 2024-05-14T10:22:13.671 INFO:teuthology.orchestra.run.smithi154.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.86349.log.gz 2024-05-14T10:22:13.671 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.183190.log.gz 2024-05-14T10:22:13.671 INFO:teuthology.orchestra.run.smithi154.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.388076.log.gz 2024-05-14T10:22:13.671 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.442550.log.gz 2024-05-14T10:22:13.671 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.387231.log.gz 2024-05-14T10:22:13.671 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.284515.log.gz 2024-05-14T10:22:13.671 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.284524.log.gz 2024-05-14T10:22:13.671 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.478492.log.gz 2024-05-14T10:22:13.671 INFO:teuthology.orchestra.run.smithi154.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.292317.log.gz 2024-05-14T10:22:13.672 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.292326.log.gz 2024-05-14T10:22:13.672 INFO:teuthology.orchestra.run.smithi154.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.311044.log.gz 2024-05-14T10:22:13.672 INFO:teuthology.orchestra.run.smithi154.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.219658.log.gz 2024-05-14T10:22:13.672 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.466479.log.gz 2024-05-14T10:22:13.673 INFO:teuthology.orchestra.run.smithi154.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.419560.log.gz 2024-05-14T10:22:13.676 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.169374.log.gz 2024-05-14T10:22:13.677 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.381093.log.gz 2024-05-14T10:22:13.677 INFO:teuthology.orchestra.run.smithi154.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.489295.log.gz 2024-05-14T10:22:13.678 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.455673.log.gz 2024-05-14T10:22:13.678 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36785.log.gz 2024-05-14T10:22:13.684 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.286154.log.gz 2024-05-14T10:22:13.698 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.129347.log.gz 2024-05-14T10:22:13.698 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.200215.log.gz 2024-05-14T10:22:13.699 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.220888.log.gz 2024-05-14T10:22:13.699 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.218011.log.gz 2024-05-14T10:22:13.699 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35862.log.gz 2024-05-14T10:22:13.699 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35835.log.gz 2024-05-14T10:22:13.699 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.405650.log.gz 2024-05-14T10:22:13.711 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.121308.log.gz 2024-05-14T10:22:13.719 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.325507.log.gz 2024-05-14T10:22:13.726 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.160684.log.gz 2024-05-14T10:22:13.728 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.372809.log.gz 2024-05-14T10:22:13.729 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.367453.log.gz 2024-05-14T10:22:13.729 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.368265.log.gz 2024-05-14T10:22:13.730 INFO:teuthology.orchestra.run.smithi154.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.414527.log.gz 2024-05-14T10:22:13.730 INFO:teuthology.orchestra.run.smithi154.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.231682.log.gz 2024-05-14T10:22:13.730 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.299083.log.gz 2024-05-14T10:22:13.731 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.297868.log.gz 2024-05-14T10:22:13.733 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.301166.log.gz 2024-05-14T10:22:13.734 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.304016.log.gz 2024-05-14T10:22:13.735 INFO:teuthology.orchestra.run.smithi154.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.235837.log.gz 2024-05-14T10:22:13.741 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.433640.log.gz 2024-05-14T10:22:13.743 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.434855.log.gz 2024-05-14T10:22:13.744 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.438234.log.gz 2024-05-14T10:22:13.744 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.469097.log.gz 2024-05-14T10:22:13.744 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.490143.log.gz 2024-05-14T10:22:13.749 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.82297.log.gz 2024-05-14T10:22:13.750 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.106027.log.gz 2024-05-14T10:22:13.754 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.353572.log.gz 2024-05-14T10:22:13.769 INFO:teuthology.orchestra.run.smithi154.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.428815.log.gz 2024-05-14T10:22:13.772 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.487162.log.gz 2024-05-14T10:22:13.783 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.421357.log.gz 2024-05-14T10:22:13.786 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36967.log.gz 2024-05-14T10:22:13.868 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.128948.log.gz 2024-05-14T10:22:13.869 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.200224.log.gz 2024-05-14T10:22:13.875 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.292733.log.gz 2024-05-14T10:22:13.876 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.119205.log.gz 2024-05-14T10:22:13.877 INFO:teuthology.orchestra.run.smithi154.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.107716.log.gz 2024-05-14T10:22:13.877 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.110740.log.gz 2024-05-14T10:22:13.877 INFO:teuthology.orchestra.run.smithi154.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.109903.log.gz 2024-05-14T10:22:13.878 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.119214.log.gz 2024-05-14T10:22:13.878 INFO:teuthology.orchestra.run.smithi154.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.110317.log.gz 2024-05-14T10:22:13.879 INFO:teuthology.orchestra.run.smithi154.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.189136.log.gz 2024-05-14T10:22:13.879 INFO:teuthology.orchestra.run.smithi154.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.321354.log.gz 2024-05-14T10:22:13.879 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.120451.log.gz 2024-05-14T10:22:13.881 INFO:teuthology.orchestra.run.smithi154.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.366585.log.gz 2024-05-14T10:22:13.882 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.413697.log.gz 2024-05-14T10:22:13.882 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.383507.log.gz 2024-05-14T10:22:13.882 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.413706.log.gz 2024-05-14T10:22:13.883 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.403566.log.gz 2024-05-14T10:22:13.884 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.441743.log.gz 2024-05-14T10:22:13.885 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.235019.log.gz 2024-05-14T10:22:13.887 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.358084.log.gz 2024-05-14T10:22:13.889 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.220075.log.gz 2024-05-14T10:22:13.902 INFO:teuthology.orchestra.run.smithi154.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.205241.log.gz 2024-05-14T10:22:13.905 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.182366.log.gz 2024-05-14T10:22:13.914 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.489713.log.gz 2024-05-14T10:22:13.919 INFO:teuthology.orchestra.run.smithi154.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.349002.log.gz 2024-05-14T10:22:13.919 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.361486.log.gz 2024-05-14T10:22:13.920 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.454857.log.gz 2024-05-14T10:22:13.925 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.443786.log.gz 2024-05-14T10:22:13.926 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.159746.log.gz 2024-05-14T10:22:13.943 INFO:teuthology.orchestra.run.smithi154.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.405228.log.gz 2024-05-14T10:22:13.945 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.442142.log.gz 2024-05-14T10:22:13.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-05-14T10:22:13.971 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.421830.log.gz 2024-05-14T10:22:13.980 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.129356.log.gz 2024-05-14T10:22:13.984 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.228816.log.gz 2024-05-14T10:22:13.988 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.155581.log.gz 2024-05-14T10:22:13.997 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.34896.log.gz 2024-05-14T10:22:14.011 INFO:teuthology.orchestra.run.smithi176.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-14T10:22:14.017 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.192968.log.gz 2024-05-14T10:22:14.021 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.367028.log.gz 2024-05-14T10:22:14.021 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.222119.log.gz 2024-05-14T10:22:14.023 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% 90.6% -- replaced with /var/log/ceph/ceph-client.admin.223771.log.gz -- replaced with /var/log/ceph/ceph-client.admin.412418.log.gz 2024-05-14T10:22:14.023 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-05-14T10:22:14.034 INFO:teuthology.orchestra.run.smithi154.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.96114.log.gz 2024-05-14T10:22:14.036 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.433220.log.gz 2024-05-14T10:22:14.036 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.397965.log.gz 2024-05-14T10:22:14.038 INFO:teuthology.orchestra.run.smithi154.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.458523.log.gz 2024-05-14T10:22:14.041 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.211057.log.gz 2024-05-14T10:22:14.041 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.105196.log.gz 2024-05-14T10:22:14.042 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.236264.log.gz 2024-05-14T10:22:14.043 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.164129.log.gz 2024-05-14T10:22:14.053 INFO:teuthology.orchestra.run.smithi154.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.287796.log.gz 2024-05-14T10:22:14.054 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.166750.log.gz 2024-05-14T10:22:14.055 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.287805.log.gz 2024-05-14T10:22:14.056 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.289450.log.gz 2024-05-14T10:22:14.057 INFO:teuthology.orchestra.run.smithi154.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.350330.log.gz 2024-05-14T10:22:14.059 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.352719.log.gz 2024-05-14T10:22:14.061 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.353141.log.gz 2024-05-14T10:22:14.062 INFO:teuthology.orchestra.run.smithi154.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.356471.log.gz 2024-05-14T10:22:14.082 INFO:teuthology.orchestra.run.smithi154.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.296967.log.gz 2024-05-14T10:22:14.089 INFO:teuthology.orchestra.run.smithi154.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.92773.log.gz 2024-05-14T10:22:14.091 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.128439.log.gz 2024-05-14T10:22:14.123 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.208661.log.gz 2024-05-14T10:22:14.125 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.153009.log.gz 2024-05-14T10:22:14.132 INFO:teuthology.orchestra.run.smithi154.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.178101.log.gz 2024-05-14T10:22:14.134 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.315649.log.gz 2024-05-14T10:22:14.140 INFO:teuthology.orchestra.run.smithi154.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.318414.log.gz 2024-05-14T10:22:14.146 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.362514.log.gz 2024-05-14T10:22:14.152 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.215906.log.gz 2024-05-14T10:22:14.162 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.307348.log.gz 2024-05-14T10:22:14.164 INFO:teuthology.orchestra.run.smithi154.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.316593.log.gz 2024-05-14T10:22:14.165 INFO:teuthology.orchestra.run.smithi154.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.438641.log.gz 2024-05-14T10:22:14.165 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.346474.log.gz 2024-05-14T10:22:14.166 INFO:teuthology.orchestra.run.smithi154.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.457299.log.gz 2024-05-14T10:22:14.166 INFO:teuthology.orchestra.run.smithi154.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.472560.log.gz 2024-05-14T10:22:14.166 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.431524.log.gz 2024-05-14T10:22:14.167 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.476826.log.gz 2024-05-14T10:22:14.170 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.472086.log.gz 2024-05-14T10:22:14.171 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.94899.log.gz 2024-05-14T10:22:14.172 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.355203.log.gz 2024-05-14T10:22:14.173 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.100300.log.gz 2024-05-14T10:22:14.173 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.291904.log.gz 2024-05-14T10:22:14.174 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.288621.log.gz 2024-05-14T10:22:14.185 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.483254.log.gz 2024-05-14T10:22:14.195 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.381497.log.gz 2024-05-14T10:22:14.195 INFO:teuthology.orchestra.run.smithi154.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.418313.log.gz 2024-05-14T10:22:14.227 INFO:teuthology.orchestra.run.smithi154.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.242584.log.gz 2024-05-14T10:22:14.228 INFO:teuthology.orchestra.run.smithi154.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.399180.log.gz 2024-05-14T10:22:14.229 INFO:teuthology.orchestra.run.smithi154.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.399597.log.gz 2024-05-14T10:22:14.249 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.317543.log.gz 2024-05-14T10:22:14.274 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33829.log.gz 2024-05-14T10:22:14.275 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34609.log.gz 2024-05-14T10:22:14.276 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34687.log.gz 2024-05-14T10:22:14.277 INFO:teuthology.orchestra.run.smithi154.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.34713.log.gz 2024-05-14T10:22:14.289 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.27945.log.gz 2024-05-14T10:22:14.298 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.318423.log.gz 2024-05-14T10:22:14.313 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.329037.log.gz 2024-05-14T10:22:14.314 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.476405.log.gz 2024-05-14T10:22:14.315 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.242150.log.gz 2024-05-14T10:22:14.318 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.487602.log.gz 2024-05-14T10:22:14.329 INFO:teuthology.orchestra.run.smithi154.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.106018.log.gz 2024-05-14T10:22:14.330 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.182375.log.gz 2024-05-14T10:22:14.331 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.184812.log.gz 2024-05-14T10:22:14.337 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.236706.log.gz 2024-05-14T10:22:14.338 INFO:teuthology.orchestra.run.smithi154.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.287388.log.gz 2024-05-14T10:22:14.339 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.292724.log.gz 2024-05-14T10:22:14.372 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.420002.log.gz 2024-05-14T10:22:14.392 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.78634.log.gz 2024-05-14T10:22:14.392 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.79639.log.gz 2024-05-14T10:22:14.396 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.168938.log.gz 2024-05-14T10:22:14.399 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.385557.log.gz 2024-05-14T10:22:14.402 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.102749.log.gz 2024-05-14T10:22:14.405 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.176053.log.gz 2024-05-14T10:22:14.411 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.414536.log.gz 2024-05-14T10:22:14.412 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.416914.log.gz 2024-05-14T10:22:14.417 INFO:teuthology.orchestra.run.smithi154.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.295735.log.gz 2024-05-14T10:22:14.420 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.478940.log.gz 2024-05-14T10:22:14.432 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.122541.log.gz 2024-05-14T10:22:14.442 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.185229.log.gz 2024-05-14T10:22:14.451 INFO:teuthology.orchestra.run.smithi154.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.229224.log.gz 2024-05-14T10:22:14.452 INFO:teuthology.orchestra.run.smithi176.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-14T10:22:14.463 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.171969.log.gz 2024-05-14T10:22:14.478 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.111160.log.gz 2024-05-14T10:22:14.492 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.365768.log.gz 2024-05-14T10:22:14.507 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.325516.log.gz 2024-05-14T10:22:14.512 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.403557.log.gz 2024-05-14T10:22:14.513 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.403965.log.gz 2024-05-14T10:22:14.517 INFO:teuthology.orchestra.run.smithi154.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.430130.log.gz 2024-05-14T10:22:14.522 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.332312.log.gz 2024-05-14T10:22:14.523 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.235428.log.gz 2024-05-14T10:22:14.541 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.349449.log.gz 2024-05-14T10:22:14.565 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.383916.log.gz 2024-05-14T10:22:14.566 INFO:teuthology.orchestra.run.smithi154.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.401807.log.gz 2024-05-14T10:22:14.567 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36494.log.gz 2024-05-14T10:22:14.568 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.397548.log.gz 2024-05-14T10:22:14.569 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36707.log.gz 2024-05-14T10:22:14.576 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.187464.log.gz 2024-05-14T10:22:14.583 INFO:teuthology.orchestra.run.smithi176.stderr: 94.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-14T10:22:14.585 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37865.log.gz 2024-05-14T10:22:14.588 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.165003.log.gz 2024-05-14T10:22:14.589 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.458124.log.gz 2024-05-14T10:22:14.596 INFO:teuthology.orchestra.run.smithi154.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.379011.log.gz 2024-05-14T10:22:14.597 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.378203.log.gz 2024-05-14T10:22:14.604 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.232497.log.gz 2024-05-14T10:22:14.606 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.233322.log.gz 2024-05-14T10:22:14.610 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.130471.log.gz 2024-05-14T10:22:14.613 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.149139.log.gz 2024-05-14T10:22:14.622 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.310218.log.gz 2024-05-14T10:22:14.625 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.320511.log.gz 2024-05-14T10:22:14.632 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33621.log.gz 2024-05-14T10:22:14.633 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.397956.log.gz 2024-05-14T10:22:14.634 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.192509.log.gz 2024-05-14T10:22:14.636 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.195709.log.gz 2024-05-14T10:22:14.641 INFO:teuthology.orchestra.run.smithi154.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.413289.log.gz 2024-05-14T10:22:14.642 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.403102.log.gz 2024-05-14T10:22:14.642 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.458115.log.gz 2024-05-14T10:22:14.643 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.470857.log.gz 2024-05-14T10:22:14.644 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.474711.log.gz 2024-05-14T10:22:14.645 INFO:teuthology.orchestra.run.smithi154.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.400009.log.gz 2024-05-14T10:22:14.645 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.180213.log.gz 2024-05-14T10:22:14.646 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.429259.log.gz 2024-05-14T10:22:14.648 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.87175.log.gz 2024-05-14T10:22:14.649 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.492337.log.gz 2024-05-14T10:22:14.649 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.384323.log.gz 2024-05-14T10:22:14.649 INFO:teuthology.orchestra.run.smithi154.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.183181.log.gz 2024-05-14T10:22:14.651 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.210624.log.gz 2024-05-14T10:22:14.651 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.351880.log.gz 2024-05-14T10:22:14.663 INFO:teuthology.orchestra.run.smithi154.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.380268.log.gz 2024-05-14T10:22:14.667 INFO:teuthology.orchestra.run.smithi154.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.285336.log.gz 2024-05-14T10:22:14.674 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36231.log.gz 2024-05-14T10:22:14.680 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.473872.log.gz 2024-05-14T10:22:14.691 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.184413.log.gz 2024-05-14T10:22:14.714 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.218002.log.gz 2024-05-14T10:22:14.715 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.169365.log.gz 2024-05-14T10:22:14.718 INFO:teuthology.orchestra.run.smithi154.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.172798.log.gz 2024-05-14T10:22:14.718 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.175654.log.gz 2024-05-14T10:22:14.747 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.109503.log.gz 2024-05-14T10:22:14.748 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.320090.log.gz 2024-05-14T10:22:14.759 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.376556.log.gz 2024-05-14T10:22:14.761 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.244793.log.gz 2024-05-14T10:22:14.762 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.368274.log.gz 2024-05-14T10:22:14.763 INFO:teuthology.orchestra.run.smithi154.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.225010.log.gz 2024-05-14T10:22:14.766 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37599.log.gz 2024-05-14T10:22:14.768 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.404824.log.gz 2024-05-14T10:22:14.769 INFO:teuthology.orchestra.run.smithi154.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34453.log.gz 2024-05-14T10:22:14.771 INFO:teuthology.orchestra.run.smithi154.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.164566.log.gz 2024-05-14T10:22:14.771 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.416440.log.gz 2024-05-14T10:22:14.772 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.480657.log.gz 2024-05-14T10:22:14.773 INFO:teuthology.orchestra.run.smithi154.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.465620.log.gz 2024-05-14T10:22:14.775 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.435264.log.gz 2024-05-14T10:22:14.776 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.179341.log.gz 2024-05-14T10:22:14.779 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.305660.log.gz 2024-05-14T10:22:14.781 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.308993.log.gz 2024-05-14T10:22:14.782 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.469978.log.gz 2024-05-14T10:22:14.785 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.408641.log.gz 2024-05-14T10:22:14.790 INFO:teuthology.orchestra.run.smithi154.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.93191.log.gz 2024-05-14T10:22:14.792 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35966.log.gz 2024-05-14T10:22:14.796 INFO:teuthology.orchestra.run.smithi154.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.108172.log.gz 2024-05-14T10:22:14.799 INFO:teuthology.orchestra.run.smithi154.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.227592.log.gz 2024-05-14T10:22:14.803 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.146267.log.gz 2024-05-14T10:22:14.803 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.156472.log.gz 2024-05-14T10:22:14.804 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.147496.log.gz 2024-05-14T10:22:14.807 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.176880.log.gz 2024-05-14T10:22:14.808 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.181519.log.gz 2024-05-14T10:22:14.817 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.201084.log.gz 2024-05-14T10:22:14.826 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.422241.log.gz 2024-05-14T10:22:14.833 INFO:teuthology.orchestra.run.smithi154.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.199398.log.gz 2024-05-14T10:22:14.844 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.175237.log.gz 2024-05-14T10:22:14.845 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.218424.log.gz 2024-05-14T10:22:14.858 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.122133.log.gz 2024-05-14T10:22:14.858 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.319639.log.gz 2024-05-14T10:22:14.859 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.398781.log.gz 2024-05-14T10:22:14.865 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.225827.log.gz 2024-05-14T10:22:14.883 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.432747.log.gz 2024-05-14T10:22:14.891 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.457308.log.gz 2024-05-14T10:22:14.898 INFO:teuthology.orchestra.run.smithi154.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.470848.log.gz 2024-05-14T10:22:14.902 INFO:teuthology.orchestra.run.smithi176.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-14T10:22:14.907 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.100291.log.gz 2024-05-14T10:22:14.907 INFO:teuthology.orchestra.run.smithi154.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.216306.log.gz 2024-05-14T10:22:14.916 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.352297.log.gz 2024-05-14T10:22:14.916 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.362194.log.gz 2024-05-14T10:22:14.919 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.288204.log.gz 2024-05-14T10:22:14.975 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37247.log.gz 2024-05-14T10:22:14.993 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.361894.log.gz 2024-05-14T10:22:15.100 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.180641.log.gz 2024-05-14T10:22:15.109 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.317071.log.gz 2024-05-14T10:22:15.134 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.412409.log.gz 2024-05-14T10:22:15.136 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.85886.log.gz 2024-05-14T10:22:15.136 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.402698.log.gz 2024-05-14T10:22:15.142 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.216315.log.gz 2024-05-14T10:22:15.150 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.421348.log.gz 2024-05-14T10:22:15.151 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45216.log.gz 2024-05-14T10:22:15.178 INFO:teuthology.orchestra.run.smithi154.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.197333.log.gz 2024-05-14T10:22:15.183 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.186240.log.gz 2024-05-14T10:22:15.185 INFO:teuthology.orchestra.run.smithi154.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.409901.log.gz 2024-05-14T10:22:15.189 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.425898.log.gz 2024-05-14T10:22:15.190 INFO:teuthology.orchestra.run.smithi154.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.329927.log.gz 2024-05-14T10:22:15.194 INFO:teuthology.orchestra.run.smithi154.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.440703.log.gz 2024-05-14T10:22:15.196 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.219245.log.gz 2024-05-14T10:22:15.196 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.480235.log.gz 2024-05-14T10:22:15.197 INFO:teuthology.orchestra.run.smithi154.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.362146.log.gz 2024-05-14T10:22:15.200 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.331330.log.gz 2024-05-14T10:22:15.202 INFO:teuthology.orchestra.run.smithi154.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.323876.log.gz 2024-05-14T10:22:15.205 INFO:teuthology.orchestra.run.smithi154.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.231273.log.gz 2024-05-14T10:22:15.208 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.383925.log.gz 2024-05-14T10:22:15.209 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.293967.log.gz 2024-05-14T10:22:15.216 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.173197.log.gz 2024-05-14T10:22:15.216 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.174829.log.gz 2024-05-14T10:22:15.217 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34427.log.gz 2024-05-14T10:22:15.218 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.176470.log.gz 2024-05-14T10:22:15.224 INFO:teuthology.orchestra.run.smithi154.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.122969.log.gz 2024-05-14T10:22:15.227 INFO:teuthology.orchestra.run.smithi154.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.79648.log.gz 2024-05-14T10:22:15.227 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34661.log.gz 2024-05-14T10:22:15.229 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35176.log.gz 2024-05-14T10:22:15.229 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.151721.log.gz 2024-05-14T10:22:15.230 INFO:teuthology.orchestra.run.smithi154.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.121724.log.gz 2024-05-14T10:22:15.231 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.321812.log.gz 2024-05-14T10:22:15.232 INFO:teuthology.orchestra.run.smithi154.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.322635.log.gz 2024-05-14T10:22:15.233 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.386824.log.gz 2024-05-14T10:22:15.234 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.302387.log.gz 2024-05-14T10:22:15.235 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.371171.log.gz 2024-05-14T10:22:15.237 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.203137.log.gz 2024-05-14T10:22:15.240 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.193408.log.gz 2024-05-14T10:22:15.241 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33931.log.gz 2024-05-14T10:22:15.245 INFO:teuthology.orchestra.run.smithi154.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.482814.log.gz 2024-05-14T10:22:15.246 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.457716.log.gz 2024-05-14T10:22:15.247 INFO:teuthology.orchestra.run.smithi154.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.484526.log.gz 2024-05-14T10:22:15.248 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.374909.log.gz 2024-05-14T10:22:15.249 INFO:teuthology.orchestra.run.smithi154.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.376960.log.gz 2024-05-14T10:22:15.250 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.95298.log.gz 2024-05-14T10:22:15.252 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.220066.log.gz 2024-05-14T10:22:15.252 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.234610.log.gz 2024-05-14T10:22:15.256 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.300342.log.gz 2024-05-14T10:22:15.259 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.369947.log.gz 2024-05-14T10:22:15.262 INFO:teuthology.orchestra.run.smithi154.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.205232.log.gz 2024-05-14T10:22:15.263 INFO:teuthology.orchestra.run.smithi154.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.377373.log.gz 2024-05-14T10:22:15.264 INFO:teuthology.orchestra.run.smithi154.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.445068.log.gz 2024-05-14T10:22:15.265 INFO:teuthology.orchestra.run.smithi154.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.454440.log.gz 2024-05-14T10:22:15.267 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.293547.log.gz 2024-05-14T10:22:15.271 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36733.log.gz 2024-05-14T10:22:15.274 INFO:teuthology.orchestra.run.smithi154.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.387666.log.gz 2024-05-14T10:22:15.276 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.435688.log.gz 2024-05-14T10:22:15.282 INFO:teuthology.orchestra.run.smithi154.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.155590.log.gz 2024-05-14T10:22:15.287 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.422232.log.gz 2024-05-14T10:22:15.287 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.153864.log.gz 2024-05-14T10:22:15.296 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.228825.log.gz 2024-05-14T10:22:15.297 INFO:teuthology.orchestra.run.smithi154.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.175645.log.gz 2024-05-14T10:22:15.297 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.178510.log.gz 2024-05-14T10:22:15.298 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.178110.log.gz 2024-05-14T10:22:15.309 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34349.log.gz 2024-05-14T10:22:15.310 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.109912.log.gz 2024-05-14T10:22:15.321 INFO:teuthology.orchestra.run.smithi154.stderr: 81.9% 77.6% -- replaced with /var/log/ceph/ceph-client.admin.150418.log.gz 2024-05-14T10:22:15.322 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.149546.log.gz 2024-05-14T10:22:15.323 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.191196.log.gz 2024-05-14T10:22:15.324 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.245207.log.gz 2024-05-14T10:22:15.327 INFO:teuthology.orchestra.run.smithi154.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.376144.log.gz 2024-05-14T10:22:15.327 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.302794.log.gz 2024-05-14T10:22:15.327 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.202719.log.gz 2024-05-14T10:22:15.327 INFO:teuthology.orchestra.run.smithi154.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.304415.log.gz 2024-05-14T10:22:15.328 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.389122.log.gz 2024-05-14T10:22:15.329 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.476414.log.gz 2024-05-14T10:22:15.331 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35783.log.gz 2024-05-14T10:22:15.334 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.301573.log.gz 2024-05-14T10:22:15.337 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.212734.log.gz 2024-05-14T10:22:15.338 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.416923.log.gz 2024-05-14T10:22:15.338 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.243533.log.gz 2024-05-14T10:22:15.339 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.451751.log.gz 2024-05-14T10:22:15.341 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.227193.log.gz 2024-05-14T10:22:15.342 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.119620.log.gz 2024-05-14T10:22:15.343 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.118805.log.gz 2024-05-14T10:22:15.354 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.215897.log.gz 2024-05-14T10:22:15.356 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.291087.log.gz 2024-05-14T10:22:15.365 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.367037.log.gz 2024-05-14T10:22:15.365 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.348194.log.gz 2024-05-14T10:22:15.366 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.419142.log.gz 2024-05-14T10:22:15.367 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.420939.log.gz 2024-05-14T10:22:15.368 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.488460.log.gz 2024-05-14T10:22:15.373 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36416.log.gz 2024-05-14T10:22:15.373 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36811.log.gz 2024-05-14T10:22:15.393 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.201901.log.gz 2024-05-14T10:22:15.396 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.153855.log.gz 2024-05-14T10:22:15.398 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.428406.log.gz 2024-05-14T10:22:15.399 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.177281.log.gz 2024-05-14T10:22:15.399 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34145.log.gz 2024-05-14T10:22:15.399 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.154300.log.gz 2024-05-14T10:22:15.399 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35117.log.gz 2024-05-14T10:22:15.408 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.120902.log.gz 2024-05-14T10:22:15.412 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.324293.log.gz 2024-05-14T10:22:15.415 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.128007.log.gz 2024-05-14T10:22:15.416 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.198989.log.gz 2024-05-14T10:22:15.418 INFO:teuthology.orchestra.run.smithi154.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.370754.log.gz 2024-05-14T10:22:15.419 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.400439.log.gz 2024-05-14T10:22:15.419 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.196117.log.gz 2024-05-14T10:22:15.420 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.224175.log.gz 2024-05-14T10:22:15.421 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.412826.log.gz 2024-05-14T10:22:15.427 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.189145.log.gz 2024-05-14T10:22:15.428 INFO:teuthology.orchestra.run.smithi154.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.80553.log.gz 2024-05-14T10:22:15.432 INFO:teuthology.orchestra.run.smithi154.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.300749.log.gz 2024-05-14T10:22:15.434 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.301980.log.gz 2024-05-14T10:22:15.434 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.432332.log.gz 2024-05-14T10:22:15.438 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.465206.log.gz 2024-05-14T10:22:15.439 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.99475.log.gz 2024-05-14T10:22:15.440 INFO:teuthology.orchestra.run.smithi154.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.306482.log.gz 2024-05-14T10:22:15.443 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.101933.log.gz 2024-05-14T10:22:15.447 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.388718.log.gz 2024-05-14T10:22:15.447 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.388085.log.gz 2024-05-14T10:22:15.448 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.387222.log.gz 2024-05-14T10:22:15.449 INFO:teuthology.orchestra.run.smithi154.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.375726.log.gz 2024-05-14T10:22:15.449 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.98245.log.gz 2024-05-14T10:22:15.451 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.311465.log.gz 2024-05-14T10:22:15.451 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.361477.log.gz 2024-05-14T10:22:15.452 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.382523.log.gz 2024-05-14T10:22:15.456 INFO:teuthology.orchestra.run.smithi154.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.444215.log.gz 2024-05-14T10:22:15.465 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.168064.log.gz 2024-05-14T10:22:15.475 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.349849.log.gz 2024-05-14T10:22:15.479 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.181936.log.gz 2024-05-14T10:22:15.483 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.293958.log.gz 2024-05-14T10:22:15.485 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36153.log.gz 2024-05-14T10:22:15.486 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.103157.log.gz 2024-05-14T10:22:15.520 INFO:teuthology.orchestra.run.smithi154.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.2.35041.log.gz 2024-05-14T10:22:15.553 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.214446.log.gz 2024-05-14T10:22:15.554 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.167627.log.gz 2024-05-14T10:22:15.560 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.307357.log.gz 2024-05-14T10:22:15.561 INFO:teuthology.orchestra.run.smithi154.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.347319.log.gz 2024-05-14T10:22:15.566 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.432756.log.gz 2024-05-14T10:22:15.567 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.467361.log.gz 2024-05-14T10:22:15.569 INFO:teuthology.orchestra.run.smithi154.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.99466.log.gz 2024-05-14T10:22:15.581 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.288213.log.gz 2024-05-14T10:22:15.586 INFO:teuthology.orchestra.run.smithi154.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.154708.log.gz 2024-05-14T10:22:15.619 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.94455.log.gz 2024-05-14T10:22:15.620 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.127077.log.gz 2024-05-14T10:22:15.620 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37273.log.gz 2024-05-14T10:22:15.728 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.229233.log.gz 2024-05-14T10:22:15.729 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35358.log.gz 2024-05-14T10:22:15.732 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35914.log.gz 2024-05-14T10:22:15.733 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.178928.log.gz 2024-05-14T10:22:15.734 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.111151.log.gz 2024-05-14T10:22:15.734 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.95715.log.gz 2024-05-14T10:22:15.736 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.127490.log.gz 2024-05-14T10:22:15.737 INFO:teuthology.orchestra.run.smithi154.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.376135.log.gz 2024-05-14T10:22:15.738 INFO:teuthology.orchestra.run.smithi154.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.358947.log.gz 2024-05-14T10:22:15.740 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.305651.log.gz 2024-05-14T10:22:15.746 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.467761.log.gz 2024-05-14T10:22:15.746 INFO:teuthology.orchestra.run.smithi154.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.235010.log.gz 2024-05-14T10:22:15.747 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.360664.log.gz 2024-05-14T10:22:15.749 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.310635.log.gz 2024-05-14T10:22:15.750 INFO:teuthology.orchestra.run.smithi154.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.164994.log.gz 2024-05-14T10:22:15.751 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.94047.log.gz 2024-05-14T10:22:15.751 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.377382.log.gz 2024-05-14T10:22:15.753 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.398373.log.gz 2024-05-14T10:22:15.754 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.471680.log.gz 2024-05-14T10:22:15.758 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.388305.log.gz 2024-05-14T10:22:15.759 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.353132.log.gz 2024-05-14T10:22:15.765 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33751.log.gz 2024-05-14T10:22:15.769 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.323060.log.gz 2024-05-14T10:22:15.771 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.345589.log.gz 2024-05-14T10:22:15.778 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.230448.log.gz 2024-05-14T10:22:15.794 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.206564.log.gz 2024-05-14T10:22:15.795 INFO:teuthology.orchestra.run.smithi154.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.195700.log.gz 2024-05-14T10:22:15.796 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.204824.log.gz 2024-05-14T10:22:15.810 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33934.log.gz 2024-05-14T10:22:15.810 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35594.log.gz 2024-05-14T10:22:15.828 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.120893.log.gz 2024-05-14T10:22:15.829 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.321803.log.gz 2024-05-14T10:22:15.832 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.370346.log.gz 2024-05-14T10:22:15.834 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.406049.log.gz 2024-05-14T10:22:15.834 INFO:teuthology.orchestra.run.smithi154.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.215052.log.gz 2024-05-14T10:22:15.834 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.370355.log.gz 2024-05-14T10:22:15.835 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.169811.log.gz 2024-05-14T10:22:15.837 INFO:teuthology.orchestra.run.smithi154.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.224597.log.gz 2024-05-14T10:22:15.837 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.308166.log.gz 2024-05-14T10:22:15.838 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.225836.log.gz 2024-05-14T10:22:15.838 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.303608.log.gz 2024-05-14T10:22:15.838 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.358956.log.gz 2024-05-14T10:22:15.841 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.439456.log.gz 2024-05-14T10:22:15.841 INFO:teuthology.orchestra.run.smithi154.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.425490.log.gz 2024-05-14T10:22:15.843 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.466953.log.gz 2024-05-14T10:22:15.845 INFO:teuthology.orchestra.run.smithi154.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.94890.log.gz 2024-05-14T10:22:15.847 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.359801.log.gz 2024-05-14T10:22:15.847 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.103565.log.gz 2024-05-14T10:22:15.848 INFO:teuthology.orchestra.run.smithi154.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.443777.log.gz 2024-05-14T10:22:15.879 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36205.log.gz 2024-05-14T10:22:15.899 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.186639.log.gz 2024-05-14T10:22:15.903 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.286163.log.gz 2024-05-14T10:22:15.908 INFO:teuthology.orchestra.run.smithi154.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.311035.log.gz 2024-05-14T10:22:15.909 INFO:teuthology.orchestra.run.smithi154.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.353563.log.gz 2024-05-14T10:22:15.921 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.91104.log.gz 2024-05-14T10:22:15.925 INFO:teuthology.orchestra.run.smithi154.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.246027.log.gz 2024-05-14T10:22:15.925 INFO:teuthology.orchestra.run.smithi154.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.78643.log.gz 2024-05-14T10:22:15.931 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.202319.log.gz 2024-05-14T10:22:15.933 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.170248.log.gz 2024-05-14T10:22:15.933 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.153418.log.gz 2024-05-14T10:22:15.934 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.153018.log.gz 2024-05-14T10:22:15.935 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.93200.log.gz 2024-05-14T10:22:15.935 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.96530.log.gz 2024-05-14T10:22:15.946 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34505.log.gz 2024-05-14T10:22:15.953 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.113294.log.gz 2024-05-14T10:22:15.954 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.221719.log.gz 2024-05-14T10:22:15.954 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.223762.log.gz 2024-05-14T10:22:15.955 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.346061.log.gz 2024-05-14T10:22:15.956 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.440922.log.gz 2024-05-14T10:22:15.956 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.402290.log.gz 2024-05-14T10:22:15.957 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.441335.log.gz 2024-05-14T10:22:15.959 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.438243.log.gz 2024-05-14T10:22:15.961 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.410335.log.gz 2024-05-14T10:22:15.961 INFO:teuthology.orchestra.run.smithi154.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.95706.log.gz 2024-05-14T10:22:15.963 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.98654.log.gz 2024-05-14T10:22:15.963 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.233313.log.gz 2024-05-14T10:22:15.965 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.184821.log.gz 2024-05-14T10:22:15.967 INFO:teuthology.orchestra.run.smithi154.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.102332.log.gz 2024-05-14T10:22:15.969 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.415008.log.gz 2024-05-14T10:22:15.972 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.423796.log.gz 2024-05-14T10:22:15.973 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.460165.log.gz 2024-05-14T10:22:15.974 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.284107.log.gz 2024-05-14T10:22:15.981 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.454210.log.gz 2024-05-14T10:22:15.982 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.486702.log.gz 2024-05-14T10:22:15.985 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.147487.log.gz 2024-05-14T10:22:15.990 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.484535.log.gz 2024-05-14T10:22:16.005 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36179.log.gz 2024-05-14T10:22:16.005 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37019.log.gz 2024-05-14T10:22:16.006 INFO:teuthology.orchestra.run.smithi154.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.403974.log.gz 2024-05-14T10:22:16.006 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37156.log.gz 2024-05-14T10:22:16.012 INFO:teuthology.orchestra.run.smithi154.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.241305.log.gz 2024-05-14T10:22:16.014 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.169802.log.gz 2024-05-14T10:22:16.015 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.180204.log.gz 2024-05-14T10:22:16.015 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.174838.log.gz 2024-05-14T10:22:16.021 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.379419.log.gz 2024-05-14T10:22:16.039 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33380.log.gz 2024-05-14T10:22:16.042 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37839.log.gz 2024-05-14T10:22:16.043 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37891.log.gz 2024-05-14T10:22:16.045 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.325926.log.gz 2024-05-14T10:22:16.045 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.374462.log.gz 2024-05-14T10:22:16.049 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.168501.log.gz 2024-05-14T10:22:16.049 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.384332.log.gz 2024-05-14T10:22:16.053 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.437774.log.gz 2024-05-14T10:22:16.053 INFO:teuthology.orchestra.run.smithi154.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.357170.log.gz 2024-05-14T10:22:16.056 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.165439.log.gz 2024-05-14T10:22:16.056 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.298276.log.gz 2024-05-14T10:22:16.057 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.97342.log.gz 2024-05-14T10:22:16.058 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.442151.log.gz 2024-05-14T10:22:16.059 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.434456.log.gz 2024-05-14T10:22:16.063 INFO:teuthology.orchestra.run.smithi154.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.211912.log.gz 2024-05-14T10:22:16.066 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.360655.log.gz 2024-05-14T10:22:16.067 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.102740.log.gz 2024-05-14T10:22:16.068 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.197750.log.gz 2024-05-14T10:22:16.069 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.481519.log.gz 2024-05-14T10:22:16.072 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.183588.log.gz 2024-05-14T10:22:16.076 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.187056.log.gz 2024-05-14T10:22:16.085 INFO:teuthology.orchestra.run.smithi154.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.379428.log.gz 2024-05-14T10:22:16.091 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.378612.log.gz 2024-05-14T10:22:16.098 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36337.log.gz 2024-05-14T10:22:16.178 INFO:teuthology.orchestra.run.smithi154.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.321363.log.gz 2024-05-14T10:22:16.179 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.418735.log.gz 2024-05-14T10:22:16.179 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.173614.log.gz 2024-05-14T10:22:16.179 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33928.log.gz 2024-05-14T10:22:16.179 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34635.log.gz 2024-05-14T10:22:16.179 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.110326.log.gz 2024-05-14T10:22:16.179 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.399588.log.gz 2024-05-14T10:22:16.179 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.483676.log.gz 2024-05-14T10:22:16.180 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.309819.log.gz 2024-05-14T10:22:16.180 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.436093.log.gz 2024-05-14T10:22:16.180 INFO:teuthology.orchestra.run.smithi154.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.328628.log.gz 2024-05-14T10:22:16.180 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.438650.log.gz 2024-05-14T10:22:16.180 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37917.log.gz 2024-05-14T10:22:16.180 INFO:teuthology.orchestra.run.smithi154.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.210633.log.gz 2024-05-14T10:22:16.182 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.473457.log.gz 2024-05-14T10:22:16.182 INFO:teuthology.orchestra.run.smithi154.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.474702.log.gz 2024-05-14T10:22:16.183 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.472095.log.gz 2024-05-14T10:22:16.183 INFO:teuthology.orchestra.run.smithi154.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.415492.log.gz 2024-05-14T10:22:16.184 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.427532.log.gz 2024-05-14T10:22:16.185 INFO:teuthology.orchestra.run.smithi154.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.425079.log.gz 2024-05-14T10:22:16.186 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.96938.log.gz 2024-05-14T10:22:16.190 INFO:teuthology.orchestra.run.smithi154.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.330822.log.gz 2024-05-14T10:22:16.190 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.332796.log.gz 2024-05-14T10:22:16.191 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.388296.log.gz 2024-05-14T10:22:16.195 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.354803.log.gz 2024-05-14T10:22:16.197 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.290272.log.gz 2024-05-14T10:22:16.201 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.482392.log.gz 2024-05-14T10:22:16.207 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.149991.log.gz 2024-05-14T10:22:16.210 INFO:teuthology.orchestra.run.smithi154.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.104374.log.gz 2024-05-14T10:22:16.215 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36603.log.gz 2024-05-14T10:22:16.216 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36655.log.gz 2024-05-14T10:22:16.224 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.161974.log.gz 2024-05-14T10:22:16.229 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.220897.log.gz 2024-05-14T10:22:16.233 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.406058.log.gz 2024-05-14T10:22:16.237 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.411602.log.gz 2024-05-14T10:22:16.241 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37510.log.gz 2024-05-14T10:22:16.251 INFO:teuthology.orchestra.run.smithi154.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.231673.log.gz 2024-05-14T10:22:16.258 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35940.log.gz 2024-05-14T10:22:16.258 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34126.log.gz 2024-05-14T10:22:16.258 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37482.log.gz 2024-05-14T10:22:16.262 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.147904.log.gz 2024-05-14T10:22:16.265 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.121317.log.gz 2024-05-14T10:22:16.267 INFO:teuthology.orchestra.run.smithi154.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.166304.log.gz 2024-05-14T10:22:16.273 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.371580.log.gz 2024-05-14T10:22:16.275 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.131568.log.gz 2024-05-14T10:22:16.277 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.161965.log.gz 2024-05-14T10:22:16.278 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.492328.log.gz 2024-05-14T10:22:16.278 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.399189.log.gz 2024-05-14T10:22:16.285 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.201093.log.gz 2024-05-14T10:22:16.292 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.414999.log.gz 2024-05-14T10:22:16.294 INFO:teuthology.orchestra.run.smithi154.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.448633.log.gz 2024-05-14T10:22:16.295 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.296143.log.gz 2024-05-14T10:22:16.296 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.309400.log.gz 2024-05-14T10:22:16.296 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.347310.log.gz 2024-05-14T10:22:16.300 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.435679.log.gz 2024-05-14T10:22:16.302 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.437323.log.gz 2024-05-14T10:22:16.302 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.406866.log.gz 2024-05-14T10:22:16.303 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.410326.log.gz 2024-05-14T10:22:16.303 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.327337.log.gz 2024-05-14T10:22:16.304 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.491848.log.gz 2024-05-14T10:22:16.305 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.458532.log.gz 2024-05-14T10:22:16.305 INFO:teuthology.orchestra.run.smithi154.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.87574.log.gz 2024-05-14T10:22:16.306 INFO:teuthology.orchestra.run.smithi154.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.354794.log.gz 2024-05-14T10:22:16.307 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.216723.log.gz 2024-05-14T10:22:16.307 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.386408.log.gz 2024-05-14T10:22:16.307 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.99062.log.gz 2024-05-14T10:22:16.307 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.356072.log.gz 2024-05-14T10:22:16.311 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.361072.log.gz 2024-05-14T10:22:16.368 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.243975.log.gz 2024-05-14T10:22:16.370 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36101.log.gz 2024-05-14T10:22:16.370 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.364100.log.gz 2024-05-14T10:22:16.371 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36468.log.gz 2024-05-14T10:22:16.376 INFO:teuthology.orchestra.run.smithi154.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.397092.log.gz 2024-05-14T10:22:16.391 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.293140.log.gz 2024-05-14T10:22:16.393 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.286975.log.gz 2024-05-14T10:22:16.398 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.388709.log.gz 2024-05-14T10:22:16.403 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.378603.log.gz 2024-05-14T10:22:16.403 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.377789.log.gz 2024-05-14T10:22:16.405 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.147083.log.gz 2024-05-14T10:22:16.415 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37813.log.gz 2024-05-14T10:22:16.415 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33777.log.gz 2024-05-14T10:22:16.416 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33922.log.gz 2024-05-14T10:22:16.416 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.419551.log.gz 2024-05-14T10:22:16.420 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35228.log.gz 2024-05-14T10:22:16.420 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35254.log.gz 2024-05-14T10:22:16.421 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.123416.log.gz 2024-05-14T10:22:16.423 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.189553.log.gz 2024-05-14T10:22:16.424 INFO:teuthology.orchestra.run.smithi154.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.111971.log.gz 2024-05-14T10:22:16.432 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.206076.log.gz 2024-05-14T10:22:16.433 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.463854.log.gz 2024-05-14T10:22:16.433 INFO:teuthology.orchestra.run.smithi154.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.461381.log.gz 2024-05-14T10:22:16.434 INFO:teuthology.orchestra.run.smithi154.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.462609.log.gz 2024-05-14T10:22:16.434 INFO:teuthology.orchestra.run.smithi154.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.461789.log.gz 2024-05-14T10:22:16.434 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.462618.log.gz 2024-05-14T10:22:16.434 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.463863.log.gz 2024-05-14T10:22:16.435 INFO:teuthology.orchestra.run.smithi154.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.463425.log.gz 2024-05-14T10:22:16.435 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.463017.log.gz 2024-05-14T10:22:16.435 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.463026.log.gz 2024-05-14T10:22:16.435 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.462206.log.gz 2024-05-14T10:22:16.436 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.462197.log.gz 2024-05-14T10:22:16.436 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.461390.log.gz 2024-05-14T10:22:16.436 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.461798.log.gz 2024-05-14T10:22:16.436 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.460981.log.gz 2024-05-14T10:22:16.436 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.233730.log.gz 2024-05-14T10:22:16.438 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.307766.log.gz 2024-05-14T10:22:16.439 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.314800.log.gz 2024-05-14T10:22:16.441 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.460972.log.gz 2024-05-14T10:22:16.441 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.466470.log.gz 2024-05-14T10:22:16.442 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.318831.log.gz 2024-05-14T10:22:16.442 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.310227.log.gz 2024-05-14T10:22:16.443 INFO:teuthology.orchestra.run.smithi154.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.98645.log.gz 2024-05-14T10:22:16.443 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.95307.log.gz 2024-05-14T10:22:16.445 INFO:teuthology.orchestra.run.smithi154.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.452619.log.gz 2024-05-14T10:22:16.447 INFO:teuthology.orchestra.run.smithi154.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.286576.log.gz 2024-05-14T10:22:16.448 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.289859.log.gz 2024-05-14T10:22:16.448 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.384731.log.gz 2024-05-14T10:22:16.450 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.79240.log.gz 2024-05-14T10:22:16.459 INFO:teuthology.orchestra.run.smithi154.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.464275.log.gz 2024-05-14T10:22:16.461 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.444638.log.gz 2024-05-14T10:22:16.471 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.483245.log.gz 2024-05-14T10:22:16.474 INFO:teuthology.orchestra.run.smithi154.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.101107.log.gz 2024-05-14T10:22:16.476 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36127.log.gz 2024-05-14T10:22:16.476 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36285.log.gz 2024-05-14T10:22:16.476 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37097.log.gz 2024-05-14T10:22:16.477 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37378.log.gz 2024-05-14T10:22:16.479 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.198998.log.gz 2024-05-14T10:22:16.479 INFO:teuthology.orchestra.run.smithi154.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.202310.log.gz 2024-05-14T10:22:16.479 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.427998.log.gz 2024-05-14T10:22:16.480 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.191187.log.gz 2024-05-14T10:22:16.481 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.172390.log.gz 2024-05-14T10:22:16.499 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.318015.log.gz 2024-05-14T10:22:16.500 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37627.log.gz 2024-05-14T10:22:16.502 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.324284.log.gz 2024-05-14T10:22:16.502 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.325099.log.gz 2024-05-14T10:22:16.504 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.370763.log.gz 2024-05-14T10:22:16.504 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.374047.log.gz 2024-05-14T10:22:16.504 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.375308.log.gz 2024-05-14T10:22:16.505 INFO:teuthology.orchestra.run.smithi154.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.375717.log.gz 2024-05-14T10:22:16.506 INFO:teuthology.orchestra.run.smithi154.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.376547.log.gz 2024-05-14T10:22:16.507 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.369530.log.gz 2024-05-14T10:22:16.508 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.491857.log.gz 2024-05-14T10:22:16.510 INFO:teuthology.orchestra.run.smithi154.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.360219.log.gz 2024-05-14T10:22:16.513 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.423787.log.gz 2024-05-14T10:22:16.513 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.433229.log.gz 2024-05-14T10:22:16.514 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.236273.log.gz 2024-05-14T10:22:16.515 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.481088.log.gz 2024-05-14T10:22:16.517 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.101924.log.gz 2024-05-14T10:22:16.517 INFO:teuthology.orchestra.run.smithi154.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.444629.log.gz 2024-05-14T10:22:16.518 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.326865.log.gz 2024-05-14T10:22:16.519 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.105607.log.gz 2024-05-14T10:22:16.521 INFO:teuthology.orchestra.run.smithi154.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.440010.log.gz 2024-05-14T10:22:16.521 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.289035.log.gz 2024-05-14T10:22:16.523 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.385144.log.gz 2024-05-14T10:22:16.559 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36759.log.gz 2024-05-14T10:22:16.640 INFO:teuthology.orchestra.run.smithi154.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.146666.log.gz 2024-05-14T10:22:16.641 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.199815.log.gz 2024-05-14T10:22:16.641 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.163721.log.gz 2024-05-14T10:22:16.646 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.154699.log.gz 2024-05-14T10:22:16.648 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.175246.log.gz 2024-05-14T10:22:16.668 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.106847.log.gz 2024-05-14T10:22:16.668 INFO:teuthology.orchestra.run.smithi154.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.164120.log.gz 2024-05-14T10:22:16.668 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.294801.log.gz 2024-05-14T10:22:16.669 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.315199.log.gz 2024-05-14T10:22:16.672 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.324691.log.gz 2024-05-14T10:22:16.673 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.372800.log.gz 2024-05-14T10:22:16.675 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.439048.log.gz 2024-05-14T10:22:16.675 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.374056.log.gz 2024-05-14T10:22:16.689 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.309810.log.gz 2024-05-14T10:22:16.690 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.308175.log.gz 2024-05-14T10:22:16.691 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.309409.log.gz 2024-05-14T10:22:16.691 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.325108.log.gz 2024-05-14T10:22:16.697 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.485820.log.gz 2024-05-14T10:22:16.697 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.412010.log.gz 2024-05-14T10:22:16.698 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.456900.log.gz 2024-05-14T10:22:16.698 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.476006.log.gz 2024-05-14T10:22:16.793 INFO:teuthology.orchestra.run.smithi154.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.327328.log.gz 2024-05-14T10:22:16.794 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.479372.log.gz 2024-05-14T10:22:16.795 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.155149.log.gz 2024-05-14T10:22:16.797 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.291078.log.gz 2024-05-14T10:22:16.802 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.196924.log.gz 2024-05-14T10:22:16.807 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.228000.log.gz 2024-05-14T10:22:16.809 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.284936.log.gz 2024-05-14T10:22:16.813 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.218841.log.gz 2024-05-14T10:22:16.828 INFO:teuthology.orchestra.run.smithi154.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.158075.log.gz 2024-05-14T10:22:16.828 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.160675.log.gz 2024-05-14T10:22:16.828 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.162401.log.gz 2024-05-14T10:22:16.834 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33881.log.gz 2024-05-14T10:22:16.836 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.317534.log.gz 2024-05-14T10:22:16.836 INFO:teuthology.orchestra.run.smithi154.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.37943.log.gz 2024-05-14T10:22:16.837 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.314392.log.gz 2024-05-14T10:22:16.837 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.324700.log.gz 2024-05-14T10:22:16.841 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% 90.3% -- replaced with /var/log/ceph/ceph-client.admin.300351.log.gz -- replaced with /var/log/ceph/ceph-client.admin.301971.log.gz 2024-05-14T10:22:16.841 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-05-14T10:22:16.841 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.474293.log.gz 2024-05-14T10:22:16.843 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.306064.log.gz 2024-05-14T10:22:16.843 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.430538.log.gz 2024-05-14T10:22:16.844 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.434864.log.gz 2024-05-14T10:22:16.845 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.455664.log.gz 2024-05-14T10:22:16.845 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.306073.log.gz 2024-05-14T10:22:16.845 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.442960.log.gz 2024-05-14T10:22:16.845 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.105616.log.gz 2024-05-14T10:22:16.846 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.444224.log.gz 2024-05-14T10:22:16.848 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.417885.log.gz 2024-05-14T10:22:16.855 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.167180.log.gz 2024-05-14T10:22:16.863 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.320919.log.gz 2024-05-14T10:22:16.864 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.481097.log.gz 2024-05-14T10:22:16.867 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.351889.log.gz 2024-05-14T10:22:16.871 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.387675.log.gz 2024-05-14T10:22:16.877 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.244393.log.gz 2024-05-14T10:22:16.880 INFO:teuthology.orchestra.run.smithi154.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.234169.log.gz 2024-05-14T10:22:16.882 INFO:teuthology.orchestra.run.smithi154.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.367857.log.gz 2024-05-14T10:22:16.886 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.377780.log.gz 2024-05-14T10:22:16.892 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.101116.log.gz 2024-05-14T10:22:16.920 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36259.log.gz 2024-05-14T10:22:16.996 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.130163.log.gz 2024-05-14T10:22:16.997 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.220475.log.gz 2024-05-14T10:22:17.004 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.170239.log.gz 2024-05-14T10:22:17.022 INFO:teuthology.orchestra.run.smithi154.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.109494.log.gz 2024-05-14T10:22:17.023 INFO:teuthology.orchestra.run.smithi154.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.314383.log.gz 2024-05-14T10:22:17.024 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.323468.log.gz 2024-05-14T10:22:17.027 INFO:teuthology.orchestra.run.smithi154.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.205653.log.gz 2024-05-14T10:22:17.028 INFO:teuthology.orchestra.run.smithi154.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.365330.log.gz 2024-05-14T10:22:17.030 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.304424.log.gz 2024-05-14T10:22:17.032 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.479363.log.gz 2024-05-14T10:22:17.040 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.411194.log.gz 2024-05-14T10:22:17.041 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.456891.log.gz 2024-05-14T10:22:17.041 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.428806.log.gz 2024-05-14T10:22:17.042 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.99878.log.gz 2024-05-14T10:22:17.042 INFO:teuthology.orchestra.run.smithi154.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.463434.log.gz 2024-05-14T10:22:17.049 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.211921.log.gz 2024-05-14T10:22:17.049 INFO:teuthology.orchestra.run.smithi154.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.418726.log.gz 2024-05-14T10:22:17.052 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.420948.log.gz 2024-05-14T10:22:17.052 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.455256.log.gz 2024-05-14T10:22:17.053 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.455265.log.gz 2024-05-14T10:22:17.053 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.213142.log.gz 2024-05-14T10:22:17.055 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.213151.log.gz 2024-05-14T10:22:17.055 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.386417.log.gz 2024-05-14T10:22:17.059 INFO:teuthology.orchestra.run.smithi154.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.80059.log.gz 2024-05-14T10:22:17.060 INFO:teuthology.orchestra.run.smithi154.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.241726.log.gz 2024-05-14T10:22:17.066 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.291913.log.gz 2024-05-14T10:22:17.069 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.465629.log.gz 2024-05-14T10:22:17.070 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.104794.log.gz 2024-05-14T10:22:17.072 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35646.log.gz 2024-05-14T10:22:17.082 INFO:teuthology.orchestra.run.smithi154.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.128448.log.gz 2024-05-14T10:22:17.084 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.404406.log.gz 2024-05-14T10:22:17.089 INFO:teuthology.orchestra.run.smithi154.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.215061.log.gz 2024-05-14T10:22:17.090 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.127998.log.gz 2024-05-14T10:22:17.091 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.128939.log.gz 2024-05-14T10:22:17.101 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.190788.log.gz 2024-05-14T10:22:17.138 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35731.log.gz 2024-05-14T10:22:17.149 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37683.log.gz 2024-05-14T10:22:17.150 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.319240.log.gz 2024-05-14T10:22:17.152 INFO:teuthology.orchestra.run.smithi154.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.203128.log.gz 2024-05-14T10:22:17.157 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.364917.log.gz 2024-05-14T10:22:17.163 INFO:teuthology.orchestra.run.smithi154.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.374471.log.gz 2024-05-14T10:22:17.167 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.409040.log.gz 2024-05-14T10:22:17.168 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.436923.log.gz 2024-05-14T10:22:17.169 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.478085.log.gz 2024-05-14T10:22:17.169 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.480226.log.gz 2024-05-14T10:22:17.170 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.389529.log.gz 2024-05-14T10:22:17.173 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.383516.log.gz 2024-05-14T10:22:17.175 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.442969.log.gz 2024-05-14T10:22:17.178 INFO:teuthology.orchestra.run.smithi154.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.440446.log.gz 2024-05-14T10:22:17.181 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.120460.log.gz 2024-05-14T10:22:17.183 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.224588.log.gz 2024-05-14T10:22:17.188 INFO:teuthology.orchestra.run.smithi154.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.98236.log.gz 2024-05-14T10:22:17.191 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.181078.log.gz 2024-05-14T10:22:17.192 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.420476.log.gz 2024-05-14T10:22:17.198 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.184005.log.gz 2024-05-14T10:22:17.217 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.285745.log.gz 2024-05-14T10:22:17.232 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36311.log.gz 2024-05-14T10:22:17.245 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.198173.log.gz 2024-05-14T10:22:17.246 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.206555.log.gz 2024-05-14T10:22:17.252 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.242141.log.gz 2024-05-14T10:22:17.266 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.158891.log.gz 2024-05-14T10:22:17.284 INFO:teuthology.orchestra.run.smithi154.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.97351.log.gz 2024-05-14T10:22:17.288 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.165867.log.gz 2024-05-14T10:22:17.289 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.319231.log.gz 2024-05-14T10:22:17.302 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.335631.log.gz 2024-05-14T10:22:17.303 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.440001.log.gz 2024-05-14T10:22:17.304 INFO:teuthology.orchestra.run.smithi154.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.433631.log.gz 2024-05-14T10:22:17.305 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.436914.log.gz 2024-05-14T10:22:17.306 INFO:teuthology.orchestra.run.smithi154.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.417322.log.gz 2024-05-14T10:22:17.307 INFO:teuthology.orchestra.run.smithi154.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.443370.log.gz 2024-05-14T10:22:17.313 INFO:teuthology.orchestra.run.smithi154.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.290263.log.gz 2024-05-14T10:22:17.325 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.332805.log.gz 2024-05-14T10:22:17.329 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37404.log.gz 2024-05-14T10:22:17.412 INFO:teuthology.orchestra.run.smithi154.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.148721.log.gz 2024-05-14T10:22:17.416 INFO:teuthology.orchestra.run.smithi154.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.179768.log.gz 2024-05-14T10:22:17.418 INFO:teuthology.orchestra.run.smithi154.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.398772.log.gz 2024-05-14T10:22:17.423 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.219667.log.gz 2024-05-14T10:22:17.425 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.161121.log.gz 2024-05-14T10:22:17.426 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34557.log.gz 2024-05-14T10:22:17.428 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35150.log.gz 2024-05-14T10:22:17.434 INFO:teuthology.orchestra.run.smithi154.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.113698.log.gz 2024-05-14T10:22:17.440 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.193846.log.gz 2024-05-14T10:22:17.457 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.330359.log.gz 2024-05-14T10:22:17.462 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.232082.log.gz 2024-05-14T10:22:17.468 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.130172.log.gz 2024-05-14T10:22:17.488 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.168055.log.gz 2024-05-14T10:22:17.499 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.179332.log.gz 2024-05-14T10:22:17.508 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.112458.log.gz 2024-05-14T10:22:17.514 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.405641.log.gz 2024-05-14T10:22:17.516 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.167189.log.gz 2024-05-14T10:22:17.534 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.464284.log.gz 2024-05-14T10:22:17.548 INFO:teuthology.orchestra.run.smithi154.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.333273.log.gz 2024-05-14T10:22:17.549 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.450927.log.gz 2024-05-14T10:22:17.554 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.359359.log.gz 2024-05-14T10:22:17.556 INFO:teuthology.orchestra.run.smithi154.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.426716.log.gz 2024-05-14T10:22:17.558 INFO:teuthology.orchestra.run.smithi154.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.475114.log.gz 2024-05-14T10:22:17.565 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.185643.log.gz 2024-05-14T10:22:17.574 INFO:teuthology.orchestra.run.smithi154.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.368679.log.gz 2024-05-14T10:22:17.579 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.491039.log.gz 2024-05-14T10:22:17.587 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35280.log.gz 2024-05-14T10:22:17.588 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35542.log.gz 2024-05-14T10:22:17.602 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.410744.log.gz 2024-05-14T10:22:17.608 INFO:teuthology.orchestra.run.smithi154.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.150894.log.gz 2024-05-14T10:22:17.613 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.176461.log.gz 2024-05-14T10:22:17.614 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.176062.log.gz 2024-05-14T10:22:17.666 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.152572.log.gz 2024-05-14T10:22:17.668 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.158900.log.gz 2024-05-14T10:22:17.675 INFO:teuthology.orchestra.run.smithi154.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.131140.log.gz 2024-05-14T10:22:17.675 INFO:teuthology.orchestra.run.smithi154.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.362242.log.gz 2024-05-14T10:22:17.684 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.156481.log.gz 2024-05-14T10:22:17.692 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.145844.log.gz 2024-05-14T10:22:17.692 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.146258.log.gz 2024-05-14T10:22:17.697 INFO:teuthology.orchestra.run.smithi154.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.486251.log.gz 2024-05-14T10:22:17.702 INFO:teuthology.orchestra.run.smithi154.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.405237.log.gz 2024-05-14T10:22:17.703 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.439057.log.gz 2024-05-14T10:22:17.704 INFO:teuthology.orchestra.run.smithi154.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.389937.log.gz 2024-05-14T10:22:17.706 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.415501.log.gz 2024-05-14T10:22:17.707 INFO:teuthology.orchestra.run.smithi154.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.427124.log.gz 2024-05-14T10:22:17.707 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.351073.log.gz 2024-05-14T10:22:17.717 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.86766.log.gz 2024-05-14T10:22:17.717 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.290680.log.gz 2024-05-14T10:22:17.720 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.328637.log.gz 2024-05-14T10:22:17.720 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.346878.log.gz 2024-05-14T10:22:17.722 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33282.log.gz 2024-05-14T10:22:17.724 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.406457.log.gz 2024-05-14T10:22:17.728 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.407697.log.gz 2024-05-14T10:22:17.736 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.485829.log.gz 2024-05-14T10:22:17.741 INFO:teuthology.orchestra.run.smithi154.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.294371.log.gz 2024-05-14T10:22:17.749 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.228009.log.gz 2024-05-14T10:22:17.751 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.286567.log.gz 2024-05-14T10:22:17.760 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36577.log.gz 2024-05-14T10:22:17.761 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36993.log.gz 2024-05-14T10:22:17.863 INFO:teuthology.orchestra.run.smithi154.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.243054.log.gz 2024-05-14T10:22:17.880 INFO:teuthology.orchestra.run.smithi154.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.347740.log.gz 2024-05-14T10:22:18.109 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.327752.log.gz 2024-05-14T10:22:18.289 INFO:teuthology.orchestra.run.smithi176.stderr: 95.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-14T10:22:18.755 INFO:teuthology.orchestra.run.smithi154.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.0.38049.log.gz 2024-05-14T10:22:21.318 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.489304.log.gz 2024-05-14T10:22:21.318 INFO:teuthology.orchestra.run.smithi154.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.242575.log.gz 2024-05-14T10:22:21.319 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35332.log.gz 2024-05-14T10:22:21.319 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34583.log.gz 2024-05-14T10:22:21.319 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.204833.log.gz 2024-05-14T10:22:21.319 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34375.log.gz 2024-05-14T10:22:21.319 INFO:teuthology.orchestra.run.smithi154.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.379859.log.gz 2024-05-14T10:22:21.319 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.107311.log.gz 2024-05-14T10:22:21.319 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.379020.log.gz 2024-05-14T10:22:21.320 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.186231.log.gz 2024-05-14T10:22:21.320 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.333282.log.gz 2024-05-14T10:22:21.320 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.183597.log.gz 2024-05-14T10:22:21.320 INFO:teuthology.orchestra.run.smithi154.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.434039.log.gz 2024-05-14T10:22:21.320 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.426317.log.gz 2024-05-14T10:22:21.320 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36551.log.gz 2024-05-14T10:22:21.320 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.408217.log.gz 2024-05-14T10:22:21.320 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.187863.log.gz 2024-05-14T10:22:21.321 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.241717.log.gz 2024-05-14T10:22:21.321 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% 85.3% -- replaced with /var/log/ceph/ceph-client.admin.163712.log.gz -- replaced with /var/log/ceph/ceph-client.admin.329518.log.gz 2024-05-14T10:22:21.321 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-05-14T10:22:21.321 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.468657.log.gz 2024-05-14T10:22:21.321 INFO:teuthology.orchestra.run.smithi154.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.217122.log.gz 2024-05-14T10:22:21.321 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% 85.6% -- replaced with /var/log/ceph/ceph-client.admin.346465.log.gz -- replaced with /var/log/ceph/ceph-client.admin.307757.log.gz 2024-05-14T10:22:21.321 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-05-14T10:22:21.322 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.85487.log.gz 2024-05-14T10:22:21.322 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.468206.log.gz 2024-05-14T10:22:21.322 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.82706.log.gz 2024-05-14T10:22:21.322 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% 80.0% -- replaced with /var/log/ceph/ceph-client.admin.289441.log.gz 2024-05-14T10:22:21.322 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.177691.log.gz 2024-05-14T10:22:21.323 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.123882.log.gz 2024-05-14T10:22:21.323 INFO:teuthology.orchestra.run.smithi154.stderr: 81.8% 81.6% -- replaced with /var/log/ceph/ceph-client.admin.440913.log.gz 2024-05-14T10:22:21.323 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.492751.log.gz 2024-05-14T10:22:21.323 INFO:teuthology.orchestra.run.smithi154.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.100699.log.gz 2024-05-14T10:22:21.323 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35568.log.gz 2024-05-14T10:22:21.323 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.375317.log.gz 2024-05-14T10:22:21.323 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.295744.log.gz 2024-05-14T10:22:21.323 INFO:teuthology.orchestra.run.smithi154.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.467352.log.gz 2024-05-14T10:22:21.324 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.475123.log.gz 2024-05-14T10:22:21.324 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37657.log.gz 2024-05-14T10:22:21.324 INFO:teuthology.orchestra.run.smithi154.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.322228.log.gz 2024-05-14T10:22:21.324 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.129755.log.gz 2024-05-14T10:22:21.324 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.406466.log.gz 2024-05-14T10:22:21.325 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.295296.log.gz 2024-05-14T10:22:21.325 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.170686.log.gz 2024-05-14T10:22:21.325 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.225001.log.gz 2024-05-14T10:22:21.325 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.425499.log.gz 2024-05-14T10:22:21.326 INFO:teuthology.orchestra.run.smithi154.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.326398.log.gz 2024-05-14T10:22:21.326 INFO:teuthology.orchestra.run.smithi154.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.332321.log.gz 2024-05-14T10:22:21.326 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.373230.log.gz 2024-05-14T10:22:21.327 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.246036.log.gz 2024-05-14T10:22:21.327 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.308584.log.gz 2024-05-14T10:22:21.327 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.226235.log.gz 2024-05-14T10:22:21.327 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37221.log.gz 2024-05-14T10:22:21.327 INFO:teuthology.orchestra.run.smithi154.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.328202.log.gz 2024-05-14T10:22:21.327 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.173206.log.gz 2024-05-14T10:22:21.328 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.27710.log.gz 2024-05-14T10:22:21.328 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.454449.log.gz 2024-05-14T10:22:21.328 INFO:teuthology.orchestra.run.smithi154.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.185220.log.gz 2024-05-14T10:22:21.328 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.243984.log.gz 2024-05-14T10:22:21.329 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.213550.log.gz 2024-05-14T10:22:21.329 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.428397.log.gz 2024-05-14T10:22:21.329 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.203946.log.gz 2024-05-14T10:22:21.330 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.425088.log.gz 2024-05-14T10:22:21.330 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.311868.log.gz 2024-05-14T10:22:21.330 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.304007.log.gz 2024-05-14T10:22:21.330 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.203537.log.gz 2024-05-14T10:22:21.330 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.221310.log.gz 2024-05-14T10:22:21.330 INFO:teuthology.orchestra.run.smithi154.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.81877.log.gz 2024-05-14T10:22:21.330 INFO:teuthology.orchestra.run.smithi154.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.481951.log.gz 2024-05-14T10:22:21.331 INFO:teuthology.orchestra.run.smithi154.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.293131.log.gz 2024-05-14T10:22:21.331 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.118327.log.gz 2024-05-14T10:22:21.331 INFO:teuthology.orchestra.run.smithi154.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.301564.log.gz 2024-05-14T10:22:21.331 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.389538.log.gz 2024-05-14T10:22:21.331 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.318006.log.gz 2024-05-14T10:22:21.331 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.471270.log.gz 2024-05-14T10:22:21.331 INFO:teuthology.orchestra.run.smithi154.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.489704.log.gz 2024-05-14T10:22:21.331 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% 81.6% -- replaced with /var/log/ceph/ceph-client.admin.190779.log.gz -- replaced with /var/log/ceph/ceph-client.admin.334199.log.gz 2024-05-14T10:22:21.332 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-05-14T10:22:21.332 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.224184.log.gz 2024-05-14T10:22:21.332 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.112857.log.gz 2024-05-14T10:22:21.332 INFO:teuthology.orchestra.run.smithi154.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.374900.log.gz 2024-05-14T10:22:21.332 INFO:teuthology.orchestra.run.smithi154.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.491030.log.gz 2024-05-14T10:22:21.332 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.181528.log.gz 2024-05-14T10:22:21.332 INFO:teuthology.orchestra.run.smithi154.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.360210.log.gz 2024-05-14T10:22:21.332 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.164557.log.gz 2024-05-14T10:22:21.332 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.447872.log.gz 2024-05-14T10:22:21.333 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.429722.log.gz 2024-05-14T10:22:21.333 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.427541.log.gz 2024-05-14T10:22:21.334 INFO:teuthology.orchestra.run.smithi154.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.171978.log.gz 2024-05-14T10:22:21.334 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.480666.log.gz 2024-05-14T10:22:21.334 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.284116.log.gz 2024-05-14T10:22:21.334 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.487611.log.gz 2024-05-14T10:22:21.334 INFO:teuthology.orchestra.run.smithi154.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.331812.log.gz 2024-05-14T10:22:21.334 INFO:teuthology.orchestra.run.smithi154.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.482383.log.gz 2024-05-14T10:22:21.334 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.35091.log.gz 2024-05-14T10:22:21.334 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36629.log.gz 2024-05-14T10:22:21.334 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.330350.log.gz 2024-05-14T10:22:21.335 INFO:teuthology.orchestra.run.smithi154.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.315208.log.gz 2024-05-14T10:22:21.335 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.103964.log.gz 2024-05-14T10:22:21.335 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34401.log.gz 2024-05-14T10:22:21.335 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.443379.log.gz 2024-05-14T10:22:21.335 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37709.log.gz 2024-05-14T10:22:21.335 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.460156.log.gz 2024-05-14T10:22:21.335 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.426725.log.gz 2024-05-14T10:22:21.336 INFO:teuthology.orchestra.run.smithi154.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.422790.log.gz 2024-05-14T10:22:21.336 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.459747.log.gz 2024-05-14T10:22:21.336 INFO:teuthology.orchestra.run.smithi154.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.478501.log.gz 2024-05-14T10:22:21.336 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.296560.log.gz 2024-05-14T10:22:21.336 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.220484.log.gz 2024-05-14T10:22:21.336 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.172381.log.gz 2024-05-14T10:22:21.336 INFO:teuthology.orchestra.run.smithi154.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.122960.log.gz 2024-05-14T10:22:21.336 INFO:teuthology.orchestra.run.smithi154.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.96929.log.gz 2024-05-14T10:22:21.337 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.186648.log.gz 2024-05-14T10:22:21.337 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.359810.log.gz 2024-05-14T10:22:21.337 INFO:teuthology.orchestra.run.smithi154.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.467770.log.gz 2024-05-14T10:22:21.337 INFO:teuthology.orchestra.run.smithi154.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.403111.log.gz 2024-05-14T10:22:21.337 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-14T10:22:21.337 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.232506.log.gz 2024-05-14T10:22:21.337 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.302378.log.gz 2024-05-14T10:22:21.337 INFO:teuthology.orchestra.run.smithi154.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.244802.log.gz 2024-05-14T10:22:21.338 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.102341.log.gz 2024-05-14T10:22:21.338 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.179777.log.gz 2024-05-14T10:22:21.338 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.105205.log.gz 2024-05-14T10:22:21.338 INFO:teuthology.orchestra.run.smithi154.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.152134.log.gz 2024-05-14T10:22:21.338 INFO:teuthology.orchestra.run.smithi154.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.227184.log.gz 2024-05-14T10:22:21.338 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.218415.log.gz 2024-05-14T10:22:21.338 INFO:teuthology.orchestra.run.smithi154.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.107302.log.gz 2024-05-14T10:22:21.339 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.306945.log.gz 2024-05-14T10:22:21.339 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33927.log.gz 2024-05-14T10:22:21.339 INFO:teuthology.orchestra.run.smithi154.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.421821.log.gz 2024-05-14T10:22:21.339 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.203546.log.gz 2024-05-14T10:22:21.339 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.232905.log.gz 2024-05-14T10:22:21.339 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33406.log.gz 2024-05-14T10:22:21.339 INFO:teuthology.orchestra.run.smithi154.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.108628.log.gz 2024-05-14T10:22:21.340 INFO:teuthology.orchestra.run.smithi154.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.346052.log.gz 2024-05-14T10:22:21.340 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.345174.log.gz 2024-05-14T10:22:21.340 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.364513.log.gz 2024-05-14T10:22:21.340 INFO:teuthology.orchestra.run.smithi154.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.412817.log.gz 2024-05-14T10:22:21.340 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.459348.log.gz 2024-05-14T10:22:21.340 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.484107.log.gz 2024-05-14T10:22:21.340 INFO:teuthology.orchestra.run.smithi154.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.411185.log.gz 2024-05-14T10:22:21.340 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.488042.log.gz 2024-05-14T10:22:21.341 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.423379.log.gz 2024-05-14T10:22:21.341 INFO:teuthology.orchestra.run.smithi154.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.450060.log.gz 2024-05-14T10:22:21.341 INFO:teuthology.orchestra.run.smithi154.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.427989.log.gz 2024-05-14T10:22:21.341 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34131.log.gz 2024-05-14T10:22:21.341 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36525.log.gz 2024-05-14T10:22:21.341 INFO:teuthology.orchestra.run.smithi154.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.81456.log.gz 2024-05-14T10:22:21.341 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.231264.log.gz 2024-05-14T10:22:21.341 INFO:teuthology.orchestra.run.smithi154.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.358075.log.gz 2024-05-14T10:22:21.342 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.148730.log.gz 2024-05-14T10:22:21.342 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.318822.log.gz 2024-05-14T10:22:21.342 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.402689.log.gz 2024-05-14T10:22:21.342 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.157469.log.gz 2024-05-14T10:22:21.342 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.217594.log.gz 2024-05-14T10:22:21.342 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.171114.log.gz 2024-05-14T10:22:21.342 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35436.log.gz 2024-05-14T10:22:21.343 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.106440.log.gz 2024-05-14T10:22:21.343 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.364926.log.gz 2024-05-14T10:22:21.343 INFO:teuthology.orchestra.run.smithi154.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.235419.log.gz 2024-05-14T10:22:21.343 INFO:teuthology.orchestra.run.smithi154.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.453389.log.gz 2024-05-14T10:22:21.343 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.289026.log.gz 2024-05-14T10:22:21.343 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.442559.log.gz 2024-05-14T10:22:21.343 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.207791.log.gz 2024-05-14T10:22:21.343 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33511.log.gz 2024-05-14T10:22:21.344 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36075.log.gz 2024-05-14T10:22:21.344 INFO:teuthology.orchestra.run.smithi154.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.362523.log.gz 2024-05-14T10:22:21.344 INFO:teuthology.orchestra.run.smithi154.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.380676.log.gz 2024-05-14T10:22:21.344 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.212743.log.gz 2024-05-14T10:22:21.344 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35757.log.gz 2024-05-14T10:22:21.344 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.401342.log.gz 2024-05-14T10:22:21.344 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.188737.log.gz 2024-05-14T10:22:21.344 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.299944.log.gz 2024-05-14T10:22:21.344 INFO:teuthology.orchestra.run.smithi154.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.387964.log.gz 2024-05-14T10:22:21.345 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.348593.log.gz 2024-05-14T10:22:21.345 INFO:teuthology.orchestra.run.smithi154.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.159299.log.gz 2024-05-14T10:22:21.345 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.217603.log.gz 2024-05-14T10:22:21.345 INFO:teuthology.orchestra.run.smithi154.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.331821.log.gz 2024-05-14T10:22:21.345 INFO:teuthology.orchestra.run.smithi154.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.215489.log.gz 2024-05-14T10:22:21.345 INFO:teuthology.orchestra.run.smithi154.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.364091.log.gz 2024-05-14T10:22:21.345 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.216714.log.gz 2024-05-14T10:22:21.345 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.459756.log.gz 2024-05-14T10:22:21.346 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.122142.log.gz 2024-05-14T10:22:21.346 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.285345.log.gz 2024-05-14T10:22:21.346 INFO:teuthology.orchestra.run.smithi154.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.287397.log.gz 2024-05-14T10:22:21.346 INFO:teuthology.orchestra.run.smithi154.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.365759.log.gz 2024-05-14T10:22:21.346 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.385995.log.gz 2024-05-14T10:22:21.346 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.86757.log.gz 2024-05-14T10:22:21.346 INFO:teuthology.orchestra.run.smithi154.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.222527.log.gz 2024-05-14T10:22:21.347 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.191595.log.gz 2024-05-14T10:22:21.347 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.199407.log.gz 2024-05-14T10:22:21.347 INFO:teuthology.orchestra.run.smithi154.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.473881.log.gz 2024-05-14T10:22:21.347 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.385153.log.gz 2024-05-14T10:22:21.347 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.485398.log.gz 2024-05-14T10:22:21.347 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.434447.log.gz 2024-05-14T10:22:21.347 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.434048.log.gz 2024-05-14T10:22:21.347 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.449382.log.gz 2024-05-14T10:22:21.348 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.152143.log.gz 2024-05-14T10:22:21.348 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.466944.log.gz 2024-05-14T10:22:21.348 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.106431.log.gz 2024-05-14T10:22:21.348 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.484966.log.gz 2024-05-14T10:22:21.348 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.491446.log.gz 2024-05-14T10:22:21.348 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.423388.log.gz 2024-05-14T10:22:21.348 INFO:teuthology.orchestra.run.smithi154.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.331321.log.gz 2024-05-14T10:22:21.349 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.362305.log.gz 2024-05-14T10:22:21.349 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.437783.log.gz 2024-05-14T10:22:21.349 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36681.log.gz 2024-05-14T10:22:21.349 INFO:teuthology.orchestra.run.smithi154.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.431515.log.gz 2024-05-14T10:22:21.349 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.431933.log.gz 2024-05-14T10:22:21.349 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.202728.log.gz 2024-05-14T10:22:21.349 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.165876.log.gz 2024-05-14T10:22:21.349 INFO:teuthology.orchestra.run.smithi154.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.299935.log.gz 2024-05-14T10:22:21.350 INFO:teuthology.orchestra.run.smithi154.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.286984.log.gz 2024-05-14T10:22:21.350 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.431045.log.gz 2024-05-14T10:22:21.350 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33485.log.gz 2024-05-14T10:22:21.350 INFO:teuthology.orchestra.run.smithi154.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.475534.log.gz 2024-05-14T10:22:21.350 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.440437.log.gz 2024-05-14T10:22:21.350 INFO:teuthology.orchestra.run.smithi154.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.171565.log.gz 2024-05-14T10:22:21.350 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.386815.log.gz 2024-05-14T10:22:21.351 INFO:teuthology.orchestra.run.smithi154.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37761.log.gz 2024-05-14T10:22:21.351 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.353971.log.gz 2024-05-14T10:22:21.351 INFO:teuthology.orchestra.run.smithi154.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.400859.log.gz 2024-05-14T10:22:21.351 INFO:teuthology.orchestra.run.smithi154.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.400018.log.gz 2024-05-14T10:22:21.351 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.424614.log.gz 2024-05-14T10:22:21.351 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.103148.log.gz 2024-05-14T10:22:21.351 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.176871.log.gz 2024-05-14T10:22:21.351 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.178519.log.gz 2024-05-14T10:22:21.352 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.171556.log.gz 2024-05-14T10:22:21.352 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.173605.log.gz 2024-05-14T10:22:21.352 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33930.log.gz 2024-05-14T10:22:21.352 INFO:teuthology.orchestra.run.smithi154.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.334208.log.gz 2024-05-14T10:22:21.352 INFO:teuthology.orchestra.run.smithi154.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.233721.log.gz 2024-05-14T10:22:21.352 INFO:teuthology.orchestra.run.smithi154.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.386004.log.gz 2024-05-14T10:22:21.352 INFO:teuthology.orchestra.run.smithi154.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.320081.log.gz 2024-05-14T10:22:21.352 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.181087.log.gz 2024-05-14T10:22:21.353 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.188728.log.gz 2024-05-14T10:22:21.353 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.424196.log.gz 2024-05-14T10:22:21.353 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.460564.log.gz 2024-05-14T10:22:21.353 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.401816.log.gz 2024-05-14T10:22:21.353 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.122550.log.gz 2024-05-14T10:22:21.353 INFO:teuthology.orchestra.run.smithi154.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.305240.log.gz 2024-05-14T10:22:21.353 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.365339.log.gz 2024-05-14T10:22:21.354 INFO:teuthology.orchestra.run.smithi154.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.475525.log.gz 2024-05-14T10:22:21.354 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.481528.log.gz 2024-05-14T10:22:21.354 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.481960.log.gz 2024-05-14T10:22:21.354 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.482823.log.gz 2024-05-14T10:22:21.354 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.156067.log.gz 2024-05-14T10:22:21.354 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.148317.log.gz 2024-05-14T10:22:21.354 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.153427.log.gz 2024-05-14T10:22:21.354 INFO:teuthology.orchestra.run.smithi154.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.91567.log.gz 2024-05-14T10:22:21.355 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.486711.log.gz 2024-05-14T10:22:21.355 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.470439.log.gz 2024-05-14T10:22:21.355 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.192045.log.gz 2024-05-14T10:22:21.355 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.131131.log.gz 2024-05-14T10:22:21.355 INFO:teuthology.orchestra.run.smithi154.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.163275.log.gz 2024-05-14T10:22:21.355 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37430.log.gz 2024-05-14T10:22:21.355 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.94056.log.gz 2024-05-14T10:22:21.355 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.387955.log.gz 2024-05-14T10:22:21.356 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.355627.log.gz 2024-05-14T10:22:21.356 INFO:teuthology.orchestra.run.smithi154.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.185652.log.gz 2024-05-14T10:22:21.356 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.436102.log.gz 2024-05-14T10:22:21.356 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.288612.log.gz 2024-05-14T10:22:21.356 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37352.log.gz 2024-05-14T10:22:21.356 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.200632.log.gz 2024-05-14T10:22:21.356 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.328211.log.gz 2024-05-14T10:22:21.356 INFO:teuthology.orchestra.run.smithi154.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.491437.log.gz 2024-05-14T10:22:21.356 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.369127.log.gz 2024-05-14T10:22:21.357 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.297859.log.gz 2024-05-14T10:22:21.357 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.298267.log.gz 2024-05-14T10:22:21.357 INFO:teuthology.orchestra.run.smithi154.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.208235.log.gz 2024-05-14T10:22:21.357 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.478931.log.gz 2024-05-14T10:22:21.357 INFO:teuthology.orchestra.run.smithi154.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.385566.log.gz 2024-05-14T10:22:21.357 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.352728.log.gz 2024-05-14T10:22:21.357 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.85064.log.gz 2024-05-14T10:22:21.357 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.92782.log.gz 2024-05-14T10:22:21.358 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.362203.log.gz 2024-05-14T10:22:21.358 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.362292.log.gz 2024-05-14T10:22:21.358 INFO:teuthology.orchestra.run.smithi154.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.409910.log.gz 2024-05-14T10:22:21.358 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.371980.log.gz 2024-05-14T10:22:21.358 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.119629.log.gz 2024-05-14T10:22:21.358 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.479804.log.gz 2024-05-14T10:22:21.358 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.79231.log.gz 2024-05-14T10:22:21.358 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35620.log.gz 2024-05-14T10:22:21.359 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.464702.log.gz 2024-05-14T10:22:21.359 INFO:teuthology.orchestra.run.smithi154.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.409457.log.gz 2024-05-14T10:22:21.359 INFO:teuthology.orchestra.run.smithi154.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.83166.log.gz 2024-05-14T10:22:21.359 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.149555.log.gz 2024-05-14T10:22:21.359 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.471261.log.gz 2024-05-14T10:22:21.359 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37045.log.gz 2024-05-14T10:22:21.360 INFO:teuthology.orchestra.run.smithi154.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.178919.log.gz 2024-05-14T10:22:21.360 INFO:teuthology.orchestra.run.smithi154.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.409448.log.gz 2024-05-14T10:22:21.360 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.207782.log.gz 2024-05-14T10:22:21.361 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.149148.log.gz 2024-05-14T10:22:21.582 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.330831.log.gz 2024-05-14T10:22:21.720 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.483685.log.gz 2024-05-14T10:22:21.721 INFO:teuthology.orchestra.run.smithi154.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.182774.log.gz 2024-05-14T10:22:21.905 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.366181.log.gz 2024-05-14T10:22:21.910 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.161524.log.gz 2024-05-14T10:22:21.924 INFO:teuthology.orchestra.run.smithi154.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.484116.log.gz 2024-05-14T10:22:21.924 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.81009.log.gz 2024-05-14T10:22:21.929 INFO:teuthology.orchestra.run.smithi154.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.123891.log.gz 2024-05-14T10:22:21.932 INFO:teuthology.orchestra.run.smithi154.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.352288.log.gz 2024-05-14T10:22:21.943 INFO:teuthology.orchestra.run.smithi154.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.162847.log.gz 2024-05-14T10:22:22.107 INFO:teuthology.orchestra.run.smithi154.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.85478.log.gz 2024-05-14T10:22:22.136 INFO:teuthology.orchestra.run.smithi154.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.109038.log.gz 2024-05-14T10:22:22.146 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.174430.log.gz 2024-05-14T10:22:22.146 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.123425.log.gz 2024-05-14T10:22:22.323 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.488888.log.gz 2024-05-14T10:22:22.382 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.241314.log.gz 2024-05-14T10:22:22.384 INFO:teuthology.orchestra.run.smithi154.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.168929.log.gz 2024-05-14T10:22:22.395 INFO:teuthology.orchestra.run.smithi154.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.194285.log.gz 2024-05-14T10:22:22.411 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.197342.log.gz 2024-05-14T10:22:22.420 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.472835.log.gz 2024-05-14T10:22:22.899 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.152581.log.gz 2024-05-14T10:22:22.952 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.203955.log.gz 2024-05-14T10:22:22.977 INFO:teuthology.orchestra.run.smithi154.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.187872.log.gz 2024-05-14T10:22:23.024 INFO:teuthology.orchestra.run.smithi154.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.159308.log.gz 2024-05-14T10:22:23.051 INFO:teuthology.orchestra.run.smithi154.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.204396.log.gz 2024-05-14T10:22:23.051 INFO:teuthology.orchestra.run.smithi154.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.205662.log.gz 2024-05-14T10:22:23.104 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.486260.log.gz 2024-05-14T10:22:23.281 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.368688.log.gz 2024-05-14T10:22:23.302 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.323885.log.gz 2024-05-14T10:22:23.304 INFO:teuthology.orchestra.run.smithi154.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.180650.log.gz 2024-05-14T10:22:23.471 INFO:teuthology.orchestra.run.smithi154.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.477655.log.gz 2024-05-14T10:22:23.933 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.349011.log.gz 2024-05-14T10:22:24.448 INFO:teuthology.orchestra.run.smithi154.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.113285.log.gz 2024-05-14T10:22:24.449 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.171123.log.gz 2024-05-14T10:22:24.449 INFO:teuthology.orchestra.run.smithi154.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.329918.log.gz 2024-05-14T10:22:24.449 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45242.log.gz 2024-05-14T10:22:24.450 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.244384.log.gz 2024-05-14T10:22:24.450 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.177290.log.gz 2024-05-14T10:22:24.518 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.228417.log.gz 2024-05-14T10:22:24.525 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.170677.log.gz 2024-05-14T10:22:24.549 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.430139.log.gz 2024-05-14T10:22:24.557 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.199806.log.gz 2024-05-14T10:22:25.140 INFO:teuthology.orchestra.run.smithi154.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.362155.log.gz 2024-05-14T10:22:25.186 INFO:teuthology.orchestra.run.smithi154.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.472569.log.gz 2024-05-14T10:22:25.274 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.194750.log.gz 2024-05-14T10:22:25.278 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.362251.log.gz 2024-05-14T10:22:25.495 INFO:teuthology.orchestra.run.smithi154.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.469987.log.gz 2024-05-14T10:22:25.587 INFO:teuthology.orchestra.run.smithi154.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.120048.log.gz 2024-05-14T10:22:31.840 INFO:teuthology.orchestra.run.smithi154.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.350339.log.gz 2024-05-14T10:22:32.209 INFO:teuthology.orchestra.run.smithi154.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.156947.log.gz 2024-05-14T10:22:32.210 INFO:teuthology.orchestra.run.smithi154.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.80068.log.gz 2024-05-14T10:22:34.542 INFO:teuthology.orchestra.run.smithi154.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.333754.log.gz 2024-05-14T10:22:37.841 INFO:teuthology.orchestra.run.smithi154.stderr: 97.3% -- replaced with /var/log/ceph/ceph-client.admin.349858.log.gz 2024-05-14T10:22:38.966 INFO:teuthology.orchestra.run.smithi154.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.226244.log.gz 2024-05-14T10:22:42.281 INFO:teuthology.orchestra.run.smithi154.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-14T10:22:42.448 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.92040.log.gz 2024-05-14T10:22:44.339 INFO:teuthology.orchestra.run.smithi154.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.195261.log.gz 2024-05-14T10:22:46.556 INFO:teuthology.orchestra.run.smithi154.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.214021.log.gz 2024-05-14T10:22:49.630 INFO:teuthology.orchestra.run.smithi154.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.357587.log.gz 2024-05-14T10:22:50.872 INFO:teuthology.orchestra.run.smithi154.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.192518.log.gz 2024-05-14T10:22:53.139 INFO:teuthology.orchestra.run.smithi154.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.214455.log.gz 2024-05-14T10:22:54.340 INFO:teuthology.orchestra.run.smithi154.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.91576.log.gz 2024-05-14T10:22:57.936 INFO:teuthology.orchestra.run.smithi154.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.81886.log.gz 2024-05-14T10:22:58.289 INFO:teuthology.orchestra.run.smithi154.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.417331.log.gz 2024-05-14T10:22:58.508 INFO:teuthology.orchestra.run.smithi154.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.107725.log.gz 2024-05-14T10:22:58.524 INFO:teuthology.orchestra.run.smithi154.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.94464.log.gz 2024-05-14T10:22:59.449 INFO:teuthology.orchestra.run.smithi154.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.294380.log.gz 2024-05-14T10:22:59.450 INFO:teuthology.orchestra.run.smithi154.stderr: 97.3% -- replaced with /var/log/ceph/ceph-client.admin.295305.log.gz 2024-05-14T10:23:02.249 INFO:teuthology.orchestra.run.smithi154.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.213559.log.gz 2024-05-14T10:23:02.316 INFO:teuthology.orchestra.run.smithi154.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.319648.log.gz 2024-05-14T10:23:02.948 INFO:teuthology.orchestra.run.smithi154.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.106856.log.gz 2024-05-14T10:23:03.993 INFO:teuthology.orchestra.run.smithi154.stderr: 97.6% -- replaced with /var/log/ceph/ceph-client.admin.243542.log.gz 2024-05-14T10:23:04.576 INFO:teuthology.orchestra.run.smithi154.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.91113.log.gz 2024-05-14T10:23:05.766 INFO:teuthology.orchestra.run.smithi154.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.469106.log.gz 2024-05-14T10:23:05.803 INFO:teuthology.orchestra.run.smithi154.stderr: 97.3% -- replaced with /var/log/ceph/ceph-client.admin.326407.log.gz 2024-05-14T10:23:06.326 INFO:teuthology.orchestra.run.smithi154.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.81465.log.gz 2024-05-14T10:23:07.260 INFO:teuthology.orchestra.run.smithi154.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.85895.log.gz 2024-05-14T10:23:09.049 INFO:teuthology.orchestra.run.smithi154.stderr: 97.3% -- replaced with /var/log/ceph/ceph-client.admin.83175.log.gz 2024-05-14T10:23:12.257 INFO:teuthology.orchestra.run.smithi154.stderr: 97.3% -- replaced with /var/log/ceph/ceph-client.admin.366594.log.gz 2024-05-14T10:23:12.601 INFO:teuthology.orchestra.run.smithi154.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.112866.log.gz 2024-05-14T10:23:13.360 INFO:teuthology.orchestra.run.smithi154.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.191604.log.gz 2024-05-14T10:23:13.430 INFO:teuthology.orchestra.run.smithi154.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.490152.log.gz 2024-05-14T10:23:14.586 INFO:teuthology.orchestra.run.smithi154.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.468215.log.gz 2024-05-14T10:23:16.157 INFO:teuthology.orchestra.run.smithi154.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.468666.log.gz 2024-05-14T10:23:16.157 INFO:teuthology.orchestra.run.smithi154.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.469546.log.gz 2024-05-14T10:23:18.398 INFO:teuthology.orchestra.run.smithi154.stderr: 97.6% -- replaced with /var/log/ceph/ceph-client.admin.294810.log.gz 2024-05-14T10:23:20.936 INFO:teuthology.orchestra.run.smithi154.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.397101.log.gz 2024-05-14T10:23:21.054 INFO:teuthology.orchestra.run.smithi154.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.109047.log.gz 2024-05-14T10:23:24.014 INFO:teuthology.orchestra.run.smithi154.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.108181.log.gz 2024-05-14T10:23:29.424 INFO:teuthology.orchestra.run.smithi176.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-14T10:23:30.476 INFO:teuthology.orchestra.run.smithi154.stderr: 96.3% -- replaced with /var/log/ceph/ceph-client.admin.356480.log.gz 2024-05-14T10:23:30.477 INFO:teuthology.orchestra.run.smithi154.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.87583.log.gz 2024-05-14T10:23:36.045 INFO:teuthology.orchestra.run.smithi154.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.211066.log.gz 2024-05-14T10:23:37.688 INFO:teuthology.orchestra.run.smithi154.stderr: 97.3% -- replaced with /var/log/ceph/ceph-client.admin.358492.log.gz 2024-05-14T10:23:49.965 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.439465.log.gz 2024-05-14T10:23:53.030 INFO:teuthology.orchestra.run.smithi176.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-14T10:24:01.751 INFO:teuthology.orchestra.run.smithi154.stderr: 97.8% -- replaced with /var/log/ceph/ceph-client.admin.437332.log.gz 2024-05-14T10:24:04.599 INFO:teuthology.orchestra.run.smithi154.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.208670.log.gz 2024-05-14T10:24:08.031 INFO:teuthology.orchestra.run.smithi176.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-14T10:25:09.228 INFO:teuthology.orchestra.run.smithi154.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.217131.log.gz 2024-05-14T10:25:13.272 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.84845.log.gz 2024-05-14T10:25:16.688 INFO:teuthology.orchestra.run.smithi176.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-14T10:25:28.572 INFO:teuthology.orchestra.run.smithi176.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-14T10:25:28.573 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-05-14T10:25:28.574 INFO:teuthology.orchestra.run.smithi176.stderr:real 3m15.654s 2024-05-14T10:25:28.574 INFO:teuthology.orchestra.run.smithi176.stderr:user 4m6.448s 2024-05-14T10:25:28.574 INFO:teuthology.orchestra.run.smithi176.stderr:sys 0m11.468s 2024-05-14T10:25:45.374 INFO:teuthology.orchestra.run.smithi154.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.150427.log.gz 2024-05-14T10:25:45.508 INFO:teuthology.orchestra.run.smithi154.stderr: 97.4% -- replaced with /var/log/ceph/ceph-client.admin.97798.log.gz 2024-05-14T10:25:57.968 INFO:teuthology.orchestra.run.smithi154.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.311877.log.gz 2024-05-14T10:26:02.483 INFO:teuthology.orchestra.run.smithi154.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.118336.log.gz 2024-05-14T10:26:09.737 INFO:teuthology.orchestra.run.smithi154.stderr: 96.3% -- replaced with /var/log/ceph/ceph-client.admin.192054.log.gz 2024-05-14T10:26:10.616 INFO:teuthology.orchestra.run.smithi154.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.431054.log.gz 2024-05-14T10:27:41.937 INFO:teuthology.orchestra.run.smithi154.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.150903.log.gz 2024-05-14T10:28:42.630 INFO:teuthology.orchestra.run.smithi154.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.127499.log.gz 2024-05-14T10:28:47.938 INFO:teuthology.orchestra.run.smithi154.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.329046.log.gz 2024-05-14T10:30:01.713 INFO:teuthology.orchestra.run.smithi154.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-14T10:30:55.265 INFO:teuthology.orchestra.run.smithi154.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.80562.log.gz 2024-05-14T10:31:18.346 INFO:teuthology.orchestra.run.smithi154.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.111980.log.gz 2024-05-14T10:31:52.698 INFO:teuthology.orchestra.run.smithi154.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.160163.log.gz 2024-05-14T10:32:42.630 INFO:teuthology.orchestra.run.smithi154.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.131577.log.gz 2024-05-14T10:33:42.902 INFO:teuthology.orchestra.run.smithi154.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.359368.log.gz 2024-05-14T10:34:42.157 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.82715.log.gz 2024-05-14T10:35:01.381 INFO:teuthology.orchestra.run.smithi154.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.430547.log.gz 2024-05-14T10:36:06.162 INFO:teuthology.orchestra.run.smithi154.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.490593.log.gz 2024-05-14T10:40:01.321 INFO:teuthology.orchestra.run.smithi154.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.226691.log.gz 2024-05-14T10:40:08.529 INFO:teuthology.orchestra.run.smithi154.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.335640.log.gz 2024-05-14T10:40:42.958 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.454219.log.gz 2024-05-14T10:41:12.783 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.81018.log.gz 2024-05-14T10:43:13.643 INFO:teuthology.orchestra.run.smithi154.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.206085.log.gz 2024-05-14T10:43:50.927 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.83634.log.gz 2024-05-14T10:45:11.169 INFO:teuthology.orchestra.run.smithi154.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-14T10:45:34.089 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-14T10:49:52.999 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.448642.log.gz 2024-05-14T10:50:39.530 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.445077.log.gz 2024-05-14T10:50:51.503 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.447106.log.gz 2024-05-14T10:50:59.890 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.451761.log.gz 2024-05-14T10:51:00.320 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.449391.log.gz 2024-05-14T10:51:07.871 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.450936.log.gz 2024-05-14T10:51:20.935 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.452628.log.gz 2024-05-14T10:51:38.008 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.453398.log.gz 2024-05-14T10:52:00.595 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.447881.log.gz 2024-05-14T10:52:33.039 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.450069.log.gz 2024-05-14T10:53:13.616 INFO:teuthology.orchestra.run.smithi154.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.246448.log.gz 2024-05-14T11:00:51.475 INFO:teuthology.orchestra.run.smithi154.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.157478.log.gz 2024-05-14T11:01:42.754 INFO:teuthology.orchestra.run.smithi154.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.389946.log.gz 2024-05-14T11:02:33.349 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-14T11:05:51.972 INFO:teuthology.orchestra.run.smithi154.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.236715.log.gz 2024-05-14T11:14:21.058 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-14T11:15:01.435 INFO:teuthology.orchestra.run.smithi154.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.381506.log.gz 2024-05-14T11:15:52.199 INFO:teuthology.orchestra.run.smithi154.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.382532.log.gz 2024-05-14T11:16:30.153 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-14T11:20:33.368 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-14T11:22:00.917 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.124333.log.gz 2024-05-14T12:27:18.630 INFO:teuthology.orchestra.run.smithi154.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.492760.log.gz 2024-05-14T12:29:27.169 INFO:teuthology.orchestra.run.smithi154.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.113707.log.gz 2024-05-14T12:29:59.840 INFO:teuthology.orchestra.run.smithi154.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.464711.log.gz 2024-05-14T12:29:59.841 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-05-14T12:29:59.841 INFO:teuthology.orchestra.run.smithi154.stderr:real 127m46.950s 2024-05-14T12:29:59.841 INFO:teuthology.orchestra.run.smithi154.stderr:user 85m58.627s 2024-05-14T12:29:59.841 INFO:teuthology.orchestra.run.smithi154.stderr:sys 4m27.607s 2024-05-14T12:29:59.843 INFO:tasks.ceph:Archiving logs... 2024-05-14T12:29:59.845 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi/7705395/remote/smithi154/log 2024-05-14T12:29:59.847 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-14T12:38:58.609 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi/7705395/remote/smithi176/log 2024-05-14T12:38:58.662 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-14T12:41:38.510 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-14T12:41:38.520 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-14T12:41:38.520 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-14T12:41:38.523 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-14T12:41:38.616 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-14T12:41:38.625 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-14T12:41:38.625 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T12:41:38.628 DEBUG:teuthology.orchestra.run.smithi176:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T12:41:38.678 INFO:teuthology.orchestra.run.smithi176.stdout: remote refid st t when poll reach delay offset jitter 2024-05-14T12:41:38.678 INFO:teuthology.orchestra.run.smithi176.stdout:============================================================================== 2024-05-14T12:41:38.678 INFO:teuthology.orchestra.run.smithi176.stdout:+hv01.front.sepi 67.205.162.81 3 u 39 1024 377 0.193 -4.289 0.272 2024-05-14T12:41:38.678 INFO:teuthology.orchestra.run.smithi176.stdout:*hv02.front.sepi 63.231.80.2 3 u 623 1024 377 0.219 -2.498 0.571 2024-05-14T12:41:38.678 INFO:teuthology.orchestra.run.smithi176.stdout:+hv03.front.sepi 74.6.168.72 3 u 976 1024 377 0.215 -2.945 0.330 2024-05-14T12:41:38.679 INFO:teuthology.orchestra.run.smithi176.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-05-14T12:41:38.760 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2024-05-14T12:41:38.760 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2024-05-14T12:41:38.760 INFO:teuthology.orchestra.run.smithi154.stdout:+hv01.front.sepi 67.205.162.81 3 u 418 1024 377 0.223 -2.573 0.320 2024-05-14T12:41:38.760 INFO:teuthology.orchestra.run.smithi154.stdout:*hv02.front.sepi 63.231.80.2 3 u 64 1024 377 0.207 -0.870 0.534 2024-05-14T12:41:38.760 INFO:teuthology.orchestra.run.smithi154.stdout:+hv03.front.sepi 74.6.168.72 3 u 463 1024 377 0.224 -1.145 0.198 2024-05-14T12:41:38.760 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-05-14T12:41:38.761 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-14T12:41:38.771 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-14T12:41:38.771 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-14T12:41:38.780 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-14T12:41:38.788 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-14T12:41:38.797 INFO:teuthology.task.internal:Duration was 41355.160359 seconds 2024-05-14T12:41:38.797 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-14T12:41:38.807 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-14T12:41:38.807 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-14T12:41:38.809 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-14T12:41:39.122 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-14T12:41:39.122 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-05-14T12:41:39.123 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-14T12:41:39.233 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi176.front.sepia.ceph.com 2024-05-14T12:41:39.233 DEBUG:teuthology.orchestra.run.smithi176:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-14T12:41:39.259 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-14T12:41:39.260 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-14T12:41:39.262 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-14T12:41:39.426 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-14T12:41:39.426 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-14T12:41:39.429 DEBUG:teuthology.orchestra.run.smithi176:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-14T12:41:40.245 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-14T12:41:40.255 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-14T12:41:40.255 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-14T12:41:40.305 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-14T12:41:40.347 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-14T12:41:40.356 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-14T12:41:40.359 DEBUG:teuthology.orchestra.run.smithi176:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-14T12:41:40.388 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-05-14T12:41:40.416 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = core 2024-05-14T12:41:40.440 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-14T12:41:40.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T12:41:40.468 DEBUG:teuthology.orchestra.run.smithi176:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-14T12:41:40.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T12:41:40.493 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-14T12:41:40.504 INFO:teuthology.task.internal:Transferring archived files... 2024-05-14T12:41:40.505 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi/7705395/remote/smithi154 2024-05-14T12:41:40.506 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-14T12:41:40.537 DEBUG:teuthology.misc:Transferring archived files from smithi176:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi/7705395/remote/smithi176 2024-05-14T12:41:40.538 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-14T12:41:40.561 INFO:teuthology.task.internal:Removing archive directory... 2024-05-14T12:41:40.561 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-14T12:41:40.573 DEBUG:teuthology.orchestra.run.smithi176:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-14T12:41:40.605 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-14T12:41:40.616 INFO:teuthology.task.internal:Not uploading archives. 2024-05-14T12:41:40.617 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-14T12:41:40.627 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-14T12:41:40.627 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-14T12:41:40.629 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-14T12:41:40.633 INFO:teuthology.orchestra.run.smithi154.stdout: 658463 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 14 12:41 /home/ubuntu/cephtest 2024-05-14T12:41:40.653 INFO:teuthology.orchestra.run.smithi176.stdout: 658462 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 14 12:41 /home/ubuntu/cephtest 2024-05-14T12:41:40.663 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-14T12:41:40.673 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-14T12:41:40.697 INFO:teuthology.nuke:Checking targets against current locks 2024-05-14T12:41:40.725 DEBUG:teuthology.nuke:shortname: smithi154 2024-05-14T12:41:40.725 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T12:41:40.746 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi/7705395', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 01:02:09.933037', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHs4J0mm8zx8a3J4L2rvdMTA/33DT2sz01pZKEX5gziVhadzlKnXKRttkVSc5otyuWH95KlxYvPeyK/8iOLZtKM='} 2024-05-14T12:41:40.751 DEBUG:teuthology.nuke:shortname: smithi176 2024-05-14T12:41:40.751 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T12:41:40.769 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-05-14_00:30:07-fs-wip-yuri4-testing-2024-04-29-0642-distro-default-smithi/7705395', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 01:02:09.931259', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE874pIG9yhkkKXVMjdZHAjPMQcXOXGYm66jv3txQQE3SckErXMjv6Wo6Vet8hmuDtnhVpwpy5bu+j1eEPSkuXU='} 2024-05-14T12:41:40.800 INFO:teuthology.orchestra.console.smithi154:Power off 2024-05-14T12:41:40.800 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-14T12:41:40.827 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2024-05-14T12:41:40.827 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T12:41:40.843 INFO:teuthology.orchestra.console.smithi176:Power off 2024-05-14T12:41:40.844 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-14T12:41:40.853 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-05-14T12:41:40.866 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off 2024-05-14T12:41:40.866 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T12:41:40.890 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2024-05-14T12:41:44.855 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T12:41:44.892 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T12:41:44.965 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-05-14T12:41:45.001 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2024-05-14T12:41:48.969 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T12:41:49.002 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T12:41:49.080 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-05-14T12:41:49.111 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2024-05-14T12:41:49.212 INFO:teuthology.orchestra.console.smithi176:Power off completed 2024-05-14T12:41:53.083 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T12:41:53.195 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-05-14T12:41:53.296 INFO:teuthology.orchestra.console.smithi154:Power off completed 2024-05-14T12:41:53.400 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} duration: 41355.160358667374 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=00be41d5421a42af9c049f8edc168864 status: fail success: false 2024-05-14T12:41:53.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-14T12:41:53.484 INFO:teuthology.run:FAIL